Information shielding method and related device

By conducting information detection and processing of information to the shared screen of the online meeting on the server side, the problem of sensitive information leakage in the online meeting is solved, and the dual effects of data security and conference content coherence are achieved.

CN119378032APending Publication Date: 2025-01-28TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310920522.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-07-25
Publication Date
2025-01-28

AI Technical Summary

Technical Problem

In online meetings, sharing screens or recording screens may lead to the leakage of sensitive information. There are shortcomings in prior art such as adding watermarks or editing videos, which cannot fundamentally avoid leakage and affect the consistency of the conference content.

Method used

By receiving the shielding instructions for target meetings on the server side, the video frames of the shared object are detected to detect the information of the shared object, and the frames containing the frames to be shielded are shielded. Other objects.

Benefits of technology

Effectively avoid the leakage of sensitive information, improve data security, and ensure the coherence and normal progress of the content of the meeting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119378032A_ABST
    Figure CN119378032A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of computers, and provides an information shielding method and a related device, which are used for shielding sensitive information in a conference, and the method comprises the following steps: when a server receives a shielding instruction for a target conference, carrying out to-be-shielded information detection on each video frame of a shared object in the target conference, according to the method and the device, information to be shielded is acquired, at least one to-be-processed frame containing the information to be shielded is shielded, a corresponding information shielding frame is acquired, and the acquired information shielding frame is transmitted to other objects except the shared object in the target conference. The information to be shielded is detected and shielded on the shared screen, so that the data security is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0002] During online meetings, presentations of presentation materials such as Power Point (PPT) and World Wide Web (Web) pages are often used. These materials may contain sensitive information, such as business data and system parameters. Sharing or recording the screen may result in the leakage of sensitive information.

[0003] Related technologies typically reduce the risk of sensitive information leakage by adding watermarks and editing meeting recordings. However, while watermarks can be used to identify the source of sensitive information leakage, there's a risk that the watermarks will be erased, and the leakage of sensitive information cannot be fundamentally prevented. Deleting footage containing sensitive information through editing can result in missing and disjointed video content, making it difficult to understand. Furthermore, editing relies on experience, making it difficult to guarantee effective editing. Therefore, the risk of sensitive information leakage still exists. Summary of the Invention

[0004] The embodiments of the present application provide an information shielding method and related devices to prevent the leakage of sensitive information while improving the continuity of conference images.

[0005] In a first aspect, an embodiment of the present application provides an information shielding method, comprising:

[0006] When a blocking instruction for a target conference is received, detecting information to be blocked on each video frame from a shared object in the target conference;

[0007] If the detection result indicates that there is at least one frame to be processed containing information to be shielded in each of the video frames, shielding the information to be shielded contained in each of the at least one frame to be processed to obtain a corresponding information shielded frame;

[0008] The obtained at least one information shielding frame is transmitted to each other object in the target conference except the shared object.

[0009] In a second aspect, an embodiment of the present application provides an information shielding method, comprising:

[0010] In response to an information shielding operation triggered by a master control object in an online conference, presenting at least one candidate shielding component to the master control object in a conference interface, wherein each information shielding component is used to trigger a type of information shielding function;

[0011] In response to the target shielding component triggered by the main control object for the at least one candidate shielding component, at least one information shielding image obtained after the shielding process is presented in the conference interface; wherein, the at least one information shielding image is obtained after shielding the at least one image to be processed.

[0012] In a third aspect, an embodiment of the present application provides an information shielding device, comprising:

[0013] an information detection unit, configured to, upon receiving a blocking instruction for a target conference, detect information to be blocked on each video frame from a shared object in the target conference;

[0014] an information shielding unit, configured to, if the detection result indicates that there is at least one frame to be processed containing information to be shielded among the video frames, shield the information to be shielded contained in each of the at least one frame to be processed to obtain a corresponding information shielded frame;

[0015] The data transmission unit is configured to transmit the obtained at least one information shielding frame to all other objects in the target conference except the shared object.

[0016] As a possible implementation, the information to be shielded is detected on each video frame from the shared object in the target conference, and the information detection unit is specifically configured to:

[0017] If the shielding instruction is a type shielding instruction for a specified information type, detecting whether each video frame contains information to be shielded of the specified information type;

[0018] If the shielding indication is a user-defined shielding indication, each of the video frames is detected to determine whether it contains an information identifier, where the information identifier is used to indicate an area in the corresponding video frame where information to be shielded exists.

[0019] As a possible implementation manner, when respectively detecting whether each video frame contains the to-be-shielded information of the specified information type, the information detection unit is specifically configured to:

[0020] If the specified information type is a number, then using text recognition technology to obtain the text contained in each video frame;

[0021] Each of the obtained texts is detected to determine whether it contains numbers. If a text contains numbers, the detection result indicates that the video frame corresponding to the text contains information to be shielded.

[0022] As a possible implementation manner, when respectively detecting whether each video frame contains an information identifier, the information detection unit is specifically configured to:

[0023] Obtaining an information identifier input by a master control object, and detecting whether each video frame contains the input information identifier, wherein the master control object is an object with information shielding authority in the target conference; or

[0024] A preset information identifier is obtained, and each video frame is detected to determine whether the preset information identifier is included.

[0025] As a possible implementation manner, when performing shielding processing on the information to be shielded contained in each of the at least one frame to be processed and obtaining a corresponding information shielding frame, the information shielding unit is specifically configured to:

[0026] Based on a preset image, the information to be shielded contained in each of the at least one frame to be processed is respectively masked to obtain a corresponding information shielding frame; or

[0027] Based on the preset image, the information to be shielded contained in each of the at least one frame to be processed is respectively fused to obtain a corresponding information shielding frame.

[0028] As a possible implementation manner, the information detection unit is specifically configured to:

[0029] When receiving a screen sharing instruction from a target conference, determining that a blocking instruction for the target conference is received; or,

[0030] When a screen recording instruction for a target conference is received, it is determined that a blocking instruction for the target conference is received.

[0031] As a possible implementation, a recording unit is further included. If the blocking instruction is the screen recording instruction, the recording unit is configured to:

[0032] A recorded conference file is obtained according to the at least one information masking frame and according to other frames in the video frames except the at least one signal masking frame.

[0033] In a fourth aspect, an embodiment of the present application provides an information shielding device, comprising:

[0034] A component presenting unit, configured to respond to a target operation triggered by a main control object in an online conference and present at least one candidate shielding component to the main control object in a conference interface, wherein each information shielding component is used to trigger a type of information shielding function;

[0035] A shielding indication unit is used to present at least one information shielding image obtained after shielding processing in the conference interface in response to the target shielding component triggered by the main control object for the at least one candidate shielding component; wherein the at least one information shielding image is obtained after shielding processing is performed on at least one image to be processed.

[0036] As a possible implementation method, the at least one candidate shielding component includes a custom shielding component; the component presentation unit is also used to: present an information identification input control in the conference interface; and obtain the information identification input by the main control object in response to the input operation of the main control object on the information identification input control.

[0037] As a possible implementation manner, the at least one candidate shielding component includes a custom shielding component; and the component presentation unit is further configured to:

[0038] If the conference materials shared in the target conference are text, then in response to the marking operation of the main control object on the text, inserting an information mark into the text;

[0039] If the conference material shared in the target conference is a web page, then in response to the main control object's editing operation on the script file of the web page, an information identifier is inserted into the script file of the web page.

[0040] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the above method.

[0041] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, which includes a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of the above method.

[0042] In the seventh aspect, an embodiment of the present application provides a computer program product, which includes a computer program, and the computer program is stored in a computer-readable storage medium. The processor of an electronic device reads and executes the computer program from the computer-readable storage medium, so that the electronic device performs the steps of the above method.

[0043] In an embodiment of the present application, when the server receives a blocking indication for a target conference, it performs a block detection on each video frame of a shared object in the target conference, and blocks at least one frame to be processed containing the block information to obtain a corresponding information blocking frame, and then transmits the obtained information blocking frame to other objects in the target conference except the shared object.

[0044] This system detects information to be blocked on the shared screen of the other person. If the shared screen contains digital information to be blocked, the video frame containing the information is blocked, eliminating the information from the shared screen. This prevents the leakage of sensitive information and improves data security. Furthermore, since the detection and blocking of blocked information is imperceptible to the participants, there is no loss of video content or discontinuity, ensuring the smooth progress of the meeting.

[0045] Other features and advantages of the present application will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present application. The purposes and other advantages of the present application can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0047] Figure 1 A schematic diagram of an application scenario provided in an embodiment of the present application;

[0048] Figure 2 A schematic diagram of a flow chart of a terminal-side information shielding method provided in an embodiment of the present application;

[0049] Figure 3A This is a schematic diagram of a conference interface provided in an embodiment of the present application when screen sharing is not initiated;

[0050] Figure 3B A schematic diagram of a conference interface for initiating screen sharing provided in an embodiment of the present application;

[0051] Figure 3C This is a schematic diagram of another conference interface for initiating screen sharing provided in an embodiment of the present application; Figure 4 A schematic diagram of a flow chart of a terminal-side authentication method provided in an embodiment of the present application;

[0052] Figure 5A This is a schematic diagram of the first conference interface provided in an embodiment of the present application;

[0053] Figure 5B This is a schematic diagram of the second conference interface provided in an embodiment of the present application;

[0054] Figure 5C This is a schematic diagram of the second conference interface provided in an embodiment of the present application;

[0055] Figure 6A This is a schematic diagram of an interface without information shielding provided in an embodiment of the present application;

[0056] Figure 6B This is a schematic diagram of an interface after information shielding provided in an embodiment of the present application;

[0057] Figure 6C This is a schematic diagram of another interface after information shielding provided in an embodiment of the present application;

[0058] Figure 7A A schematic diagram of a first custom shielding assembly provided in an embodiment of the present application;

[0059] Figure 7B A schematic diagram of a second custom shielding assembly provided in an embodiment of the present application;

[0060] Figure 7C A schematic diagram of information marks in the text provided in the embodiments of this application;

[0061] Figure 7D This is a schematic diagram of an embodiment of the present application using a selection box for marking; Figure 8 A schematic diagram of a prompt information provided in an embodiment of the present application;

[0062] Figure 9 A schematic diagram of a flow chart of a server-side information shielding method provided in an embodiment of the present application;

[0063] Figure 10 A schematic diagram of an interaction process between a terminal device and a server provided in an embodiment of the present application;

[0064] Figure 11A A schematic diagram of a web page with information identification provided in an embodiment of the present application;

[0065] Figure 11B A schematic diagram of information to be blocked in a web page provided in an embodiment of the present application;

[0066] Figure 11C A schematic diagram of a web page after information shielding provided in an embodiment of the present application;

[0067] Figure 12 A schematic diagram of the structure of an information retrieval device provided in an embodiment of the present application;

[0068] Figure 13 This is a schematic diagram of the structure of another information retrieval device provided in an embodiment of the present application;

[0069] Figure 14 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0070] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of the technical solutions of this application, but not all of them. Based on the embodiments described in this application document, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the technical solutions of this application.

[0071] To facilitate understanding of the technical solutions provided in the embodiments of the present application, some key terms used in the embodiments of the present application are explained here:

[0072] Meeting: A meeting in the embodiments of the present application refers to a scenario that supports screen sharing by one or more objects, including but not limited to online meetings, online classes, and multi-person screen sharing.

[0073] Shared object: refers to the object with which the screen is shared in the meeting.

[0074] Main Control Object: refers to the participant who plays the main control and guidance role in the meeting. For example, for an online meeting, the main control object can be the host or lecturer, or for an online class, the main control object can be the teacher or a student designated by the teacher.

[0075] Screen Sharing: During a meeting, you can share your screen with other participants by initiating screen sharing. After initiating screen sharing, any actions performed on that screen, such as opening files or switching between file pages, can also be seen by other participants. This allows the presenter to synchronize their presentation content with other participants in real time. The shared screen can be the presenter's entire screen or a selected area, such as an application window or a file window.

[0076] The following is a brief introduction to the design concept of the embodiments of this application.

[0077] During online meetings, presentations, web pages, and other meeting materials are often presented. These materials may contain sensitive information, such as business data and system parameters. Sharing or recording the screen may result in the leakage of sensitive information.

[0078] Related technologies typically reduce the risk of sensitive information leakage by adding watermarks or editing meeting recordings. However, while watermarks can be used to identify the source of sensitive information leakage, there's a risk of watermark removal, and the leakage of sensitive information cannot be completely prevented. Deleting footage containing sensitive information through editing can result in missing and incoherent video content, making it difficult to understand and disrupting the normal progress of the meeting.

[0079] In an embodiment of the present application, when the server receives a blocking indication for a target conference, it performs a block detection on each video frame of a shared object in the target conference, and blocks at least one frame to be processed containing the block information to obtain a corresponding information blocking frame, and then transmits the obtained information blocking frame to other objects in the target conference except the shared object.

[0080] This system detects information to be blocked on the shared screen of the other person. If the shared screen contains digital information to be blocked, the video frame containing the information is blocked, eliminating the information from the shared screen. This prevents the leakage of sensitive information and improves data security. Furthermore, since the detection and blocking of blocked information is imperceptible to the participants, there is no loss of video content or discontinuity, ensuring the smooth progress of the meeting.

[0081] The following briefly introduces the application scenarios to which the technical solutions of the embodiments of the present application can be applied. It should be noted that the application scenarios described below are only used to illustrate the embodiments of the present application and are not limiting. In the specific implementation process, the technical solutions provided by the embodiments of the present application can be flexibly applied according to actual needs.

[0082] The solution provided by the embodiment of this application can be applied to most conference scenarios, such as online conferences, online classes, etc. Figure 1 As shown, it is a schematic diagram of an application scenario provided by an embodiment of the present application, in which a terminal device 101 and a server 102 may be included.

[0083] Terminal device 101 can be any device with conferencing capabilities, such as a mobile phone, tablet computer (PAD), laptop computer, desktop computer, smart TV, smart car device, or smart wearable device. Terminal device 101 can be installed with a conferencing application (APP), which can be a software client, a web page, a mini-program, or other client.

[0084] Server 102 is a server corresponding to software or web pages, applets, etc., and the embodiments of the present application do not limit the specific type of client. Server 102 can be, for example, an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms, but is not limited to these.

[0085] It should be noted that the information shielding method in the embodiment of the present application can be executed by the terminal device 101 alone, or can be executed jointly by the server 102 and the terminal device 101. For example, when the terminal device 101 receives a shielding instruction for the target conference, the information to be shielded is detected for each video frame from the shared object in the target conference. If the detection result indicates that there is at least one frame to be processed containing information to be shielded in each video frame, the information to be shielded contained in each of the at least one frame to be processed is shielded to obtain a corresponding information shielding frame. Then, the obtained at least one information shielding frame is transmitted to the terminal devices of each other object in the target conference except the shared object, and then the terminal device displays the shared screen. For another example, after the terminal device 101 presents the conference interface corresponding to the target conference, when the shielding operation is triggered, the server 102 responds and transmits the processed at least one information shielding frame to the terminal devices of each other object in the target conference except the shared object, and then the terminal device displays the shared screen. This application is not specifically limited here and will not be repeated here.

[0086] Taking the joint execution of the server 102 and the terminal device 101 as an example, the server 102 and the terminal device 101 may each include one or more processors, memories, and an interactive I / O interface, etc. The server 102 and the terminal device 101 establish a connection through the interactive I / O interface, and their respective memories may also store program instructions required to be executed in the information shielding method provided in the embodiment of the present application. When these program instructions are executed by the processor, they can be used to implement the multi-screen sharing process provided in the embodiment of the present application. For example, the terminal device 101 may store program instructions for displaying the conference interface and the operation processing related processes on the conference interface, so that the processor of the terminal device 101 can execute these processes. The server 102 may store program instructions for responding to the operation processing to achieve synchronization of the content displayed on each terminal device 101, so that the processor of the server 102 can execute these processes.

[0087] In the embodiment of the present application, each terminal device 101 and the server 102 can be directly or indirectly connected to each other through one or more networks 103. The network 103 can be a wired network or a wireless network, for example, a mobile cellular network or a Wireless Fidelity (WIFI) network. Of course, other possible networks are also possible, and the embodiment of the present application does not limit this.

[0088] It should be noted that Figure 1 The examples shown are just for illustration. In fact, the number of terminal devices and servers is not limited and is not specifically limited in the embodiments of this application.

[0089] The technical solution of the embodiment of the present application can be implemented based on cloud technology. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network within a wide area network or a local area network to realize data calculation, storage, processing, and sharing.

[0090] Cloud technology is a general term for network technologies, information technologies, integration technologies, management platform technologies, and application technologies based on the cloud computing business model. It can form a resource pool that can be used flexibly and conveniently on demand. Cloud computing technology will become a crucial support. Backend services for technical network systems, such as video websites, image websites, and more portals, require extensive computing and storage resources. With the rapid development and application of the internet industry, every item will likely have its own unique identifier, requiring transmission to backend systems for logical processing. Different levels of data will be processed separately, and data from various industries will require a strong system backend, which can only be achieved through cloud computing.

[0091] Cloud conferencing is a type of cloud technology, and the meetings referred to in the embodiments of this application may include cloud conferencing. Cloud conferencing is an efficient, convenient, and low-cost conferencing format based on cloud computing technology. Users only need to use a simple and easy-to-use internet interface to quickly and efficiently share voice, data files, and videos with teams and clients around the world. The cloud conferencing service provider helps users with complex technologies such as data transmission and processing during the meeting.

[0092] Currently, cloud conferencing mainly focuses on service content based on the Software as a Service (SaaS) model, including telephone, network, video and other service forms. Video conferencing based on cloud computing is called cloud conferencing.

[0093] In the era of cloud conferencing, data transmission, processing, and storage are all handled by the computer resources of video conferencing manufacturers. Users no longer need to purchase expensive hardware or install cumbersome software. They only need to open a browser and log in to the corresponding interface to conduct efficient remote meetings.

[0094] Cloud conferencing systems support dynamic multi-server cluster deployment and offer multiple high-performance servers, significantly improving conference stability, security, and availability. In recent years, video conferencing has gained widespread popularity due to its ability to significantly improve communication efficiency, continuously reduce communication costs, and enhance internal management. It has been widely adopted in various fields, including transportation, finance, carriers, education, and enterprises. Undoubtedly, the convenience, speed, and ease of use of cloud computing will further enhance the appeal of video conferencing, and will undoubtedly usher in a new wave of video conferencing applications.

[0095] The following describes the information shielding method provided by the exemplary embodiment of the present application in combination with the application scenarios described above and with reference to the accompanying drawings. It should be noted that the above application scenarios are only shown to facilitate understanding of the spirit and principles of the present application, and the implementation methods of the present application are not limited in this respect.

[0096] See Figure 2 As shown, it is a flow chart of an information shielding method provided in an embodiment of the present application. The process is applied to a terminal device, and the specific process is as follows:

[0097] S201: In response to a target operation triggered by a main control object in a target conference, a terminal device presents at least one candidate shielding component to the main control object in a conference interface, where each information shielding component is used to trigger a type of information shielding function.

[0098] Among them, the target operation can be a screen sharing operation or a screen recording operation, but is not limited to this. The screen sharing operation can also be called a screen sharing operation, and the screen recording operation can also be called a screen recording operation. In an embodiment of the present application, a conference APP can be installed on the terminal device of each participant, and each participant can enter the target conference through the conference APP. Sharing operation controls for triggering screen sharing and / or screen recording operation controls for triggering screen recording can be displayed on the terminal devices of the participants entering the target conference. When a participant triggers the sharing operation control, the participant can be called a shared object. In an embodiment of the present application, both the shared object and the host of the target meeting can be used as the main control object to control the opening or closing of the information shielding function.

[0099] The candidate shielding components include any one or more of the type shielding components and the custom shielding components. Each candidate shielding component is used to trigger a type of information shielding function, and the information shielding function includes but is not limited to one or more of the type shielding function and the custom shielding function. Among them, the type shielding function is used to shield the information to be shielded of the specified information type contained in the video frame. Since numbers are usually more sensitive in actual application, numbers can be used as the specified information type. In this way, the type shielding function can be used to shield the numbers in the conference screen, thereby ensuring data security. Of course, the specified information type can also be an image, text, etc., but not limited to this. The custom shielding component is used to trigger the custom shielding function, and the custom shielding function is used to shield the information to be shielded specified by the shared object in the video frame. Through the custom shielding function, the shared object can specify the information to be shielded according to the needs to meet the personalized information shielding needs.

[0100] Assume that the participants of the target meeting include: Object A, Object B, Object C, Object D and Object E, where Object A is the meeting host. Figure 3A As shown, it is a schematic diagram of a conference interface provided by an embodiment of the present application when screen sharing is not initiated. At this time, there is no participant to share the screen. Figure 3A It can be the conference interface of any participating object among Object A, Object B, Object C, Object D and Object E. The conference interface displays an operation control for triggering screen sharing (i.e., a "Initiate Sharing" button), and a screen recording operation control for triggering screen recording (i.e., a "Screen Recording" button). Of course, the screen sharing operation can also be triggered in other ways, such as shortcuts or other feasible ways, and the embodiments of the present application are not limited to this. The conference interface can also present buttons such as a "Mute" button, a "Start Video" button, but is not limited to this.

[0101] Assume that object B clicks the "Initiate Sharing" button, see Figure 3B As shown, the shared screen B of object B is displayed in the conference interface of the target conference. Figure 3BSpecifically, taking the screen sharing of object B as an example, in the terminal device of object B, the shared screen of object B is presented in the conference interface, and two candidate shielding components are presented, the two candidate shielding components are respectively a "digital shield" button and a "custom shield" button, wherein the "digital shield" button is a type shielding component, and the "custom shield" button is a custom shielding component. In the terminal device of object A, the shared screen of object B can be presented in the conference interface, and two candidate shielding components are presented, the two candidate shielding components are respectively a "digital shield" button and a "custom shield" button. Of course, the screen sharing operation can also be triggered in other ways, such as shortcuts or other feasible ways, which is not limited in the embodiments of the present application. In the respective terminal devices of object C, object D and object E, the shared screen of object B is presented in the conference interface. That is, when screen sharing or recording is enabled, the host and screen-sharing participants can use the "Block" and "Custom Block" buttons on the meeting interface to toggle information blocking on or off. However, the "Block" and "Custom Block" buttons do not appear on the meeting interface for other participants, meaning they do not have information blocking permissions. However, when screen sharing or recording is not enabled, the "Block" and "Custom Block" buttons are visible to all participants.

[0102] It should be noted that the above description only uses the digital shielding function as an example. In actual application, the type shielding component can also be an "image shielding" button. For the type shielding component, the conference interface can present either an "image shielding" button or a "digital shielding" button, or both an "image shielding" button and a "digital shielding" button. For example, see Figure 3C As shown, the host of the target meeting and the participants sharing the screen can turn on or off the corresponding information blocking function through the "Digital Blocking" button, "Digital Blocking" and "Custom Blocking" buttons on the meeting interface.

[0103] In one possible implementation, considering that the arbitrary control of participants may cause the meeting process to be not smooth, for example, during a speech, a participant mistakenly closes the shared screen of others, which may interrupt the speech and be detrimental to the progress of the meeting, in order to avoid the occurrence of such situations, different levels of permissions can be given to different participants, and different levels of permissions have different operating permissions.

[0104] The embodiments of this application may include but are not limited to the following levels of permissions:

[0105] (1) Level 1 permissions: The user has the right to block all shared screen information in the target meeting. Generally speaking, level 1 permissions are for overall control of the entire process of the target meeting. Therefore, the participant who is granted level 1 permissions should be the overall controller of the target meeting, such as the host.

[0106] (2) Second-level permissions only grant information shielding rights to one's own shared screen. Second-level permissions facilitate the initiator of screen sharing to quickly control their own shared screen. Participants with second-level permissions can control their own shared screens but cannot operate on the shared screens of other participants. Therefore, participants granted second-level permissions can be shared objects.

[0107] (3) The third level of permissions does not allow any shared screen operation permissions, that is, it can only display on the conference interface but cannot operate any shared screen. Therefore, participants granted the third level of permissions can be other participants except the shared objects and the host.

[0108] See also Figure 4 As shown, it is a flow chart of an authentication method provided in an embodiment of the present application. The method can be applied to a terminal device or a server. This article only describes the method by applying it to a terminal device as an example.

[0109] S401: Determine whether the participant x is the host of the target conference. The participant x can be any participant in the target conference.

[0110] S402: If the result of S401 is yes, that is, the participant x is the conference host, it is determined that the participant x has the first level authority.

[0111] Among them, participants can be mainly divided into three types, namely, conference hosts, participants with shared screens, and participants without shared screens.

[0112] When only one participant is sharing their screen, the shared screen on the conference interface is that participant's shared screen. However, when multiple participants are sharing their screens, the shared screens on the conference interface can be divided into two types: their own shared screen and those not owned by them. The conference moderator has the highest level of authority for the target conference, namely, first-level authority, and can operate on all shared screens, including their own and those not owned by them. Therefore, when participant x is determined to be the primary controller, it can be determined that participant x has first-level authority. In subsequent operations, participant x's operational permissions will be controlled according to first-level authority.

[0113] S403: If the result of S401 is no, that is, the participant x is not the conference host, it is determined whether there is currently a shared screen.

[0114] S404: If the result of S403 is yes, determine whether the participants currently sharing the screen include the participant x.

[0115] S405: If the result of S404 is yes, that is, the participants currently sharing the screen include participant x, it is determined that participant x has the second level permission.

[0116] S406: If the result of S403 or S404 is no, it is determined that the participant x has the third level authority.

[0117] Specifically, when participant x is not the conference host, the permissions of participant x need to be determined based on whether participant x shares the screen. If there is no shared screen at present, then participant x must not have screen sharing, and participant x has the third level permission. If there is a shared screen, it is necessary to further determine whether participant x has its own shared screen, that is, whether participant x is included in the participants currently initiating sharing. If included, participant x has the second level permission. If not included, participant x does not have screen sharing, which is the third level permission.

[0118] In the embodiment of the present application, the content displayed on the conference interface may be different corresponding to different levels of authority.

[0119] If participant x has first-level permissions in the target conference, all screen manipulation controls will be displayed in participant x's conference interface, allowing participant x to manage any shared screen. If a participant shares a screen, at least one candidate blocking component corresponding to that shared screen will be presented. If multiple participants share screens, at least one candidate blocking component corresponding to each shared screen will be presented.

[0120] In the case of multiple screen sharing, since each shared screen can correspond to its own operating component, one or more shared screens can be controlled independently. In actual application, the candidate shielding component of each shared screen can be displayed at the corresponding position of each shared screen, for example, displaying the candidate shielding component above the shared screen. Of course, the candidate shielding component can also be displayed in other possible positions, and there is no limitation on this.

[0121] For example, see Figure 5AAs shown, assuming that there are two shared screens, namely shared screen C of object C and shared screen B of object B, the candidate shielding components corresponding to shared screen B and shared screen C can be presented in the conference interface of participating object x, and the candidate shielding components are displayed above each shared screen.

[0122] Of course, the positions of the candidate shielding components of each shared screen may also be adjustable. For example, after selecting a candidate shielding component, it may be dragged to any position.

[0123] In a possible implementation, considering the correspondence between components and shared screens, in order to avoid the situation where it is impossible to determine which shared screen the screen operation control corresponds to, the dragging range of the candidate shielded component can be limited. For example, the dragging can be performed only within the shared screen area, such as Figure 3B In the example, for the candidate shielding component of shared screen B, the component can be dragged only within the range of shared screen B.

[0124] If participant x has the second-level permission for the target conference, the screen operation controls corresponding to participant x's shared screen will be displayed in the conference interface. Figure 5B As shown, in the conference interface of participant x, shared screen B is the shared screen of participant x (that is, participant x is object B), and shared screen C is the shared screen of object B. Then, only the candidate shielding components of shared screen B can be displayed. In this way, participant x can only perform screen management for the shared screen shared by itself.

[0125] It should be noted that the display described in the embodiments of the present application can be interpreted as follows:

[0126] In the first case, when the participant x has the second level of permission, only the candidate shielding components of the participant x's shared screen will be displayed, while the candidate shielding components of other shared screens will not be displayed, i.e. Figure 5B The situation shown.

[0127] The second situation is that when the participant x has the second level of permission, all candidate shielding components of the shared screen will be displayed, but the states of these candidate shielding components are different. For example, the candidate shielding components of the shared screen of the participant x are in an operable state, while the candidate shielding components of other shared screens can be displayed but are in an inoperable state.

[0128] If participant x has the third level permission for the target conference, the screen operation controls corresponding to participant x's shared screen will not be displayed in the conference interface. For example, see Figure 5CAs shown, if participant x is object E, and in the conference interface of participant x, shared screen B is the shared screen of object B, and shared screen C is the shared screen of object B, then the candidate shielding components of shared screen B and shared screen C are not displayed, thereby restricting the non-participating participant from shielding the shared screen. Of course, not displaying the screen operation control corresponding to the shared screen of participant x can mean not displaying the screen operation control, or it can mean that the screen operation control is displayed but in an inoperable state.

[0129] S202. In response to the target shielding component triggered by the master object for at least one candidate shielding component, the terminal device presents at least one information shielding image obtained after shielding processing in the conference interface, wherein the at least one information shielding image is obtained after shielding processing is performed on at least one image to be processed.

[0130] In the embodiment of the present application, since different candidate shielding components correspond to different information shielding functions, when the candidate shielding components triggered by the main control object are different, the response process of the terminal device may also be different. The response process of different candidate shielding components is explained below.

[0131] The first type of information shielding component: a type shielding component. When the main control object triggers the type shielding component, the terminal device responds to the main control object triggering the type shielding component and presents at least one information shielding image after shielding processing by the type shielding function in the conference interface.

[0132] The designated information type includes, but is not limited to, numbers, images, etc., but is not limited thereto and is not limited thereto.

[0133] In some embodiments, considering that numbers are generally more sensitive and important data, the type shielding component can be used to shield information for numbers, wherein the numbers can be Arabic numerals, Chinese numerals, or a combination of the two.

[0134] It should be noted that the masking process for the processed images can be performed by either the terminal device or the server. If the masking process is performed by the terminal device, the terminal device transmits the obtained information masked images to the server, which then transmits them to the other participants. If the masking process is performed by the server, the terminal device transmits each video frame to the server, which then performs masking processing and returns the masked information masked images to each terminal device for transmission to the other participants. The specific masking process is described below and will not be repeated here.

[0135] For example, suppose that subject B is showing a text document to other participants, which states that "In the first half of 2023, the operating profit of xx company has increased from 10 billion to 15 billion, creating a new high in the past decade." Figure 6A As shown in FIG, if the main control object (object B or host) does not trigger the "digital shield" button (i.e., type shield component), then the content of the text material will be directly presented in the shared screen B. After the main control object triggers the "digital shield" button, refer to Figure 6B As shown, in the conference interface of object C, object D and object E, the shielded shared screen B is presented. In the shielded shared screen B, the content of the text material is "In the first half of 2018, the operating profit of xx company has increased from RMB 100 million to RMB 100 million, creating a new high in recent years". Figure 6C As shown, in the conference interface of object A and object B, the shared screen B after the shielding process can be presented, and the shared screen B without the shielding process can also be presented at the same time. Of course, in the conference interface of object A and object B, only the shared screen B without the shielding process can also be presented, and there is no limitation on this.

[0136] For another example, object B is presenting a conference material to other participants, and the conference material contains images (such as company logos, videos, etc.). If the main control object (object B or host) does not trigger the "image shielding" button (i.e., type shielding component), then the image will be presented normally in the shared screen B. After the main control object triggers the "image shielding" button, the shielded shared screen B is presented in the conference interface of objects C, D, and E. In the shielded shared screen B, the image is shielded (such as covered with mosaics, white-filled rectangular boxes, etc.), while in the conference interface of objects A (host) and B, as an example, the shielded shared screen B can be presented, and the unshielded shared screen B can be presented at the same time. As another example, only the unshielded shared screen B can be presented.

[0137] In some implementations, the controlling object can also input a specified information type, thereby performing information blocking on the information to be blocked of the specified information type. For example, to facilitate the controlling object's input of the specified information type, a selection interface for selecting the specified information type to be blocked can be provided to the shared object, and the specified information type input by the shared object can be obtained through the selection interface. The selection interface can be a standalone interface, or it can be presented in the form of a pop-up window, a floating window, or the like, but is not limited thereto.

[0138] The second type of information shielding component: a custom shielding component. When the main control object triggers the type shielding component, the terminal device responds to the custom shielding component triggered by the main control object, and presents at least one information shielding image after shielding processing by the custom shielding function in the conference interface.

[0139] The information identifier may be, but is not limited to, one or more of a symbol, text, or graphic. The information identifier is used to indicate the area where the information to be blocked is located. It should be noted that in the embodiments of the present application, the custom blocking function can block all content in the area indicated by the information identifier, and can also block information such as numbers and images contained in the area, without limitation. This article only uses the example of blocking numbers contained in the area for illustration.

[0140] In some embodiments, the information identifier set by the system can be directly used. In order to reduce user misoperation, the information identifier set by the user can be prompted. Exemplarily, when the main control object triggers the type shielding component, in the conference interface, identification prompt information is presented to the main control object to prompt the information identifier set by the system. The conference interface can also present an information confirmation component corresponding to the identification prompt information. In response to the triggering operation of the main control object on the information confirmation component, the terminal device presents at least one information shielding image after shielding processing through the custom shielding function in the conference interface.

[0141] The identification prompt information may be presented in the form of a pop-up window, a floating window, etc., but is not limited thereto.

[0142] For example, see Figure 7AAs shown, after the main control object clicks the "Custom Blocking" button, the terminal device presents an identification prompt message and a "Confirm" button to the main control object in the conference interface. The identification prompt message is "Please add blocking identifiers <<** and **>> before and after the information to be blocked". This prompt message is used to prompt the main control object to add blocking identifiers <<** and **>> before and after the text to be blocked, where <<** is inserted at the starting position of the text to be blocked, and **>> is inserted at the end position of the text to be blocked, and the "Confirm" button is an information confirmation component. After the main control object inserts the information identifier into the text material, the text material after the information identifier is inserted is as follows: "In the first half of 2023, the operating profit of xx company has increased from 10 billion to 15 billion, <<**creating a new high in the past ten years**>>". In this way, when the main control object clicks the "Confirm" button, the shielded shared screen B is presented in the conference interface of object C, object D and object E. In the conference interface of object A and object B, the shielded shared screen B and the unshielded shared screen B can be presented. In the shielded shared screen B, the text material is as follows: "In the first half of 2023, the operating profit of xx company has increased from 10 billion to 15 billion, creating a new high in recent years", that is, the number in "created a new high in the past ten years" is shielded.

[0143] In some implementations, to increase the flexibility of the conference system and thus enhance the user experience of the conference system, the master object may specify an information identifier, and then block the information to be blocked based on the specified information identifier. In an embodiment of the present application, the terminal device may also present an information identifier input control in the conference interface, and then, in response to the master object's input operation on the information identifier input control, obtain the information identifier entered by the shared object.

[0144] For example, in order to improve information processing efficiency, the terminal device can present each reference identifier to the main control object in the information identifier input control, and in response to the identifier selection operation triggered by the main control object for each reference identifier, use the reference identifier selected by the main control object as the information identifier input by the shared object.

[0145] For example, see Figure 7B As shown, after the main control object clicks the "Custom Block" button, the terminal device presents the information identification input control and the "Confirm" button to the main control object in the conference interface. The information identification input control contains various reference identifications, including rectangles, circles, underlines, etc. The terminal device responds to the identification selection operation triggered by the main control object for each reference identification, and uses the reference identification rectangle selected by the main control object as the information identification input by the shared object. When the main control object inserts the information identification into the text material, the text material after the information identification is inserted is as shown in FIG. Figure 7CAs shown, the information to be blocked is "increased from 10 billion to 15 billion" and "created a new high in the past decade". In this way, when the main control object clicks the "Confirm" button, the blocked shared screen B will be displayed in the conference interface of objects C, D, and E. In the conference interface of objects A and B, the blocked shared screen B and the unblocked shared screen B can be displayed. Figure 7C As shown, in the shared screen B after shielding, the text material is as follows: "In the first half of 2023, the operating profit of xx company has increased from 10 billion to 15 billion, creating a new high in recent years", that is, the numbers in "increased from 10 billion to 15 billion" and "created a new high in the past decade" are shielded.

[0146] In some implementations, the master control object can also use a selection box as an information marker to identify the area of ​​information to be blocked in conference materials. Thus, when the master control object triggers the type blocking component, the terminal device responds to the master control object triggering the custom blocking component and presents at least one information blocking image in the conference interface, after being blocked using the custom blocking function.

[0147] The selection box includes but is not limited to a rectangular selection box, an elliptical selection box, a single-row selection box, and a single-column selection box. The single-row selection box defines the border as a row with a width of 1 pixel, and the single-column selection box defines the border as a column with a width of 1 pixel.

[0148] For example, see Figure 7D As shown, the target object uses an elliptical selection box to select "increased from 10 billion to 15 billion" and "created a new high in the past decade" in the text material, thereby shielding the numbers in "increased from 10 billion to 15 billion" and "created a new high in the past decade".

[0149] The selection box can be an information identifier set by the system, or it can be an information identifier selected by the main control object from the reference identifier. There is no limitation on this and no further details will be given here.

[0150] In some embodiments, each participant's terminal device can present a prompt message in the conference interface that the blocking function is turned on, thereby prompting the participant to turn on the information blocking function. Figure 8 As shown, a prompt message of "Enable digital shielding" can be displayed in the conference interface of each participant.

[0151] In some embodiments, if the conference materials shared in the target meeting are text, the terminal device inserts an information identifier into the text in response to the main control object's identification operation on the text; if the conference materials shared in the target meeting are web pages, the terminal device inserts an information identifier into the script file of the web page in response to the main control object's editing operation on the script file of the web page.

[0152] Next, the information shielding process is described.

[0153] See Figure 9 As shown, it is a flow chart of an information shielding process provided in an embodiment of the present application. The process is applied to the server, and the specific process is as follows:

[0154] S901: When the server receives a blocking instruction for a target conference, it detects information to be blocked on each video frame from a shared object in the target conference.

[0155] The blocking instruction can be a type-based blocking instruction for a specific information type or a custom blocking instruction. The blocking instruction can include a blocking type, including but not limited to type-based blocking and custom blocking. The blocking instruction can be sent to the server by the terminal device of the master control object after the master control device triggers the target blocking component. The blocking instruction can be sent by either a shared object in the target conference or the host of the target conference.

[0156] In some embodiments, when the master object triggers a screen sharing and recording operation, the master object's terminal device presents a candidate blocking component in the conference interface, and then, in response to the target blocking component triggered by the master object, sends a blocking instruction for the target conference to the server. Therefore, before receiving the blocking instruction for the target conference, the server may also receive a screen sharing instruction from the target conference, or receive a screen recording instruction from the target conference.

[0157] The video frames of a shared object refer to the image frames included in the shared screen shared by the shared object. These video frames may be transmitted to the server by the shared object via a terminal device. Upon receiving a blocking instruction, the server blocks the frames of the shared screen that require blocking. Since the conference is ongoing, the video frames obtained by the server may be transmitted to the server in real time by the terminal device.

[0158] When detecting information to be blocked, there are several possible detection methods, including but not limited to the following:

[0159] The first detection method: if the blocking indication is a type blocking indication for a specified information type, the server detects whether each video frame contains information to be blocked of the specified information type.

[0160] Specifically, if the specified information type is a number, the server utilizes text recognition technology to obtain the text contained in each video frame. The server then detects whether each text contains a number. If a text contains a number, the detection result indicates that the video frame corresponding to the text contains the information to be blocked. The specific implementation of the text recognition technology is not limited.

[0161] For example, suppose that the object currently being screen shared is object B, and the video frames of object B include frame 1, frame 2, frame 3, ..., frame M. The server uses text recognition technology to obtain the text contained in frame 1, frame 2, frame 3, ..., frame M. The server detects whether each text contains numbers. Taking the text of frame 1, frame 2, and frame 3 as an example, text 1 of frame 1 "In 2021, the operating profit of xx company increased by 10%" contains Chinese numbers, text 2 of frame 2 "In 2022, the operating profit of xx company increased by 20%" contains Arabic numerals, and text 3 of frame 3 "In the first half of 2023, the operating profit of xx company has increased from 10 billion to 15 billion, creating a new high in the past decade" contains Chinese numbers and Arabic numerals. Therefore, in the detection results, frame 1, frame 2, and frame 3 all contain information to be blocked.

[0162] If the specified information type is an image, the server uses image recognition technology to detect whether each video frame contains an image. If a video frame contains an image, the detection result indicates that the video frame contains information to be blocked. The specific implementation method of the image recognition technology is not limited. For example, the object currently being screen shared is object B, and each video frame of object B includes frame 1, frame 2, frame 3, ..., frame M. The server uses image recognition technology to detect whether frame 1, frame 2, frame 3, ..., frame M contains an image. Assume that frame 1, frame 2, and frame 3 contain the company logo. Therefore, in the detection result, frame 1, frame 2, and frame 3 all contain information to be blocked.

[0163] The second detection method: if the shielding indication is a custom shielding indication, the server detects whether each video frame contains an information identifier, and the information identifier is used to indicate an area in the corresponding video frame where information to be shielded exists.

[0164] In the embodiment of the present application, in the custom shielding function, the information identifier to be used can be indicated by the main control object. In order to improve the efficiency of information shielding, the system preset information identifier can also be used.

[0165] Specifically, as a possible implementation method, the server can obtain the information identifier input by the shared object and detect whether each video frame contains the input information identifier. As another possible implementation method, the server obtains a preset information identifier and detects whether each video frame contains the preset information identifier.

[0166] If the master object input information identifier is included in the blocking instruction corresponding to the custom blocking instruction, the blocking instruction may also include the master object input information identifier. If the blocking instruction includes the shared object input information identifier, the server obtains the shared object input information identifier and detects whether each video frame contains the input information identifier.

[0167] For example, when subject B clicks the "Custom Block" button and enters a rectangle as the information identifier, the terminal device sends a blocking instruction for the target conference to the server. The blocking instruction carries the information rectangle identifying the information. After receiving the blocking instruction, the server obtains the information identifier entered by subject B and checks whether each video frame, such as frame 1, frame 2, frame 3, ..., frame M, contains the rectangle. If the blocking instruction does not carry the information identifier entered by the shared subject, the server obtains a preset information identifier and checks whether each video frame contains the preset information identifier.

[0168] For example, when object B clicks the "Custom Blocking" button, the terminal device sends a blocking instruction for the target conference to the server. After receiving the blocking instruction, the server obtains the preset information identifiers <<** and **>> and respectively detects whether the preset information identifiers <<** and **>> are contained in each video frame such as frame 1, frame 2, frame 3,..., frame M.

[0169] For another example, when subject B clicks the "Custom Block" button, the terminal device sends a blocking instruction for the target conference to the server. After receiving the blocking instruction, the server detects whether each video frame, such as frame 1, frame 2, frame 3, ..., frame M, contains a selection box. The selection box can be a rectangular selection box, an elliptical selection box, a single-row selection box, a single-column selection box, etc. S902: If the detection result indicates that at least one unprocessed frame contains information to be blocked in each video frame, the server blocks the information to be blocked contained in each of the at least one unprocessed frame to obtain a corresponding information-blocked frame.

[0170] In the embodiment of the present application, the frame to be processed may also be referred to as an image to be processed.

[0171] In an embodiment of the present application, when performing masking processing, as a possible implementation method, the server can mask the information to be masked contained in each of at least one frame to be processed based on a preset image to obtain a corresponding information masking frame. The preset image can be, but is not limited to, a rectangular frame filled with white.

[0172] For example, the detection results show that in each video frame, the frames to be processed containing information to be shielded include frame 1, frame 2, frame 3, etc. The server covers the information to be shielded contained in each of the frames to be processed, frame 1, frame 2, and frame 3, respectively, based on a rectangular frame filled with white, to obtain the corresponding information shielding frame.

[0173] As another possible implementation, the server may also fuse a preset image with the information to be masked contained in at least one frame to be processed to obtain a corresponding information masked frame. The preset image may be, but is not limited to, a white-filled rectangular frame.

[0174] For example, the detection results indicate that, in each video frame, the frames to be processed that contain information to be shielded include frame 1, frame 2, frame 3, etc. The server fuses the image blocks containing the information to be shielded contained in frames 1, 2, and 3 respectively based on a white-filled rectangular frame to obtain the corresponding information shielding frame. By image fusion, it is possible to avoid the separation of the preset image from the area it covers due to reasons such as video playback freeze during the meeting, thereby leaking the information to be shielded, thereby improving information security. S903. The server transmits the obtained at least one information shielding frame to all other objects in the target conference except the shared object.

[0175] In this embodiment of the present application, after the server transmits the information shielding frame to each other object, the other object can present the corresponding information shielding frame in the conference interface. It should be noted that in this embodiment of the present application, the information shielding frame can also be referred to as an information shielding image. For example, the server transmits each obtained information shielding frame to object C, object D, and object E. The server can also transmit all frames in each video frame, excluding the at least one signal shielding frame, to object C, object D, and object E.

[0176] In some embodiments, if the blocking indication is a screen recording indication, the server blocks the frame according to at least one information, and obtains the recorded conference file according to other frames in each video frame except for at least one signal-blocked frame.

[0177] That is to say, in this application, if the subject turns on screen recording, the server records the screen based on the shared screen after information shielding. By recording the shared screen after information shielding, sensitive information can be avoided from appearing in the recorded meeting file, thereby ensuring information security during the screen recording process.

[0178] Assume that the participants of the target conference include: object A, object B, object C, object D, and object E, where object A is the conference host. The participant currently sharing the screen is object B.

[0179] See Figure 10 As shown, it is a schematic diagram of the interaction between the terminal device and the server during the digital shielding process provided in an embodiment of the present application.

[0180] S101. After object B turns on the information shielding function, terminal device B sends a shielding instruction for a target conference to a server.

[0181] S102: The server detects and processes the information to be blocked in each video frame of object B, obtaining a blocked shared screen B. The blocked shared screen B includes the at least one information-blocked frame obtained, as well as all other frames in each video frame except for the at least one signal-blocked frame. See S901-S903 for details.

[0182] S103a: The server sends the shielded shared screen B to other participants, so that the other participants can present the shielded shared screen B. The other participants include object C, object D, and object E.

[0183] S103b: The server instructs terminal device B to display normally, that is, the unshielded shared screen B is presented on terminal device B. Terminal device B may also present the shielded shared screen B at the same time.

[0184] S103c: The server instructs terminal device A to display normally, that is, the unshielded shared screen B is presented on terminal device A. Terminal device A may also present the shielded shared screen B at the same time.

[0185] The execution order of S103a, S103b, and S103c is not limited.

[0186] S104. After object B turns off the information shielding function, terminal device B sends a shielding turning off instruction for the target conference to the server.

[0187] S105: The server cancels information shielding. That is, the server no longer detects and processes the information to be shielded for subsequent video frames of object B.

[0188] S106a: The server instructs other conference participants to display normally, that is, the unblocked shared screen B is displayed on the terminal devices of other conference participants.

[0189] S106b: The server instructs terminal device B to display normally, that is, terminal device B presents the unshielded shared screen B.

[0190] S106c. The server instructs terminal device A to display normally, that is, terminal device A presents shared screen B that is not blocked.

[0191] The execution order of S106a, S106b, and S106c is not limited.

[0192] Below, this application is described with reference to a specific embodiment.

[0193] Assume that the conference materials shared by the participants are web pages, which may contain one or more of text, images, videos and other information.

[0194] See Figure 11A As shown, the conference materials that subject B needs to share are web pages. For the digital and image masking functions, subject B does not need to process the web pages. For the custom masking function, subject B can insert information tags into the HTML file corresponding to the web page. The inserted information tags indicate the area containing the information to be masked. For example, the HTML file is composed of tag attribute information of each tag, and the information tags can be inserted into the web page in the form of tags.

[0195] When object B clicks the "Custom Block" button, object B's terminal device sends a blocking instruction for the target conference to the server. When the server receives the blocking instruction, it detects the information to be blocked in each video frame of object B. Specifically, it detects whether each video frame of object B contains a rectangle. Figure 11B As shown, the information to be masked contained in a certain video frame includes "1213", "4", and "12".

[0196] If the detection result represents each video frame of object B, there is a frame to be processed that contains information to be blocked, then refer to Figure 11C As shown, a white-filled rectangle is used to perform shielding processing on the information to be shielded contained in the frame to be processed, and a corresponding information shielding frame is obtained.

[0197] Afterwards, the server transmits the obtained information shielding frame and other frames in each video frame except the signal shielding frame to objects C, D and E in the target conference respectively, so that the information shielding frame is displayed in the respective conference interfaces of objects C, D and E.

[0198] Based on the same inventive concept, the embodiment of the present application provides an information shielding device. Figure 12 As shown, it is a schematic structural diagram of the information shielding device 1200, which may include:

[0199] The component presenting unit 1201 is configured to respond to a target operation triggered by a master control object in an online conference and present at least one candidate shielding component to the master control object in a conference interface, wherein each information shielding component is configured to trigger a type of information shielding function;

[0200] The shielding indication unit 1202 is used to present at least one information shielding image obtained after shielding processing in the conference interface in response to the target shielding component triggered by the main control object for the at least one candidate shielding component; wherein, the at least one information shielding image is obtained after shielding processing is performed on at least one image to be processed.

[0201] As a possible implementation, the at least one candidate shielding component includes a custom shielding component; and the component presenting unit 1201 is further configured to:

[0202] In the conference interface, presenting an information identification input control;

[0203] In response to the input operation of the master object on the information identifier input control, the information identifier input by the master object is acquired.

[0204] As a possible implementation, the at least one candidate shielding component includes a custom shielding component; and the component presenting unit 1201 is further configured to:

[0205] If the conference materials shared in the target conference are text, then in response to the marking operation of the main control object on the text, inserting an information mark into the text;

[0206] If the conference material shared in the target conference is a web page, then in response to the main control object's editing operation on the script file of the web page, an information identifier is inserted into the script file of the web page.

[0207] Based on the same inventive concept, the embodiment of the present application provides an information shielding device. Figure 13 As shown, it is a schematic structural diagram of the information shielding device 1300, which may include:

[0208] The information detection unit 1301 is configured to detect information to be blocked on each video frame from a shared object in the target conference when a blocking instruction for the target conference is received;

[0209] The information shielding unit 1302 is configured to, if the detection result indicates that there is at least one frame to be processed containing information to be shielded among the video frames, shield the information to be shielded contained in each of the at least one frame to be processed to obtain a corresponding information shielded frame;

[0210] The data transmission unit 1303 is configured to transmit the obtained at least one information shielding frame to all other objects in the target conference except the shared object.

[0211] As a possible implementation, the information detection unit 1301 performs the detection of information to be shielded on each video frame from the shared object in the target conference, and is specifically configured to:

[0212] If the shielding instruction is a type shielding instruction for a specified information type, detecting whether each video frame contains information to be shielded of the specified information type;

[0213] If the shielding indication is a user-defined shielding indication, each of the video frames is detected to determine whether it contains an information identifier, where the information identifier is used to indicate an area in the corresponding video frame where information to be shielded exists.

[0214] As a possible implementation, when detecting whether each video frame contains the to-be-shielded information of the specified information type, the information detection unit 1301 is specifically configured to:

[0215] If the specified information type is a number, using text recognition technology to obtain the text contained in each video frame; detecting whether each text contains a number; if a text contains a number, the detection result indicates that the video frame corresponding to the text contains the information to be blocked;

[0216] If the designated information type is an image, image recognition technology is used to detect whether each video frame contains an image.

[0217] As a possible implementation, when detecting whether each video frame includes an information identifier, the information detection unit 1301 is specifically configured to:

[0218] Obtaining an information identifier input by a master control object, and detecting whether each video frame contains the input information identifier, wherein the master control object is an object with information shielding authority in the target conference; or

[0219] A preset information identifier is obtained, and each video frame is detected to determine whether the preset information identifier is included.

[0220] As a possible implementation, when performing shielding processing on the information to be shielded contained in each of the at least one frame to be processed and obtaining a corresponding information shielding frame, the information shielding unit 1302 is specifically configured to:

[0221] Based on a preset image, the information to be shielded contained in each of the at least one frame to be processed is respectively masked to obtain a corresponding information shielding frame; or

[0222] Based on the preset image, the information to be shielded contained in each of the at least one frame to be processed is respectively fused to obtain a corresponding information shielding frame.

[0223] As a possible implementation, the information detection unit 1301 is specifically configured to:

[0224] When receiving a screen sharing instruction from a target conference, determining that a blocking instruction for the target conference is received; or,

[0225] When a screen recording instruction for a target conference is received, it is determined that a blocking instruction for the target conference is received.

[0226] As a possible implementation, the method further includes a recording unit 1304. If the blocking instruction is the screen recording instruction, the recording unit 1304 is configured to:

[0227] A recorded conference file is obtained according to the at least one information masking frame and according to other frames in the video frames except the at least one signal masking frame.

[0228] For the convenience of description, the above parts are divided into modules (or units) according to their functions and described separately. Of course, when implementing this application, the functions of each module (or unit) can be implemented in the same or multiple software or hardware.

[0229] Regarding the apparatus in the above embodiment, the specific manner in which each unit executes the request has been described in detail in the embodiment of the method, and will not be elaborated on here.

[0230] Those skilled in the art will appreciate that various aspects of the present application can be implemented as systems, methods, or program products. Therefore, various aspects of the present application can be specifically implemented in the following forms: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or an implementation that combines hardware and software aspects, which may be collectively referred to herein as a "circuit," "module," or "system."

[0231] Based on the same inventive concept, an embodiment of the present application further provides an electronic device. In one embodiment, the electronic device may be a server or a terminal device. Figure 14 , which is a schematic structural diagram of a possible electronic device provided in an embodiment of the present application, Figure 14 In the embodiment, the electronic device 1400 includes a processor 1410 and a memory 1420 .

[0232] The memory 1420 stores a computer program that can be executed by the processor 1410 . The processor 1410 can execute the steps of the above-mentioned information shielding method by executing the instructions stored in the memory 1420 .

[0233] Memory 1420 may be a volatile memory, such as random-access memory (RAM); a non-volatile memory, such as read-only memory (ROM), flash memory, a hard disk drive (HDD), or a solid-state drive (SSD); or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto. Memory 1420 may also be a combination of the aforementioned memories.

[0234] The processor 1410 may include one or more central processing units (CPUs) or digital processing units, etc. The processor 1410 is configured to implement the above-mentioned information shielding method when executing the computer program stored in the memory 1420 .

[0235] In some embodiments, the processor 1410 and the memory 1420 may be implemented on the same chip. In some embodiments, they may also be implemented on separate chips.

[0236] The specific connection medium between the processor 1410 and the memory 1420 is not limited in the embodiment of the present application. In the embodiment of the present application, the processor 1410 and the memory 1420 are connected via a bus as an example. Figure 14 The connections between the other components are shown in bold lines for illustration only and are not intended to be limiting. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of description, Figure 14 The diagram shows a single thick line, but this does not indicate that there is only one bus or one type of bus.

[0237] Based on the same inventive concept, an embodiment of the present application provides a computer-readable storage medium, which includes a computer program. When the computer program is run on an electronic device, the computer program is used to cause the electronic device to perform the steps of the above-mentioned information shielding method. In some possible implementations, various aspects of the information shielding method provided by the present application can also be implemented in the form of a program product, which includes a computer program. When the program product is run on an electronic device, the computer program is used to cause the electronic device to perform the steps in the above-mentioned information shielding method. For example, the electronic device can perform the following steps: Figure 2 or Figure 9 Follow the steps shown in .

[0238] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: an electrical connection having one or more wires, a portable disk, a hard disk, RAM, ROM, an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0239] The program product of the embodiments of the present application may be a CD-ROM and include a computer program, and may be run on an electronic device. However, the program product of the present application is not limited thereto. In this document, a readable storage medium may be any tangible medium that contains or stores a computer program that can be used by or in conjunction with a command execution system, apparatus, or device.

[0240] A readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a readable computer program. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a computer program for use by or in conjunction with a command execution system, apparatus, or device.

[0241] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.

[0242] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. An information shielding method, characterized in that: include: When a blocking instruction for a target conference is received, detecting information to be blocked for each video frame from a shared object in the target conference; If the detection result indicates that there is at least one frame to be processed containing information to be shielded in each of the video frames, shielding the information to be shielded contained in each of the at least one frame to be processed is performed to obtain a corresponding information shielding frame; The obtained at least one information shielding frame is transmitted to other objects in the target conference except the shared object.

2. The method according to claim 1, characterized in that The detecting of information to be shielded on each video frame from a shared object in the target conference includes: If the shielding indication is a type shielding indication for a specified information type, detecting whether each video frame contains information to be shielded of the specified information type; If the shielding indication is a user-defined shielding indication, it is respectively detected whether each video frame contains an information identifier, and the information identifier is used to indicate an area in the corresponding video frame where information to be shielded exists.

3. The method according to claim 2, characterized in that The respectively detecting whether each of the video frames contains the to-be-shielded information of the specified information type comprises: If the specified information type is a number, then using text recognition technology to obtain the text contained in each video frame; respectively detecting whether each of the obtained texts contains a number; if a text contains a number, the detection result indicates that the video frame corresponding to the text contains the information to be shielded; If the designated information type is an image, image recognition technology is used to detect whether each video frame contains an image.

4. The method according to claim 2, characterized in that The respectively detecting whether each video frame contains an information identifier includes: Obtaining an information identifier input by a master control object, and detecting whether each video frame contains the input information identifier, wherein the master control object is an object having information shielding authority in the target conference; or, A preset information identifier is obtained, and each of the video frames is detected to determine whether the preset information identifier is included.

5. The method according to any one of claims 1 to 4, characterized in that The shielding process is performed on the information to be shielded respectively contained in the at least one frame to be processed to obtain a corresponding information shielding frame, including: Based on a preset image, the information to be shielded contained in each of the at least one frame to be processed is respectively covered to obtain a corresponding information shielding frame; or, Based on the preset image, the information to be shielded contained in each of the at least one frame to be processed is respectively fused to obtain a corresponding information shielding frame.

6. The method according to any one of claims 1 to 4, characterized in that Before receiving the blocking instruction for the target conference, the method further includes: receiving a screen sharing instruction from the target conference; or, Receive a screen recording instruction from the target conference.

7. The method according to claim 6, characterized in that If the blocking instruction is the screen recording instruction; Then, after transmitting the obtained at least one information shielding frame and other frames of the video frames except the at least one signal shielding frame to other objects in the target conference except the shared object, the method further includes: A recorded conference file is obtained according to the at least one information shielding frame and according to other frames in the video frames except the at least one signal shielding frame.

8. An information shielding method, characterized in that: include: In response to an information shielding operation triggered by a main control object in an online conference, at least one candidate shielding component is presented to the main control object in a conference interface, wherein each information shielding component is used to trigger a type of information shielding function; In response to the target shielding component triggered by the main control object for the at least one candidate shielding component, at least one information shielding image obtained after the shielding process is presented in the conference interface; wherein, the at least one information shielding image is obtained after shielding the at least one image to be processed.

9. The method according to claim 8, characterized in that The at least one candidate shielding component includes a custom shielding component; if the target shielding component is the custom shielding component, then before presenting at least one information shielding frame image obtained after shielding processing in the conference interface, the method further includes: In the conference interface, presenting an information identification input control; In response to the input operation of the main control object on the information identifier input control, the information identifier input by the main control object is obtained.

10. The method according to claim 8, characterized in that The at least one candidate shielding component includes a custom shielding component; if the target shielding component is the custom shielding component, then before presenting at least one information shielding frame image obtained after shielding processing in the conference interface, the method further includes: If the conference material shared in the target conference is text, in response to the marking operation of the main control object on the text, inserting an information mark into the text; If the conference material shared in the target conference is a web page, then in response to the editing operation of the main control object on the script file of the web page, an information identifier is inserted into the script file of the web page.

11. An information shielding device, characterized in that: include: an information detection unit, configured to detect information to be blocked on each video frame from a shared object in the target conference when a blocking instruction for the target conference is received; an information shielding unit, configured to, if the detection result indicates that there is at least one frame to be processed containing information to be shielded in each of the video frames, respectively shield the information to be shielded contained in each of the at least one frame to be processed to obtain a corresponding information shielding frame; The data transmission unit is used to transmit the obtained at least one information shielding frame to other objects in the target conference except the shared object.

12. An information shielding device, characterized in that: include: A component presenting unit, configured to respond to a target operation triggered by a main control object in an online conference, and present at least one candidate shielding component to the main control object in a conference interface, wherein each information shielding component is used to trigger a type of information shielding function; A shielding indication unit is used to present at least one information shielding image obtained after shielding processing in the conference interface in response to the target shielding component triggered by the main control object for the at least one candidate shielding component; wherein the at least one information shielding image is obtained after shielding processing is performed on at least one image to be processed.

13. An electronic device, characterized in that: It includes a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of any method described in claims 1 to 7, or executes the steps of any method described in claims 8 to 10.

14. A computer-readable storage medium, characterized in that: The method comprises a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of any one of the methods of claims 1 to 10.

15. A computer program product, characterized in that It includes a computer program, which is stored in a computer-readable storage medium. The processor of the electronic device reads and executes the computer program from the computer-readable storage medium, so that the electronic device performs the steps of any method described in claims 1 to 7, or performs the steps of any method described in claims 8 to 10.