A method for sharing a custom hidden privacy content desktop for android

Abstract

The technical scheme of the present application provides a sharing desktop method for customizing hidden privacy content of Android. After the present application is adopted, when a user uses a desktop sharing function through a network audio and video conference APP applied to an Android mobile terminal, the user can customize to hide the privacy message that needs to be hidden, improve the security of the desktop sharing, and improve the trust degree of the user for the desktop sharing function. Compared with the prior art, the present application has the following advantages: the user can quickly customize the privacy requirement of the user through the scene simulation test, and confirm the privacy scheme; through the privacy matching mode, the user can accurately filter out the privacy information during the desktop sharing, so as to protect the privacy of the user from being stolen, and ensure the security during the desktop sharing; during the desktop sharing, the user can view the possible privacy information through the split screen mode, and ensure the timely acquisition of the key information.

Description

Technical Field

[0001] This invention relates to a method for customizing the hiding of private messages when an Android mobile terminal conducts a web conference in shared desktop mode. Background Technology

[0002] Nowadays, online conferencing is widely used. Online audio and video conferencing offers advantages such as convenience, speed, and freedom from geographical constraints. Through online audio and video conferencing, a participant can share the desktop of their device with other participants in the same city or even around the world, quickly presenting documents, images, and operation methods they want to share, achieving highly efficient meeting results. The application of online audio and video conferencing technology is even more widespread on mobile devices; participants do not need to prepare a PC and can start the meeting directly using their mobile phones.

[0003] However, using a mobile device to participate in online audio and video conferences and sharing the device's desktop with other participants can lead to some awkward situations. This is because most users don't specifically prepare a dedicated phone for online audio and video conferencing; they typically use their own frequently used mobile phones. When a user uses the desktop sharing function provided by an online audio and video conferencing app, privacy issues inevitably arise due to desktop sharing. For example, a private instant messaging message or transaction information might pop up during desktop sharing, and this private content is forcibly "shared" with other participants. This is an unfriendly experience and prevents users from sharing their desktops with peace of mind.

[0004] To address the aforementioned privacy concerns, current network audio and video conferencing apps for Android mobile devices typically provide security warnings before sharing the desktop. For example, they might warn users that "While recording or projecting content, the network conference can access all information displayed on your screen or played on your device, including passwords, payment details, photos, messages, and audio you are playing," reminding users to protect their privacy. Some apps even offer more targeted warnings, such as "Beware of impersonating customer service; do not perform financial transfers while 'sharing your screen.'" However, these warnings only serve as reminders and do not effectively prevent privacy breaches; some users simply ignore them. More security-conscious users may take steps before enabling desktop sharing, such as disabling notifications for instant messaging tools like WeChat and SMS, and hiding privacy-sensitive applications. However, this method is cumbersome, can cause users to miss important messages during the video conference, and requires re-enabling notifications after the conference ends. The aforementioned methods for preventing privacy leaks are not convenient enough and do not improve user satisfaction with web conferencing applications. Summary of the Invention

[0005] The technical problem this invention aims to solve is that when network audio and video conferencing apps currently used on Android mobile terminals share their desktops, the private content displayed on the desktop is also shared, resulting in the leakage of users' privacy.

[0006] To solve the above-mentioned technical problems, the technical solution of the present invention is to provide a method for sharing an Android desktop with customizable hidden privacy content, characterized by the following steps:

[0007] Step 1: When the user selects to enable the shared desktop function provided by the network audio and video conferencing APP installed on the Android mobile terminal, a scenario simulation test is triggered, and the process proceeds to Step 2.

[0008] Step 2: If the user chooses not to perform scenario simulation testing through the online audio and video conferencing app, they will directly enter the shared desktop mode; if the user chooses to perform scenario simulation testing through the online audio and video conferencing app, they will proceed to Step 3.

[0009] Step 3: The network audio and video conferencing APP calls the built-in desktop simulation game program module to enter desktop simulation mode; after entering desktop simulation mode, the network audio and video conferencing APP displays the desktop simulation operation page to the user.

[0010] Step 4: On the desktop simulation operation page, the network audio and video conferencing APP randomly selects at least one application from each application category to push application messages to the user. The user determines whether the pushed application messages need to be hidden based on their privacy needs: if the user chooses to hide the application messages pushed by the current application, the application type corresponding to the current application is set as the application type that needs to be hidden; otherwise, the application type corresponding to the current application is set as the application type that does not need to be hidden. All application types that need to be hidden constitute a privacy type set.

[0011] Step 5: Store the privacy type set obtained in Step 4 as a data dictionary model;

[0012] Step 6: The network audio and video conferencing APP starts desktop sharing. The network audio and video conferencing APP starts the automatic push mode of desktop sharing video frames. The network audio and video conferencing APP, as the client, pushes the video frames to the server. The video frames display the entire desktop screen. After receiving the video frames pushed by the client, the server compresses the video frames and pushes them to other clients for rendering after processing.

[0013] During the desktop sharing process, the Android system of the mobile terminal uses a listening service to determine in real time whether there are application push messages. If there are application push messages, the application message is intercepted and the application type corresponding to the push application is determined according to the data dictionary model. If the current application type does not belong to the privacy type set, the automatic push mode of desktop sharing video frames is maintained; if the current application type belongs to the privacy type set, the process proceeds to step 7.

[0014] Step 7: Start split-screen mode on the Android mobile terminal. The shared screen window and the privacy screen window are displayed on the desktop at the same time. The opened applications are displayed in the shared screen window, and the application messages to be pushed are displayed in the privacy screen window.

[0015] Meanwhile, the online audio and video conferencing app disables the automatic push mode for desktop shared video frames and enables a custom video capture mode. In the custom video capture mode, the app trims the recorded video, removing the image portion containing the privacy screen window from the video frame while retaining the image portion containing the shared screen window. After processing, the app, acting as a client, pushes the trimmed video frames to the server. The server receives the trimmed video frames, compresses them, and then pushes them to other clients for rendering, thus achieving the goal of hiding user privacy information.

[0016] After the video conferencing app enables the custom video capture mode, if the preset threshold conditions are reached, the custom video capture mode will be turned off, the desktop sharing video frame automatic push mode will be turned on again, and the process will return to step 6 until the online meeting ends.

[0017] Preferably, in step 2, if the user chooses not to perform the scenario simulation test, and the network audio and video conferencing APP directly enters the shared desktop mode, the network audio and video conferencing APP will provide the user with a privacy leakage risk warning.

[0018] Preferably, in step 3, the UI of the desktop simulation operation page is consistent with the desktop UI of the Android mobile operating system.

[0019] Preferably, in step 4, all application types that do not need to be hidden constitute a set of non-privacy types, and in step 5, the set of privacy types and the set of non-privacy types are stored as a data dictionary model.

[0020] Preferably, in step 4, the user determines whether each pushed application message needs to be hidden based on their privacy needs, including the following steps:

[0021] Step 401: When the user determines that the current application message pushed by the current application is content that needs to be hidden when sharing the desktop, click on the application message;

[0022] Step 402: After the network audio and video conferencing APP captures the user's click operation on the current application message, it records it and marks the application type corresponding to the application that pushed the application message as the application type that needs to be hidden.

[0023] If the network audio and video conferencing app does not detect the user's click after the app pushes an application message, it will randomly select at least one other application under the current application type to push the application message to the user; if the application messages pushed by all selected applications under the current application type are not clicked by the user, it means that the application messages pushed by the current application type can pop up when the desktop is shared, which does not affect privacy, and the current application type will be marked as an application type that does not need to be hidden.

[0024] Step 403: After the network audio and video conferencing APP completes the marking of the current application type, it randomly selects an application from the next application type to push application messages to the user;

[0025] Step 404: Repeat steps 401 to 403 until all application types are marked. The network audio and video conferencing APP exits desktop simulation mode.

[0026] Preferably, in step 7, the shared screen window and the privacy screen window each occupy 1 / 2 of the entire screen. In the video custom capture mode, the network audio and video conferencing APP trims the recorded video, cutting off 1 / 2 of the image from each video frame.

[0027] Preferably, in step 7, the threshold condition is that within a set time period, no application matching the privacy type set pushes application messages to the user.

[0028] With this invention, when users utilize the desktop sharing function through a network audio and video conferencing app on an Android mobile terminal, they can customize the hiding of private messages, improving desktop sharing security and increasing user trust in the function. Compared to existing technologies, this invention has the following specific advantages:

[0029] 1) Users can quickly customize their privacy needs and confirm their privacy solutions through scenario simulation tests;

[0030] 2) By using privacy matching, users can accurately filter out private information when sharing their desktop, thereby protecting their privacy from being stolen and ensuring the security of desktop sharing;

[0031] 3) When sharing the desktop, users can view potentially private information through split-screen mode to ensure timely access to critical information. Attached Figure Description

[0032] Figure 1 This illustrates the overall process of the present invention;

[0033] Figure 2 It illustrates the split-screen display method on mobile terminals;

[0034] Figure 3 It illustrates the privacy protection process when sharing a desktop. Detailed Implementation

[0035] The present invention will be further illustrated below with reference to specific embodiments. It should be understood that these embodiments are for illustrative purposes only and are not intended to limit the scope of the invention. Furthermore, it should be understood that after reading the teachings of this invention, those skilled in the art can make various alterations or modifications to the invention, and these equivalent forms also fall within the scope defined by the appended claims.

[0036] The Android custom hidden privacy content sharing desktop method disclosed in this embodiment adopts the video custom capture function supported by the current Android system. When the video custom capture function is enabled, the APP running on the Android system continuously feeds its own captured custom audio and video data to the SDK through an API (e.g., sendCustomAudioData), instead of directly sending back the page video frames to the server by automatically obtaining them.

[0037] like Figure 1 As shown, the Android custom hidden privacy content sharing desktop method provided by the present invention specifically includes the following steps:

[0038] Step 1: When the user selects to enable the shared desktop function provided by the network audio and video conferencing APP installed on the Android mobile terminal, a scenario simulation test is triggered, and the process proceeds to Step 2.

[0039] In this embodiment, the user can enable the shared desktop function by clicking the shared desktop control provided by the network audio and video conferencing APP (it should be noted that those skilled in the art can also use other methods to enable the shared desktop function, the specific method of which depends on the network audio and video conferencing APP used by the user, and will not be listed here). In this embodiment, when the user clicks the control, the network audio and video conferencing APP will not directly enter the shared desktop mode, but will proceed to step 2, triggering the scenario simulation test.

[0040] Step 2: Users can choose whether to conduct scenario simulation testing: If the user chooses not to conduct scenario simulation testing, the network audio and video conferencing APP will directly enter the shared desktop mode; if the user chooses to conduct scenario simulation testing, proceed to Step 3.

[0041] In this embodiment, scenario simulation testing is not mandatory for users. If a user chooses not to perform scenario simulation testing, the system will not be able to meet their specific needs for hiding privacy. To avoid situations where users have privacy information they actually need to hide but mistakenly choose not to perform scenario simulation testing, when a user chooses not to perform scenario simulation testing and directly starts the desktop sharing process, the network audio and video conferencing app provides the user with a corresponding prompt. For example, it may provide a prompt message such as, "When recording or projecting content, the network conference will be able to obtain all information displayed on your screen or played on your device, including passwords, payment details, photos, messages, and audio information you are playing." At this time, the user can choose to stop desktop sharing and re-trigger the scenario simulation test to make the corresponding settings.

[0042] Step 3: The online audio / video conferencing app enters desktop simulation mode. This desktop simulation mode is implemented in a similar way to existing "interactive movies," by embedding a desktop simulation game module within the online audio / video conferencing app. When the user selects to perform a scenario simulation test, the online audio / video conferencing app invokes this game module, thus entering desktop simulation mode.

[0043] Upon entering desktop simulation mode, the network audio and video conferencing app displays a desktop simulation operation page to the user. The UI of this desktop simulation operation page is completely consistent with the desktop UI of the Android system used by the mobile terminal. It should be noted that due to the fragmentation of the Android operating system, it is difficult to ensure that the UI of the simulation operation page is consistent with the desktop UI of the user's current mobile terminal's Android system. Therefore, in this embodiment, the UI of the desktop simulation operation page references the page style of mainstream Android models, but this invention does not limit the specific style of the desktop UI.

[0044] Step 4: On the desktop simulation page, the network audio and video conferencing app randomly selects at least one application from each application category to push application messages to the user. The user determines whether each pushed application message needs to be hidden based on their privacy needs. If the user chooses to hide the application messages pushed by the current application, the application type corresponding to the current application is set as the application type that needs to be hidden; otherwise, the application type corresponding to the current application is set as the application type that does not need to be hidden. All application types that need to be hidden constitute the privacy type set, and all application types that do not need to be hidden constitute the non-privacy type set.

[0045] In this embodiment, the classification of applications can refer to the classification of applications in major Android app stores. For example, all applications can be divided into the following types:

[0046] I. Practical Lifestyle Categories:

[0047] Includes lifestyle services, food, weather, calendar, practical tools, flashlights, etc.

[0048] II. Social Apps

[0049] Common social networking apps include QQ, WeChat, Weibo, Momo, and Maimai.

[0050] III. Efficient Office Work

[0051] This includes notes, WPS Office software, email, cloud storage, etc.

[0052] IV. Photographic Images

[0053] Includes subcategories such as camera, image enhancement, photo album, photo library, and video shooting.

[0054] V. Music Videos

[0055] Includes music, videos, karaoke, FM radio, live streaming, etc.

[0056] VI. News Apps

[0057] Common apps of this type include Toutiao, Tencent News, Yidian Zixun, Sohu News, Phoenix News, NetEase News, etc.

[0058] VII. Entertainment Apps

[0059] Includes entertainment, jokes, horoscopes, emoticons, and game apps.

[0060] 8. Shopping Apps

[0061] This includes online stores, group buying and food delivery, shopping guides, movies, and discount sales.

[0062] IX. Travel and Tourism

[0063] This includes map navigation, hotels, trains, high-speed rail, buses and subways, and car rentals.

[0064] 10. Financial Apps

[0065] It includes mobile payment, financial institution applications, securities applications, financing and finance, insurance business, online lending, and financial information services.

[0066] It should be noted that the above application type classification references Android application markets such as Huawei AppGallery, Wandoujia, and Tencent App Store. The application types may include, but are not limited to, the ten types listed above, and can be set by those skilled in the art as needed. The determination of application type can be made through the Android application markets such as Huawei AppGallery, Wandoujia, and Tencent App Store already installed on the user's mobile terminal. This invention does not limit the method for determining application type.

[0067] In this invention, the application messages pushed to the user by the application may include: a pop-up message from an instant messaging software, a pop-up email notification, a pop-up payment information, or access to a photo album page, etc. This invention does not limit the way the application pushes application messages to the user.

[0068] In this embodiment, when the user determines that the application message pushed by the current application is content that needs to be hidden during desktop sharing, the user clicks on the application message. The network audio / video conferencing app captures and records this click, marking the application type corresponding to the application that pushed the message as an application type that needs to be hidden. If the network audio / video conferencing app does not capture the user's click after the application pushes the message, it randomly selects at least one other application under the current application type to push the application message to the user. If none of the application messages pushed by all selected applications under the current application type are clicked by the user, it indicates that the application messages pushed by the current application type can pop up during desktop sharing and do not affect privacy; therefore, the current application type is marked as an application type that does not need to be hidden. After marking the current application type, the network audio / video conferencing app randomly selects an application from the next application type to push the application message to the user. This process is repeated until all application types are marked, at which point the network audio / video conferencing app exits desktop simulation mode.

[0069] Step 5: Store the privacy type set and non-privacy type set obtained in Step 4 as a data dictionary model, for example:

[0070] {

[0071] "Privacy": {"Finance", "Shopping", "Social", "xxx", "xxx"},

[0072] "Non-privacy": {"Travel", "News", "Productivity", "xxx", "xxx"}

[0073] }

[0074] Step 6, Combining Figure 3 The online audio and video conferencing app initiates desktop sharing and activates an automatic video frame push mode. The app, acting as a client, pushes video frames to the server, displaying the entire desktop screen within each frame. Upon receiving the video frames from the client, the server compresses them before pushing them to other clients for rendering. This invention does not limit the compression ratio or method used for the video frames.

[0075] During desktop sharing, the Android system on the mobile terminal uses a listening service to determine in real time whether any applications are about to push application messages. If an application is about to push an application message, the system uses a data dictionary model to determine whether the application type belongs to the privacy type set. If the current application type does not belong to the privacy type set, the automatic push mode for desktop sharing video frames is maintained. If the current application type belongs to the privacy type set, the process proceeds to step 7.

[0076] The following methods can be used to determine whether the current application type belongs to the privacy type set:

[0077] This invention utilizes Android's built-in NotificationListenerService to listen for push notifications from applications. When Android detects a push notification from an application through this service, it intercepts the message. The source of the message is then identified, confirming the specific application that pushed it. After confirming the application, the application type is determined. As mentioned earlier, the type determination is based on data from various Android app stores, which will not be elaborated upon here.

[0078] Once the application type is determined, it is matched against the previously defined user-defined data dictionary model. If the application type corresponding to the application pushing the message is in the user-defined privacy type set, the message is considered a private message that the user needs to hide, and split-screen mode is enabled to display it to the user. If the message is not in the user-defined privacy type set, it is displayed directly on the desktop shared screen.

[0079] Step 7: Start split-screen mode on Android system, such as... Figure 2 As shown, a shared screen window and a privacy screen window are simultaneously displayed on the desktop. In this embodiment, each window occupies half of the entire screen. Opened applications are displayed in the shared screen window, while application messages to be pushed are displayed in the privacy screen window.

[0080] Meanwhile, the online audio and video conferencing app disables the automatic push mode for desktop shared video frames and enables a custom video capture mode. In custom video capture mode, the app crops the recorded video, cutting each frame by half to remove the portion containing the privacy screen window while retaining the portion containing the shared screen window. After processing, the app calls the `sendCustomAudioData` method, acting as the client, to push the cropped video frames to the server. The server receives the cropped video frames, compresses them, and then pushes them to other clients for rendering, thus achieving the goal of hiding user privacy information.

[0081] After the network audio and video conferencing APP enables the custom video capture mode, if a preset threshold condition is reached (in this embodiment, those skilled in the art can define the threshold condition as needed, for example, it can be defined as: if no user-defined privacy message is pushed within 2 minutes, the custom video capture mode is turned off), the custom video capture mode is turned off, the desktop sharing video frame automatic push mode is turned on again, and the process returns to step 6 until the network meeting ends.

[0082] After adopting the above method, when users share their desktop through a network audio and video conferencing app installed on an Android mobile terminal, they can hide private information in a customized way, and users can view relevant private messages simultaneously when sharing their desktop.

Claims

1. A method for sharing a desktop in Android to customize and hide private content, characterized in that, Includes the following steps: Step 1: When the user selects to enable the shared desktop function provided by the network audio and video conferencing APP installed on the Android mobile terminal, a scenario simulation test is triggered, and the process proceeds to Step 2. Step 2: If the user chooses not to perform scenario simulation testing through the online audio and video conferencing app, they will directly enter the shared desktop mode; if the user chooses to perform scenario simulation testing through the online audio and video conferencing app, they will proceed to Step 3. Step 3: The network audio and video conferencing APP calls the built-in desktop simulation game program module to enter desktop simulation mode; after entering desktop simulation mode, the network audio and video conferencing APP displays the desktop simulation operation page to the user. Step 4: On the desktop simulation operation page, the network audio and video conferencing APP randomly selects at least one application from each application category to push application messages to the user. The user determines whether the pushed application messages need to be hidden based on their privacy needs: if the user chooses to hide the application messages pushed by the current application, the application type corresponding to the current application is set as the application type that needs to be hidden; otherwise, the application type corresponding to the current application is set as the application type that does not need to be hidden. All application types that need to be hidden constitute a privacy type set. Step 5: Store the privacy type set obtained in Step 4 as a data dictionary model; Step 6: The network audio and video conferencing APP starts desktop sharing. The network audio and video conferencing APP starts the automatic push mode of desktop sharing video frames. The network audio and video conferencing APP, as the client, pushes the video frames to the server. The video frames display the entire desktop screen. After receiving the video frames pushed by the client, the server compresses the video frames and pushes them to other clients for rendering after processing. During the desktop sharing process, the Android system of the mobile terminal uses a listening service to determine in real time whether there are application push messages. If there are application push messages, the application message is intercepted and the application type corresponding to the push application is determined according to the data dictionary model. If the current application type does not belong to the privacy type set, the automatic push mode of desktop sharing video frames is maintained; if the current application type belongs to the privacy type set, the process proceeds to step 7. Step 7: Start split-screen mode on the Android mobile terminal. The shared screen window and the privacy screen window are displayed on the desktop at the same time. The opened applications are displayed in the shared screen window, and the application messages to be pushed are displayed in the privacy screen window. Meanwhile, the online audio and video conferencing app disables the automatic push mode for desktop shared video frames and enables a custom video capture mode. In the custom video capture mode, the app trims the recorded video, removing the image portion containing the privacy screen window from the video frame while retaining the image portion containing the shared screen window. After processing, the app, acting as a client, pushes the trimmed video frames to the server. The server receives the trimmed video frames, compresses them, and then pushes them to other clients for rendering, thus achieving the goal of hiding user privacy information. After the video conferencing app enables the custom video capture mode, if the preset threshold conditions are reached, the custom video capture mode will be turned off, the desktop sharing video frame automatic push mode will be turned on again, and the process will return to step 6 until the online meeting ends.

2. The Android custom hidden privacy content sharing desktop method as described in claim 1, characterized in that, In step 2, if the user chooses not to perform the scenario simulation test, and the online audio and video conferencing app directly enters the shared desktop mode, the online audio and video conferencing app will provide the user with a privacy leakage risk warning.

3. The method for sharing an Android desktop with customizable hidden privacy content as described in claim 1, characterized in that, In step 3, the UI of the desktop simulation operation page is consistent with the desktop UI of the Android mobile operating system.

4. The Android custom hidden privacy content sharing desktop method as described in claim 1, characterized in that, In step 4, all application types that do not need to be hidden constitute a set of non-privacy types. In step 5, the set of privacy types and the set of non-privacy types are stored as a data dictionary model.

5. The Android custom hidden privacy content sharing desktop method as described in claim 1, characterized in that, In step 4, users determine whether each pushed application message needs to be hidden based on their privacy needs, including the following steps: Step 401: When the user determines that the current application message pushed by the current application is content that needs to be hidden when sharing the desktop, click on the application message; Step 402: After the network audio and video conferencing APP captures the user's click operation on the current application message, it records it and marks the application type corresponding to the application that pushed the application message as the application type that needs to be hidden. If the network audio and video conferencing app does not detect the user's click after the app pushes an application message, it will randomly select at least one other application under the current application type to push the application message to the user; if the application messages pushed by all selected applications under the current application type are not clicked by the user, it means that the application messages pushed by the current application type can pop up when the desktop is shared, which does not affect privacy, and the current application type will be marked as an application type that does not need to be hidden. Step 403: After the network audio and video conferencing APP completes the marking of the current application type, it randomly selects an application from the next application type to push application messages to the user; Step 404: Repeat steps 401 to 403 until all application types are marked. The network audio and video conferencing APP exits desktop simulation mode.

6. The Android custom hidden privacy content sharing desktop method as described in claim 1, characterized in that, In step 7, the shared screen window and the privacy screen window each occupy 1 / 2 of the entire screen. In the video custom capture mode, the network audio and video conferencing APP trims the recorded video, cutting off 1 / 2 of the image from each video frame.

7. The Android custom hidden privacy content sharing desktop method as described in claim 1, characterized in that, In step 7, the threshold condition is that within a set time period, no application matching the privacy type set pushes application messages to the user.

Images