Data transmission method, device, conference system, wireless screen transfer device and storage medium

JP7651814B2Active Publication Date: 2025-03-27GUANGZHOU SHIYUAN ELECTRONICS CO LTD +1
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2022573513
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-07-29
Publication Date
2025-03-27
Estimated Expiration
2042-07-29

AI Technical Summary

Benefits of technology

【0013】 上記データ伝送方法、端末機器、画面共有装置、電子機器及び記憶媒体では、該データ伝送方法は、端末機器と、ワイヤレス画面転送装置と、表示機器と、を含む会議システムに適用され、ワイヤレス画面転送装置は端末機器及び表示機器にそれぞれ接続され、第1アプリ及び第2アプリが記憶されており、該データ伝送方法において、ワイヤレス画面転送装置が端末機器に接続されると、端末機器はワイヤレス画面転送装置に作動電圧を供給することと、端末機器はワイヤレス画面転送装置にクエリパケットを送信することと、ワイヤレス画面転送装置はワイヤレス画面転送装置がDP作動モードをサポートすることを含む応答情報を端末機器に送信することと、端末機器はDPプロトコルフォーマットのメディアデータをワイヤレス画面転送装置に送信することと、ワイヤレス画面転送装置は第1アプリを端末機器に送信することと、端末機器のスクリーンに第1確認ウィンドウをポップアップし、第1確認ウィンドウを介して、端末機器のスクリーン上に展示されているメディアコンテンツ内のプライバシーウィンドウを識別してその位置情報を取得するプライバシー識別プログラムを含む第1アプリを実行する命令を受信することと、端末機器は位置情報をワイヤレス画面転送装置に送信することと、ワイヤレス画面転送装置は受信した位置情報及びメディアデータに基づき、位置情報に基づいてメディアデータに対してプライバシー処理を行うプライバシー処理プログラムを含む第2アプリを実行することと、ワイヤレス画面転送装置はプライバシー処理が行われたメディアデータを表示機器に送信し、表示機器は受信したメディアデータを表示することと、を含む。端末機器は画面共有装置によって画面共有を行うときに、現在表示されているソフトウェアウィンドウのウィンドウ情報を検出し、プライバシーウィンドウが存在するか否かを確認し、プライバシーウィンドウの表示位置情報を画面共有装置に送信し、画面共有装置は表示位置情報に基づいてスクリーン画面内のプライバシー情報についてプライバシー処理を行い、これによって、端末機器が画面共有を通じて多くの人に表示される場合にプライバシーや情報漏洩を回避する。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007651814000001
    Figure 0007651814000001
  • Figure 0007651814000002
    Figure 0007651814000002
  • Figure 0007651814000003
    Figure 0007651814000003
Patent Text Reader

Abstract

The embodiments of the present application provide a data transmission method, device, conference system, wireless screen transfer device and storage medium, in which when the wireless screen transfer device is connected to a terminal device to transfer a screen to a display device, the terminal device quickly loads a privacy identification program from the wireless screen transfer device, and transmits corresponding media data to the wireless screen transfer device in real time according to the current display screen, while simultaneously executing the privacy identification program to identify a privacy window in the current display screen, obtain corresponding position information, and send the position information to the wireless screen transfer device, and when the wireless screen transfer device executes an application related to screen transfer in real time, the privacy processing program among them performs privacy processing on the media data according to the received position information, so that the media data sent to the display device does not include substantial content in the privacy window. By quickly loading and detecting, it is easy to avoid privacy or information leakage when the terminal device is displayed to many people through screen sharing.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The embodiments of the present application relate to the technical field of interaction, and in particular to a data transmission method, device, conference system, wireless screen transfer device, and storage medium. [Background technology]

[0002] Screen sharing is a frequently used function in large-scale communication situations such as meetings and classes. In a typical screen sharing format, the terminal device that receives the data (e.g. a computer or mobile phone) projects the screen image onto the desired display device (exhibit, television, projector, etc.) in a wired or wireless manner, and the display device displays the received screen image.

[0003] Although multiple people participate in activities such as meetings and classes, most of the terminal devices used for screen sharing are personal, and software with strong personal attributes may be opened during use. When such software is displayed to many people through screen sharing, there is a risk of privacy and information leakage. Summary of the Invention [Problem to be solved by the invention]

[0004] The present application provides a data transmission method, device, conference system, wireless screen transfer device, and storage medium that solve the technical issues of privacy and information leakage risks that exist in conventional screen sharing formats. [Means for solving the problem]

[0005] In a first aspect, the present embodiment comprises: A data transmission method applied to a conference system including a terminal device, a wireless screen transfer device, and a display device, comprising: the wireless screen transfer device is connected to the terminal device and the display device, and a first application and a second application are stored in the wireless screen transfer device; When the wireless screen transfer device is connected to the terminal device, the terminal device supplies an operating voltage to the wireless screen transfer device; The terminal device transmits a query packet to the wireless screen transfer device; The wireless screen transfer device sends response information to the terminal device, the response information including that the wireless screen transfer device supports a DP working mode; The terminal device transmits media data in a DP protocol format to the wireless screen transfer device; The wireless screen transfer device transmits the first application to the terminal device; receiving a command to execute a first application including a privacy identification program that pops up a first confirmation window on a screen of the terminal device and identifies a privacy window in the media content displayed on the screen of the terminal device through the first confirmation window and acquires location information of the privacy window; The terminal device transmits the location information to the wireless screen transfer device; The wireless screen transfer device executes a second application including a privacy processing program that performs privacy processing on the media data based on the location information, based on the received location information and the media data; The wireless screen transfer device transmits the privacy-processed media data to a display device, and the display device displays the received media data.

[0006] In a second aspect, the present embodiment comprises: A data transmission method applied to a wireless screen transfer device, comprising: The wireless screen transfer device includes a TYPE-C port, a wireless module, a microprocessor, and a memory, the TYPE-C port, the memory, and the wireless module are all electrically connected to the microprocessor, a first app and a second app are stored in the memory, the first app includes a privacy identification program, and the second app includes a privacy processing program, the TYPE-C port includes a first data port and a second data port, receiving, via the first data port, media data in a DP protocol format, which is media content currently being displayed on a screen of the terminal device; and a microprocessor fetching from the memory a first application for identifying a privacy window in the media content being displayed on the screen of the terminal device and obtaining its position information; and controlling the first application to be output to the terminal device via the second data port; receiving location information transmitted by the terminal device via a second data port, the location information being location information of a privacy window within the media content displayed on a screen of the terminal device; The microprocessor executes a second application based on the location information and the media data, the second application performing privacy processing on the media data based on the location information; and transmitting the privacy-processed media data to a display device by the wireless module.

[0007] In a third aspect, the present embodiment comprises: Receiving media data in DP protocol format via the TYPE-C port, which is the media content currently being displayed on the screen of the terminal device; Transmitting a first application to the terminal device via a TYPE-C port, the first application including a privacy identification program for identifying a privacy window in a media content displayed on a screen of the terminal device and acquiring position information thereof, and receiving position information transmitted by the terminal device, the position information being the position information of the privacy window in the media content displayed on the screen of the terminal device; Executing a second application including a privacy processing program that performs privacy processing on the media data based on the location information and the media data; and encoding the privacy-processed media data and transmitting the encoded data to a display device.

[0008] In a fourth aspect, the present embodiment comprises: The system includes a terminal device, a wireless screen transfer device, and a display device, The wireless screen transfer device is connected to a terminal device and a display device, respectively. A first application and a second application are stored in the wireless screen transfer device. The terminal device includes a power supply circuit and a central processor. The wireless screen transfer device includes a microprocessor. The display device includes a display screen and a main processor. The power supply circuit supplies an operating voltage to the wireless screen transfer device when the wireless screen transfer device is connected to the terminal device; The central processor is configured to send a query packet to the wireless screen transfer device; The microprocessor is configured to send response information to the terminal device, the response information including that the wireless screen transfer device supports a DP working mode; The central processor is further configured to send the media data in the DP protocol format to the wireless screen transfer device; The microprocessor is further configured to transmit the first app to the terminal device; The central processor is further configured to perform control to pop up a first confirmation window on the screen of the terminal device, and receive, via the first confirmation window, an instruction to execute a first app including a privacy identification program to identify a privacy window in the media content displayed on the screen of the terminal device and obtain location information thereof; The central processor is further configured to transmit the position information to the wireless screen transfer device; The microprocessor is further configured to execute a second app based on the received location information and the media data, the second app including a privacy processing program that performs privacy processing on the media data based on the location information; The microprocessor is further configured to transmit the privacy processed media data to a display device; The main processor further provides a conferencing system configured to control a display screen to display the received media data.

[0009] In a fifth aspect, the present embodiment comprises: The device includes a TYPE-C port, a wireless module, a microprocessor, and a memory, the TYPE-C port, the memory, and the wireless module are all electrically connected to the microprocessor, a first app and a second app are stored in the memory, the first app includes a privacy identification program, and the second app includes a privacy processing program, the TYPE-C port includes a first data port and a second data port, The microprocessor receiving, via a first data port, media data in a DP protocol format, which is a media content currently being displayed on a screen of the terminal device; retrieve from the memory a first application that identifies a privacy window in media content displayed on a screen of the terminal device and obtains location information thereof, and control the first application to be output to the terminal device via the second data port; receiving location information transmitted by the terminal device via a second data port, the location information being location information of a privacy window within the media content displayed on a screen of the terminal device; run a second application that performs privacy processing on the media data based on the location information and the media data; There is further provided a wireless screen transfer device configured to transmit, by a wireless module, the privacy-processed media data to a display device.

[0010] In a sixth aspect, the present embodiment comprises: a TYPE-C port, a wireless module, a microprocessor, and a memory, the TYPE-C port, the memory, and the wireless module are all electrically connected to the microprocessor, and a first application and a second application are stored in the memory; The microprocessor Receives media data in DP protocol format, which is the media content currently displayed on the terminal device screen, through the TYPE-C port, Transmitting a first application to the terminal device via a TYPE-C port, the first application including a privacy identification program for identifying a privacy window in media content displayed on a screen of the terminal device and acquiring position information thereof, and receiving position information transmitted by the terminal device, the position information being position information of the privacy window in the media content displayed on the screen of the terminal device; execute a second application including a privacy processing program that performs privacy processing on the media data based on the location information and the media data; There is further provided a data transmission device configured to encode the privacy-processed media data by the wireless module and transmit the encoded data to the display device.

[0011] In a seventh aspect, the present embodiment comprises: The present invention further provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, realizes the data transmission method according to any one of the first to third aspects.

[0012] In an eighth aspect, the present embodiment comprises: The present invention further provides a data transmission program which, when executed, realizes the data transmission method according to any one of the first to third aspects. Effect of the Invention

[0013] In the above data transmission method, terminal device, screen sharing device, electronic device, and storage medium, the data transmission method is applied to a conference system including a terminal device, a wireless screen transfer device, and a display device, the wireless screen transfer device is connected to the terminal device and the display device, respectively, and a first application and a second application are stored in the wireless screen transfer device. In the data transmission method, when the wireless screen transfer device is connected to the terminal device, the terminal device supplies an operating voltage to the wireless screen transfer device, the terminal device transmits a query packet to the wireless screen transfer device, the wireless screen transfer device transmits response information to the terminal device, the response information including that the wireless screen transfer device supports a DP operating mode, and the terminal device transmits media data in a DP protocol format to the wireless screen transfer device, and the wireless screen transfer The apparatus includes transmitting a first application to a terminal device, popping up a first confirmation window on a screen of the terminal device, and receiving, via the first confirmation window, a command to execute the first application including a privacy identification program for identifying a privacy window in media content displayed on the screen of the terminal device and acquiring its position information, the terminal device transmitting the position information to a wireless screen transfer device, the wireless screen transfer device executing, based on the received position information and media data, a second application including a privacy processing program for performing privacy processing on the media data based on the position information, the wireless screen transfer device transmitting the privacy-processed media data to a display device, and the display device displaying the received media data. When performing screen sharing through a screen sharing device, the terminal device detects window information of a currently displayed software window, checks whether a privacy window exists, and transmits display position information of the privacy window to the screen sharing device, and the screen sharing device performs privacy processing on the privacy information in the screen based on the display position information, thereby avoiding privacy and information leakage when the terminal device is displayed to many people through screen sharing. [Brief description of the drawings]

[0014] In order to more clearly explain the technical solutions of the embodiments of the present application or the prior art, the drawings necessary for the description of the embodiments or the prior art will be briefly described below. Obviously, the drawings in the following description are only a part of the embodiments of the present application, and those skilled in the art can also obtain other drawings based on these drawings without requiring creative efforts. [Figure 1] FIG. 1 is a schematic diagram of an apparatus architecture according to an embodiment of the present application. [Diagram 2] 2 is a flowchart of a data transmission method according to an embodiment of the present application; [Diagram 3] FIG. 2 is a schematic diagram of a screen displayed on a display device according to an embodiment of the present application. [Figure 4] FIG. 4 is a schematic diagram of a screen transfer effect on a display device of the screen displayed in FIG. 3. [Diagram 5] 1 is a structural schematic diagram of a peripheral device according to an embodiment of the present application; [Figure 6] FIG. 2 is a schematic diagram of the pin arrangement on the plug side of a Type-C port. [Figure 7] FIG. 1 is a structural schematic diagram of a conference system according to an embodiment of the present application; [Figure 8] FIG. 2 is a structural schematic diagram of a wireless screen transfer device according to an embodiment of the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] In order to clarify the purpose, technical solution and advantages of the present application, the embodiments of the present application will be described in more detail below with reference to the drawings. Note that the specific embodiments described herein are for interpreting the present application, but are not intended to limit the present application. Also, for convenience of explanation, only parts related to the present application are shown in the drawings, not the entire structure.

[0016] Due to the length of the specification, the specification of the present application does not comprehensively describe all possible embodiments, and it should be understood by those skilled in the art based on the specification of the present application that any combination of technical features is also a possible embodiment, as long as the technical features are not mutually contradictory.

[0017] Each embodiment will be described in detail below.

[0018] The data transmission device is operated between the processing device and the large-screen display device, and in the embodiment of the present application, the data transmission device may be a wireless screen transfer device. The processing device may be a terminal device such as a personal computer, a PAD, or a mobile phone, and the large-screen display device may be a smart tablet for a conference or a conference display device, and the embodiment of the present application is not limited thereto. The wireless screen transfer device processes the audio-video data displayed on the screen of the processing device, and the data is displayed on the large-screen display device so that it can be viewed and shared by more people.

[0019] In the prior art, the wireless screen transfer device (Type-C type) and the processing device are connected through a Type-C port to transmit data. Here, the TYPE-C port, i.e., USB-Type-C, is hereinafter abbreviated as TYPE-C port, and USB-Type-C is a hardware port specification of Universal Serial Bus, which has a high transmission speed (up to 10Gbps) and a strong power transport capability (up to 100W), and is compatible with USB2.0, USB3.0, and DP (Display Port), that is, the TYPE-C port supports the function of outputting video in DP protocol format. A generic driver protocol is pre-installed in the operating system of the processing device, and according to the pre-installed generic driver protocol, the DP audio-video data corresponding to the media content currently displayed on the processing device is transmitted to the wireless screen transfer device, and the wireless screen transfer device transmits the DP audio-video data to the large-screen display device for display. During the above-mentioned screen sharing, a user may open email or instant communication tools on the processing device to do personal things, and the media content corresponding to the DP audio-video data transmitted to the large-screen display device is a copy of the media content corresponding to the DP audio-video data output from the operating system of the processing device, resulting in a risk of privacy information leakage.

[0020] In view of the technical problems existing in the prior art, the technical solutions of the embodiments of the present application are proposed.

[0021] As shown in FIG. 1, FIG. 1 is a schematic diagram of a wireless screen transfer device 31 implementing the present invention between a computer 21 and a conference display device 11. In this embodiment, a first application and a second application are pre-installed in the wireless screen transfer device 31, the first application includes a privacy identification program, and the second application includes a privacy processing program. In this embodiment, the computer 21 first timeThe computer 21 is paired or connected to the wireless screen transfer device 31. Specifically, the present application may be realized by the following method, and the implementation process of the following method may be generally referred to as the flowchart shown in FIG.

[0022] In step 110, the wireless screen transfer device is connected to the computer and powered on.

[0023] Specifically, the wireless screen transfer device has a TYPE-C port, which is plugged into the data port of the computer, and if the data port of the computer is a TYPE-C port, it is directly plugged in, and if the data port of the computer is a USB port, an adapter is required for connection. The terminal device can supply the basic working voltage to the wireless screen transfer device through the power pin of the Type-C port, and the working voltage can be 5V or other voltages, and the wireless screen transfer device is powered and starts to work under the basic voltage.

[0024] In step 120, the wireless screen transfer device receives the query packet sent by the computer and sends response information to the computer.

[0025] Specifically, when the wireless screen transfer device is powered on, the computer may send a query packet to the wireless screen transfer device through the CC pin of the Type-C port, the query packet may be information customized by the vendor, and when the wireless screen transfer device receives the signal, it sends response information to the computer through its CC pin, and the response information describes the device attributes of the wireless screen transfer device, specifically, including information such as the current working mode or the supported working mode of the wireless screen transfer device being the DP mode, the specific power supply range, and the device type of the wireless screen transfer device being described as an external storage device. The computer may set the power supply voltage to the wireless screen transfer device according to the power supply range information.

[0026] In step 130, the wireless screen transfer device receives media data in DP protocol format sent by the computer, where the media data includes at least one of video data or audio data being displayed on the computer.

[0027] Specifically, when the computer receives the response information sent by the wireless screen transfer device and determines that the current working mode of the wireless screen transfer device is the DP mode, the computer may make the TYPE-C port of the computer work in the DP mode and call the DP driver pre-installed in the computer operating system. For example, if the computer supports a TYPE-C port, the computer may transmit media data in the DP protocol format including audio and video to the differential signal transmission pin pair (Display Port, i.e., as the first data port) of the wireless screen transfer device via the differential pin pair of the TYPE-C port of the computer.

[0028] In step 140, the computer retrieves the first app.

[0029] Specifically, the computer may receive the first app from a wireless screen transfer device, may obtain the first app from a third-party device, or may obtain the first app from a specific website.

[0030] Furthermore, for example, if a computer first time When receiving the first application from the wireless screen transfer device, the operation procedure may be as follows.

[0031] Specifically, when the computer receives the response information transmitted by the wireless screen transfer device, the computer may display a drive letter corresponding to the external storage device according to the description of the device type. first timeWhen pairing or connecting to the wireless screen transfer device, the user needs to open the drive letter corresponding to the wireless screen transfer device on the computer side, and the computer displays the contents stored in the storage space of the wireless screen transfer device, i.e., an icon corresponding to the program stored in the wireless screen transfer device, for example, the icon of the first application. When the user double-clicks or right-clicks on the icon of the first application, the program stored in the wireless screen transfer device is loaded into the internal memory of the computer via the USB 2.0 data transmission pins (D+ and D-, i.e., the second data port) of the Type-C port and executed by the processor of the computer, thereby displaying the content currently displayed on the screen of the computer. Privacy Window Location information can be obtained.

[0032] In step 150, the wireless screen transfer device receives location information sent by the computer, the location information being the location of a privacy window within the media content being displayed on the computer screen.

[0033] Specifically, when the first application is loaded into the internal memory of the computer, a first confirmation window pops up, and if the first application has a program for screen sharing control and privacy identification, the user can confirm through the window whether to perform privacy identification (e.g., by checking confirmation) and start screen transfer (e.g., by clicking a button). If the user confirms through the popped-up first confirmation window that privacy identification will be performed in the subsequent screen sharing, the screen currently displayed on the computer screen will be displayed in the screen sharing. Privacy WindowThe position information of the screen is acquired and sent to the second data port of the wireless screen transfer device via the USB 2.0 data transmission pins (D+ and D-), otherwise the above confirmation cannot be made. Here, the screen sharing control program allows the user to decide whether to project on the main screen or the extended screen, decide to project a specific app window instead of the entire screen, join screen sharing in the form of joining (multi-screen sharing) or preemption, decide whether to project audio, decide whether to project mouse pointer, decide image quality, etc., all of which may be set through the pop-up first confirmation window. The privacy identification program has a predetermined List of may be included, and List of Specifically, the privacy window model information included in the privacy window model information may be a system default setting or a setting customized by a user. Software corresponding to the privacy window may include, but is not limited to, a social application, instant communication software, e-mail software, etc. The privacy window model information may be a process name and a window name. In the process of executing the privacy identification program, the processor of the computer obtains information on a window currently displayed on the screen, and converts the information on the window into a predetermined List of The information in a particular display window is matched against the information contained in List of If the model information matches the model information recorded in the terminal device, it is determined that the display window is a privacy window and that the position of the privacy window needs to be transmitted to the wireless screen transfer device. Furthermore, preferably, when the first application (including a privacy identification program but not including a screen sharing control program) is loaded into the internal memory of the terminal device, a first confirmation window is popped up, and the user may confirm whether to perform privacy identification through the window and whether to start screen transfer at this time, and the screen transfer command may be received through a hardware button of the wireless screen transfer device.

[0034] Corresponding to the location information of the privacy window identified by the computer and the corresponding transmission process, the wireless screen transfer device receives location information data through a second data port, analyzes the location information data by a microprocessor to obtain location information, and processes the media data according to the location information.

[0035] In step 160, the wireless screen transfer device executes a second application that performs privacy processing on the media data based on the location information.

[0036] Specifically, the wireless screen transfer device executes the second application based on the received position information data of the privacy window, processes the area corresponding to the synchronously received video media data based on the position information data, encodes the audio data and the processed video media data, and obtains compressed media data. The processing methods include adding a mosaic layer, overwriting a predetermined graphic template, deleting area image data, etc. Among them, the mosaic layer is based on existing pixel data in the area to fuse adjacent pixels to prevent the original image from being displayed clearly. Overwriting the predetermined graphic template is overwriting a predetermined graphic template that does not contain privacy information in the area identified by the position information, and the graphic template may correspond to a software window or may not be related to the software window, and such a method has little impact on the display effect of the entire screen. Deleting the area image data is covering the entire area identified by the position information with a specific color, and such a method is the simplest area image processing method.

[0037] Preferably, when the wireless screen transfer device does not receive the privacy window position information data, the wireless screen transfer device starts compression and encoding of the received audio media data and video media data (unprocessed) according to a screen transfer command received by the microprocessor of the wireless screen transfer device and output by the user, and transmits the compressed media data to the large-screen display device via a communication network for display. Specifically, the microprocessor of the wireless screen transfer device may receive the screen transfer command through a screen transfer button of the wireless screen transfer device, where the screen transfer button of the wireless screen transfer device is a hardware button provided on the top or side of the wireless screen transfer device, but the screen transfer button of the wireless screen transfer device may also be a software button, which is realized by a program and disposed on the interface of the display screen of the wireless screen transfer device or the display interface of the processing device, and the user may start compression and encoding of the audio and video data by clicking the software button (i.e., the first confirmation window).

[0038] In step 170, the wireless screen transfer device transmits the encoded media data to the display device.

[0039] Specifically, the wireless screen transfer device transmits the encoded media data to the display device through the wireless module via the communication network for display, where the display device may have a receiving box, which may be integrated with the display device or may be designed separately from the display device, for receiving the media data from the wireless screen transfer device and transmitting it to the display device for display.

[0040] In addition, when the microprocessor of the wireless screen transfer device receives a screen transfer command output by the user, it starts compressing and encoding the received audio media data and processed video media data (or unprocessed), and by the time the microprocessor of the wireless screen transfer device receives the screen transfer command output by the user, media data has been received, but the received audio and / or video media data is discarded without being compressed or transmitted, thus saving resources of the microprocessor of the screen transfer device; that is, in step 170, the transmission of the encoded media data to the display device may be a step that is executed after confirming the receipt of the screen transfer command in step 140.

[0041] In another optional embodiment, based on the above, the method may further include step 180 .

[0042] In step 180, the wireless screen transfer device receives the location information obtained by the computer in accordance with the privacy processing confirmation command, and performs privacy processing on the media data based on the location information.

[0043] Specifically, if the computer executes the privacy identification program and identifies that a privacy window exists in the window currently displayed on the screen, a second confirmation window may be popped up, and the second confirmation window is for receiving a privacy processing confirmation command, which instructs to increase and / or decrease the privacy window that is the subject of the specified privacy processing. The location information of the privacy window is sent to the wireless screen transfer device according to the privacy processing confirmation command, and the wireless screen transfer device performs privacy processing on the video media data based on the updated location information. The second confirmation window may be a predetermined List ofand displaying a privacy window list matching the privacy window model information in the terminal device, the user can confirm in the second confirmation window whether to continue the privacy process for the privacy window, and the second confirmation window can display a list of windows currently displayed on the terminal device, and the user can confirm in the second confirmation window whether to continue the privacy process for the privacy window or whether to put non-privacy windows into the privacy process state. Furthermore, since the timing of the user's confirmation of the second confirmation window cannot be controlled, when the computer executes the privacy identification program, as long as it identifies that a privacy window exists in the window currently displayed on the screen, it will automatically transmit the position information of the privacy window to the wireless screen transfer device, and the wireless screen transfer device can perform privacy processing on the media data received synchronously based on the position information, thereby disclosing the user's privacy leakage. Furthermore, the position information may be transmitted when the display position of the privacy window changes, i.e., if the display position of the privacy window does not change, the terminal device does not transmit the position information, and the screen transfer device performs privacy processing based on the previously received position information; if the display position of the privacy window changes, the terminal device updates and transmits the position information, and such changes are due to opening a new software window, closing, minimizing or moving an existing privacy window, or terminating the privacy processing state. The position information may be transmitted in real time, i.e., the position information is transmitted synchronously with the screen image.

[0044] 3 and 4 show the display effect diagrams of a specific privacy window on the computer 21 and the conference display device 11, respectively. In the connection state shown in FIG. 1, at a certain time in the screen transfer, the display window 212 of the social application is displayed on the screen 211 of the computer 21 by the user's operation, the computer 21 pops up a second confirmation window, receives a privacy processing confirmation command for the social application in the second confirmation window, and in response to the privacy processing confirmation command, the computer 21 transmits the position information of the display window 212 of the social application to the wireless screen transfer device. Of course, between displaying the display window 212 and receiving the privacy processing confirmation command, the position information of the display window 212 is transmitted by default, and if the command received in the second confirmation window does not perform privacy processing for the social application, the position information of the remaining privacy windows is updated when the command is received. The computer 21 also transmits the entire screen image 211 as media data to the wireless screen transfer device 31 in real time, and the wireless screen transfer device 31 performs privacy processing on the media data based on the location information in the process of executing the second application, i.e., performs privacy processing on the area of ​​the media data corresponding to the location information, and transmits the processed media data to the conference display device 11 to display it as shown in FIG. 4, and the conference display device 11 displays the screen sharing screen 111 corresponding to the media data, where the information in the display window 112 of the social application is no longer clearly displayed.

[0045] In one optional embodiment, a device identifier is added to the media data transmitted to the conference display device 11 by the wireless screen transfer device 31, and the device identifier includes data origin information, that is, the device identifier is an identifier corresponding to the computer 21 of the media data or the personal account information of the initiator of the multi-person interaction, and the identifier exists and is set to be invisible to the naked eye, so that when multiple people participate in the interaction and take and transfer photos on site, the data origin information can be confirmed by the identifier in the transferred photos, and in this way, information leaked to the outside can be traced.

[0046] FIG. 5 is a structural schematic diagram of an embodiment of a peripheral device according to an embodiment of the present application. The peripheral device 30 is a data transmission device, and may be the Type-C type wireless screen transfer device 31 shown in FIG. 1, which includes a screen data receiving port 311 (which may be a Type-C port), a wireless module 312, a microprocessor 313, and a memory 314. Here, the memory 314 is connected to the microprocessor 313, and stores a first app as an executable program including a privacy identification program or a screen sharing control program and a privacy identification program that can be developed in an integrated manner, and a second app including a privacy processing program. When the processing device is connected to the peripheral device 30, the screen sharing first app is automatically downloaded to the processing device, and when the processing device receives a command for screen sharing and privacy identification by the user, the first app identifies the position information of the privacy window in the screen currently displayed on the processing device, and sends the position information and a command for starting screen sharing to the wireless screen transfer device. Preferably, the user does not need to select privacy identification, and in this case, the processing device only receives the screen sharing command by the user and sends the screen sharing command to the peripheral device 30. The screen data receiving port 311 is connected to the video signal port of the processing device, and receives the uncompressed audio-video data and the privacy window position information (if any) output from the video signal port. The microprocessor 313 is connected to the screen data receiving port 311, and executes a second application based on the received audio-video data and the privacy window position information, i.e., processes the video data based on the privacy window position information. The microprocessor compresses and encodes the audio data and the processed video data according to the received screen sharing start command. Furthermore, if the microprocessor 313 does not receive the privacy window position information, it compresses and encodes the received audio-video data according to the received screen sharing start command.The wireless module 312 is also connected to the microprocessor 313, communicates with the wireless communication network, and transmits the received compressed and encoded audio-video data to a network node in the wireless communication network that pairs with the wireless module 312, such as a network node module of a large-screen display device for a conference. Here, the wireless module 312 is a modularized component realized by wireless communication technology, and transmits the received signal to the wireless communication network in a wireless form, so that the signal can be captured by a network node of the wireless communication network, such as a WiFi module, a Bluetooth module, or a ZigBee module.

[0047] Preferably, the peripheral device 30 may include a data conversion chip, the screen data receiving port 311 is connected to the data conversion chip, the data conversion chip is connected to the screen data receiving port 311 and the microprocessor 313, and the microprocessor 313 is connected to the wireless module 312 and the memory 314. The data conversion chip converts the media content in the packet corresponding to the DP protocol received from the user's processing device into a data format suitable for the microprocessor 313, specifically, the data conversion chip can convert the video part of the media content into data in MIPI format and convert the audio part of the media content into data in I2S format. After the format conversion is performed by the data conversion chip, the above two kinds of formatted media data can be provided to the microprocessor 313. Preferably, the microprocessor 313 is a hardware processor (e.g., an ARM processor), and can compress and encode the two kinds of formatted media data.

[0048] The processing device includes a first processor, a video signal port, and a first display, and is a device in which a first operating system is installed on the first processor, such as a terminal device such as a notebook computer, a mobile phone, or a tablet. As can be seen from the above characteristics, the video signal port described in the embodiment of the present application is limited by a generic driver protocol pre-installed in the first operating system for audio-video communication with a peripheral device, and can perform audio-video communication with the peripheral device according to the generic driver protocol pre-installed even if a driver program is not installed in the first operating system, and the audio-video communication includes output of audio-video data. Specifically, a processing device generally has a plurality of ports, such as a power port, a USB port, an AUX port, an HDMI (registered trademark) port, a VGA port, or a DP port, and the video signal port such as the HDMI (registered trademark) port, the VGA port, or the DP port is a port that transmits audio-video data and also operates according to the generic driver protocol pre-installed in the first operating system, that is, the format of the audio-video data output from these video signal ports is the output format of the audio-video data supported by the native system, and can be transmitted to the peripheral device without requiring conversion such as compression encoding. When the peripheral device is connected to the processing device through these video signal ports, it obtains the first audio-video data output by the processor of the processing device at this time, and the media content corresponding to the first audio-video data is the same as the media content currently displayed in the first exhibit. When the processing device is connected to the peripheral device 30, the executable first app is downloaded to the internal memory of the processing device, and when the processing device receives a command for screen sharing and privacy identification by a user, the first app is executed by the first processor to identify the position information of the privacy window in the screen currently displayed on the processing device, and transmits the position information and the screen sharing command to the wireless screen transmission device.

[0049] In one embodiment, the screen data receiving port 311 of the peripheral device 30 may be the above-mentioned TYPE-C port. As shown in FIG. 6, the TYPE-C port has a total of 24 pins, the 24 pins include two rows of pins with the same function, and the two rows of pins with the same function support forward insertion or reverse insertion. The TYPE-C port includes two pairs of power pins (A9, B4, B9, A4), four pairs of differential pins (A11 and B2, A10 and B3, A4 and B10, A2 and B11), and a CC pin (A5) used for pairing communication when inserted and paired. Among them, the TX+, TX-, RX+, and RX- in each pair of pins are differential signal transmission pins, and each pair of differential signal transmission pins supports operation in USB mode or DP (DisplayPort) mode. When the differential signal transmission pin pair operates in USB mode, the signal transmission pin pair transmits USB 3.0 signals, and when the differential signal transmission pin pair operates in DP mode, the signal transmission pin pair is used as a DP (DisplayPort) port (i.e., the first data port).

[0050] In one embodiment, the data transmission device is a wireless screen transfer device with a TYPE-C port. The wireless screen transfer device includes a TYPE-C port, a wireless module, a microprocessor and a memory, the TYPE-C port, the wireless module and the memory are electrically connected to the microprocessor respectively, among which, the TYPE-C port includes a first data port and a second data port, and a specific embodiment is as follows:

[0051] When the wireless screen transfer device is connected to the TYPE-C receiving port of the terminal device through the TYPE-C port, it is started up and powered on, and the terminal device supplies a basic operating voltage to the wireless screen transfer device through the power pin of the Type-C port, the operating voltage may be 5V or other voltages, and the wireless screen transfer device is powered under the basic voltage and starts to work. When the wireless screen transfer device is powered on, the terminal device sends a query packet to the wireless screen transfer device through the CC pin, and the query packet may be a signal customized by the vendor. When the wireless screen transfer device receives the signal, it sends response information to the terminal device through its CC pin, and the response information describes the device attributes of the wireless screen transfer device, specifically including information such as the current operating mode or supported operating mode of the wireless screen transfer device being DP mode, a specific power supply range, and the device type of the wireless screen transfer device being described as an external storage device. When the terminal device receives the response information sent by the wireless screen transfer device, it displays a drive letter corresponding to the external storage device according to the description of the device type. The terminal device may also adjust the power supply voltage to the wireless screen transfer device based on the power supply range information. If the terminal device identifies that the current operating mode or supported operating mode of the wireless screen transmission device is DP (DisplayPort) mode, the terminal device makes the TYPE-C port operate in DP (DisplayPort) mode, calls a DP (DisplayPort) driver pre-installed in the operating system of the terminal device, and transmits media data in DP protocol format including audio and video to a first data port of the wireless screen transmission device through a differential pin pair of the TYPE-C port of the terminal device.

[0052] When the terminal device is connected to the wireless screen transfer device through the Type-C port for the first time, the terminal device accepts the user's operation to open the external storage device (for example, an operation to open the corresponding drive letter of the wireless screen transfer device) and displays the contents stored in the storage space, i.e., displays an icon corresponding to the program stored in the wireless screen transfer device, i.e., the icon of the first application. When the user double-clicks or right-clicks on the icon, the program stored in the wireless screen transfer device is loaded into the internal memory of the terminal device through the USB 2.0 data transmission pins (D+ and D-, i.e., the second data port) of the Type-C port and executed by the processor of the terminal device, thereby displaying the currently displayed program on the screen of the terminal device. Privacy Window When the terminal device is connected to the wireless screen transfer device again through the Type-C port after installing the corresponding service, the first application is automatically loaded to the terminal device through the data transmission pin of the USB 2.0 (i.e., the second data port) from the wireless screen transfer device according to the service installed on the terminal device and executed by the processor of the terminal device, thereby displaying the current location information of the screen of the terminal device. Privacy window The location information is obtained, and the location information and a screen sharing command are sent to the wireless screen transfer device, in which case privacy processing is performed without the user being aware of it. Here, the TYPE-C receiving port of the terminal device has USB2.0 data transmission pins D+ and D- corresponding to the USB2.0 (i.e., second data port) data transmission pins of the TYPE-C port of the wireless screen transfer device.

[0053] When the first application (including the screen sharing control program and the privacy identification program) is loaded into the internal memory of the terminal device, a first confirmation window pops up, and the user can confirm through the window whether to perform screen transfer and privacy identification. If the user confirms through the popped-up first confirmation window that privacy identification will also be performed in the subsequent screen sharing, the screen currently displayed on the screen is used in the screen sharing. Privacy Window The position information of the screen is acquired and transmitted to the second data port of the wireless screen transfer device through the USB 2.0 data transmission pins (D+ and D-), otherwise the above confirmation cannot be made. Here, the screen sharing control program allows the user to decide whether to project on the main screen or the extended screen, decide to project a specific application window instead of the entire screen, join screen sharing in the form of joining (multi-screen sharing) or preemption, decide whether to project audio, decide whether to project mouse pointer, decide image quality, etc., all of which may be set through the pop-up first confirmation window. Preferably, when the first application (including the privacy identification program but not including the screen sharing control program) is loaded into the internal memory of the terminal device, the first confirmation window is popped up, and the user may confirm through the window whether to perform privacy identification and whether to start screen transfer at this time, and the screen transfer command may be received through a hardware button of the wireless screen transfer device. The privacy processing program includes a predetermined List of may be included, and List ofSpecifically, the privacy window model information included in the privacy software may be a system default setting or a setting customized by a user. The privacy software may include, but is not limited to, a social application, an instant communication software, an e-mail software, etc. The privacy window model information may be a process name and a window name. In the process of executing the privacy identification program, the processor of the terminal device obtains information of a window currently displayed on the screen, and converts the information of the window into a predetermined List of The information in a particular display window is matched against the information contained in List of If it matches with the model information recorded in the display window, it is determined that the display window is a privacy window and the position of the privacy window needs to be transmitted to the wireless screen transfer device.

[0054] When the wireless screen transfer device receives the position information data of the privacy window, the microprocessor executes the second application, and the privacy processing program includes processing the area corresponding to the received video media data synchronously based on the position information data. The processing method includes adding a mosaic layer, overwriting a predetermined graphic template, deleting area image data, etc. Among them, the mosaic layer is a method of fusing adjacent pixels based on existing pixel data in the area to prevent the original image from being displayed clearly. Overwriting a predetermined graphic template is overwriting a predetermined graphic template that does not include privacy information in the area identified by the position information, and the graphic template may correspond to a software window or may not be related to the software window, and such a method has little effect on the display effect of the entire screen. Deleting area image data is covering the entire area identified by the position information with a specific color, and such a method is the simplest area image processing means. In addition, when the microprocessor of the wireless screen transfer device receives a screen transfer start command outputted by a user, it starts compression and encoding of the received audio media data and processed video media data (or unprocessed).

[0055] Preferably, when the wireless screen transfer device does not receive the privacy window position information data, the wireless screen transfer device starts compression and encoding of the received audio media data and video media data (unprocessed) according to a screen transfer command received by the microprocessor of the wireless screen transfer device and output by the user, and transmits the compressed media data to the large-screen display device via a communication network for display. Specifically, the microprocessor of the wireless screen transfer device may receive the screen transfer command through a screen transfer button of the wireless screen transfer device, where the screen transfer button of the wireless screen transfer device is a hardware button provided on the top or side of the wireless screen transfer device, but the screen transfer button of the wireless screen transfer device may also be a software button, which is realized by a program and disposed on the interface of the display screen of the wireless screen transfer device or the display interface of the processing device, and the user may start compression and encoding of the audio and video data by clicking the software button (i.e., the first confirmation window).

[0056] In another optional embodiment, based on the above content, if the terminal device executes a privacy identification program to identify and find that a privacy window exists in the window currently displayed on the screen, a second confirmation window may be popped up, the second confirmation window is for receiving a privacy processing confirmation command, and the privacy processing confirmation command instructs to increase and / or decrease the privacy window to be subjected to privacy processing. The position information of the privacy window is transmitted to the wireless screen transfer device according to the privacy processing confirmation command, and the wireless screen transfer device performs privacy processing on the video media data based on the updated position information. The second confirmation window may be a predetermined List ofand displaying a privacy window list matching the privacy window model information in the terminal device, and the user can confirm in the second confirmation window whether to continue the privacy process for the privacy window, and the second confirmation window can display a list of windows currently displayed on the terminal device, and the user can confirm in the second confirmation window whether to continue the privacy process for the privacy window, and can confirm whether to put a normally displayed software window into a privacy process state. Furthermore, since the timing of the user's confirmation of the second confirmation window cannot be controlled, when the terminal device executes the privacy identification program, as long as it identifies that a privacy window exists in a window currently displayed on the screen, it can automatically transmit position information of the privacy window to the wireless screen transfer device, and the wireless screen transfer device can perform privacy processing on the media data received synchronously based on the position information. In addition to popping up the second confirmation window when a privacy window is detected, the second confirmation window can also be popped up when a window trigger command is received. According to such a pop-up method, the user can change the privacy process state of an existing display window by himself, for example, canceling the privacy process for a display window that originally required privacy processing, or subjecting a display window that originally did not require privacy processing to privacy processing.

[0057] The position information may also be transmitted when the display position of the privacy window changes, i.e., if the display position of the privacy window does not change, the terminal device does not transmit the position information, and the screen transfer device performs privacy processing based on the previously received position information; if the display position of the privacy window changes, the terminal device updates and transmits the position information, and such changes are due to opening a new software window, closing, minimizing or moving an existing privacy window, or terminating the privacy processing state. The position information may also be transmitted in real time, i.e., the position information is transmitted synchronously with the screen image.

[0058] From the perspective of data transmission of the wireless screen transfer device, an embodiment of the present application may be realized by the following method, which includes: receiving media data in a DP protocol format, which is media content currently displayed on a screen of a terminal device, via a TYPE-C port; sending a first application to the terminal device via the TYPE-C port, the first application including a privacy identification program, which identifies a privacy window in the media content displayed on the screen of the terminal device and obtains its position information, receiving position information sent by the terminal device, which is the position information of the privacy window in the media content displayed on the screen of the terminal device; executing a second application, which includes a privacy processing program, to perform privacy processing on the media data based on the position information based on the position information based on the position information and the media data; and encoding the media data that has been privacy processed and sending it to a display device.

[0059] In one particular embodiment, the TYPE-C port includes a first data port and a second data port, and in such case, receiving media data in DP protocol format via the TYPE-C port includes receiving media data in DP protocol format via the first data port of the TYPE-C port, and transmitting the first app to the terminal device via the TYPE-C port and receiving the location information transmitted by the terminal device includes transmitting the first app to the terminal device and receiving the location information transmitted by the terminal device via the second data port of the TYPE-C port.

[0060] In another particular embodiment, the privacy identification program includes a predetermined List of where the privacy window is identified by the privacy window model information.

[0061] In a particular embodiment, the wireless screen transfer device may add a device identifier of the terminal device to the media data.

[0062] In this embodiment, the data transmission process is described in the embodiment based on the hardware device, so that the details not described here can be referred to the above.

[0063] Fig. 7 is a structural schematic diagram of a conference system according to an embodiment of the present application. As shown in Fig. 7, the conference system includes a terminal device 410, a wireless screen transfer device 420, and a display device 430, the wireless screen transfer device 420 is connected to the terminal device 410 and the display device 430 respectively, a first application 423 and a second application 424 are stored in the wireless screen transfer device 420, the first application 423 and the second application 424 may be stored in the memory 422 of the wireless screen transfer device 420, the terminal device 410 includes a power supply circuit 411 and a central processor 412, the wireless screen transfer device 420 includes a microprocessor 421, and the display device 430 includes a display screen 432 and a main processor 431. The power supply circuit 411 provides a working voltage to the wireless screen transfer device 420 when the wireless screen transfer device 420 is connected to the terminal device 410. The central processor 412 is configured to send a query packet to the wireless screen transfer device 420. The microprocessor 421 is configured to send response information to the terminal device 410, including that the wireless screen transfer device 420 supports the DP working mode. The central processor 412 is further configured to send media data in the DP protocol format to the wireless screen transfer device 420. The microprocessor 421 is further configured to send a first app to the terminal device 410. The central processor 412 is further configured to perform control such as receiving an instruction to execute a first app 423 including a privacy identification program for popping up a first confirmation window on the terminal device 410 screen and identifying a privacy window in the media content displayed on the screen of the terminal device 410 through the first confirmation window and obtaining its position information. The central processor 412 is further configured to send the position information to the wireless screen transfer device 420. The microprocessor 421 is further configured to execute a second app 424 including a privacy processing program for performing privacy processing on the media data based on the position information based on the received position information and media data. The microprocessor 421 is further configured to send the media data subjected to privacy processing to the display device 430.The main processor 431 is configured to control a display screen 432 to display the received media data.

[0064] Based on the above embodiment, when the terminal device 410 executes the first application 423 and identifies that a privacy window exists in the media content currently displayed on the screen, a second confirmation window pops up on the screen of the terminal device 410, and the second confirmation window receives a privacy processing confirmation command, which instructs to increase and / or decrease the privacy window to be subjected to privacy processing. The terminal device 410 obtains the confirmed privacy window according to the privacy processing confirmation command, and transmits position information corresponding to the confirmed privacy window to the wireless screen transfer device 420.

[0065] Based on the above embodiment, the central processor 412 is further configured to pop up a second confirmation window when the privacy window appears for the first time on the media content currently being displayed on the screen of the terminal device 410 .

[0066] Based on the above embodiment, the privacy identification program including the privacy window model information includes a predetermined List of When the terminal device 410 executes the privacy identification program, it obtains window information corresponding to the media content currently displayed on the screen, and if the window information matches the privacy window model information, it determines that a privacy window exists in the media content currently displayed on the screen, and transmits the position information of the privacy window to the wireless screen transfer device 420.

[0067] Based on the above embodiment, the wireless screen transfer device 420 adds the device identifier of the terminal device 410 to the media data.

[0068] Based on the above embodiment, the central processor 412 is further configured to pop up a second confirmation window when the terminal device 410 receives the window trigger command.

[0069] The conference system according to the embodiment of the present application can implement or auxiliarily implement any of the data transmission methods according to the above embodiments, and has corresponding functions and beneficial effects.

[0070] In addition, in the embodiment of the above conference system, each unit and module included is merely divided according to functional logic, and is not limited to the above division, as long as the corresponding function can be achieved. Furthermore, the specific names of each functional unit are merely for distinguishing one from the other, and do not limit the scope of the patent of this application.

[0071] Fig. 8 is a structural schematic diagram of a wireless screen transfer device according to an embodiment of the present application. As shown in Fig. 8, the wireless screen transfer device 50 includes a TYPE-C port 51, a wireless module 52, a microprocessor 53, and a memory 54, the TYPE-C port 51, the memory 54 and the wireless module 52 are all electrically connected to the microprocessor 53, the memory 54 stores a first application 541 and a second application 542, the first application 541 includes a privacy identification program, the second application 542 includes a privacy processing program, and the TYPE-C port 51 includes a first data port and a second data port. The microprocessor 53 is configured to receive, via the first data port, media data in DP protocol format, which is the media content currently displayed on the screen of the terminal device, retrieve from the memory 54 a first application 541 for identifying a privacy window in the media content displayed on the screen of the terminal device and obtaining its position information, perform control to output the first application 541 to the terminal device via the second data port, receive, via the second data port, position information sent by the terminal device, which is position information of the privacy window in the media content displayed on the screen of the terminal device, and execute, based on the position information and the media data, a second application 542 for performing privacy processing on the media data based on the position information, and transmit the media data subjected to privacy processing by the wireless module 52 to the display device.

[0072] Based on the above embodiment, the privacy identification program includes a predetermined List of where the privacy window is identified by the privacy window model information.

[0073] Based on the above embodiment, the wireless screen transfer device 50 adds the device identifier of the terminal device to the media data.

[0074] The wireless screen transfer device according to the embodiments of the present application can implement or auxiliarily implement any of the data transmission methods according to the above embodiments, and has corresponding functions and beneficial effects.

[0075] In addition, in the above embodiment of the wireless screen transfer device, each unit and module included is merely divided according to functional logic, and is not limited to the above division, as long as the corresponding function is achieved. Furthermore, the specific names of each functional unit are merely for distinguishing one from the other, and do not limit the scope of the patent of this application.

[0076] An embodiment of the present application also provides a data transmission device, the data transmission device including a TYPE-C port, a wireless module, a microprocessor, and a memory, the TYPE-C port, the memory, and the wireless module are all electrically connected to the microprocessor, and a first application and a second application are stored in the memory, the microprocessor is configured to receive media data in a DP protocol format, which is a media content currently displayed on a screen of a terminal device, through the TYPE-C port, transmit to the terminal device through the TYPE-C port a first application including a privacy identification program for identifying a privacy window in the media content displayed on the screen of the terminal device and obtaining position information thereof, receive position information transmitted by the terminal device, which is position information of the privacy window in the media content displayed on the screen of the terminal device, and execute a second application including a privacy processing program for performing privacy processing on the media data based on the position information, and encode the privacy-processed media data and transmit it to a display device through the wireless module.

[0077] Based on the above embodiment, the TYPE-C port includes a first data port and a second data port, and in such case, receiving media data in the DP protocol format via the TYPE-C port includes receiving the media data in the DP protocol format via the first data port of the TYPE-C port, and sending the first application to the terminal device via the TYPE-C port includes sending the first application to the terminal device via the second data port of the TYPE-C port, and receiving the location information sent by the terminal device.

[0078] Based on the above embodiment, the privacy identification program includes a predetermined List of where the privacy window is identified by the privacy window model information.

[0079] Based on the above embodiment, the device identifier of the terminal device is added to the media data.

[0080] The data transmission device according to the embodiments of the present application can execute or auxiliarily execute any of the data transmission methods according to the above embodiments, and has corresponding functions and beneficial effects.

[0081] In addition, in the above embodiment of the data transmission device, each unit and module included is merely divided according to functional logic, and is not limited to the above division, as long as the corresponding function is achieved. Furthermore, the specific names of each functional unit are merely for distinguishing one from the other, and do not limit the scope of the patent of this application.

[0082] An embodiment of the present application also provides a storage medium including computer-executable instructions that, when executed by a computer processor, perform relevant operations of the data transmission method according to any embodiment of the present application and have corresponding functions and beneficial effects.

[0083] Those skilled in the art will appreciate that the embodiments of the present application may be provided as a method, a system, or a computer program product.

[0084] Thus, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer usable storage media (including, but not limited to, disk memory, CD-ROM, optical memory, etc.) containing computer usable program code. The present application is described with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It is understood that each flow and / or block in the flowcharts and / or block diagrams, and combinations of flows and / or blocks in the flowcharts and / or block diagrams, may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, whereby the instructions executed by the processor of the computer or other programmable data processing device constitute an apparatus that realizes the functions specified in one or more flows and / or one or more blocks in the flowcharts and / or block diagrams. These computer program instructions may also be stored in a computer readable memory that can be activated to cause a computer or other programmable data processing device to operate in a particular manner, whereby the instructions stored in the computer readable memory constitute an article of manufacture including an instruction apparatus implementing the functions specified in one or more flows of the flowcharts and / or one or more blocks of the block diagrams. These computer program instructions may be loaded into a computer or other programmable data processing device, whereby a series of operational steps are executed on the computer or other programmable device to generate a computer-implemented process, whereby the instructions executing on the computer or other programmable device provide steps for implementing the functions specified in one or more flows of the flowcharts and / or one or more blocks of the block diagrams.

[0085] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. The memory can include non-persistent memory, such as random access memory (RAM) and / or read only memory (ROM) or flash RAM, among other forms of non-volatile memory in a computer readable medium. Memory is one example of a computer readable medium.

[0086] Computer-readable media includes persistent and non-persistent, removable and non-removable media, and may implement information storage by any method or technology. Information may be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc-read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cartridges, magnetic tapes, magnetic disk storage or other magnetic storage or other non-transmission media that may be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

[0087] It is noted that the terms "comprise", "include", or any other variation thereof are intended to cover a non-exclusive inclusion, whereby a process, method, article, or device that includes a set of elements includes not only those elements, but also other elements not expressly listed or that are inherent to such process, method, article, or device. In the absence of further limitations, an element qualified by the phrase "comprises a" does not exclude the presence of further identical elements in the process, method, article, or device that includes the element.

[0088] It should be noted that the above is merely a preferred embodiment of the present application and the technical principles applied thereto. It is obvious to those skilled in the art that the present application is not limited to the specific embodiments described herein, and various obvious modifications, adjustments and substitutions can be made by those skilled in the art without departing from the scope of the present application. Therefore, although the present application has been described in more detail by the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is defined by the appended claims.

Claims

1. A data transmission method applied to a conference system including a terminal device, a wireless screen transfer device, and a display device, comprising: the wireless screen transfer device is connected to the terminal device and the display device, respectively, and a first application and a second application are stored therein; The data transmission method includes: When the wireless screen transfer device is connected to the terminal device, the terminal device supplies an operating voltage to the wireless screen transfer device; The terminal device transmits a query packet to the wireless screen transfer device; The wireless screen transfer device sends response information to the terminal device, the response information including that the wireless screen transfer device supports a DP working mode; The terminal device transmits media data in a DP protocol format to the wireless screen transfer device; the wireless screen transfer device transmits the first application to the terminal device; popping up a first confirmation window on a screen of the terminal device, and receiving a command to execute the first app including a privacy identification program through the first confirmation window to identify a privacy window in media content displayed on the screen of the terminal device and obtain location information thereof, the privacy window being a display window in which privacy information exists; the terminal device transmits the position information to the wireless screen transfer device; the wireless screen transfer device executes the second application, the second application including a privacy processing program that performs privacy processing on the media data based on the location information, based on the received location information and the media data; the wireless screen transfer device transmits the privacy-processed media data to the display device, and the display device displays the received media data.

2. When the terminal device executes and identifies the first app and a privacy window exists in the media content displayed on the current screen, pops up a second confirmation window on the screen of the terminal device; The second confirmation window is for receiving a privacy processing confirmation command, the privacy processing confirmation command instructing to increase and / or decrease a privacy window to be subject to privacy processing; The terminal device obtains a confirmed privacy window according to the privacy processing confirmation command, and transmits position information corresponding to the confirmed privacy window to the wireless screen transfer device. The method of claim 1.

3. popping up the second confirmation window when a privacy window is displayed for the first time on the media content currently being displayed on the screen of the terminal device. The method of claim 2.

4. The privacy identification program includes a predetermined list including privacy window model information; When the terminal device executes the privacy identification program, the terminal device obtains window information corresponding to the media content currently displayed on the screen, and if the window information matches the privacy window model information, the terminal device confirms that a privacy window exists in the media content currently displayed on the screen, and transmits position information of the privacy window to the wireless screen transfer device. The method according to any one of claims 1 to 3.

5. The wireless screen transfer device adds a device identifier of the terminal device to the media data. The method according to any one of claims 1 to 3.

6. and popping up the second confirmation window when the terminal device receives the window trigger command. The method according to claim 2 or 3.

7. A data transmission method applied to a wireless screen transfer device, comprising: the wireless screen transfer device includes a TYPE-C port, a wireless module, a microprocessor, and a memory, the TYPE-C port, the memory, and the wireless module are all electrically connected to the microprocessor, a first application and a second application are stored in the memory, the first application includes a privacy identification program, and the second application includes a privacy processing program, the TYPE-C port includes a first data port and a second data port, The data transmission method includes: receiving, via the first data port, media data in a DP protocol format, which is a media content currently being displayed on a screen of a terminal device; the microprocessor retrieving from the memory the first application, which identifies a privacy window in the media content being displayed on the screen of the terminal device and retrieves its position information; and controlling the first application to be output to the terminal device via the second data port, the privacy window being a display window in which privacy information exists; receiving location information from the terminal device via the second data port, the location information being location information of a privacy window in media content displayed on a screen of the terminal device; The microprocessor executes the second application based on the location information and the media data, the second application performing privacy processing on the media data based on the location information; transmitting, by the wireless module, the privacy processed media data to a display device.

8. The privacy identification program includes a predetermined list including privacy window model information, and the privacy window is identified by the privacy window model information. The method according to claim 7.

9. The wireless screen transfer device adds a device identifier of the terminal device to the media data. The method according to claim 7.

10. 1. A data transmission method, comprising: receiving media data in DP protocol format via the TYPE-C port, the media content being currently displayed on the screen of the terminal device; Transmitting a first application to the terminal device via a TYPE-C port, the first application including a privacy identification program for identifying a privacy window in a media content displayed on a screen of the terminal device and acquiring location information thereof, and receiving location information from the terminal device, the location information being location information of a privacy window in a media content displayed on a screen of the terminal device, the privacy window being a display window in which privacy information exists; Executing a second application based on the location information and the media data, the second application including a privacy processing program for performing privacy processing on the media data based on the location information; encoding the privacy-processed media data and transmitting the encoded data to a display device.

11. the TYPE-C port includes a first data port and a second data port; In such a case, receiving media data in the DP protocol format via the above-mentioned TYPE-C port is receiving media data in a DP protocol format via the first data port of a TYPE-C port; Transmitting the first application to the terminal device via the TYPE-C port and receiving location information from the terminal device transmitting a first application to the terminal device via the second data port of the TYPE-C port and receiving location information from the terminal device. The method of claim 10.

12. The privacy identification program includes a predetermined list including privacy window model information, and the privacy window is identified by the privacy window model information.

12. The method according to claim 10 or 11.

13. Add a device identifier of the terminal device to the media data 12. The method according to claim 10 or 11.

14. A conference system, comprising: The system includes a terminal device, a wireless screen transfer device, and a display device, the wireless screen transfer device is connected to the terminal device and the display device respectively, a first application and a second application are stored in the wireless screen transfer device, the terminal device includes a power supply circuit and a central processor, the wireless screen transfer device includes a microprocessor, the display device includes a display screen and a main processor, The power supply circuit supplies an operating voltage to the wireless screen transfer device when the wireless screen transfer device is connected to the terminal device; The central processor is configured to send a query packet to the wireless screen transfer device; The microprocessor is configured to send response information to the terminal device, the response information including that the wireless screen transfer device supports a DP working mode; The central processor is further configured to transmit media data in a DP protocol format to the wireless screen transfer device; The microprocessor is further configured to transmit a first application to the terminal device; The central processor is further configured to control the terminal device to pop up a first confirmation window on the screen and receive, via the first confirmation window, an instruction to execute a first app including a privacy identification program for identifying a privacy window in a media content displayed on the screen of the terminal device and acquiring location information thereof, the privacy window being a display window in which privacy information exists; the central processor is further configured to transmit the position information to the wireless screen transfer device; The microprocessor is further configured to execute the second app based on the received location information and media data, the second app including a privacy processing program that performs privacy processing on the media data based on the location information; the microprocessor is further configured to transmit the privacy-processed media data to a display device; The main processor is configured to control the display screen to display the received media data.

15. A wireless screen transfer device, a TYPE-C port, a wireless module, a microprocessor, and a memory, the TYPE-C port, the memory, and the wireless module are all electrically connected to the microprocessor, a first application and a second application are stored in the memory, the first application includes a privacy identification program, and the second application includes a privacy processing program, the TYPE-C port includes a first data port and a second data port, The microprocessor includes: receiving, via the first data port, media data in a DP protocol format, which is a media content currently being displayed on a screen of the terminal device; The first application is acquired from the memory, the first application identifying a privacy window in the media content displayed on the screen of the terminal device and acquiring its position information, and the first application is output to the terminal device via the second data port, the privacy window being a display window in which privacy information exists; receiving location information from the terminal device via the second data port, the location information being location information of a privacy window within media content displayed on a screen of the terminal device; execute a second application that performs privacy processing on the media data based on the location information and the media data; A wireless module is configured to transmit the privacy-processed media data to a display device. Wireless screen transfer device.

16. A data transmission device, a TYPE-C port, a wireless module, a microprocessor, and a memory, the TYPE-C port, the memory, and the wireless module are all electrically connected to the microprocessor, and a first application and a second application are stored in the memory; The microprocessor includes: receiving media data in a DP protocol format, which is a media content currently being displayed on a screen of a terminal device, via the TYPE-C port; transmitting a first application to the terminal device via the TYPE-C port, the first application including a privacy identification program for identifying a privacy window in the media content displayed on the screen of the terminal device and acquiring position information thereof; receiving position information from the terminal device, the position information being position information of a privacy window in the media content displayed on the screen of the terminal device, the privacy window being a display window in which privacy information exists; execute a second application including a privacy processing program that performs privacy processing on the media data based on the location information, based on the location information and the media data; The wireless module is configured to encode the privacy-processed media data and transmit the encoded data to a display device. Data transmission device.

17. A computer-readable storage medium storing a computer program which, when executed by a processor, implements the data transmission method according to any one of claims 1 to 3 and 7 to 11.

Citation Information

Patent Citations

  • Screen projection processing method and device, equipment and storage medium

    CN113391774A

  • Conference demonstration method, device, equipment and medium

    CN114610251A

  • Information processing system, control device, information processing program, and image display method

    JP2013172301A

  • Image transmission apparatus, program, and image transmission method

    JP2021016032A

  • Data transmission device and data transmission method

    JP2022500883A