Data transmission method and data transmission system

Abstract

A data transmission method and a data transmission system. After a second terminal receives screen data from a first terminal, the screen data is displayed in the form of a capture card window. When the second terminal confirms that the capture card window is displayed in full screen, it switches to an HDMI channel and displays the first screen data in the HDMI channel; thus, after the second terminal obtains the first touch operation data, it performs the touch operation corresponding to the first touch operation data, and transmits the first touch operation data back to the first terminal, so that the first terminal performs the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal, realizing the touch transmission function, and can realize the function of sharing the screen data of the first terminal through the Internet.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a data transmission method and a data transmission system. Background Art

[0002] Hospitals, banks, research institutes and other places that require internal and external network isolation generally have two interactive tablets, one of which, interactive tablet A, can only access the local area network due to the security restrictions of the place, and cannot access the external network, while the other interactive tablet B can access the internal and external networks. When a user wants to conduct a video conference, it is expected to open the video conferencing software on interactive tablet B to enable the shared desktop function, so as to share the screen data displayed by interactive tablet A with other participants of the video conference. In the related art, generally, an HDMI capture card is added between the two interactive tablets, and the screen data of interactive tablet A is collected by the HDMI capture card, and the collected screen data is sent to interactive tablet B for display, so as to send the screen data to other external network devices through the networkable interactive tablet B. Since the interactive tablet realizes the external network access function through the main control module to which it is connected, that is, the HDMI capture card sends the collected screen data to the main control module of interactive tablet B, which is displayed by the main control module, and realizes sending the screen data to the external network device, in this case, when the user performs a touch operation on interactive tablet B, interactive tablet B cannot send the touch data to interactive tablet A. Summary of the invention

[0003] In order to solve the above problems, the embodiments of the present application provide a data transmission method and a data transmission system.

[0004] An embodiment of the present application provides a data transmission method, which is applied to a second terminal, wherein the second terminal includes a host channel and an HDMI channel, and the method includes:

[0005] Receiving first picture data; the first picture data includes picture data of a display picture displayed on a first terminal;

[0006] Displaying a capture card window on the current display screen of the host channel, and displaying the first screen data in the capture card window;

[0007] After confirming that a sharing operation on a display screen has been received, second screen data of the current display screen is sent to a conference terminal for display, the conference terminal being connected to the second terminal via the Internet;

[0008] When confirming that the acquisition card window is to be displayed in full screen, switching to the HDMI channel;

[0009] Displaying the first picture data in full screen in the HDMI channel;

[0010] After receiving the first touch operation data, the first touch operation data is sent to the first terminal, so that after receiving the first touch operation data, the first terminal performs the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal;

[0011] The first terminal is only connected to a local area network, and the second terminal is connected to the Internet.

[0012] In an embodiment of the present application, after the second terminal receives the screen data from the first terminal, the screen data is displayed in the form of a capture card window. When the second terminal confirms that the capture card window is displayed in full screen, it switches to the HDMI channel and displays the first screen data in the HDMI channel. Therefore, after the second terminal obtains the first touch operation data, it executes the touch operation corresponding to the first touch operation data, and transmits the first touch operation data back to the first terminal, so that the first terminal performs the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal, thereby realizing the touch return function, and can realize the function of sharing the screen data of the first terminal through the Internet. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0014] Figure 1 A schematic diagram of connecting two interactive tablets with isolated internal and external networks in the related technology of this application;

[0015] Figure 2 A schematic diagram of the structure of a data transmission system provided in an embodiment of the present application;

[0016] Figure 3 A schematic diagram of the structure of a data transmission system provided in an embodiment of the present application;

[0017] Figure 4 A schematic diagram showing an example of a sidebar display effect provided in an embodiment of the present application;

[0018] Figure 5 A flowchart of a data transmission method provided in an embodiment of the present application;

[0019] Figure 6 A flowchart of another data transmission method provided in an embodiment of the present application;

[0020] Figure 7A schematic diagram of the system architecture of a data transmission system provided in an embodiment of the present application;

[0021] Figure 8 A schematic diagram of the structure of another data transmission system provided in an embodiment of the present application;

[0022] Fig. 9 A flowchart of another data transmission method provided in an embodiment of the present application;

[0023] Fig.10 A schematic diagram of the structure of a data transmission system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0025] In the following introduction, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance. The following introduction provides multiple embodiments of the present application, and different embodiments can be replaced or combined, so the present application can also be considered to include all possible combinations of the same and / or different embodiments recorded. Therefore, if one embodiment includes features A, B, and C, and another embodiment includes features B and D, then the present application should also be considered to include embodiments containing one or more of all other possible combinations of A, B, C, and D, although the embodiment may not be clearly recorded in the following text.

[0026] The following description provides examples and does not limit the scope, applicability or examples set forth in the claims. Changes may be made to the functions and arrangements of the elements described without departing from the scope of the present application. Various processes or components may be appropriately omitted, substituted or added to each example. For example, the described method may be performed in an order different from the order described, and various steps may be added, omitted or combined. In addition, features described in some examples may be combined in other examples.

[0027] The hardware part of the interactive tablet is composed of a touch display module, a whole machine module (including a controller) and other parts, which are combined together by integral structural parts. The touch display module includes a display screen, a touch component and a backlight component. The backlight component is used to provide a backlight source for the display screen. The display screen generally uses a liquid crystal display device for displaying pictures. The touch component is arranged on the display screen or at the front end of the display screen to collect touch data generated by the user's touch operation and send the collected touch data to the whole machine module for processing.

[0028] In actual use, the screen data is displayed on the interactive tablet's display screen. When the user clicks on the content displayed on the screen with a touch object such as a finger or a stylus, for example, clicks on a graphic button displayed on the screen, the touch component of the interactive tablet will collect the touch data, and the touch component will convert the touch data into coordinate data of the touch point and send it to the whole machine module, or send the touch data to the whole machine module and convert it into coordinate data of the touch point by the whole machine module. After the whole machine module obtains the coordinate data of the touch point, it sends it to the corresponding program to implement the corresponding control operation, drive the display content to change, and achieve diversified display and operation effects.

[0029] Touch components can be divided into five basic categories based on technical principles: vector pressure sensing technology touch components, resistance technology touch components, capacitance technology touch components, electromagnetic technology touch screens, infrared technology touch components, and surface acoustic wave technology touch components. According to the working principle of the touch component and the medium for transmitting information, the touch component can be divided into four categories: resistance, capacitance induction, electromagnetic induction, infrared, and surface acoustic wave.

[0030] In the embodiment of the present application, the interactive tablet is equivalent to a display screen with a touch function with a whole machine module. The whole machine module is a built-in module of the interactive tablet, which does not include a main control module. A low-performance Android system runs inside it. The whole machine module mainly realizes the display processing and touch data processing functions of the interactive tablet. The hardware configuration of the whole machine module is low. In addition to configuring the operating system and basic processing software (such as whiteboard writing software, annotation application software), it does not support the installation of other application software. If the interactive tablet needs to realize other functions, it needs to access the main control module, and the corresponding functions are realized by installing relevant application software on the main control module. For example, if a file needs to be displayed, it is necessary to install relevant display software on the main control module. If a video conferencing function needs to be realized, it is necessary to install video conferencing software on the main control module, and so on. The main control module is a pluggable (OPS, Open Pluggable Specification) module on the interactive tablet, and the application software running on the interactive tablet is installed on the main control module. The main control module can run operating systems such as Windows and high-performance Android. For example, the main control module can use a PC module, a high-performance Android module, etc., which can be understood as a computer.

[0031] The interactive tablet at least includes signal source channels such as Android channel, host channel and HDMI channel, which are used to receive input signals from different signal sources, so that the interactive tablet can switch between different signal source channels to present media content provided by different signal sources. Among them, the Android channel is the working channel of the whole machine module of the interactive tablet itself, which is used to present the media content of the whole machine module. The signal source connected to the host channel is the host module, so the host channel is used to present the media data input by the host module of the interactive tablet. The HDMI channel is used to present the media data of the signal source connected through the HDMI interface of the interactive tablet. In addition, when the interactive tablet is in the host channel or HDMI channel, the display screen of the interactive tablet will actually display the screens of two systems, one is the screen of the Android channel, and the other is the screen of the host channel or the HDMI channel. There will be a partial transparent area in the screen of the Android channel, so that the screen of the host channel or the HDMI channel is displayed in the transparent area, so that the display screen presented at the end is the display screen of the two channels. For example, if the screen of the Android channel is a sidebar, then the screen of the Android channel is transparent except for the display area of ​​the sidebar, so that the display screen of the host channel or HDMI channel can be displayed in the transparent area, and the result presented to the user is that the interactive flat panel displays the screen of the host channel or HDMI channel, and the sidebar of the Android channel is superimposed on the screen. Specifically, the whole machine module will pre-set the area size of the display screen of the host channel or HDMI channel, so that when the whole machine module receives the touch data of the touch component, it will send the touch data in the pre-set area to the host channel or HDMI channel for response.

[0032] More specifically, the whole machine module includes a main control board, which is provided with a main control chip, a power supply circuit of the main control chip and other peripheral circuits, and is also provided with multiple communication interfaces for communication, and multiple communication interfaces are connected to the main control chip. The multiple communication interfaces specifically include a serial interface, a USB interface, an HDMI interface, a Type-C interface and / or a touch line port (Touch out port), etc. The whole machine module is connected to the main control module through a serial interface, and interfaces such as a USB interface and an HDMI interface are communicated with other devices or terminals to receive input signals from different signal sources and form corresponding signal source channels. For example, the whole machine module is connected to the main control module through a serial interface to form a host channel, so that the media content sent by the host channel can be received and presented, or it is connected to an external device through an HDMI interface to form an HDMI channel, thereby presenting the media data input by the external device.

[0033] The main control chip has two independent functional units, namely, a first functional unit and a second functional unit. The first functional unit is installed with an Android system, and the second functional unit is used to switch the signal source channel of the interactive flat panel. The first functional unit and the second functional unit can be implemented by different codes running on the same main control chip, or by different codes on two main control chips (in this case, there are two main control chips).

[0034] When the interactive tablet is in different signal source channels, the whole machine module has different processing methods for touch data. When the signal source channel of the interactive tablet is the Android channel, it means that the interactive tablet is in the working channel of the whole machine module itself, which is used to present the media content of the whole machine module. At this time, when the whole machine module receives the touch data sent by the touch component, the Android system performs compatibility processing of the touch data (through compatibility processing, the touch data generated by different types of touch components are processed into data in a unified format, so that the processing process of the Android system can be identified and responded), and performs operation response of the touch data, and performs corresponding operations. When the signal source channel of the interactive tablet is the host channel, when the whole machine module receives the touch data sent by the touch component, the Android system first performs compatibility processing of the touch data, and then the Android system forwards the touch data generated in the display screen area of ​​the host channel to the host channel through the second functional unit for response according to the area size of the display screen of the pre-set host channel. When the signal source channel of the interactive tablet is the HDMI channel, when the whole machine module receives the touch data sent by the touch component, the Android system first performs compatibility processing of the touch data, performs operation response of the touch data, and performs corresponding operations. Then, the Android system forwards the touch data generated in the display screen area of ​​the HDMI channel to the touch line port (Touch out port) through the second functional unit according to the preset display screen area size of the HDMI channel, and the external device of the touch line port (Touch out port) responds.

[0035] Figure 1 This is a schematic diagram of connecting two interactive tablets with isolated internal and external networks in the related technology of this application. Figure 1In the embodiment, the first terminal 10 and the second terminal 20 are both interactive tablets in the embodiment of the present application. The first terminal 10 is only connected to the local area network, and the second terminal 20 is connected to the Internet. The first terminal 10 includes a first main control module 11 and a first whole machine module 12, and the second terminal 20 includes a second main control module 21, a second whole machine module 22, and a second touch screen 23. The application software for displaying files of the first terminal 10 is installed on the first main control module 11. Therefore, the HDMI capture card 30 is connected between the first main control module 11 and the second main control module 21, and is used to transmit the screen data in the first terminal 10 to the second terminal 20. After the HDMI capture card 30 captures the screen data of the first main control module 11, it is sent to the second main control module 21 and displayed in the form of a capture card window, so that the software installed in the second main control module 21, such as video conferencing software, can share the display screen containing the capture card window with other external terminals through the Internet, so as to achieve the purpose of sending the screen data of the first terminal 10 to other external terminals through the Internet for screen sharing.

[0036] In this case, since the HDMI capture card 30 sends the picture data of the first main control module 11 to the second main control module 21 for display, the second terminal 20 is in the host channel. In this case, the second whole machine module 22 sends the received touch data to the second main control module 21 for response, and the touch data of the second terminal 20 cannot be sent to the first terminal 10, that is, the touch feedback function cannot be realized.

[0037] If the touch feedback function is to be implemented, the screen data of the first main control module 11 needs to be sent to the second whole machine module 22 for display. However, since the hardware configuration of the second whole machine module 22 is relatively low, in addition to configuring the operating system and basic processing software (such as whiteboard writing software, annotation application software), it does not support the installation of application software. In this case, although the touch feedback function can be implemented, it is impossible to achieve the purpose of sending the screen data of the first terminal 10 to other external terminals through the Internet for screen sharing.

[0038] Therefore, in the current related technology, the connection method between the first terminal 10 and the second terminal 20 isolated by the internal and external networks cannot simultaneously meet the needs of sharing the screen data of the first terminal 10 through the Internet and sending the touch data of the second terminal 20 to the first terminal 10.

[0039] See also Figure 2 , Figure 2 Schematic diagram of a data transmission system provided in an embodiment of the present application. Figure 2 As shown, the data transmission system may include a first terminal 10 , a second terminal 20 and an HDMI capture card 30 .

[0040] Among them, the HDMI capture card 30 includes a target HDMI port 301 and a target USB port 302, the first terminal 10 includes a first main control module 11 and a first whole machine module 12, the first main control module 11 includes a first HDMI port 111 and a first USB port 112, the second terminal 20 includes a second main control module 21, a second whole machine module 22 and a second touch screen 23, the second whole machine module 22 is connected to the second main control module 21 and the second touch screen 23 respectively, the second main control module 21 includes a second HDMI port 211 and a second USB port 212, the second whole machine module 22 includes a third HDMI port 221 and a touch line port 222, the first USB port 112 is connected to the touch line port 222, the first HDMI port 111 is connected to the target HDMI port 301, the target USB port 302 is connected to the second USB port 212, the second HDMI port 211 is connected to the third HDMI port 221, the first terminal 10 is only connected to the local area network, and the second terminal 20 is connected to the Internet.

[0041] Among them, Figure 3 As shown, the first HDMI port on the first main control module 11 is an HDMI OUT port, the second HDMI port on the second main control module 21 is an HDMI OUT port, the third HDMI port 221 on the second whole machine module 22 is an HDMI IN port, and the touch line port on the second whole machine module is a TOUCH port.

[0042] As mentioned above, in the conventional technology, the main control module of the interactive tablet and the whole machine module are connected through a serial interface, so as to realize data interactive communication through the serial interface and realize related interactive functions. In this embodiment, the HDMI OUT port on the second main control module 21 is connected to the HDMI IN port on the second whole machine module 22, and a new communication link between the second main control module 21 and the second whole machine module 22 is constructed, so that the second whole machine module 22 can perform data interaction through the HDMI channel to realize the data transmission of the main control module to the HDMI IN port of the whole machine module, so that part or all of the screen displayed by the host channel can be sent to the HDMI channel for display. By connecting the touch line port (Touchout port) of the second whole machine module 22 to the first USB port 112 of the first terminal, and combining it with the HDMI channel working mode, the touch line port (Touch out port) can realize the characteristics of touch data output, and the touch data of the second terminal can be transmitted back to the first terminal for response.

[0043] A sidebar application may be run on the top left or right of the screen page of the first terminal 10 and the second terminal 20. After the sidebar is clicked to expand, there may be some high-frequency buttons, such as "return" and "home page". Figure 4The host sidebar is displayed under the host channel, and the whole device sidebar is displayed under the HDMI channel. The switching between the HDMI channel and the host channel is realized by monitoring the user's click operation on the sidebar button.

[0044] In one embodiment, after the second terminal 20 is started, the system mode of the second terminal 20 is first determined; if the system mode is not the duplicate screen mode, the system mode is switched to the duplicate screen mode. In the duplicate screen mode, the host channel and the HDMI channel can be switched.

[0045] The first terminal 10 and / or the second terminal 20 include but are not limited to: a personal computer, an interactive tablet, a handheld device, a vehicle-mounted device, a wearable device, a computing device or other processing device connected to a wireless modem, etc. In different networks, the user terminal can be called different names, such as: user equipment, access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent or user device, cellular phone, cordless phone, personal digital assistant (PDA), terminal equipment in 5G network or future evolution network, etc.

[0046] For the convenience of description, the embodiment of the present application is described by taking the example that both the first terminal and the second terminal are interactive tablets.

[0047] It should be noted that the number of ports in the above modules is only explained as an example, and the embodiments of the present application do not limit the specific number of ports.

[0048] Through the above connection method, an HDMI capture card is connected to the HDMI OUT port of the first terminal 10 and the USB port of the main control module of the second terminal 20 at one end, so that the screen of the first terminal can be displayed on the main control screen of the second terminal in a windowed manner. Then, through an HDMI cable, the HDMI OUT of the second main control module 21 of the second terminal 20 is connected to the HDMI IN of the second whole machine module 22 of the second terminal 20 to realize the data transmission of the main control module to the HDMI IN port of the whole machine module, so that part or all of the screen of the host channel can be sent to the HDMI channel for display. Finally, a Touch touch cable is used to connect the first terminal 10 and the second terminal 20 to each other to realize the touch return function. The user's need for touch return of the main control screen under multiple large screens can be met by the internal terminal under the condition of a local area network through the HDMI capture card + HDMI cable + TOUCH cable, combined with a specific software implementation method, and the screen data of the first terminal 10 can be shared through the Internet connected to the second terminal 20.

[0049] Next, combine Figure 1-Figure 4 The data transmission system shown introduces the data transmission method provided in the embodiment of the present application.

[0050] See also Figure 5 , Figure 5 1 is a flow chart of a data transmission method provided by an embodiment of the present application. This embodiment mainly emphasizes the process of realizing touch feedback, and the method includes:

[0051] S101, after receiving first picture data sent by a first main control module through a target HDMI port, the HDMI capture card sends the first picture data to a second USB port of a second main control module through a target USB port;

[0052] In the embodiment of the present application, the HDMI capture card can be understood as a capture card with a high-definition multimedia port. The capture card is mainly used to capture external photoelectric, video, audio and other analog signals and digitize them into a computer for digital processing. It mainly includes image capture cards, video capture cards, audio capture cards (such as sound cards), data capture cards, etc. The HDMI capture card has two different types of ports: an HDMI port and a USB port. Two terminals can be connected through these two ports. The HDMI capture card receives data in the HDMI data format of one of the terminals through the HDMI port, and after format conversion, converts the data in the HDMI format into data in the USB data format and sends it to the other terminal.

[0053] The first main control module in the embodiment of the present application can be understood as an external system module carried by the first terminal, such as a PC module or a high-performance Android module, which is mainly used for transmitting video-related data.

[0054] The second main control module in the embodiment of the present application can be understood as an external system module mounted on the second terminal, and can also be a PC module or a high-performance Android module, which is mainly used for transmitting video-related data.

[0055] In the embodiment of the present application, the first screen data may be understood as data information corresponding to the screen displayed by the first terminal.

[0056] Specifically, the first main control module collects the first picture data of the first terminal, and sends the first picture data to the HDMI capture card through the first HDMI port. The HDMI capture card obtains the first picture data through the target HDMI port, and sends the first picture data to the second USB port of the second main control module on the second terminal through the target USB port, so as to transmit the first picture data of the first terminal to the second terminal. It should be noted that here, the first picture data obtained by the HDMI capture card through the target HDMI port is the data encoded into the HDMI format by the first main control module. The HDMI capture card performs format conversion on the data in the HDMI data format, converts the first picture data from the HDMI data format to the USB data format, and then sends it to the second main control module through the target USB port, that is, the first picture data received from the target HDMI port is transmitted in the HDMI data format, and the first picture data sent through the target USB port is transmitted in the USB data format. Therefore, after the second main control module receives the first picture data in the USB data format, it can be displayed in a corresponding form according to the setting of the second main control module, such as displaying as a window, displaying in full screen, or popping up a window for the user to confirm whether to display, etc.

[0057] S102, after the second main control module receives the first picture data of the first terminal acquired by the HDMI acquisition card through the second USB port, the second terminal displays the acquisition card window in the host channel working mode, and displays the first picture data in the acquisition card window, where the first picture data includes picture data of the display picture displayed on the first terminal;

[0058] The acquisition card window is a window on the display screen of the second terminal, and the window is used to display the first screen data. In the embodiment of the present application, the acquisition card window is generated by an independent program running on the second main control module, and the independent program can be referred to as the acquisition card window program. The acquisition card window program runs on the second main control module and can receive the first screen data, so that the received first screen data can be displayed on the acquisition card window.

[0059] Specifically, after the second main control module receives the first screen data in the USB data format transmitted by the HDMI capture card through the second USB port, it will display the capture card window on the current display screen of the second terminal, and display the first screen data in the capture card window, so as to display the screen content of the first terminal on the second terminal. At this time, the second terminal is in the host channel mode, which is used to display the screen data of the second main control module. That is, the actual display effect is to superimpose the capture card window on the screen of the second main control module, and then display the first screen data in the capture card window. For example, the second main control module originally runs the video conferencing software and displays the video conferencing screen. After the second main control module receives the first screen data through the second USB port, it displays the capture card window on the video conferencing screen and displays the first screen data in the capture card window. Therefore, the screen seen by the user is on the screen of the second terminal, and the screen data of the first terminal is displayed in the form of a window.

[0060] S103, when the second main control module confirms that the acquisition card window is displayed in full screen, it sends channel switching information to the second whole machine module, and sends the first picture data to the third HDMI port (HDMI in port) of the second whole machine module through the second HDMI port (HDMI out port);

[0061] In the embodiment of the present application, the channel can be understood as a data channel used to access the display memory to obtain the EDID format data of the EEPROM in the display, thereby determining the display properties (such as resolution, aspect ratio, etc.) information of the display, and can transmit the physical data of the display directly to the terminal.

[0062] In the embodiment of the present application, when the user performs a full-screen display operation on the acquisition card window, the user operation will trigger a corresponding operation signal, and the second main control module confirms that the operation signal for full-screen display has been received, and then sends channel switching information to the second whole machine module. At the same time, the second main control module sends the first screen data to the second whole machine module. The full-screen display operation can include clicking a preset control on the sidebar, such as clicking a full-screen display button, selecting full-screen display through a menu, voice control, and the like.

[0063] The second main control module is connected to the second whole machine module via a serial interface, and the second main control module transmits the channel switching information to the second whole machine module via the serial interface.

[0064] S104: After receiving the channel switching information, the second whole machine module switches the signal source channel from the host channel to the HDMI channel, and after receiving the first picture data sent by the second main control module, the second terminal displays the first picture data in the HDMI channel working mode;

[0065] Specifically, after receiving the channel switching information, the second whole machine module switches from the host channel to the HDMI channel to implement channel switching, and at the same time, receives the first picture data. Since the second whole machine module is connected to the second touch screen, the second whole machine module sends the first picture data to the second touch screen for display, thereby realizing the display of the first picture data and the switching of channels in full screen mode.

[0066] S105: After the second whole machine module obtains the first touch operation data of the second touch screen, it sends the first touch operation data to the first USB port of the first terminal through the touch line port;

[0067] Under the HDMI channel, the user can perform touch operations on the second touch screen of the second terminal. When the user inputs touch information on the second touch screen, the second whole machine module obtains the first touch operation data of the touch operation, and then responds to the touch operation on the second terminal, such as generating a touch track, responding to operation controls, etc. At the same time, the second terminal is connected to the first terminal through a touch line, and the second whole machine module sends the first touch operation data to the first main control module of the first terminal through the touch line, so that the first terminal also responds.

[0068] Among them, the touch operation may include a writing operation, calling a graphic control to insert a graphic operation, calling an adjustment control to adjust the display screen, etc. For example, the user writes marks on the display screen, forms a circle selection track, etc. on the second touch screen of the second terminal. At this time, since the second whole machine module sends the first touch operation data to the first main control module of the first terminal through the touch line, the first terminal can also write marks on its display screen, form a circle selection track, etc.

[0069] S106: After receiving the first touch operation data through the first USB port, the first terminal executes the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal.

[0070] The first terminal receives the first touch operation data sent by the second terminal through the first main control module, responds to the touch operation corresponding to the first touch operation data, and updates the display screen to present the same response effect as the second terminal, thereby realizing touch feedback, and then realizing the process of the user operating and controlling the screen on the first terminal through the touch operation of the second terminal.

[0071] In one or more embodiments of the present application, after the second main control module of the second terminal obtains the screen data of the first terminal, the screen data is displayed in the form of a capture card window. When the second main control module confirms that the capture card window is displayed in full screen, channel switching information is sent to the second whole machine module, and the screen data of the second main control module is sent to the third HDMI port of the second whole machine module through the second HDMI port. After receiving the channel switching information, the second whole machine module switches the signal source channel to the HDMI channel, so that the screen data can be displayed through the HDMI channel. Then, under the HDMI channel, after the second whole machine module obtains the first touch operation data, the first touch operation data is transmitted back to the first main control module, so that the touch operation corresponding to the first touch operation data is executed, and the display screen of the first terminal is updated, thereby realizing the touch transmission function, and the function of sharing the screen data of the first terminal through the Internet can be realized.

[0072] See also Figure 6 , Figure 6 FIG. 1 is a flow chart of another data transmission method provided by an embodiment of the present application. This embodiment mainly emphasizes the touch back transmission process during a video conference. Figure 6 As shown, the method includes:

[0073] S201, after receiving the first picture data sent by the first main control module through the target HDMI port, the HDMI capture card sends the picture data to the second USB port of the second main control module through the target USB port;

[0074] S202, after the second main control module receives the first picture data of the first terminal acquired by the HDMI acquisition card through the second USB port, the second terminal displays the acquisition card window in the host channel working mode, and displays the first picture data in the acquisition card window, where the first picture data includes picture data of the display picture displayed on the first terminal;

[0075] For details of S201-S202, please refer to S101-S102, which will not be repeated here.

[0076] S203: After confirming receipt of the sharing operation on the display screen, the second main control module sends the second screen data of the current display screen to a conference terminal for display. The conference terminal is connected to the second main control module via the Internet.

[0077] The received sharing operation on the display screen can be passively received, that is, the second main control module receives the sharing request for the display screen sent by the conference terminal through the video conferencing software, and after receiving the user's confirmation operation on the sharing request, it confirms that the sharing operation on the display screen has been received. Specifically, it can be the joining operation performed by the user clicking the video conference joining button when other conference terminals invite users to a video conference. It can also be actively initiated, that is, after the second main control module receives the sharing instruction for the display screen initiated by the user on the video conferencing software, it confirms that the sharing operation on the display screen has been received. Specifically, it can be the user clicking the initiation button in the video conferencing software on the screen and selecting the participating terminal.

[0078] S204, when the second main control module confirms that the acquisition card window is displayed in full screen, it sends channel switching information to the second whole machine module, and sends the first picture data to the third HDMI port of the second whole machine module through the second HDMI port;

[0079] It should be noted that for the main control module, if the capture card window is displayed in full screen, it means that the picture actually displayed by the main control module is the full-screen display window of the capture card window. Therefore, the second picture data sent by the main control module to the conference terminal for display is the data in the capture card window in the full-screen display state, that is, the conference terminal will also display the contents of the capture card window in full screen to achieve consistency with the display screen of the first terminal.

[0080] S205, after receiving the channel switching information, the second whole machine module switches the signal source channel to the HDMI channel, and after receiving the first picture data sent by the second main control module, displays the first picture data through the second touch screen;

[0081] S206: After acquiring the first touch operation data of the second touch screen, the second whole machine module performs a corresponding touch operation and sends the first touch operation data to the first USB port of the first main control module through the touch line port;

[0082] S207: After receiving the first touch operation data through the first USB port, the first terminal performs the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal.

[0083] Executing the touch operation corresponding to the first touch operation data may specifically include: drawing a corresponding writing handwriting based on the first touch operation; or calling a corresponding application control based on the first touch operation.

[0084] The touch operation may be a writing operation, or calling a graphic control to insert a graphic operation, calling an adjustment control to adjust the display screen, etc. For example, the user writes marks on the display screen, forms a circle selection track, etc. on the second touch screen of the second terminal. At this time, since the second whole machine module sends the first touch operation data to the first main control module of the first terminal through the touch line, the first terminal can also write marks on its display screen, form a circle selection track, etc.

[0085] For details of S204-S207, please refer to S103-S106, which will not be repeated here.

[0086] S208. After receiving the second touch operation data of the second touch screen, the second whole machine module sends the second touch operation data to the second main control module;

[0087] The second touch operation may be a writing operation.

[0088] Since the second whole machine module is connected to the second touch screen and the second main control module respectively, when the user inputs the second touch operation on the second touch screen, the second whole machine module receives the second touch operation data corresponding to the second touch operation sent by the second touch screen, and then sends it to the second main control module.

[0089] S209: After receiving the second touch operation data, the second main control module displays the corresponding handwriting, and sends the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data.

[0090] After receiving the second touch operation data, the second main control module writes corresponding notes and simultaneously sends the data to the conference terminal synchronously. Then, the same written notes are also displayed on the conference terminal, achieving the effect of remote control and synchronous display.

[0091] S210: After receiving the third touch operation data sent by the conference terminal, the second main control module executes the touch operation corresponding to the third touch operation data and updates the display screen of the HDMI channel.

[0092] The user can also perform touch operations on the conference terminal, then the conference terminal sends the corresponding second touch operation data to the second main control module, the second main control module responds to the corresponding operation, and synchronously updates the display screen. Specifically, after the second main control module receives the second touch operation data sent by the conference terminal, it executes the touch operation corresponding to the second touch operation data, generates the corresponding touch handwriting on a transparent layer, and sends the data of the transparent layer with the touch handwriting to the second whole machine module, which is superimposed and displayed by the whole machine module with the first screen data to realize the update of the display screen of the HDMI channel, which is manifested as the touch handwriting displayed on the first screen data, restoring the operation of the conference terminal. Thus, in the process of screen sharing, the touch operation performed by the user on the conference terminal can be received and the corresponding handwriting data can be formed. In medical scenarios, it can be realized to receive the expert annotation data of remote consultation experts, so that local doctors can see the consultation opinions more clearly. Therefore, this solution can not only share the intranet data to other conference terminals through the external network terminal, but also receive and display the handwriting data of other conference terminals.

[0093] S211, when the second whole machine module confirms that an operation instruction to exit the HDMI channel has been received, the signal source channel is switched to the host channel, and after receiving the second picture data of the current display picture sent by the second main control module through the host channel, the second picture data is displayed;

[0094] The second whole machine module calls the port for displaying the whole machine sidebar and displays the whole machine sidebar; when the second whole machine module receives a click operation on the preset control of the whole machine sidebar, it confirms that it has received the operation instruction to exit the HDMI channel, then exits the HDMI channel and switches to the host channel, and the second main control module is connected to the second whole machine module through a serial interface, the second main control module sends the second screen data to the second whole machine module through the connected serial interface, and the second whole machine module sends it to the second touch screen to display the second screen data.

[0095] S212, when the second main control module confirms the windowing operation on the acquisition card window, the acquisition card window is displayed in a windowed manner on the current display screen;

[0096] Windowed operation and full-screen operation are inverse processes of each other. It can be understood that after full-screen operation, the current channel is HDMI, and after windowed operation, the current channel is host.

[0097] Windowed operation can also be input by clicking on the preset controls in the sidebar, or by voice input. After the windowed operation is performed, the HDMI channel is switched to the host channel.

[0098] S213, the second main control module confirms the operation of reducing the acquisition card window, and reduces the acquisition card window according to a preset size;

[0099] At this time, the capture card window covers most of the display area. In order to facilitate the user to operate other content displayed on the touch screen (such as opening video conferencing software, opening instant messaging software, etc.), the user can click the capture card window program's shrink button to shrink the window and control the capture card window to shrink according to the preset size. Of course, it is still under the host channel at this time.

[0100] S214: When the second main control module confirms that the acquisition card window is to be displayed in full screen, the acquisition card window is displayed in full screen on the current display screen.

[0101] Similarly, full-screen display can be achieved by clicking on the preset controls in the sidebar, or by voice input, etc., directly changing the reduced capture card window into a full-screen window, while switching from the host channel to the HDMI channel.

[0102] For example, Figure 7 As shown, when an orthopedic surgeon needs to explain the X-ray image of the sternum by touching and transmitting it back during a video conference, the doctor connects the first terminal and the second terminal through an HDMI capture card, so that the image data of the first terminal is transmitted to the second main control module of the second terminal through the HDMI capture card. The second main control module will control the generation of a capture card window, and display the image corresponding to the transmitted image data in the capture card window. At this time, the doctor initiates a meeting by clicking on the video conferencing software on the screen of the second terminal to initiate an operation, and invites other doctors to participate in the video conference to discuss the situation of the X-ray image. After responding to the initiation operation, the second terminal will send a video conference request to other conference terminals via the Internet, and send the image data to the connected conference terminal, so that the conference terminals participating in the video conference can see the image of the first terminal displayed on the second terminal. When the doctor clicks on the preset control (such as the "Home" control) in the sidebar of the display screen of the second terminal, the second terminal will display the acquisition card window in full screen. At this time, it is in the HDMI channel. Since the doctor usually gives a specific explanation on the displayed screen after the window is displayed in full screen, he may need to click on the content in the screen to select, enlarge, annotate and other touch operations when necessary. At this time, the second terminal will send the touch data corresponding to these touch operations to the first terminal, so that the first terminal can control and feedback according to the returned touch data.

[0103] In one or more embodiments of the present application, after the second main control module of the second terminal obtains the screen data of the first terminal, the screen data is displayed in the form of a capture card window. After the second main control module confirms that a sharing operation on the display screen has been received, the second screen data of the currently displayed screen is sent to a conference terminal for display. The conference terminal is connected to the second main control module through the Internet. When the second main control module confirms that the capture card window is displayed in full screen, channel switching information is sent to the second whole machine module, and the screen data of the second main control module is sent to the third HDMI port of the second whole machine module through the second HDMI port. After the second whole machine module receives the channel switching information, the signal source channel is switched to the HDMI channel, so that the screen data can be displayed through the HDMI channel. Then, under the HDMI channel, after the second whole machine module obtains the first touch operation data, the first touch operation data is transmitted back to the first main control module, so that the touch operation corresponding to the first touch operation data is executed, and the display screen of the first terminal is updated, so as to realize the touch transmission function, and the function of sharing the screen data of the first terminal through the Internet can be realized.

[0104] See also Figure 8 , Figure 8 Schematic diagram of another data transmission system provided in an embodiment of the present application. Figure 8 As shown, the data transmission system may include a first terminal 10 and a second terminal 20 .

[0105] Among them, the first terminal 10 includes a first main control module 11 and a first whole machine module 12, the first main control module 11 includes a first Type-C port 111 and a first USB port 112, the second terminal 20 includes a second main control module 21, a second whole machine module 22 and a second touch screen 23, the second whole machine module 22 is connected to the second main control module 21 and the second touch screen 23 respectively, the second main control module 21 includes a second HDMI port 211 and a second Type-C port 212, the second whole machine module 22 includes a third HDMI port 221 and a touch line port 222, the first USB port 112 is connected to the touch line port 222, the first Type-C port 111 is connected to the second Type-C port 212, the second HDMI port 211 is connected to the third HDMI port 221, the first terminal 10 is only connected to the local area network, and the second terminal 20 is connected to the Internet.

[0106] Among them, Figure 8 As shown, the second HDMI port on the second main control module 21 is an HDMI OUT port, the third HDMI port 221 on the second whole machine module 22 is an HDMI IN port, and the touch line port on the second whole machine module is a TOUCH port.

[0107] The first terminal 10 is used to send first screen data to the second Type-C port 212 of the second main control module 21 through the first Type-C port, where the first screen data includes screen data of a display screen displayed on the first terminal 10;

[0108] The second main control module 21 is used to display the capture card window on the second terminal 20 through the host channel after receiving the first picture data through the second Type-C port 212, and display the first picture data in the capture card window;

[0109] The second main control module 21 is also used to send channel switching information to the second whole machine module 22 when confirming that the acquisition card window is displayed in full screen, and send the first picture data to the third HDMI port 221 of the second whole machine module through the second HDMI port 211;

[0110] The second whole machine module 22 is used to switch the signal source channel from the host channel to the HDMI channel after receiving the channel switching information, and display the first picture data through the second touch screen 23 after receiving the first picture data sent by the second main control module 21;

[0111] The second whole machine module 22 is also used to obtain the first touch operation data of the second touch screen 23, and send the first touch operation data to the first USB port of the first main control module 11 through the touch line port 222; here, after the second whole machine module 22 obtains the first touch operation data, it can also perform the corresponding touch operation, and also realize the response to the first touch operation data on the second terminal.

[0112] The first terminal 10 is further configured to, after receiving the first touch operation data through the first USB port 112 , execute the touch operation corresponding to the first touch operation data and update the display screen of the first terminal.

[0113] In the embodiment of the present application, an HDMI acquisition card is not required. The first terminal is connected to the second terminal with two Type-C data cables to realize serial port connection of the two terminals to realize data interaction between the two terminals. This connection method is simple and convenient, and can save costs. In addition, after the second main control module of the second terminal obtains the screen data of the first terminal, the screen data is displayed in the form of a capture card window. When the second main control module confirms that the capture card window is displayed in full screen, the channel switching information is sent to the second whole machine module, and the screen data of the second main control module is sent to the third HDMI port of the second whole machine module through the second HDMI port. After the second whole machine module receives the channel switching information, the signal source channel is switched to the HDMI channel, so that the screen data can be displayed through the HDMI channel. Then, under the HDMI channel, after the second whole machine module obtains the first touch operation data, the first touch operation data is transmitted back to the first main control module, so as to perform the touch operation corresponding to the first touch operation data, and update the display screen of the first terminal, realize the touch transmission function, and can realize the function of sharing the screen data of the first terminal through the Internet.

[0114] Next, combine Figure 8 The data transmission system shown introduces the data transmission method provided in the embodiment of the present application.

[0115] like Fig. 9 As shown, Fig. 9 1 is a flow chart of another data transmission method provided by an embodiment of the present application. This embodiment mainly emphasizes the process of realizing touch feedback, and the method includes:

[0116] S301: A first terminal sends first screen data to a second Type-C port of a second main control module through a first Type-C port, where the first screen data includes screen data of a display screen displayed on the first terminal;

[0117] Type-C is a hardware interface specification for a universal serial bus. The biggest feature of the Type-C double-sided pluggable port is that it supports double-sided insertion of the USB interface. At the same time, the USB data cable used with it must also be thinner and lighter.

[0118] The first terminal is connected to the Type-C port of the second terminal via a USB data cable, and the screen data displayed by the first terminal is transmitted to the second main control module of the second terminal.

[0119] S302: After receiving the first picture data through the second Type-C port, the second main control module displays a capture card window on the second terminal through the host channel, and displays the first picture data in the capture card window;

[0120] Since the two ports are the same, there is no need to convert the format of the first screen data. After the second main control module receives the first screen data through the second Type-C port, it can display it in a corresponding form according to the setting of the second main control module, such as displaying it as a window, displaying it in full screen, or popping up a window for the user to confirm whether to display it.

[0121] In the embodiment of the present application, the first screen data can be displayed in the form of a capture card window.

[0122] S303: When the second main control module confirms that the acquisition card window is displayed in full screen, it sends channel switching information to the second whole machine module, and sends the first picture data to the third HDMI port of the second whole machine module through the second HDMI port;

[0123] S304: After receiving the channel switching information, the second whole machine module switches the signal source channel from the host channel to the HDMI channel, and after receiving the first picture data sent by the second main control module, displays the first picture data through the second touch screen;

[0124] S305, after the second whole machine module obtains the first touch operation data of the second touch screen, it sends the first touch operation data to the first USB port of the first main control module through the touch line port; here, after the second whole machine module obtains the first touch operation data of the second touch screen, it can also perform a corresponding touch operation, and the second terminal also responds to the first touch operation data;

[0125] S306: After receiving the first touch operation data through the first USB port, the first terminal performs the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal.

[0126] The specific description of S303 to S306 can be found in S103 to S106 and will not be repeated here.

[0127] In the embodiment of the present application, an HDMI acquisition card is not required. The first terminal is connected to the second terminal with two Type-C data cables to realize serial port connection of the two terminals to realize data interaction between the two terminals. This connection method is simple and convenient, and can save costs. In addition, after the second main control module of the second terminal obtains the screen data of the first terminal, the screen data is displayed in the form of a capture card window. When the second main control module confirms that the capture card window is displayed in full screen, the channel switching information is sent to the second whole machine module, and the screen data of the second main control module is sent to the third HDMI port of the second whole machine module through the second HDMI port. After the second whole machine module receives the channel switching information, the signal source channel is switched to the HDMI channel, so that the screen data can be displayed through the HDMI channel. Then, under the HDMI channel, after the second whole machine module obtains the first touch operation data, the first touch operation data is transmitted back to the first main control module, so as to perform the touch operation corresponding to the first touch operation data, and update the display screen of the first terminal, realize the touch transmission function, and can realize the function of sharing the screen data of the first terminal through the Internet.

[0128] The touch feedback process mentioned in this application is described below in conjunction with the second terminal.

[0129] It should be noted that the first terminal is only connected to the local area network, and the second terminal is connected to the Internet. The second terminal includes a host channel and an HDMI channel. These two channels are used to receive input signals from different signal sources, so that different signal source channels can be switched to present media content provided by different signal sources. Among them, the signal source connected to the host channel is the host module, so that the host channel is used to present the media data input by the host module of the interactive tablet. The HDMI channel is used to present the media data of the signal source connected through the HDMI interface of the interactive tablet.

[0130] Specifically, the system mode of the second terminal is switched to the copy screen mode, in which the host channel and the HDMI channel can be switched. The first screen data is displayed on the display screen of the first terminal, the first terminal transmits the first screen data to the second terminal, the second terminal receives the first screen data, displays a capture card window on the current display screen of the host channel, and displays the first screen data in the capture card window.

[0131] When the user performs a full-screen operation on the capture card window, the second terminal confirms that the capture card window is displayed in full screen, switches the signal source channel from the host channel to the HDMI channel, and displays the first picture data in full screen in the HDMI channel.

[0132] Since it is in the HDMI channel at this time, the second terminal performs a corresponding touch operation after receiving the first touch operation data input by the user, and sends the first touch operation data to the first terminal, so that after the first terminal receives the first touch operation data, it performs the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal, thereby realizing the touch operation on the second terminal being transmitted back to the first terminal.

[0133] Under the HDMI channel, the second terminal can also receive the second touch operation data input by the user and display the corresponding handwriting on the current display interface. When the second terminal is also connected to a conference terminal, the second touch operation data is synchronously sent to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data, thereby maintaining the same effect of the second terminal and the conference terminal display screen. Therefore, through this method, not only can the touch operation data on the second terminal be transmitted back to the first terminal, but the touch operation data on the second terminal can also be sent to the conference terminal for display.

[0134] Under the HDMI channel, the second terminal can receive the third touch operation data sent by the conference terminal, perform the touch operation corresponding to the third touch operation data, and update the display screen of the HDMI channel, so as to achieve the effect of controlling the display interface of the second terminal through the conference terminal.

[0135] Of course, the user can exit the HDMI channel by operating the second terminal, thereby switching the signal source channel of the second terminal to the host channel. Under the host channel, when the windowed operation of the capture card window is confirmed, the full screen mode is changed to the windowed mode, and the capture card window is displayed in a windowed manner on the current display screen. The possible ways to exit the HDMI channel include displaying the whole machine sidebar on the current display screen, and the user clicks the preset control of the whole machine sidebar, and then confirms that the operation instruction to exit the HDMI channel has been received.

[0136] In order to facilitate the operation of application software or tools on the display interface, the user can adjust the size of the capture card window, confirm receipt of the adjustment operation on the capture card window at the second terminal, and adjust the capture card window according to the preset size.

[0137] In addition, the second terminal is connected to the conference terminal via the Internet. Under the host channel, the user can operate the corresponding video conferencing software. When the second terminal confirms that it has received the sharing operation on the currently displayed second screen data, it sends the second screen data to the connected conference terminal for display, thereby achieving the effect of screen sharing. Among them, the sharing operation of the second screen data can be passively received by the second terminal, that is, the second terminal can receive the sharing request of the display screen sent by the conference terminal through the video conferencing software, and after receiving the user's confirmation operation on the sharing request, it confirms that it has received the sharing operation on the display screen; it can also be actively initiated by the second terminal, that is, after the second terminal receives the sharing instruction of the display screen initiated by the user on the video conferencing software, it confirms that it has received the sharing operation on the display screen.

[0138] In one embodiment, the second terminal is connected to the first terminal via an HDMI capture card, the HDMI capture card is used to capture the first screen data of the first terminal, and send the first screen data to the second terminal, the first screen data includes screen data displayed on the display screen of the first terminal. In another embodiment, the second terminal is connected to the first terminal via a Type-C cable, and the first terminal directly sends the first screen data displayed on the display screen of the first terminal to the second terminal via the Type-C cable.

[0139] In one or more embodiments of the present application, after the second terminal obtains the screen data of the first terminal, the screen data is displayed in the form of a capture card window. After the second terminal confirms that it has received the sharing operation on the displayed screen, the second screen data of the currently displayed screen is sent to a conference terminal connected via the Internet for display. When the second terminal confirms that the capture card window is displayed in full screen, the signal source channel is switched to the HDMI channel so that the screen data can be displayed through the HDMI channel. Then, under the HDMI channel, after the second terminal obtains the first touch operation data, the first touch operation data is transmitted back to the first terminal, so that the first terminal executes the touch operation corresponding to the first touch operation data and updates the displayed screen, thereby realizing the touch transmission function and the function of sharing the screen data of the first terminal through the Internet.

[0140] The following will be combined with the attached Fig. 9 , the data transmission system provided by the embodiment of the present application is introduced in detail. It should be noted that the attached Fig. 9 The data transmission system shown is used to execute the present application Figure 5 For the convenience of explanation, only the part related to the embodiment of the present application is shown. For the specific technical details not disclosed, please refer to the present application. Figure 5 The embodiment shown.

[0141] See also Fig. 9 , Fig. 9 800 is a schematic diagram of the structure of a data transmission system 800 provided in an embodiment of the present application. Fig. 9 As shown, the system includes: an HDMI capture card 801, a second main control module 802, a second whole machine module 803 and a first terminal 804, wherein:

[0142] The HDMI capture card 801 is used for receiving the first picture data sent by the first main control module through the target HDMI port, and then sending the picture data to the second USB port of the second main control module through the target USB port;

[0143] The second main control module 802 is configured to, after receiving the first picture data of the first terminal acquired by the HDMI acquisition card through the second USB port, cause the second terminal to display the acquisition card window in the host channel working mode and display the first picture data in the acquisition card window, wherein the first picture data includes picture data of a display picture displayed on the first terminal;

[0144] The second main control module 802 is used to send channel switching information to the second whole machine module when confirming that the acquisition card window is displayed in full screen, and send the first picture data to the third HDMI port of the second whole machine module through the second HDMI port;

[0145] The second whole machine module 803 is used for switching the signal source channel from the host channel to the HDMI channel after receiving the channel switching information, and after receiving the first picture data sent by the second main control module, the second terminal displays the first picture data in the HDMI channel working mode;

[0146] The second whole machine module 803 is used for acquiring the first touch operation data of the second touch screen, and sending the first touch operation data to the first USB port of the first terminal through the touch line port;

[0147] The first terminal 804 is configured to, after receiving the first touch operation data through the first USB port, execute the touch operation corresponding to the first touch operation data and update the display screen of the first terminal.

[0148] Optionally, the second main control module 802 is further used to send the second screen data of the current display screen to a conference terminal for display after confirming that a sharing operation on the display screen has been received. The conference terminal is connected to the second main control module via the Internet.

[0149] Optionally, the second main control module 802 is used to confirm that a sharing operation on a display screen has been received, specifically to:

[0150] After receiving a request for sharing the display screen sent by the conference terminal through the video conferencing software and receiving the user's confirmation operation on the sharing request, it is confirmed that the sharing operation on the display screen has been received; or, after receiving a sharing instruction for the display screen initiated by the user on the video conferencing software, it is confirmed that the sharing operation on the display screen has been received.

[0151] Optionally, the second whole machine module 803 is further configured to send the second touch operation data to the second main control module after receiving the second touch operation data of the second touch screen;

[0152] The second main control module 802 is further configured to display the corresponding handwriting after receiving the second touch operation data, and send the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data.

[0153] Optionally, when the second whole machine module confirms that an operation instruction to exit the HDMI channel has been received, it is used to switch the signal source channel to the host channel, and after receiving the second picture data of the current display picture sent by the second main control module through the host channel, display the second picture data;

[0154] When the second main control module confirms the windowing operation on the acquisition card window, the acquisition card window is displayed in a windowed manner on the current display screen.

[0155] Optionally, the second whole machine module 803 is used to confirm that an operation instruction to exit the HDMI channel is received, specifically for:

[0156] Call the port that displays the whole machine sidebar and display the whole machine sidebar;

[0157] When the second whole machine module receives a click operation on a preset control of the whole machine sidebar, it confirms that an operation instruction to exit the HDMI channel has been received.

[0158] Optionally, the second main control module 802 is further used to confirm the reduction operation of the capture card window and reduce the capture card window according to a preset size.

[0159] Optionally, the second main control module 802 is further used to confirm that when the capture card window is to be displayed in full screen, the capture card window is displayed in full screen on the current display screen.

[0160] Optionally, the second main control module 802 is further configured to, after receiving the third touch operation data sent by the conference terminal, execute the touch operation corresponding to the third touch operation data and update the display screen of the HDMI channel.

[0161] Optionally, the second whole machine module 803 is further used to determine the system mode of the second terminal;

[0162] If the system mode is not the copy screen mode, the system mode is switched to the copy screen mode.

[0163] Optionally, executing a touch operation corresponding to the first touch operation data is specifically used to: draw a corresponding writing handwriting based on the first touch operation; or, based on the first touch operation, call a corresponding application control.

[0164] In one or more embodiments of the present application, after the second main control module of the second terminal obtains the screen data of the first terminal, the screen data is displayed in the form of a capture card window. After the second main control module confirms that a sharing operation on the display screen has been received, the second screen data of the currently displayed screen is sent to a conference terminal for display. The conference terminal is connected to the second main control module through the Internet. When the second main control module confirms that the capture card window is displayed in full screen, channel switching information is sent to the second whole machine module, and the screen data of the second main control module is sent to the third HDMI port of the second whole machine module through the second HDMI port. After the second whole machine module receives the channel switching information, the signal source channel is switched to the HDMI channel, so that the screen data can be displayed through the HDMI channel. Then, under the HDMI channel, after the second whole machine module obtains the first touch operation data, the first touch operation data is transmitted back to the first main control module, so that the touch operation corresponding to the first touch operation data is executed, and the display screen of the first terminal is updated, so as to realize the touch transmission function, and the function of sharing the screen data of the first terminal through the Internet can be realized.

[0165] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the above method are implemented. The computer-readable storage medium may include, but is not limited to, any type of disk, including a floppy disk, an optical disk, a DVD, a CD-ROM, a micro drive, and a magneto-optical disk, a ROM, a RAM, an EPROM, an EEPROM, a DRAM, a VRAM, a flash memory device, a magnetic card or an optical card, a nanosystem (including a molecular memory IC), or any type of medium or device suitable for storing instructions and / or data.

[0166] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0167] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0168] In the several embodiments provided in the present application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service ports, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0169] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0170] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0171] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of each embodiment method of the present application. The aforementioned memory includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, disk or optical disk, etc., and other media that can store program codes.

[0172] A person skilled in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by entering a program to instruct the relevant hardware. The program may be stored in a computer-readable memory, and the memory may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0173] The above are only exemplary embodiments of the present disclosure and cannot be used to limit the scope of the present disclosure. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the specification and practicing the disclosure here, those skilled in the art will easily think of the implementation scheme of the present disclosure. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field that are not recorded in the present disclosure. The description and examples are only regarded as exemplary, and the scope and spirit of the present disclosure are defined by the claims.

Claims

1. A data transmission method, applied to a second terminal, wherein the second terminal includes a host channel and an HDMI channel, characterized in that: The method comprises: Receiving first picture data, wherein the first picture data includes picture data of a display picture displayed on a first terminal; Displaying a capture card window on the current display screen of the host channel, and displaying the first screen data in the capture card window; When it is confirmed that the acquisition card window is displayed in full screen, it means that the channel switching information is received, and the signal source channel is switched from the host channel to the HDMI channel; wherein the second terminal includes a touch line port, the first terminal includes a first USB port, and the second terminal is in the working mode of the HDMI channel, and the touch line port can output touch data; Displaying the first picture data in full screen in the HDMI channel; After receiving the first touch operation data, the first touch operation data is sent to the first USB port of the first terminal through the touch line port, so that after receiving the first touch operation data, the first terminal performs the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal; The first terminal is connected to a local area network, and the second terminal is connected to the Internet.

2. The method according to claim 1, characterized in that: The method further comprises: After confirming that a sharing operation on a display screen has been received, second screen data of the current display screen is sent to a conference terminal for display, and the conference terminal is connected to the second terminal via the Internet.

3. The method according to claim 2, characterized in that The confirming receipt of the sharing operation on the display screen includes: After receiving a request for sharing a display screen sent by a conference terminal through the video conference software and receiving a confirmation operation of the user for the sharing request, confirming receipt of the sharing operation for the display screen; or, After receiving the sharing instruction of the display screen initiated by the user on the video conferencing software, it is confirmed that the sharing operation of the display screen has been received.

4. The method according to claim 1, characterized in that After the first picture data is displayed in full screen in the HDMI channel, the method further includes: receiving second touch operation data; According to the second touch operation data, displaying corresponding writing handwriting on the current display interface; The second touch operation data is sent to a conference terminal, so that the conference terminal displays corresponding handwriting according to the second touch operation data, and the conference terminal is connected to the second terminal via the Internet.

5. The method according to claim 1, characterized in that The method further comprises: When confirming that an operation instruction to exit the HDMI channel has been received, switching the signal source channel to the host channel; When the windowing operation on the acquisition card window is confirmed, the acquisition card window is displayed in a windowed manner on the current display screen.

6. The method according to claim 5, characterized in that The confirming receipt of the operation instruction to exit the HDMI channel includes: Display the whole machine sidebar on the current display screen; When a click operation on a preset control of the whole machine sidebar is received, it is confirmed that an operation instruction to exit the HDMI channel is received.

7. The method according to claim 5, characterized in that After the acquisition card window is displayed in a windowed manner on the current display screen, the method further includes: Confirming that the adjustment operation on the acquisition card window has been received, the acquisition card window is adjusted according to a preset size.

8. The method according to claim 1, characterized in that: The method further comprises: After receiving the third touch operation data sent by the conference terminal, the touch operation corresponding to the third touch operation data is executed, and the display screen of the HDMI channel is updated. The conference terminal is connected to the second terminal via the Internet.

9. The method according to claim 1, characterized in that: Before receiving the first picture data, the method further includes: determining a system mode of the second terminal; If the system mode is a non-copy screen mode, the system mode is switched to the copy screen mode.

10. The method according to claim 1, characterized in that The performing of the touch operation corresponding to the first touch operation data includes: Based on the first touch operation, draw corresponding handwriting; or, Based on the first touch operation, a corresponding application control is called.

11. The method according to claim 1, characterized in that The receiving first picture data comprises: Receive first picture data sent by a video capture card, wherein the video capture card is used to capture the picture data of the first terminal.

12. A data transmission method, characterized in that: The method is applied to a data transmission system, the system comprising a first terminal, a second terminal and an HDMI capture card, the first terminal being connected to a local area network, the second terminal being connected to the Internet, the first terminal comprising a first HDMI port and a first USB port, the second terminal comprising a second main control module, a second whole machine module and a second touch screen, the second main control module comprising a second HDMI port and a second USB port, the second whole machine module comprising a third HDMI port and a touch line port, the first USB port being connected to the touch line port, the first HDMI port being connected to the second USB port via the HDMI capture card, the second HDMI port being connected to the third HDMI port, and the second terminal being able to output touch data when the touch line port is in the working mode of the HDMI channel; The method comprises: After the second main control module receives the first picture data of the first terminal acquired by the HDMI acquisition card through the second USB port, the second terminal displays the acquisition card window in the host channel working mode and displays the first picture data in the acquisition card window, wherein the first picture data includes picture data of a display picture displayed on the first terminal; When the second main control module confirms that the acquisition card window is to be displayed in full screen, the second main control module sends channel switching information to the second whole machine module, and sends the first picture data to the third HDMI port of the second whole machine module through the second HDMI port; After receiving the channel switching information, the second whole machine module switches the signal source channel from the host channel to the HDMI channel, and after receiving the first picture data sent by the second main control module, the second terminal displays the first picture data in the HDMI channel working mode; After the second whole machine module acquires the first touch operation data of the second touch screen, the first touch operation data is sent to the first USB port of the first terminal through the touch line port; After receiving the first touch operation data through the first USB port, the first terminal performs the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal.

13. The method according to claim 12, characterized in that The method further comprises: After confirming receipt of the sharing operation on the display screen, the second main control module sends the second screen data of the current display screen to a conference terminal for display. The conference terminal is connected to the second main control module via the Internet.

14. The method according to claim 12, characterized in that The second main control module confirms receipt of the sharing operation on the display screen, including: The second main control module receives a sharing request for the display screen sent by the conference terminal through the video conference software, and after receiving a confirmation operation of the user for the sharing request, confirms receipt of the sharing operation for the display screen; or, After receiving the sharing instruction of the display screen initiated by the user on the video conferencing software, the second main control module confirms that the sharing operation of the display screen is received, and the conference terminal is connected to the second terminal via the Internet.

15. The method according to claim 12, characterized in that After the first screen data is displayed by the second touch screen, the method further includes: After receiving the second touch operation data of the second touch screen, the second whole machine module sends the second touch operation data to the second main control module; After receiving the second touch operation data, the second main control module displays the corresponding handwriting and sends the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data. The conference terminal is connected to the second terminal via the Internet.

16. The method according to claim 12, characterized in that The method further comprises: When the second whole machine module confirms that it has received the operation instruction to exit the HDMI channel, it switches the signal source channel to the host channel, receives the second screen data of the current display screen sent by the second main control module through the host channel, and displays the second screen data through the second touch screen; When the second main control module confirms the windowing operation on the acquisition card window, the acquisition card window is displayed in a windowed manner on the current display screen.

17. The method according to claim 16, characterized in that The second whole machine module confirms that an operation instruction to exit the HDMI channel is received, including: Display the whole machine sidebar on the current display screen; When the second whole machine module receives a click operation on the preset control of the whole machine sidebar, it confirms that an operation instruction to exit the HDMI channel is received.

18. The method according to claim 17, characterized in that After the acquisition card window is displayed in a windowed manner on the current display screen, the method further includes: The second main control module confirms the adjustment operation of the acquisition card window and adjusts the acquisition card window according to a preset size.

19. The method according to claim 12, characterized in that The method further comprises: After receiving the third touch operation data sent by the conference terminal, the second main control module executes the touch operation corresponding to the third touch operation data and updates the display screen of the HDMI channel. The conference terminal is connected to the second terminal via the Internet.

20. The method according to claim 12, characterized in that Before the second main control module receives the first picture data of the first terminal acquired by the HDMI acquisition card through the second USB port, the method further includes: determining a system mode of the second terminal; If the system mode is a non-copy screen mode, the system mode is switched to the copy screen mode.

21. The method according to claim 12, characterized in that The performing of the touch operation corresponding to the first touch operation data includes: Based on the first touch operation, draw corresponding handwriting; or, Based on the first touch operation, a corresponding application control is called.

22. A data transmission method, characterized in that: The method is applied to a data transmission system, the system comprising a first terminal and a second terminal, the first terminal being connected to a local area network, the second terminal being connected to the Internet, the first terminal comprising a first main control module, the first main control module comprising a first Type-C port and a first USB port, the second terminal comprising a second main control module, a second whole machine module, and a second touch screen, the second whole machine module being connected to the second main control module and the second touch screen respectively, the second main control module comprising a second HDMI port and a second Type-C port, the second whole machine module comprising a third HDMI port and a touch line port, the first USB port being connected to the touch line port, the first Type-C port being connected to the second Type-C port, the second HDMI port being connected to the third HDMI port, and the second terminal being capable of outputting touch data at the touch line port in a working mode of the HDMI channel; The method comprises: The first terminal sends first picture data to the second Type-C port of the second main control module through the first Type-C port, where the first picture data includes picture data of a display picture displayed on the first terminal; After receiving the first picture data through the second Type-C port, the second main control module displays a capture card window on the second terminal through the host channel, and displays the first picture data in the capture card window; When the second main control module confirms that the acquisition card window is to be displayed in full screen, the second main control module sends channel switching information to the second whole machine module, and sends the first picture data to the third HDMI port of the second whole machine module through the second HDMI port; After receiving the channel switching information, the second whole machine module switches the signal source channel from the host channel to the HDMI channel, and after receiving the first screen data sent by the second main control module, displays the first screen data through the second touch screen; After the second whole machine module acquires the first touch operation data of the second touch screen, the first touch operation data is sent to the first USB port of the first main control module through the touch line port; After receiving the first touch operation data through the first USB port, the first terminal performs the touch operation corresponding to the first touch operation data and updates the display screen of the first terminal.

23. A data transmission system, characterized in that: The system comprises a first terminal, a second terminal and an HDMI capture card, the first terminal comprises a first HDMI port and a first USB port, the second terminal comprises a second main control module, a second whole machine module and a second touch screen, the second whole machine module is respectively connected to the second main control module and the second touch screen, the second main control module comprises a second HDMI port and a second USB port, the second whole machine module comprises a third HDMI port and a touch line port, the first USB port is connected to the touch line port, the first HDMI port is connected to the second USB port through the HDMI capture card, the second HDMI port is connected to the third HDMI port, the first terminal is connected to a local area network, the second terminal is connected to the Internet, and the second terminal is in the working mode of the HDMI channel, and the touch line port can output touch data; The HDMI capture card is used to capture first picture data of the first terminal and send the first picture data to the second USB port of the second main control module, where the first picture data includes picture data of a display picture displayed on the first terminal; The second main control module is used to display a capture card window on the second terminal through a host channel after receiving the first picture data through the second USB port, and display the first picture data in the capture card window; The second main control module is further used to send channel switching information to the second whole machine module when confirming that the acquisition card window is displayed in full screen, and send the first picture data to the third HDMI port of the second whole machine module through the second HDMI port; The second whole machine module is used for switching the signal source channel from the host channel to the HDMI channel after receiving the channel switching information, and for displaying the first picture data in the HDMI channel working mode after receiving the first picture data sent by the second main control module; The second whole machine module is further used for acquiring first touch operation data of the second touch screen, and sending the first touch operation data to the first USB port of the first terminal through the touch line port; The first terminal is configured to, after receiving the first touch operation data through the first USB port, execute the touch operation corresponding to the first touch operation data and update a display screen of the first terminal.

24. The system according to claim 23, characterized in that The second main control module is further used to send the second screen data of the current display screen to a conference terminal for display after confirming that a sharing operation on the display screen has been received. The conference terminal is connected to the second main control module via the Internet.

25. The system according to claim 23, characterized in that The second whole machine module is further configured to send the second touch operation data to the second main control module after receiving the second touch operation data of the second touch screen; The second main control module is also used to display the corresponding handwriting after receiving the second touch operation data, and send the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data, and the conference terminal is connected to the second terminal via the Internet.

26. The system according to claim 23, characterized in that When the second whole machine module confirms that an operation instruction to exit the HDMI channel has been received, the second whole machine module is used to switch the signal source channel to the host channel, and after receiving the second picture data of the current display picture sent by the second main control module through the host channel, display the second picture data; When the second main control module confirms the windowing operation on the acquisition card window, it is used to display the acquisition card window in a windowed manner on the current display screen.

27. The system according to claim 23, characterized in that The second main control module is also used to confirm that when the acquisition card window is displayed in full screen, the acquisition card window is displayed in full screen on the current display screen.

28. The system according to claim 23, characterized in that The second main control module is used to receive the third touch operation data sent by the conference terminal, execute the touch operation corresponding to the third touch operation data, and update the display screen of the HDMI channel. The conference terminal is connected to the second terminal via the Internet.

29. A data transmission system, characterized in that: The system includes a first terminal and a second terminal, the first terminal includes a first main control module, the first main control module includes a first Type-C port and a first USB port, the second terminal includes a second main control module, a second whole machine module and a second touch screen, the second whole machine module is connected to the second main control module and the second touch screen respectively, the second main control module includes a second HDMI port and a second Type-C port, the second whole machine module includes a third HDMI port and a touch line port, the first USB port is connected to the touch line port, the first Type-C port is connected to the second Type-C port, the second HDMI port is connected to the third HDMI port, the first terminal is connected to a local area network, the second terminal is connected to the Internet, and the second terminal is in a working mode of the HDMI channel, and the touch line port can output touch data; The first terminal is used to send first picture data to the second Type-C port of the second main control module through the first Type-C port, where the first picture data includes picture data of a display picture displayed on the first terminal; The second main control module is configured to display a capture card window on the second terminal through a host channel after receiving the first picture data through the second Type-C port, and display the first picture data in the capture card window; The second main control module is further used to send channel switching information to the second whole machine module when confirming that the acquisition card window is displayed in full screen, and send the first picture data to the third HDMI port of the second whole machine module through the second HDMI port; The second whole machine module is used to switch the signal source channel from the host channel to the HDMI channel after receiving the channel switching information, and display the first screen data through the second touch screen after receiving the first screen data sent by the second main control module; The second whole machine module is further used for acquiring the first touch operation data of the second touch screen and sending the first touch operation data to the first USB port of the first main control module through the touch line port; The first terminal is further configured to, after receiving the first touch operation data through the first USB port, execute the touch operation corresponding to the first touch operation data and update a display screen of the first terminal.

30. The system according to claim 29, characterized in that The second main control module is further used to send the second screen data of the current display screen to a conference terminal for display after confirming that a sharing operation on the display screen has been received. The conference terminal is connected to the second main control module via the Internet.

31. The system according to claim 29, characterized in that The second whole machine module is further configured to send the second touch operation data to the second main control module after receiving the second touch operation data of the second touch screen; The second main control module is also used to display the corresponding handwriting after receiving the second touch operation data, and send the second touch operation data to the conference terminal, so that the conference terminal displays the corresponding handwriting according to the second touch operation data, and the conference terminal is connected to the second terminal via the Internet.

32. The system according to claim 29, characterized in that When the second whole machine module confirms that an operation instruction to exit the HDMI channel has been received, the second whole machine module is used to switch the signal source channel to the host channel, and after receiving the second picture data of the current display picture sent by the second main control module through the host channel, display the second picture data; When the second main control module confirms the windowing operation on the acquisition card window, it is used to display the acquisition card window in a windowed manner on the current display screen.

33. The system according to claim 29, characterized in that The second main control module is also used to confirm that when the acquisition card window is displayed in full screen, the acquisition card window is displayed in full screen on the current display screen.

34. The system according to claim 29, characterized in that The second main control module is used to receive the third touch operation data sent by the conference terminal, execute the touch operation corresponding to the third touch operation data, and update the display screen of the HDMI channel. The conference terminal is connected to the second terminal via the Internet.

Images