Data transmission method and system

Abstract

The application further provides a data transmission method and system, which can display both the screen projection content of the electronic device and the image content collected by the image collecting device on one interactive panel, thereby reducing the number of interactive panels during data transmission, reducing the space occupation and input cost of the interactive panels.

Description

Technical Field

[0001] This application relates to electronic devices, and more particularly to a data transmission method and system. Background Technology

[0002] Traditional technologies offer numerous solutions to facilitate communication during meetings. These include projecting presentations onto a screen for sharing, remote instant messaging, and providing a writing canvas on a large touchscreen tablet. Another approach involves using data transmission devices that connect to users' electronic devices (including laptops, tablets, desktops, and mobile phones) via cables, transmitting media data (including screen and audio data) from these devices to an interactive whiteboard in the meeting room for display.

[0003] In the prior art, interactive flat panels can also be combined with image acquisition devices and image processing devices to realize video conferencing. The image processing device can be a video conferencing device, video conferencing terminal or other device that can be used to process images. It can be used to acquire images captured by image acquisition devices such as cameras, process them and send them to the interactive flat panel for display.

[0004] However, in the existing technology, in order to simultaneously realize video conferencing provided by the data transmission device and the image processing device, at least two interactive whiteboards need to be set up in the same meeting room to display the content provided by the data transmission device and the image processing device respectively, which greatly increases the space occupation and investment cost. Summary of the Invention

[0005] This application also provides a data transmission method and system to overcome the problems of large space occupation and high investment costs in existing data transmission systems.

[0006] This application provides a data transmission system, comprising: an electronic device, a data transmission device, an interactive flat panel, an image acquisition device, and an image processing device; wherein the electronic device is connected to the data transmission device, the data transmission device is connected to the interactive flat panel, and the interactive flat panel and the image acquisition device are respectively connected to the image processing device; the data transmission device is used to acquire first content displayed by the electronic device and send the first content to the interactive flat panel; the interactive flat panel, after receiving the first content, sends the first content to the image processing device; the image acquisition device is used to acquire second content of the surrounding environment and send the second content to the image processing device; the image processing device is used to, upon receiving the first content and the second content, merge the first content and the second content to obtain third content, and send the third content to the interactive flat panel; the interactive flat panel, upon receiving the third content, displays the third content on a display screen; the interactive flat panel is further used to, upon acquiring a first touch action on the third content displayed on the display screen, send the information of the first touch action to the electronic device via the data transmission device.

[0007] In one embodiment of the first aspect of this application, the interactive flat panel is further configured to determine a fourth content and simultaneously display the fourth content and the third content on a display screen; the interactive flat panel is further configured to execute the instruction corresponding to the second touch action when a second touch action is obtained on the fourth content displayed on the display screen.

[0008] In one embodiment of the first aspect of this application, when the interactive flat panel is in a first display state, after receiving the first content, the interactive flat panel displays the first content on the display screen; when the interactive flat panel is in a second display state, after receiving the first content, the interactive flat panel sends the first content to the image processing device.

[0009] In one embodiment of the first aspect of this application, the image processing apparatus is specifically used to merge the second content onto a preset area of ​​the first content to obtain the third content.

[0010] In one embodiment of the first aspect of this application, the interactive flat panel includes: a transmission processing device and a display processing device; the transmission processing device is connected to a data transmission device, an image processing device, and a display processing device, and the display processing device is also connected to the image processing device; the transmission processing device is configured to, after receiving first content, send the first content to the image processing device; the display processing device is configured to, after receiving third content sent by the image processing device, display the third content on a display screen; the display processing device is further configured to, when a first touch action is performed on the third content displayed on the display screen, send information of the first touch action to the transmission processing device; after receiving the first touch action, the transmission processing device transmits the information of the first touch action to an electronic device through the data transmission device.

[0011] In one embodiment of the first aspect of this application, the fourth content includes: a first icon control and a second icon control; the display processing device is configured to, when an operation of the first icon control is detected, send a first instruction to the transmission processing device; when an operation of the second icon control is detected, send a second instruction to the transmission processing device; the transmission processing device is configured to, when receiving the first instruction, determine to switch the interactive flat panel to a first display state; when receiving the second instruction, determine to switch the interactive flat panel to a second display state.

[0012] In one embodiment of the first aspect of this application, the transmission processing device is specifically configured to, upon receiving a first instruction, execute a fourth instruction in the operating system, wherein the fourth instruction is configured to control the transmission processing device to stop outputting data to the image processing device; and the transmission processing device is specifically configured to, upon receiving a second instruction, execute a third instruction in the operating system, wherein the third instruction is configured to control the transmission processing device to output data to the image processing device.

[0013] In one embodiment of the first aspect of this application, the display processing device is further configured to, after detecting the operation of the preset icon control in the fourth content, send the instruction and the second instruction corresponding to the preset icon control to the transmission processing device.

[0014] This application provides a data transmission method, executed by the data transmission system provided in the first aspect of this application. The method includes: a data transmission device acquiring first content displayed by an electronic device and sending the first content to an interactive flat panel; the interactive flat panel sending the first content to an image processing device; an image acquisition device acquiring second content of the surrounding environment and sending the second content to the image processing device; the image processing device merging the first content and the second content to obtain third content and sending the third content to the interactive flat panel; the interactive flat panel displaying the third content; and when the interactive flat panel acquires a first touch action on the third content displayed on the screen, sending the information of the first touch action to the electronic device via the data transmission device.

[0015] A third aspect of this application provides an interactive flat panel, which is executed by the interactive flat panel in the data transmission system provided in the first aspect of this application. When in a first display state, the interactive flat panel receives first content sent by a data transmission device and displays the first content on a display screen. When in a second display state, the interactive flat panel receives the first content sent by the data transmission device and sends the first content to an image processing device, causing the image processing device to obtain third content based on the first content and second content from an image acquisition device and send it to the interactive flat panel. Upon receiving the third content, the interactive flat panel displays the third content on a display screen.

[0016] A fourth aspect of this application provides an image processing apparatus, executed by the image processing apparatus in the data transmission system provided in the first aspect of this application, comprising: a first input interface, a second input interface, an output interface, and a processing unit; the processing unit is connected to an interactive flat panel via the first input interface, the processing unit is connected to an image acquisition device via the second input interface, and the processing unit is connected to the interactive flat panel via the output interface; the processing unit is configured to: receive first content sent by the interactive flat panel via the first input interface; receive second content sent by the image acquisition device via the second input interface; merge the first content and the second content to obtain third content; and send the third content to the interactive flat panel via the input interface.

[0017] In summary, the data transmission method and system provided in this application enable the display of both the screen projection content of electronic devices and the image content captured by the image acquisition device on a single interactive flat panel, thereby reducing the number of interactive flat panels required for data transmission, reducing the space occupied and investment costs of the interactive flat panels, and improving the user experience of the interactive flat panels. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 A schematic diagram illustrating a data transmission scenario provided in this application;

[0020] Figure 2 A schematic diagram illustrating the connection relationships for the data transmission scenario provided in this application;

[0021] Figure 3 A schematic diagram illustrating another data transmission scenario provided in this application;

[0022] Figure 4A A schematic diagram illustrating an embodiment of the connection relationship for another data transmission scenario provided in this application;

[0023] Figure 4B A schematic diagram illustrating an embodiment of the connection relationship for another data transmission scenario provided in this application;

[0024] Figure 5 A schematic diagram illustrating the first display state of the interactive flat panel provided in this application;

[0025] Figure 6 A schematic diagram illustrating the second display state of the interactive flat panel provided in this application;

[0026] Figure 7 A schematic diagram illustrating another data transmission scenario provided in this application;

[0027] Figure 8 A schematic diagram illustrating an embodiment of the display page of an interactive flat panel provided in this application;

[0028] Figure 9 A schematic diagram of instruction transmission in the first display state of the interactive flat panel provided in this application;

[0029] Figure 10 A schematic diagram of an embodiment of instruction transmission in the second display state of the interactive flat panel provided in this application;

[0030] Figure 11 A schematic diagram of another embodiment of instruction transmission in the second display state of the interactive flat panel provided in this application;

[0031] Figure 12 This is a schematic diagram of an embodiment of the display page of the interactive flat panel provided in this application. Detailed Implementation

[0032] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0033] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0034] The technical solutions of this application will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0035] Figure 1A schematic diagram of a data transmission scenario provided in this application, wherein, as shown... Figure 1 As shown, taking the scenario where a user needs to share a presentation on electronic device 1 during a meeting as an example, due to the screen size limitation of electronic device 1, the user can connect electronic device 1 to data transmission device 3 using connection cable 2, and then transmit the presentation displayed on the display interface of electronic device 1 to the interactive flat panel 4 mounted on the wall for display through data transmission device 3.

[0036] In this system, electronic device 1 can be a device with a display interface, such as a laptop, tablet, desktop computer, or workstation; data transmission device 3 can also be called a screen projection device, screen projector, wireless screen projector, screen transmitter, or wireless screen transmitter; and interactive whiteboard 4 can also be called an interactive smart whiteboard, smart interactive whiteboard, smart interactive whiteboard, large-screen whiteboard, or simply a large whiteboard. Data transmission device 3 and interactive whiteboard 4 can be connected wirelessly, including but not limited to: Wireless Fidelity (Wi-Fi), Bluetooth, or other short-range wireless communication methods. Interactive whiteboard 4 can work with data transmission device 3 to share presentations from electronic device 1. In some embodiments, interactive whiteboard 4 can also independently achieve remote instant communication and provide a writing canvas via a touch-sensitive panel. In some implementations, data transmission device 3 and interactive whiteboard 4 can be provided by the same manufacturer. Users can purchase both data transmission device 3 and interactive whiteboard 4, install interactive whiteboard 4 on the conference room wall, and then use data transmission device 3 to transmit the screen from electronic device 1 to interactive whiteboard 4 for display.

[0037] Electronic device 1 and data transmission device 3 can communicate with each other via a wired connection cable 2. The connection cable 2 can be a Universal Serial Bus (USB) cable, a High Definition Multimedia Interface (HDMI) cable, or a network cable. In one embodiment, the USB cable can be a USB Type-C cable. Since the interactive whiteboard 4 is typically mounted on a conference room wall and is not easily moved, and the data transmission device 3 is designed to be increasingly smaller and more portable, the data transmission device 3 is usually connected to the electronic device 1 via a wired connection cable 2 and to the interactive whiteboard 4 via wireless communication methods such as Wi-Fi or Bluetooth.

[0038] In some embodiments, the connecting cable 2 can be separate from the data transmission device 3. The connecting cable 2 can be provided by the manufacturer of the data transmission device 3 or purchased separately by the user. In other embodiments, the connecting cable 2 can be integrated with the data transmission device 3, that is, the connecting cable 2 and the data transmission device 3 together form a single device. In this case, the connecting cable 2 can be regarded as part of the data transmission device 3. This way, when the user connects the data transmission device 3 to the electronic device 1, the step of connecting one end of the data transmission device 3 to the connecting cable 2 can be omitted. The user only needs to connect the electronic device 1 to the other end of the connecting cable, thereby improving efficiency and avoiding the situation where the data transmission device 3 cannot connect to the electronic device 1 because the connecting cable 2 cannot be found.

[0039] In some embodiments, such as Figure 1 The scene shown can also include an image acquisition device 5 and an image processing device 6. The image acquisition device 5 can be a camera or other device capable of acquiring images, specifically used for acquiring... Figure 1 The image acquisition device 5 captures images in the scene shown and sends the captured images to the image processing device 6 for further processing. The image processing device 6 can be a video conferencing device, video conferencing terminal, or other device capable of processing images. It can acquire images captured by the image acquisition device 5, process them, and then send them to the interactive flat panel. At this time, since the data transmission device 3 is transmitting the display content of the electronic device 1 to the interactive flat panel 4, the interactive flat panel 4 receives and displays the content of the electronic device 1. In order to display the images captured by the image acquisition device 5, an additional interactive flat panel 7 needs to be set up on top of the interactive flat panel 4, and the interactive flat panel 7 is connected to the image processing device 6. This allows the image processing device 6 to receive the images captured by the image acquisition device 5 and send them to the interactive flat panel 7 for display.

[0040] At this point, the user can view the content projected from the electronic device 1 via the interactive whiteboard 4, or view the content captured by the image acquisition device 5 via the interactive whiteboard 7. Figure 1 In this scenario, there are two interactive flat panels and two types of content (video stream, content stream, etc.) present simultaneously. Therefore, the entire system consisting of electronic device 1, data transmission device 3, interactive flat panel 4, image acquisition device 5, image processing device 6, and interactive flat panel 7 can also be called a "dual-screen dual-stream" data transmission system.

[0041] In some embodiments, such as Figure 1In the scenario shown, the interactive whiteboard 4 can also send the display content of the electronic device 1, which it obtains from the data transmission device 3, to the image processing device 6. This allows the image processing device 6 to send the display content of the electronic device 1 and the image content captured by the image acquisition device 5 to other image processing devices 6' via the internet or other means. The image processing device 6' then sends the received content to the interactive whiteboard connected to it for display. The image processing device 6 can also receive the content sent by the image processing device 6' and display it through the interactive whiteboard 4 and interactive whiteboard 7, thereby enabling the transmission of video conferencing content between the image processing devices 6 and 6'. This allows both parties participating in the video conference to see the screen projection content of the electronic device 1, meeting the interactive needs of video conferencing.

[0042] Figure 2 A schematic diagram illustrating the connection relationships in the data transmission scenario provided in this application shows, as follows: Figure 1 The diagram illustrates the connections between the devices. Specifically: the connection between electronic device 1 and data transmission device 3 (①) can be via data cable 2; the connection between data transmission device 3 and interactive flat panel 4 (②) can be achieved through wireless communication methods such as Wi-Fi; the connection between interactive flat panel 4 and image processing device 6 (③) can be achieved via an HDMI cable, with interactive flat panel 4 connected to one end of the HDMI cable via its HDMI OUT port and image processing device 6 connected to the other end via its HDMI IN port; the connection between image acquisition device 5 and image processing device 6 (④) can be achieved via a wired connection such as a USB cable, VGA cable, or HDMI cable; and the connection between image processing device 6 and interactive flat panel 7 (⑤) can be achieved via an HDMI cable, with image processing device 6 connected to one end of the HDMI cable via its HDMI OUT port and interactive flat panel 7 connected to the other end via its HDMI IN port.

[0043] In one embodiment, after electronic device 1 sends the first content 401 to be displayed to interactive flat panel 4 via data transmission device 3, interactive flat panel 4, in addition to displaying the first content 401, also sends the content to image processing device 6 via connection relationship ③. Simultaneously, image acquisition device 5 also sends its acquired second content 701 to image processing device 6 via connection relationship ⑤. Image processing device 6 then combines the first content 401 and the second content 701 through video stream mixing and sends the combined content to other image processing devices 6' via the Internet. Other image processing devices 6' then send the received content to the interactive flat panel connected to their respective image processing devices for display. At this time, the interactive flat panel connected to image processing device 6' will simultaneously display the first content 401 and the second content 701. Meanwhile, image acquisition device 5', connected to image processing device 6', acquires image content 701' of the environment where image processing device 6' is located and sends it to image processing device 6. At this time, image processing device 6 can simultaneously display the second content 701 and content 701' on interactive flat panel 7, ultimately achieving... Figure 1 The meeting room shown is a video conference with other participants.

[0044] In order to achieve such Figure 1 The dual-screen, dual-stream data transmission method in the scenario depicted requires at least two interactive whiteboards to be set up in the same meeting room, significantly increasing space occupation and investment costs. Furthermore, because implementing dual-screen, dual-stream transmission involves numerous devices that need to be controlled, users must manage and configure these devices individually, leading to complex operation, obstacles to user experience, and impacting the efficiency of both the interactive whiteboards and data transmission devices during data transmission. This ultimately greatly reduces the user experience of the interactive whiteboards.

[0045] Therefore, this application also provides a data transmission method and an interactive flat panel, which can display both the screen projection content transmitted by the electronic device 1 through the data transmission device and the image content captured by the image acquisition device 5 on a single interactive flat panel, thereby reducing the number of interactive flat panels required for data transmission and reducing the space occupied and investment costs of the interactive flat panels. Since the user simultaneously views the screen projection content of the electronic device 1 and the content captured by the image acquisition device 5 through a single interactive flat panel, the entire system consisting of the electronic device, the data transmission device, the interactive flat panel, the image acquisition device, and the image processing device can be referred to as a "single-screen dual-stream" data transmission system.

[0046] For example, Figure 3 This is a schematic diagram of another data transmission scenario provided in this application, in such a way... Figure 3The scene shown includes: electronic device 1, data transmission device 3, interactive whiteboard 4, image acquisition device 5, and image processing device 6. Among them, as shown... Figure 3 The specific connection methods of electronic device 1, data transmission device 3, interactive whiteboard 4, image acquisition device 5, and image processing device 6 in the scenario shown are as follows: Figure 4A As shown, Figure 4A This is a schematic diagram illustrating an embodiment of the connection relationship in another data transmission scenario provided in this application, wherein electronic device 1 is connected to data transmission device 3, data transmission device 3 is connected to interactive flat panel 4, and interactive flat panel 4 and image acquisition device 5 are respectively connected to image processing device 6. Figure 3 The connection and setup methods for the devices shown in -4 are the same as those shown in the diagram. Figure 1 The devices in the illustrated scenarios are the same and will not be described again. This application will mainly focus on the devices in... Figure 3 The functions implemented in it will be introduced.

[0047] Specifically, such as Figure 4A In the "single-screen dual-stream" data transmission system shown, in order to display both the content projected from electronic device 1 and the content acquired by image acquisition device 5 on interactive flat panel 4, after data transmission device 3 acquires the first content displayed by electronic device 1 and sends it to interactive flat panel 4 via projection and other related technologies, interactive flat panel 4 does not immediately display the first content. Instead, it sends the first content to image processing device 6. Simultaneously, image acquisition device 5, after acquiring the second content of its environment, also sends it to image processing device 6. Upon receiving the first and second content, image processing device 6 merges them to obtain a third content, which is then sent to interactive flat panel 4. Finally, interactive flat panel 4 displays the third content on its display screen after receiving it from image processing device 6. Figure 3 As can be seen in the scenario shown, the third content displayed by the interactive whiteboard 4 includes the first content displayed by the electronic device 1 and the second content captured by the image acquisition device 5. In one specific implementation, the second content in the third content is merged and covered onto the preset upper right corner area of ​​the first content. Visually, the second content will obscure part of the preset area of ​​the first content. In some embodiments, the preset area where the second content is displayed can be any position and any size, or the position and size of the preset area can be specified by the user of the interactive whiteboard 4.

[0048] In some embodiments, the interactive flat panel 4 provided in this application has at least two display states: when in the first display state, after receiving the first content from the electronic device 1 sent by the data transmission device 3, the interactive flat panel 4 directly displays the first content on the display screen; while when in the second display state, after receiving the first content, the interactive flat panel 4 sends the first content to the image processing device 6, and the image processing device 6 merges the first content and the second content from the image acquisition device 5 to obtain the third content and sends it to the interactive flat panel 4, and then the interactive flat panel 4 displays the third content on the display screen.

[0049] Furthermore, in order to achieve the above two display states, the interactive flat panel 4 can switch its internal display channels. In some embodiments, the interactive flat panel 4 may include at least signal source channels such as Android channel, host channel and HDMI channel. These signal source channels can be used to receive input signals from different signal sources, so that the interactive flat panel can switch between different signal source channels to present media content provided by different signal sources, thereby realizing the switching between the first display state and the second display state in this application.

[0050] The interactive flat panel 4 uses two channels: an Android channel, a dedicated channel for the interactive flat panel's main module (also known as a display processing device, running the Android system), to display media content from the main module; and a host channel, which receives media data from the host module (also known as a PC module, transmission processing device, running a Windows system), to display media data input from the host module. The interactive flat panel 4 uses an HDMI channel to display media data from the signal source connected via its HDMI interface. In some embodiments, when the interactive flat panel 4 is in either the host channel or the HDMI channel, its display screen actually shows two images: one from the Android channel and the other from the host channel or the HDMI channel. The Android channel image has a partially transparent area, which is then displayed as the host channel or HDMI channel image, resulting in a final display of both channels.

[0051] For example, in such Figure 3In the scenario shown, the interactive flat panel 4 can determine the fourth content, such as a sidebar, through its own Android channel. The sidebar includes multiple controls, and combined with the third content received from the image processing device 6, the interactive flat panel 4 can simultaneously display the third and fourth content on the display screen. For the user's second touch action on the fourth content on the display screen, the entire module can execute the corresponding instruction after acquiring the second touch action. For example, if the Android channel's screen is a sidebar, then the Android channel's screen, except for the sidebar's display area, is entirely transparent. Therefore, the display screen of the host channel or HDMI channel can be displayed in the transparent area. The final result presented to the user is that the interactive flat panel displays the host channel or HDMI channel's screen, with the Android channel's sidebar superimposed on top. Specifically, the entire module pre-sets the area size of the display screen for the host channel or HDMI channel, so that when the entire module receives touch data from the touch component, it sends the touch data within this pre-set area to the host channel or HDMI channel for response.

[0052] More specifically, Figure 4B A schematic diagram illustrating an embodiment of the connection relationship for another data transmission scenario provided in this application, wherein, in Figure 4A Based on the above, in a specific implementation, the interactive flat panel 4 can include a transmission processing device 41 and a display processing device 42. The transmission processing device 41 can be an electronic device or module capable of running an operating system, such as a pluggable PC module on the interactive flat panel 4. It can run a Windows operating system and can receive content from the electronic device 1 sent by the data transmission device 3, process the content, and send it to the display processing device 42 for display on the screen. Simultaneously, applications in the interactive flat panel 4 also run on the operating system of the transmission processing device 41. The display processing device 42 can be a processing device or module such as the CPU of the interactive flat panel. It can run an Android operating system. When the display processing device 41 receives content (such as images or video streams) sent by the transmission processing device 41, it displays the content on the screen of the interactive flat panel 4.

[0053] In some embodiments, the interactive flat panel 4 shown in FIG. 4 includes at least one output interface for sending first content to the image processing device 6, and includes an input interface for receiving third content sent by the image processing device 6. Correspondingly, the image processing device 6 also includes a first input interface, a second input interface, and an output interface. The two input interfaces are used to receive the first content from the interactive flat panel 4 and the second content from the image acquisition device 5, respectively, and the output interface is used to send the third content. Figure 4B In the example shown, the transmission processing device 41 of the interactive flat panel 4 is provided with at least one HDMI OUT interface, and the display processing device 42 of the interactive flat panel 4 is provided with at least one HDMI IN interface; the image processing device 6 is provided with at least one HDMI OUT interface and at least one HDMI IN interface. The transmission processing device 41 is connected to the HDMI IN interface of the image processing device 6 via its HDMI OUT interface and an HDMI cable, allowing the transmission processing device 41 to send first content to the image processing device 6 via the HDMI cable. The image processing device 6 is connected to the HDMI IN interface of the display processing device 42 via its HDMI OUT interface and an HDMI cable, allowing the image processing device 6 to send third content to the display processing device 42 via the HDMI cable. The image processing device 6 also includes a processing unit for sending and receiving data through the aforementioned interfaces, and for merging the first content and the second content to obtain the third content.

[0054] In some embodiments, the display processing device 42 and the transmission processing device 41 establish a communication connection within the interactive flat panel 4 through connection relationship ⑥. Specifically, the display processing device 42 and the transmission processing device 41 can be connected through a 40-pin Open Pluggable Specification (OPS) interface, which includes an HDMI interface and a USB interface. The display processing device 42 and the transmission processing device 41 can transmit video data through the HDMI interface of the OPS interface and transmit other data control data through the USB interface.

[0055] In some embodiments, such as Figure 3 In the scenario shown, the first display state of the interactive whiteboard 4 can also be referred to as the default state, normal state, normal mode, etc. Figure 5 This is a schematic diagram of the first display state of the interactive flat panel provided in this application, as shown below. Figure 5As shown, in the first display state, the electronic device 1 sends the first content 401 to be displayed to the transmission processing device 41 of the interactive flat panel 4 through the data transmission device 3. After receiving the first content 401, the transmission processing device 41 in the interactive flat panel 4 directly sends the first content 401 to the display processing device 42, and the display processing device 42 displays the received first content 401 on the display screen, thereby realizing the single-screen single-stream (video stream corresponding to the first content 401) display of the interactive flat panel.

[0056] The second display state can also be referred to as single-screen dual-stream state, shared screen state, etc. Figure 6 This is a schematic diagram of the second display state of the interactive flat panel provided in this application, as shown below. Figure 6 As shown, in the second display state, electronic device 1 sends the first content 401 to the transmission processing device 41 of the interactive flat panel 4 via data transmission device 3. The transmission processing device 41 then further sends the first content 401 to the image processing device 6. Simultaneously, image acquisition device 5 acquires the second content 701 of the surrounding environment and sends it to the image processing device 6. The image processing device 6 merges the first content 401 and the second content 701 into video streams, obtaining a third content that includes both the first content 401 and the second content 701. This third content is then sent to the display processing device 42, which simultaneously displays the received first content 401 and the second content 701 on the display screen, achieving single-screen dual-stream display (video stream corresponding to the first content 401 and video stream corresponding to the second content 701) on the interactive flat panel.

[0057] In some embodiments, Figure 7 A schematic diagram illustrating another data transmission scenario provided in this application, such as... Figure 7 It shows Figure 3 Some of the devices in the scene, such as the image processing device 6 and the interactive whiteboard 4, and other devices not shown, are referenced. Figure 3 As shown, further details are omitted. Figure 7 In the scenario shown, the image processing device 6 is in such a state as Figure 3 Based on the above, it can also be connected to the image processing device 6' via the Internet, and data can be transmitted between the image processing device 6 and the image processing device 6' via the Internet. For example, the image processing device 6 is also equipped with a communication unit, so that the processing unit of the image processing device 6 can use the communication unit to transmit data via the Internet. Figure 7The interactive flat panel 4 shown is in the second display state described above. The image processing device 6 sends the first content 401 and the second content 701 to the display device 4 for display. At the same time, the image processing device 6 can also send the first content 401 and the second content 701 to the image processing device 6', so that the image processing device 6' sends the first content 401 and the second content 701 to the display device 4' for display.

[0058] In some embodiments, the image processing device 6' can also be connected to the image acquisition device 5'. After the image acquisition device 5' acquires the image content 701' of the surrounding environment, it sends the content 701' to the image processing device 6'. The image processing device 6' then sends the content 701' to the image processing device 6'. The image processing device 6 can then send the overall content after merging the received first content 401, second content 701, and content 701' to the display processing device 42, which displays it on the display screen.

[0059] Therefore, in Figure 7 In the scenario shown, image processing device 6 and image processing device 6' can transmit data to each other via the Internet, enabling interactive whiteboard 4 to display the environmental content captured by image acquisition device 5', and interactive whiteboard 4' to display the environmental content captured by image acquisition device 5' and simultaneously display the content transmitted from electronic device 1 to interactive whiteboard 4, thereby enabling video conferencing with electronic device 1 as the video content sharer.

[0060] In summary, in this application Figure 3-7 The scene shown is similar to Figure 1-2 Compared to the scenario shown, this method allows for the display of both screen projection content from electronic devices and image content captured by image acquisition devices on a single interactive flat panel. This reduces the number of interactive flat panels required for data transmission, decreases their space requirements and investment costs, and improves the user experience.

[0061] Furthermore, based on the foregoing embodiments of this application, an interactive flat panel supporting single-screen dual-stream is provided. During use, the interactive flat panel can switch between a first display state and a second display state according to different scenarios. In one specific implementation, Figure 8This application provides a schematic diagram of an embodiment of the display page of an interactive flat panel. The interactive flat panel 4's main module provides a "display mode selection program" in the fourth displayed content. When the user of the interactive flat panel opens this application, the application provides two selection controls on the display page, corresponding to a first display state and a second display state, respectively. When the display processing device 42 determines the user's operation on the control corresponding to the first display state, the display processing device 42 sends a first instruction to the transmission processing device 41, causing the transmission processing device 41 to switch to the first display state according to the first instruction. Figure 5 In the first display state, data received from data transmission device 3 is directly sent to display processing device 42 for display. When display processing device 42 determines the user's operation on the control corresponding to the second display state, it sends a second instruction to data transmission processing device 41, causing the execution of... Figure 6 The second display state shown is that after receiving data from the data transmission device 3, the data is sent to the image processing device 6. The image processing device 6 combines the data with the content of the image acquisition device 5 and then sends the processed content to the display processing device 42 for display.

[0062] In some embodiments, when the interactive flat panel 4 is in the first display state, if a user clicks on the interactive flat panel 4 to perform an operation, the display device 42 of the interactive flat panel 4 detects this operation and sends an operation-corresponding instruction to the transmission processing device 41, the source of the displayed content, causing the transmission processing device 41 to execute the corresponding action. For example, Figure 9 This is a schematic diagram of instruction transmission in the first display state of the interactive flat panel provided in this application. Taking a PPT as an example, the first content 401 to be displayed determined by the transmission processing device 41 is sent to the display processing device 42, which then displays it on the display screen. Subsequently, when the display processing device 402 detects a user's click operation on the first content displayed on the display screen, it sends a corresponding instruction to the transmission processing device. After receiving the instruction, the transmission processing device 41 sends it to the electronic device, which then performs a page-turning operation on the PPT based on the click operation, thereby adjusting and updating the first content 401 to be displayed. The updated content is then sent to the transmission processing device 41, which in turn sends it to the display processing device 42 for display. For the user of the interactive flat panel 4, the content projected by the electronic device 1 can be controlled by clicking on the interactive flat panel 4.

[0063] However, in some other embodiments, when the interactive flat panel 4 is in the second display state, if the user clicks on the interactive flat panel 4 to perform an operation, the display device 42 of the interactive flat panel 4, after detecting this operation, cannot transmit the corresponding instruction to the transmission processing device 41 because it is currently displaying third content sent from the image processing device 6, i.e., under the HDMI channel, and therefore cannot transmit it to the electronic device, thus failing to achieve the aforementioned interactive control. For example, Figure 10 This is a schematic diagram of an embodiment of instruction transmission in the second display state of the interactive flat panel provided in this application. Taking PPT as an example, the first content 401 to be displayed determined by the transmission processing device 41 is sent to the image processing device 6. The image processing device 6 combines the first content 401 with the second content 701 from the image acquisition device 5 to send the combined third content (the third content) to the display processing device 402, which then displays it on the display screen. Subsequently, when the display processing device 402 detects a user's click operation on the third content displayed on the screen, it sends a corresponding instruction to the image processing device 6 via the HDMI channel, but cannot send the corresponding instruction to the image acquisition device 41 via the PC channel. However, since the image processing device 6 is also passively receiving the content provided by the transmission processing device 41, it cannot further process the instruction and cannot update the content to be displayed.

[0064] Therefore, this application also provides a method for transmitting instructions in the second display state of the aforementioned interactive flat panel, wherein, Figure 11 This is a schematic diagram of another embodiment of instruction transmission in the second display state of the interactive flat panel provided in this application. When in the second display state, after the display processing device 42 detects a first touch action by the user on the third content displayed on the screen, it sends information about the detected first touch action, such as the coordinates of the first touch action and the corresponding instruction, to the transmission processing device 41 via the USB interface in the OPS interface between the display processing device 402 and the transmission processing device 41, using the Human Interface Device (HID) protocol. This enables... Figure 11In the scenario shown, when the display processing device 402 detects a user's first touch operation on the third content displayed on the screen, the transmission processing device 41 also receives the information of the first touch operation. The transmission processing device 41 then sends the information of the first touch operation to the electronic device via the data transmission device 3. This causes the electronic device to perform a page-turning operation on the PPT based on the click operation, ultimately adjusting and updating the first content 401 to be displayed. The electronic device 1 sends the updated first content to the transmission processing device 41 via the data transmission device 3. The transmission processing device 41 then sends the updated first content to the image processing device 6. The image processing device 6 combines the first and second content to update the third content, and finally sends the third content to the display processing device 42 for display. This achieves the updating of the third content displayed on the interactive whiteboard 4, thereby overcoming the limitations of traditional methods. Figure 10 The issue of command transmission in the second display state shown.

[0065] In some embodiments, interactive flat panels are such as Figure 8 The displayed page provides an application for users to select the display state, and allows them to use applications such as [example application name] after switching to the second display state. Figure 11 The instructions are transmitted in the manner shown. In other embodiments, the interactive flat panel can also display corresponding icons in the sidebar or other positions of the displayed fourth content through its host module, allowing the user to select the first or second display state. In this case, the user only needs to perform a single click to select the display state, switching between single-screen single-stream and single-screen multi-stream, which can also be called a "one-click dual-stream switch," thereby reducing the operations required for the user to switch display states. For example... Figure 12 This is a schematic diagram of an embodiment of the display page of the interactive flat panel provided in this application. A sidebar 100 is provided on one edge of the page displaying the fourth content on the interactive flat panel. Multiple icon controls are displayed in the sidebar 100. A second icon control 1001 can be used to indicate switching to a second display state, and a first icon control 1002 can be used to indicate switching to a first display state. This achieves the function of one-click activation of dual streams through a user-friendly graphical interface, improving the user experience. For example, when the display processing device detects a click operation on the first icon control 1002, it sends a first instruction to the transmission processing device to indicate switching to the first display state. Upon receiving the first instruction, the transmission processing device determines to switch to the first display state. Similarly, when the display processing device detects a click operation on the second icon control 1001, it sends a second instruction to the transmission processing device to indicate switching to the second display state. Upon receiving the second instruction, the transmission processing device determines to switch to the second display state.

[0066] In other embodiments, this application can also provide a more intelligent display state switching method, enabling users to switch display states seamlessly without needing to click any controls. For example, the interactive flat panel's transmission processing device can run and provide different applications to the user, such as... Figure 12 The interactive flat panel's display page shows icon controls 200 corresponding to different applications. Among them, the applications corresponding to preset icon controls 2001 are denoted as "Whiteboard," "Annotation," "Video Conferencing," and "Single Screen Dual Stream," etc. These applications require the interactive flat panel to switch to a secondary display state to utilize the content provided by the image processing device. Therefore, after clicking the preset icon control 2001 for the aforementioned applications, the user needs to manually follow the prompts as shown below. Figure 8 The display state is switched in the manner shown. Therefore, in this embodiment, the transmission processing device in the interactive flat panel can record the identification information of these applications. When the display processing device detects that the user operates on the control of a preset application in the fourth content, in addition to sending the instruction corresponding to the preset application to the transmission processing device, it also sends a second instruction to the transmission processing device, so that the transmission processing device determines to switch to the second display state according to the second instruction. Thus, without the user's awareness, the function of enabling single-screen dual-stream is realized according to the usage of the application, which can further improve the user experience.

[0067] In some embodiments, the above-mentioned Figure 12 The example shown illustrates a method for switching display states via controls and applications. To achieve this display state switching process, one approach is for developers from the interactive flat panel manufacturer to implement it through software programs. Figure 12 The page is displayed, and when a user clicks on a control, the display switches to the corresponding state.

[0068] In another implementation, based on the Windows system running on the transmission processing device, the projection technology within the Windows system can also be used to achieve the aforementioned display state switching. Specifically, in this embodiment, the transmission processing device does not output data through its HDMI OUT interface in the first display state, but outputs data through its HDMI OUT interface in the second display state. Similarly, Windows projection technology does not output data through its HDMI OUT interface in the "computer screen only" state, but outputs data through the HDMI OUT signal in the "copy" state. Therefore, the display state switching control provided in this application can be associated with the states in Windows projection technology. Figure 12In the example shown, when the transmission processing device determines that a click operation on control 1001 has been received based on the second instruction sent by the display processing device, it executes the third instruction corresponding to the "copy" projection state in the Windows system of the transmission processing device, so that the transmission processing device can output data through its HDMI OUT interface; while when the transmission processing device determines that a click operation on control 1002 has been received based on the first instruction sent by the display processing device, it executes the fourth instruction corresponding to the "computer screen only" projection state in the Windows system of the transmission processing device, so that the transmission processing device does not output data through its HDMI OUT interface.

[0069] In one embodiment, as... Figure 2 In the scenario shown, the data transmission device 3 can also be equipped with a hardware switch. When the user turns on the hardware switch by pressing it, the data transmission device 3 starts sending the content of the electronic device 1 to the interactive flat panel 4 for display. When the interactive flat panel 4 receives the content sent by the data transmission device 3, it switches from the first display state to the second display state. When the user turns off the hardware switch by pressing it again, the data transmission device 3 stops sending data to the interactive flat panel 4, and the interactive flat panel 4 switches from the second display state back to the first display state.

[0070] In the foregoing embodiments, the data transmission methods executed by each entity in the data transmission system provided by this application have been described. To implement the functions of the methods provided by this application, each executing entity may include hardware structures and / or software modules, implementing the aforementioned functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0071] It should be understood that the division of the various modules of the above-mentioned execution entity is merely a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. For example, the display processing device and the transmission processing device of an interactive flat panel can be integrated into a single physical entity or physically separated. Furthermore, these modules can be implemented entirely in software through processing element calls; they can also be implemented entirely in hardware; or some modules can be implemented by processing element calls to software, while others are implemented in hardware. These modules can be separate processing elements, or they can be integrated into a chip within the aforementioned device. Alternatively, they can be stored as program code in the memory of the aforementioned device, and called and executed by a processing element of the device. The implementation of other modules is similar. Moreover, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element mentioned here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each of the above modules can be completed through integrated logic circuits in the hardware of the processor element or through software instructions.

[0072] For example, these modules can be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs). As another example, when a module is implemented using processing element scheduler code, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor capable of calling program code. Furthermore, these modules can be integrated together to implement a system-on-a-chip (SOC).

[0073] In the above embodiments, the methods executed by each executing entity can be implemented entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks (SSDs)).

[0074] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0075] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A data transmission system, characterized in that, include: The device includes an electronic device, a data transmission device, an interactive flat panel, an image acquisition device, and an image processing device; wherein the electronic device is connected to the data transmission device, the data transmission device is connected to the interactive flat panel, and the interactive flat panel and the image acquisition device are respectively connected to the image processing device. The data transmission device is used to acquire the first content displayed by the electronic device and send the first content to the interactive flat panel; after receiving the first content, the interactive flat panel sends the first content to the image processing device. The image acquisition device is used to acquire a second content of the surrounding environment and send the second content to the image processing device; the image processing device is used to, upon receiving the first content and the second content, merge the first content and the second content to obtain a third content, and send the third content to the interactive tablet; after receiving the third content, the interactive tablet displays the third content on the display screen; the interactive tablet is also used to determine a fourth content and simultaneously display the fourth content and the third content on the display screen; wherein, the fourth content is a sidebar generated through the interactive tablet's own channel, and the third content is displayed in other display areas of the display screen excluding the sidebar; The interactive flat panel is also used to: when a first touch action is received on the third content displayed on the display screen, send the information of the first touch action to the electronic device through the data transmission device; when a second touch action is received on the fourth content displayed on the display screen, execute the instruction corresponding to the second touch action; The interactive flat panel has at least the following two display states: When the interactive flat panel is in the first display state, after receiving the first content, the interactive flat panel displays the first content on the display screen; When the interactive flat panel is in the second display state, after receiving the first content, the interactive flat panel sends the first content to the image processing device; The interactive flat panel includes multiple signal source channels, which are used to receive input signals from different signal sources. The interactive flat panel switches between different signal source channels to switch between the first display state and the second display state.

2. The system according to claim 1, characterized in that, The image processing device is specifically used to merge the second content onto a preset area of ​​the first content to obtain the third content.

3. The system according to claim 2, characterized in that, The interactive flat panel includes: A transmission processing device and a display processing device; the transmission processing device is connected to the data transmission device, the image processing device and the display processing device, and the display processing device is also connected to the image processing device; The transmission processing device is used to send the first content to the image processing device after receiving the first content; the display processing device is used to display the third content on the display screen after receiving the third content sent by the image processing device. The display processing device is further configured to, when a first touch action is performed on the third content displayed on the display screen, send information of the first touch action to the transmission processing device; and after receiving the first touch action, the transmission processing device transmits the information of the first touch action to the electronic device through the data transmission device.

4. The system according to claim 3, characterized in that, The fourth content includes: a first icon control and a second icon control; The display processing device is configured to send a first instruction to the transmission processing device when an operation of the first icon control is detected; and to send a second instruction to the transmission processing device when an operation of the second icon control is detected. The transmission processing device is used to, upon receiving the first instruction, determine to switch the interactive flat panel to the first display state; and upon receiving the second instruction, determine to switch the interactive flat panel to the second display state.

5. The system according to claim 4, characterized in that, The transmission processing device is specifically used to execute a fourth instruction in the operating system when it receives the first instruction, wherein the fourth instruction is used to control the transmission processing device to stop outputting data to the image processing device; The transmission processing device is specifically used to execute a third instruction in the operating system when it receives the second instruction, wherein the third instruction is used to control the transmission processing device to output data to the image processing device.

6. The system according to claim 4 or 5, characterized in that, The display processing device is further configured to, after detecting an operation of a preset icon control in the fourth content, send the first instruction and the second instruction corresponding to the preset icon control to the transmission processing device.

7. A data transmission method, characterized in that, An application is made in a data transmission system, the data transmission system comprising: an electronic device, a data transmission device, an interactive flat panel, an image acquisition device, and an image processing device; wherein, the electronic device is connected to the data transmission device, the data transmission device is connected to the interactive flat panel, and the interactive flat panel and the image acquisition device are respectively connected to the image processing device; the data transmission method includes: The data transmission device acquires the first content displayed by the electronic device and sends the first content to the interactive flat panel; The interactive flat panel sends the first content to the image processing device; The image acquisition device acquires a second element of the surrounding environment and sends the second element to the image processing device; The image processing device merges the first content and the second content to obtain a third content, and sends the third content to the interactive tablet. The interactive flat panel displays the third content; The interactive flat panel determines a fourth piece of content and displays the fourth piece of content and the third piece of content simultaneously; wherein, the fourth piece of content is a sidebar generated through the interactive flat panel's own channel, and the third piece of content is displayed in other display areas of the display screen other than the sidebar. When the interactive tablet receives a first touch action on the third content displayed on the display screen, it sends the information of the first touch action to the electronic device through the data transmission device; when the interactive tablet receives a second touch action on the fourth content displayed on the display screen, it executes the instruction corresponding to the second touch action. The interactive flat panel has at least the following two display states: When the interactive flat panel is in the first display state, after receiving the first content, the interactive flat panel displays the first content on the display screen; When the interactive flat panel is in the second display state, after receiving the first content, the interactive flat panel sends the first content to the image processing device; The interactive flat panel includes multiple signal source channels, which are used to receive input signals from different signal sources. The interactive flat panel switches between different signal source channels to switch between the first display state and the second display state.

8. An interactive flat panel, characterized in that, The interactive flat panel has at least the following two display states: When in the first display state, the interactive flat panel receives the first content sent by the data transmission device and displays the first content on the display screen; When in the second display state, after the interactive flat panel receives the first content sent by the data transmission device, it sends the first content to the image processing device, so that the image processing device obtains the third content based on the first content and the second content from the image acquisition device and sends it to the interactive flat panel. After receiving the third content, the interactive flat panel displays the third content on the display screen. The interactive flat panel determines a fourth piece of content and simultaneously displays the fourth piece of content and the third piece of content on the display screen; wherein, the fourth piece of content is a sidebar generated through the interactive flat panel's own channel, and the third piece of content is displayed in other display areas of the display screen excluding the sidebar; When a first touch action is received on the third content displayed on the display screen, the information of the first touch action is sent to the electronic device through the data transmission device; when a second touch action is received on the fourth content displayed on the display screen, the instruction corresponding to the second touch action is executed. The interactive flat panel includes multiple signal source channels, which are used to receive input signals from different signal sources. The interactive flat panel switches between different signal source channels to switch between the first display state and the second display state.

9. An image processing apparatus, characterized in that, include: The system comprises a first input interface, a second input interface, an output interface, and a processing unit. The processing unit is connected to the interactive flat panel via the first input interface, the interactive flat panel is connected to the data transmission device, the data transmission device is connected to the electronic device, the processing unit is connected to the image acquisition device via the second input interface, and the processing unit is connected to the interactive flat panel via the output interface. The processing unit is used for: The first content sent by the interactive flat panel is received through the first input interface; the first content is the first content displayed by the electronic device, which is acquired and sent to the interactive flat panel by the data transmission device. The second content sent by the image acquisition device is received through the second input interface; The third content is obtained by combining the first content and the second content; The third content is sent to the interactive flat panel through the input interface; The interactive flat panel includes at least a first display state and a second display state. When the interactive flat panel is in the second display state, the processing unit is used to: receive first content sent by the interactive flat panel through the first input interface. The second content sent by the image acquisition device is received through the second input interface; the third content is obtained by merging the first content and the second content; the third content is sent to the interactive tablet through the input interface so that the interactive tablet displays the fourth content and the third content on the display screen at the same time; wherein, the fourth content is a sidebar generated through the channel of the interactive tablet itself, and the third content is displayed in other display areas of the display screen except for the sidebar; The interactive flat panel includes multiple signal source channels, which are used to receive input signals from different signal sources. The interactive flat panel switches between different signal source channels to switch between the first display state and the second display state.

Images