Information transmission method and device, equipment and storage medium

Abstract

The invention discloses an information transmission method and device, equipment and a storage medium, and relates to the technical field of information, and the method comprises the steps: obtaining an information flow sent by a first terminal through a USB virtual network interface module, and sending the information flow to a webpage real-time communication receiving module; decoding the information stream received by the webpage real-time communication receiving module through a video decoding module to obtain a decoded information stream; the decoded information flow is processed through an output module, the processed information flow is transmitted to the second terminal through a data transmission interface, and the cost and the wiring difficulty can be reduced.

Description

Technical Field

[0001] The present application relates to the field of information technology, and in particular to an information transmission method, device, equipment and storage medium. Background Art

[0002] In recent years, cloud video conferencing services such as Tencent Meeting, Microsoft Teams, and Zoom have been widely used, mainly running on desktop computers or mobile terminals. When using desktop computers, cameras and microphones are often connected via USB. In a conference room environment, dedicated audio and video peripherals such as VideoBar will be deployed to meet the needs of multi-person audio and video acquisition. Participants can bring laptops and connect the laptops to audio and video peripherals via USB cables, and use HDMI cables to connect the laptops to display devices.

[0003] However, this solution requires the laptop to be connected to both USB and HDMI cables, which increases costs and wiring difficulty.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present application is to provide an information transmission method, device, equipment and storage medium, aiming to solve the current technical problem of connecting a laptop to both USB and HDMI cables at the same time, which increases costs and wiring difficulty.

[0006] To achieve the above purpose, the present application proposes an information transmission method, which is applied to an external device, and the method comprises the following steps:

[0007] Acquire the information stream sent by the first terminal through the USB virtual network port module, and send it to the web page real-time communication receiving module;

[0008] Decoding the information stream received by the webpage real-time communication receiving module through a video decoding module to obtain a decoded information stream;

[0009] The decoded information stream is processed by an output module, and the processed information stream is transmitted to the second terminal through a data transmission interface.

[0010] In one embodiment, the method further comprises the following steps:

[0011] Receiving an audio output signal transmitted by the first terminal via USB;

[0012] Sending the audio output signal to the audio output module via the USB audio class module;

[0013] The audio output signal in the audio output module is output through the built-in speaker.

[0014] In one embodiment, the method further comprises the following steps:

[0015] Collect microphone input signals and audio output echo reference signals through an audio acquisition module;

[0016] The audio output echo reference signal is used as a reference, the microphone input signal is preprocessed by an audio preprocessing module, and the preprocessed microphone input signal is output.

[0017] The preprocessed microphone input signal is sent to the first terminal via the USB according to a preset USB audio class specification through a USB audio class module.

[0018] In one embodiment, the method further comprises the following steps:

[0019] Acquire an optical signal through a lens, and input the optical signal into an image sensor;

[0020] Convert the optical signal input by the lens into a digital image signal through an image sensor, and send the digital image signal to a video acquisition module;

[0021] The digital image signal is processed by the video acquisition module to obtain a video signal;

[0022] Processing the video signal through the video processing module to obtain a processed video signal;

[0023] The processed video signal is sent to the first terminal via the USB according to a preset USB video class specification through a USB video class module.

[0024] In one embodiment, the step of processing the video signal by the video processing module to obtain the processed video signal includes:

[0025] Processing the video signal through the video processing module to output an image;

[0026] Encoding the output image through a video encoding module to obtain a video code stream;

[0027] The USB video class module sends the video code stream to the first terminal via USB according to the preset USB video class specification.

[0028] The present application also proposes an information transmission method, which is applied to a first terminal, and the method includes:

[0029] An information stream is sent to an external device so that the external device obtains the information stream sent by the first terminal through the USB virtual network port module, and sends it to the web real-time communication receiving module of the external device, the information stream received by the web real-time communication receiving module is decoded by the video decoding module of the external device to obtain a decoded information stream, the decoded information stream is processed by the output module of the external device, and the processed information stream is transmitted to the second terminal through the data transmission interface of the external device.

[0030] In one embodiment, the method further comprises:

[0031] In response to a request for accessing a preset web page in the browser, a web page real-time communication sending request is initiated to access the content in the USB storage module in the external device end through the web page real-time communication sending request.

[0032] In addition, to achieve the above-mentioned purpose, the present application also proposes an information transmission device, which is arranged at an external device end, and the device comprises:

[0033] An information acquisition module, used for acquiring the information stream sent by the first terminal through the USB virtual network port module, and sending it to the web page real-time communication receiving module;

[0034] An information decoding module, used for decoding the information stream received by the webpage real-time communication receiving module through the video decoding module to obtain a decoded information stream;

[0035] The information processing module is used to process the decoded information stream through the output module and transmit the processed information stream to the second terminal through the data transmission interface.

[0036] In addition, to achieve the above-mentioned purpose, the present application also proposes an information transmission device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the information transmission method described above.

[0037] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the information transmission method described above are implemented.

[0038] One or more technical solutions proposed in this application have at least the following technical effects:

[0039] In the present application, the external device is connected to the first terminal via a USB cable through a USB virtual network port module, that is, information transmission between the external device and the first terminal such as a laptop can be achieved through a single USB cable, and then the processed information stream is transmitted to the second terminal through the data transmission interface, that is, the external device is connected to the second terminal. Therefore, the laptop only needs to connect the USB cable to achieve information transmission, which reduces the cost and wiring difficulty. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0042] Figure 1 A flowchart of the first embodiment of the information transmission method of the present application is provided;

[0043] Figure 2 This is a schematic diagram of the architecture of the information transmission system for this application;

[0044] Figure 3 This is a schematic diagram of the module structure of the information transmission device according to an embodiment of the present application;

[0045] Figure 4 This is a schematic diagram of the device structure of the hardware operating environment involved in the information transmission method in the embodiment of the present application.

[0046] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0047] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0048] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0049] The main solution of the embodiment of the present application is: obtaining the information stream sent by the first terminal through the USB virtual network port module, and sending it to the web real-time communication receiving module; decoding the information stream received by the web real-time communication receiving module through the video decoding module to obtain the decoded information stream; processing the decoded information stream through the output module, and transmitting the processed information stream to the second terminal through the data transmission interface.

[0050] In this embodiment, for the convenience of description, the following description is made with the information transmission system as the execution subject.

[0051] In recent years, cloud video conferencing services such as Tencent Conference, Microsoft Teams, and Zoom have become increasingly popular. The clients of these video conferencing services are mainly run on desktop computers or mobile terminals (including mobile phones and laptops). When running on desktop computers, USB is usually used to connect cameras and microphones as audio and video peripherals for audio and video acquisition and output. In a conference room environment, in order to meet the audio and video acquisition of multiple people, dedicated conference room-level audio and video peripherals are usually deployed, such as an integrated audio and video VideoBar device, such as VHD's M1000 series audio and video all-in-one machine. A single device can achieve functions such as audio acquisition, audio playback, and video acquisition. Participants can bring their own laptops, connect VideoBar via a USB cable, and then connect to a display device such as a TV via an HDMI cable, and run the cloud video conferencing client on the computer. This solution is usually called BYOD (Bring Your Own Device) or BYOM (Bring Your Own Meeting). This solution requires connecting two cables, USB and HDMI, at the same time, which increases the cost of cable procurement and engineering wiring, especially HDMI cables, which are more expensive and inconvenient to wire when the distance is far. Solutions to this problem include:

[0052] 1. Wireless screen projection

[0053] Use screen projection protocols supported by operating systems such as AirPlay and Miracast, or external screen projection devices, to project the computer screen onto the display device via the WiFi network. The disadvantages include:

[0054] (1) The display device needs to support these protocols, or the TV's external screen projection receiving box needs to support these protocols;

[0055] (2) The screen projection effect (such as resolution, frame rate, delay, etc.) is greatly affected by the quality of the wireless signal.

[0056] 2. Use a chip that supports DisplayLink

[0057] DisplayLink is a proprietary technology of Synaptics. After installing the chip driver in Windows and other operating systems, the computer output image can be encoded and transmitted to the receiving end via USB. The receiving end uses the DisplayLink decoding chip to decrypt and output to the TV via HDMI. The disadvantages of this solution are:

[0058] (1) Use the more expensive DisplayLink chip;

[0059] (2) You need to install the DisplayLink driver on your computer. This driver takes up a lot of CPU resources for video encoding.

[0060] 3. Computer outputs DisplayPort Alt-Mode output via TYPE-C interface

[0061] The TYPE-C interface of newer computers has a built-in DisplayPort Alt-Mode output, which can directly output high-quality images. The video stream is transmitted to the receiver with built-in DisplayPort Alt-Mode receiving capability through a high-quality USB cable, and the receiver then outputs the computer image to the TV through HDMI. The disadvantages of this solution are:

[0062] (1) Both the computer and the receiver need to support DisplayPort Alt-Mode;

[0063] (2) The USB cable required to transmit DisplayPort Alt-Mode has very high quality requirements, especially when it comes to long-distance transmission. The cable cost rises sharply;

[0064] (3) There may be compatibility issues between DisplayPort Alt-Mode implementations from different manufacturers.

[0065] Therefore, the present application provides a solution. In the present application, the external device is connected to the first terminal via a USB cable through a USB virtual network port module, that is, information transmission between the external device and the first terminal such as a notebook can be achieved through a single USB cable, and then the processed information stream is transmitted to the second terminal through the data transmission interface, that is, the external device is connected to the second terminal. Therefore, the notebook only needs to connect the USB cable to achieve information transmission, which reduces the cost and wiring difficulty.

[0066] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device, information transmission device, etc. that can realize the above functions, or an electronic system, information transmission system, etc. that can realize the above functions. The following takes the information transmission system as an example to illustrate this embodiment and the following embodiments.

[0067] Based on this, the present application embodiment provides an information transmission method, referring to Figure 1 , Figure 1 A flowchart of the first embodiment of the information transmission method of the present application is provided.

[0068] In this embodiment, the information transmission method is applied to an external device, and includes steps S10 to S30:

[0069] Step S10, obtaining the information stream sent by the first terminal through the USB virtual network port module, and sending it to the web page real-time communication receiving module;

[0070] It should be noted that in the information transmission system, there are an external device end, a first terminal and a second terminal, wherein the first terminal is connected to the external device end, and the external device end is connected to the second terminal, thereby realizing the transmission of information among the first terminal, the external device end and the second terminal.

[0071] It should be noted that the external device has but is not limited to a USB virtual network port module, a web page real-time communication receiving module, a video decoding module and an output module, so that the external device communicates with the first terminal and the second terminal.

[0072] Among them, the external device end can be but not limited to audio and video peripherals, such as VideoBar devices, etc.; the first terminal can be but not limited to mobile phones, laptops, tablets, etc.; the second terminal can be but not limited to televisions, mobile phones, laptops, tablets, etc.

[0073] As an implementation method, the external device end includes the following four types of modules:

[0074] ●Lens, image sensor, video acquisition module, video processing module, video encoding module, UVC (USB Video Class) module;

[0075] ●Microphone, audio acquisition module, audio 3A processing module, UAC (USB Audio Class) module, audio output module, speaker;

[0076] ●USB virtual network port module, USB storage module, WebRTC (web real-time communication) video sending module, WebRTC video receiving module, video decoding module, video output module;

[0077] ●USB HUB module;

[0078] Among them, the USB virtual network port module, USB storage module, WebRTC video sending module, WebRTC video receiving module, video decoding module, video output module, and USB HUB module are the main modules of the present invention, and other modules are existing modules of the VideoBar device. Part or all of these VideoBar modules can be used as different embodiments of the present invention.

[0079] The external device end is connected to the first terminal via USB, and the external device end obtains the information stream sent by the first terminal via the USB virtual network port module and sends it to the web page real-time communication receiving module. The connection method between the external device end and the second terminal is not limited here.

[0080] As an implementation manner, it is assumed that the external device end is a VideoBar device, the first terminal is a notebook computer, and the second terminal is a television.

[0081] Among them, after the VideoBar device is connected to the laptop computer via a USB cable, a USB virtual network port device is provided to the laptop computer, thereby enabling two-way network communication with the laptop computer.

[0082] Step S20, decoding the information stream received by the webpage real-time communication receiving module through a video decoding module to obtain a decoded information stream;

[0083] The video decoding module decodes the video stream received by the web page real-time communication receiving module.

[0084] Step S30, processing the decoded information stream through the output module, and transmitting the processed information stream to the second terminal through the data transmission interface;

[0085] Among them, the output module includes but is not limited to an audio output module and a video output module. Among them, the audio output module outputs the received audio signal through a built-in speaker; the video output module scales, switches or synthesizes the video output by the video processing module and the video output by the video decoding module, and then outputs it through interfaces such as HDMI.

[0086] This embodiment provides an information transmission method. In this application, an external device is connected to a first terminal via a USB cable through a USB virtual network port module, that is, information transmission between the external device and a first terminal such as a notebook can be achieved through a single USB cable. Then, the processed information stream is transmitted to the second terminal through a data transmission interface, that is, the external device is connected to the second terminal. Therefore, the notebook only needs to connect a USB cable to achieve information transmission, which reduces costs and wiring difficulty.

[0087] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the first embodiment can be referred to the above introduction, and will not be repeated in the following. On this basis, the information transmission method further includes steps S40 to S60:

[0088] Step S40, receiving an audio output signal transmitted by the first terminal via USB;

[0089] The external device receives the audio output signal transmitted by the first terminal via USB.

[0090] Step S50, sending the audio output signal to the audio output module through the USB audio class module;

[0091] The USB audio class module is a hardware or software component that is specifically used to process audio data transmission on the USB interface. It is responsible for decoding and converting the received audio signal.

[0092] As an implementation method, the computer output audio signal sent by the laptop computer through the USB cable according to the UAC (USB Video Class) specification is sent to the audio output module.

[0093] Step S60: output the audio output signal in the audio output module through a built-in speaker.

[0094] The audio output module sends the processed audio signals to the built-in speakers of the receiving device. The speakers are responsible for converting these electrical signals into sound waves so that people can hear the sound.

[0095] This embodiment directly transmits audio signals through the USB interface, avoiding the complicated settings and connection steps that may be required in traditional audio transmission methods, making the transmission of audio signals more convenient and efficient.

[0096] Based on the first embodiment of the present application, in the third embodiment of the present application, the same or similar contents as those in the first embodiment can be referred to the above introduction, and will not be described in detail later. On this basis, the information transmission method further includes steps S70 to S90:

[0097] Step S70, collecting microphone input signals and audio output echo reference signals through an audio collection module;

[0098] Among them, the microphone is used to receive acoustic signals and convert them into electrical signals or digital signals.

[0099] Among them, the audio acquisition module is used to collect microphone input signals and audio output echo reference signals.

[0100] Step S80 , using the audio output echo reference signal as a reference, preprocessing the microphone input signal through an audio preprocessing module, and outputting the preprocessed microphone input signal.

[0101] Among them, the audio preprocessing module is also called the audio 3A processing module. The audio 3A processing module uses the echo reference signal collected by the audio acquisition module as a reference, performs automatic gain control (AGC), automatic noise suppression (ANS), automatic echo cancellation (AEC) and other processing on the microphone input collected by the audio acquisition module, and outputs the processed microphone signal.

[0102] Step S90: Sending the preprocessed microphone input signal to the first terminal via the USB according to a preset USB audio class specification through a USB audio class module.

[0103] Among them, the USB audio class module is also used to send the microphone signal output by the audio 3A processing to the computer through USB according to the UAC (USB audio class) specification.

[0104] Among them, the USB audio class module can also be used to interact with the computer side for audio control through HID and other specifications.

[0105] This embodiment uses the USB audio class specification to transmit signals, thereby ensuring compatibility and interoperability between different devices, which enables the solution to be widely used on various devices supporting USB audio.

[0106] Based on the first embodiment of the present application, in the fourth embodiment of the present application, the same or similar contents as those in the first embodiment can be referred to the above introduction, and will not be repeated in the following. On this basis, the information transmission method further includes steps S100 to S130, S170:

[0107] Step S100, acquiring an optical signal through a lens, and inputting the optical signal into an image sensor;

[0108] The lens in this embodiment is an optical lens.

[0109] Step S110, converting the optical signal input by the lens into a digital image signal through an image sensor, and sending the digital image signal to a video acquisition module;

[0110] Among them, the image sensor is used to convert the optical signal input by the lens into an electrical signal and further into a digital signal.

[0111] Step S120, performing image signal processing on the digital image signal through the video acquisition module to obtain a video signal;

[0112] The video acquisition module is used to perform ISP (image signal) processing on the digital image signal from the image sensor to obtain a YUV signal, where YUV is a video signal.

[0113] Step S130, processing the video signal through a video processing module to obtain a processed video signal;

[0114] The video processing module is used to perform automatic exposure, automatic white balance, color space conversion and other processing on the video data collected by the video acquisition module.

[0115] Step S170: Send the processed video signal to the first terminal via USB according to a preset USB video class specification through a USB video class module.

[0116] The USB video class module is used to send the video signal output by the video processing module to the computer via USB according to the UVC (USB video class) specification.

[0117] This embodiment ensures compatibility and interoperability between different devices by using the USB video class specification for signal transmission, which enables the solution to be widely used on various devices supporting USB video.

[0118] Based on the fourth embodiment of the present application, in the fifth embodiment of the present application, the same or similar contents as those in the fourth embodiment can be referred to the above description, and will not be described in detail later. On this basis, the step S130, after processing the video signal through the video processing module, the processed video signal is obtained, and steps S140 to S160 are also included:

[0119] Step S140, processing the video signal through the video processing module to output an image;

[0120] The video processing module is used to perform automatic exposure, automatic white balance, color space conversion and other processing on the video data collected by the video acquisition module.

[0121] Step S150, encoding the output image through a video encoding module to obtain a video code stream;

[0122] The task of the video encoding module is to convert the output image frames into an efficient and compressed video code stream format. This encoding process aims to reduce the size of the video data while maintaining the visual quality and smoothness of the image. Common video encoding standards include H.264, H.265 (HEVC), MJPEG, etc. The encoded video code stream is more suitable for transmission in the network or storage in a limited space.

[0123] Step S160: Send the video code stream to the first terminal via USB according to the preset USB video class specification through the USB video class module.

[0124] Among them, the USB video class module can also be used to send the MJPEG and other video code streams output by the video encoding module to the computer through USB according to the UVC (USB video class) specification.

[0125] This embodiment ensures compatibility and interoperability between different devices by using the USB video class specification for video data transmission, which enables the solution to be widely used on various devices supporting USB video without requiring additional drivers or settings.

[0126] The embodiment of the present application further provides an information transmission method, which is applied to a first terminal, and the method includes step S200:

[0127] Step S200, sending an information stream to an external device so that the external device obtains the information stream sent by the first terminal through the USB virtual network port module, and sends it to the web real-time communication receiving module of the external device, and decodes the information stream received by the web real-time communication receiving module through the video decoding module of the external device to obtain a decoded information stream, processes the decoded information stream through the output module of the external device, and transmits the processed information stream to the second terminal through the data transmission interface of the external device.

[0128] This embodiment is applied to a first terminal, and the first terminal can send information streams such as audio streams or video streams to an external device.

[0129] Furthermore, the first terminal may be installed with cloud conference client software, and the cloud conference client may use the UAC and UVC audio and video peripherals provided by the external device through the capabilities provided by the first terminal operating system (such as Windows, Linux or MacOS) to complete audio and video acquisition.

[0130] In the present application, the external device is connected to the first terminal via a USB cable through a USB virtual network port module, that is, information transmission between the external device and the first terminal such as a laptop can be achieved through a single USB cable, and then the processed information stream is transmitted to the second terminal through the data transmission interface, that is, the external device is connected to the second terminal. Therefore, the laptop only needs to connect the USB cable to achieve information transmission, which reduces the cost and wiring difficulty.

[0131] Based on the previous embodiment, in the embodiments of the present application, the same or similar contents as the previous embodiment can be referred to the above introduction, and will not be repeated in the following. On this basis, the information transmission method further includes step S210:

[0132] Step S210, in response to a request for accessing a preset web page in the browser, a web page real-time communication sending request is initiated to access the content in the USB storage module in the external device through the web page real-time communication sending request.

[0133] It should be noted that the USB storage module is used to present a USB storage device to the computer after being connected to the computer via a USB cable, so that the computer can access the files stored in the VideoBar.

[0134] In this embodiment, the first terminal is a PC, that is, a laptop computer, which is used to access a shortcut link of a WebRTC (web real-time communication) sending module stored on a USB storage device in an external device. The WebRTC sending module is implemented in the form of a web page. Clicking the link can open a browser and access the WebRTC sending module in the external device through a virtual network port.

[0135] Among them, the PC is also used to run cloud video conferencing software and browsers.

[0136] It should be noted that the first terminal may also include a browser, which is the actual operating environment of the WebRTC (Web Real-Time Communication) sending module. The browser provides the communication capabilities required by the WebRTC sending module and the capture and video encoding and transmission capabilities of the local computer desktop or window.

[0137] Furthermore, the WebRTC sending module can also be divided into a WebRTC video sending module and a WebRTC audio sending module. The WebRTC video sending module is stored in a web page on the USB storage module. The computer can initiate WebRTC video sending by accessing the web page through a browser.

[0138] Correspondingly, there is a WebRTC video receiving module in the external device end, and the WebRTC video receiving module receives the video stream sent by the WebRTC video sending module through the USB virtual network port.

[0139] As an implementation method, when the first terminal sends information to the external device, it can be first distributed through the USB hub module in the external device. Among them, USB virtual network port, USB storage, UAC, UVC, HID and other USB-based functions need to be allocated corresponding USB endpoints and USB bandwidth. When the number of USB endpoints and bandwidth supported by a single USB device is insufficient, these USB functions are distributed to different USB devices through the USB hub module.

[0140] In this embodiment, the USB storage content is accessed through a browser. The user does not need to carry an additional storage device or install specific software. As long as the device is connected to a system that supports this function, it can be easily accessed through a web page.

[0141] For example, to help understand the above embodiments, please refer to Figure 2 , Figure 2 A schematic diagram of the architecture of an information transmission system is provided.

[0142] Among them, there are the following 6 lines in the architecture diagram.

[0143] (1) The external device receives the audio output signal transmitted by the first terminal through the USB; sends the audio output signal to the audio output module through the USB audio class module; and outputs the audio output signal in the audio output module through the built-in speaker.

[0144] (2) The external device collects the microphone input signal and the audio output echo reference signal through the audio collection module; takes the audio output echo reference signal as a reference, pre-processes the microphone input signal through the audio pre-processing module, outputs the pre-processed microphone input signal, sends the pre-processed microphone input signal to the USB audio class module, sends the pre-processed microphone input signal to the first terminal according to the preset USB audio class specification through the USB audio class module, the USB hub and the USB cable, and outputs it through the cloud conference client software of the first terminal.

[0145] (3) acquiring an optical signal through a lens in an external device, and inputting the optical signal into an image sensor; converting the optical signal input by the lens into a digital image signal through the image sensor, and sending the digital image signal to a video acquisition module; performing image signal processing on the digital image signal through the video acquisition module to obtain a video signal; processing the video signal through the video processing module to output an image; encoding the output image through the video encoding module to obtain a video code stream; and sending the video code stream to the first terminal through the USB according to the preset USB video class specification through the USB video class module.

[0146] (4) acquiring an optical signal through a lens in an external device end, and inputting the optical signal into an image sensor; converting the optical signal input by the lens into a digital image signal through the image sensor, and sending the digital image signal to a video acquisition module; performing image signal processing on the digital image signal through the video acquisition module to obtain a video signal; processing the video signal through a video processing module to obtain a processed video signal; and sending the processed video signal through a USB video class module to the first terminal via a USB according to a preset USB video class specification.

[0147] (5) Acquire the information stream sent by the first terminal through the USB virtual network port module at the external device end, and send it to the web real-time communication receiving module; decode the information stream received by the web real-time communication receiving module through the video decoding module to obtain a decoded information stream; process the decoded information stream through the output module, and transmit the processed information stream to the second terminal through the data transmission interface.

[0148] (6) In response to a request to access a preset web page in the browser, the first terminal initiates a web page real-time communication sending request to access the content in the USB storage module in the external device through the web page real-time communication sending request.

[0149] It should be noted that this embodiment proposes a method to directly transmit the computer screen projection signal in the USB cable originally used to transmit the camera and microphone signals. Without adding any additional high-cost chips on the computer and VideoBar ends, a single ordinary USB cable can meet the two-way audio and video transmission between the computer and the VideoBar.

[0150] From VideoBar to computer, the standard UVC / UAC protocol is used. No additional driver needs to be installed on the computer side to achieve two-way transmission of camera video capture and audio.

[0151] From computer to VideoBar, by using USB virtual network port and WebRTC technology, the computer screen can be transmitted to VideoBar without installing private drivers and additional software. After decoding, VideoBar can be output through HDMI and other interfaces.

[0152] Among them, the main technical key points of the present invention are the following 5 points:

[0153] 1. Use the USB virtual network port to establish two-way network communication between the first terminal and the external device;

[0154] 2. The external device provides USB storage to the first terminal and provides a webpage link for sending the WebRTC video to the first terminal user;

[0155] 3. Send the computer's desktop and window images to the external device for decoding and display through WebRTC;

[0156] 4. Use a USB hub to solve the problem that there may not be enough USB endpoints on the external device side;

[0157] 5. Finally, two-way audio and video transmission between the first terminal and the external device is achieved through a USB cable, and no private driver or software needs to be installed on the first terminal.

[0158] The beneficial effects of the present invention are: bidirectional audio and video transmission can be achieved by using a single common USB cable, thereby reducing the implementation cost of the external device end and the deployment cost of the entire BYOD / BYOM.

[0159] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the information transmission method of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0160] The present application also provides an information transmission device, which is arranged at the external device end, please refer to Figure 3 , the information transmission device comprises:

[0161] The information acquisition module 10 is used to acquire the information stream sent by the first terminal through the USB virtual network port module, and send it to the web page real-time communication receiving module;

[0162] An information decoding module 20, configured to decode the information stream received by the webpage real-time communication receiving module through a video decoding module to obtain a decoded information stream;

[0163] The information processing module 30 is used to process the decoded information stream through the output module, and transmit the processed information stream to the second terminal through the data transmission interface.

[0164] The information transmission device provided by the present application adopts the information transmission method in the above embodiment, which can solve the technical problem that the cost and wiring difficulty are increased by connecting the notebook to the USB and HDMI cables at the same time. Compared with the prior art, the beneficial effects of the information transmission device provided by the present application are the same as the beneficial effects of the information transmission method provided by the above embodiment, and the other technical features in the information transmission device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0165] The present application provides an information transmission device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the information transmission method in the above-mentioned embodiment one.

[0166] Reference below Figure 4 , which shows a schematic diagram of the structure of an information transmission device suitable for implementing the embodiments of the present application. The information transmission device in the embodiments of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The information transmission device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0167] like Figure 4 As shown, the information transmission device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the information transmission device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the information transmission device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows an information transmission device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0168] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0169] The information transmission device provided by the present application adopts the information transmission method in the above embodiment, which can solve the technical problem that the cost and wiring difficulty are increased by connecting the notebook to the USB and HDMI cables at the same time. Compared with the prior art, the beneficial effects of the information transmission device provided by the present application are the same as the beneficial effects of the information transmission method provided by the above embodiment, and the other technical features in the information transmission device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0170] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0171] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0172] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the information transmission method in the above-mentioned embodiment.

[0173] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0174] The computer-readable storage medium may be included in the information transmission device; or may exist independently without being assembled into the information transmission device.

[0175] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the information transmission device, the information transmission device: obtains the information stream sent by the first terminal through the USB virtual network port module, and sends it to the web real-time communication receiving module; decodes the information stream received by the web real-time communication receiving module through the video decoding module to obtain the decoded information stream; processes the decoded information stream through the output module, and transmits the processed information stream to the second terminal through the data transmission interface.

[0176] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0177] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0178] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0179] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned information transmission method, and can solve the technical problem that the cost and wiring difficulty are increased by connecting the notebook to both USB and HDMI cables at the same time. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the information transmission method provided by the above-mentioned embodiment, and will not be repeated here.

[0180] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. An information transmission method, characterized in that: Applied to an external device, the method comprises the following steps: Acquire the information stream sent by the first terminal through the USB virtual network port module, and send it to the web page real-time communication receiving module; Decoding the information stream received by the webpage real-time communication receiving module through a video decoding module to obtain a decoded information stream; The decoded information stream is processed by an output module, and the processed information stream is transmitted to the second terminal through a data transmission interface.

2. The method according to claim 1, characterized in that The method further comprises the following steps: Receiving an audio output signal transmitted by the first terminal via USB; Sending the audio output signal to the audio output module via the USB audio class module; The audio output signal in the audio output module is output through the built-in speaker.

3. The method according to claim 1, characterized in that The method further comprises the following steps: Collect microphone input signals and audio output echo reference signals through an audio acquisition module; Using the audio output echo reference signal as a reference, preprocessing the microphone input signal through an audio preprocessing module, and outputting the preprocessed microphone input signal; The preprocessed microphone input signal is sent to the first terminal via the USB according to a preset USB audio class specification through a USB audio class module.

4. The method according to claim 1, characterized in that The method further comprises the following steps: Acquire an optical signal through a lens, and input the optical signal into an image sensor; Convert the optical signal input by the lens into a digital image signal through an image sensor, and send the digital image signal to a video acquisition module; The digital image signal is processed by the video acquisition module to obtain a video signal; Processing the video signal through the video processing module to obtain a processed video signal; The processed video signal is sent to the first terminal via the USB according to a preset USB video class specification through a USB video class module.

5. The method according to claim 4, characterized in that The step of processing the video signal by the video processing module to obtain the processed video signal includes: Processing the video signal through the video processing module to output an image; Encoding the output image through a video encoding module to obtain a video code stream; The USB video class module sends the video code stream to the first terminal via USB according to the preset USB video class specification.

6. An information transmission method, characterized in that: Applied to a first terminal, the method includes: An information stream is sent to an external device so that the external device obtains the information stream sent by the first terminal through the USB virtual network port module, and sends it to the web real-time communication receiving module of the external device, the information stream received by the web real-time communication receiving module is decoded by the video decoding module of the external device to obtain a decoded information stream, the decoded information stream is processed by the output module of the external device, and the processed information stream is transmitted to the second terminal through the data transmission interface of the external device.

7. The method according to claim 6, characterized in that The method further comprises: In response to a request for accessing a preset web page in the browser, a web page real-time communication sending request is initiated to access the content in the USB storage module in the external device end through the web page real-time communication sending request.

8. An information transmission device, characterized in that: Set at the external device end, the device includes: An information acquisition module, used for acquiring the information stream sent by the first terminal through the USB virtual network port module, and sending it to the web page real-time communication receiving module; An information decoding module, used for decoding the information stream received by the webpage real-time communication receiving module through the video decoding module to obtain a decoded information stream; The information processing module is used to process the decoded information stream through the output module and transmit the processed information stream to the second terminal through the data transmission interface.

9. An information transmission device, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the information transmission method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the information transmission method according to any one of claims 1 to 7 are implemented.

Images