Video acquisition method and device
By reading the interactive operation element parameters of the video window, it generates a transparent operation window and is bonded, which solves the problem of virtual camera control restrictions in video conferencing, realizes the interactive operation capability of the video conferencing software, and improves the demonstration effect.
Patent Information
- Application Number
- CN202111528908.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-15
- Publication Date
- 2025-01-10
- Estimated Expiration
- 2041-12-15
AI Technical Summary
During the video conferencing process, due to the process level of the system software, OBS can only control the top-level virtual camera when communicating with the conference software, resulting in the inability to directly expose or call other capabilities of the video conferencing software in real time, such as text communication and voting, etc. Frequent software switching is required to affect the demonstration effect.
By reading the interactive element parameters of the video window, a transparent operation window that can simulate interactions is generated and fitted with the video window to realize the transparency of the virtual video stream image layer and the tiling of the interactive elements, and then On the video conferencing software side, you can control images and other capabilities without frequent switching operations.
It realizes the interactive operation capability on the video conferencing software side, avoids frequent software switching operations, and improves the demonstration effect.
Smart Images

Figure CN114143496B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of video conferencing, and in particular to a video acquisition method and device. Background Art
[0002] During video conferencing, with the diversity of presentation and collaboration needs, it is usually necessary to use third-party OBS streaming presentation software to achieve personalized creative expression needs. Generally, the audio and video communication between video conferencing software and OBS is based on the connection of virtual cameras, which manipulates the OBS virtual camera presentation layer to push the audio and video streams to the video conferencing software port. Limited by the system software process level, when OBS communicates with the conference software, we can generally only manipulate the top-level OBS. At this time, other capabilities that the video conferencing software level needs to express, such as text communication, voting, etc., cannot be directly exposed and called in real time. They need to be implemented through frequent software switching, which greatly reduces the presentation effect. Summary of the invention
[0003] In order to solve the above technical problems, the first aspect of the present invention provides a video acquisition method, the method comprising:
[0004] S10: Reading parameters of at least one interactive element operable in different presentation modes of the first video window;
[0005] S20: generating a transparent operation window capable of simulating interactive operation according to the parameters of the interactively operable elements in different demonstration modes of the at least one first video window read;
[0006] S30: Attach the transparent operation window to the second video window.
[0007] Preferably, step S20: the method of generating a transparent operation window capable of simulating interactive operation according to the parameters of the interactively operable elements in different demonstration modes of at least one first video window read comprises:
[0008] S201: Simulate and generate transparent element blocks of interactively operable elements;
[0009] S202: Overlaying the transparent element block with a transparent image canvas to generate a transparent operation window that can simulate interactive operations.
[0010] Preferably, the parameters of the interactively operable element include the area coordinates of the interactively operable element relative to the first video window and the element size.
[0011] Preferably, the area coordinates and element size of the transparent element block relative to the transparent image canvas are the same as the area coordinates and element size of the interactive element relative to the first video window.
[0012] Preferably, before step S10, the method further includes step S00: reading a first size ratio and a first coordinate parameter of at least one first video window, and a second size ratio and a second coordinate parameter of at least one second video window.
[0013] Preferably, in step S30, the transparent operation window is scaled proportionally to be equal in height to the second video window and centered to achieve positioning fit between the transparent operation window and the second video window.
[0014] A second aspect of the present invention provides a video acquisition device, the device comprising:
[0015] A reading module, reading parameters of at least one interactively operable element in different presentation modes of the first video window;
[0016] A generating module, generating a transparent operating window capable of simulating interactive operations according to the parameters of the interactively operable elements in different demonstration modes of at least one first video window read;
[0017] The fitting module fits the transparent operation window with the second video window.
[0018] Preferably, the generating module comprises:
[0019] Simulation unit, which simulates transparent element tiles that generate interactive elements;
[0020] The overlay unit overlays the transparent element block on the transparent image canvas to generate a transparent operation window that can simulate interactive operations.
[0021] A third aspect of the present invention provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and wherein the computer program can be executed in the processor to implement any of the above methods.
[0022] A fourth aspect of the present invention is a storage medium storing a computer program, wherein the computer program can implement any of the above methods when executed in a processor.
[0023] The advantages and positive effects of the present invention are: The embodiment of the present invention reads the parameters of the interactive operation elements of the first video window, simulates and generates a transparent operation window that can simulate interactive operations according to the interactive parameters, and simultaneously reads the coordinate size of the second video window, matches and fits the transparent operation window with the second video window, thereby realizing interactive operations of the second video window that receives video data.
[0024] At the same time, the embodiment of the present invention makes the virtual video stream image layer transparent, blocks the interactive elements, reads the coordinate size of the video conference software image window, matches and fits the transparent layer with the conference image layer, and then fits the interactive elements to the video conference window. It is not necessary to frequently switch the software end to control the image in the video conference and other capabilities of the conference software end. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] Figure 1 A flow chart showing a video acquisition method according to an embodiment of the present invention is shown;
[0026] Figure 2 The schematic diagram of the structure of the video acquisition device of the present invention is shown. DETAILED DESCRIPTION
[0027] In order to make the purpose, technical solution and advantages of the present invention clearer, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that in the description of the present invention, unless otherwise clearly specified and limited, the term "storage medium" can be various media that can store computer programs, such as ROM, RAM, magnetic disk or optical disk. The term "processor" can be a chip or circuit with data processing function, such as CPLD (Complex Programmable Logic Device), FPGA (Field-Programmable Gate Array), MCU (Microcontroller Unit), PLC (Programmable Logic Controller) and CPU (Central Processing Unit). The term "electronic device" can be any device with data processing function and storage function, which can generally include fixed terminals and mobile terminals. Fixed terminals such as desktop computers. Mobile terminals such as mobile phones, PADs and mobile robots. In addition, the technical features involved in the different embodiments of the present invention described later can be combined with each other as long as they do not conflict with each other.
[0028] In order to better understand the present invention, the present invention is further described below in conjunction with specific embodiments and drawings.
[0029] The video acquisition method provided in this embodiment is applicable to a video conference between at least one first video device and at least one second video device, where the first video device is, for example, a local video device and the second video device is, for example, a remote video device. The first video device is provided with at least one actual camera; the second video device can be the same video device as the first video device or a different video device. The first video device and the second video device are, for example, mobile phones, tablets, desktop computers connected to cameras, etc.
[0030] Video conferencing software is installed in both the first video device and the second video device. The video conferencing software in the first video device and the second video device interact and establish a video connection through the Internet. After the video connection is established, the first video device can transmit video data to the second video device.
[0031] Furthermore, a virtual camera is pre-installed in the first video device, and the window (screen) data of the first video device is format-converted using the virtual camera to obtain video output data, which is displayed in the window of the second video device. The virtual camera is a type of application software that can simulate a real camera.
[0032] The first video device has a first video window, the second video device has a second video window, and the video data transmitted between the first video device and the second video device includes video data acquired by a camera of the first video device and / or window data of the first video window acquired by a virtual camera.
[0033] Figure 1 A flow chart of a video acquisition method according to an embodiment of the present invention is shown. Figure 1 As shown: The method includes:
[0034] S00: Reading a first size ratio and a first coordinate parameter of at least one first video window, and a second size ratio and a second coordinate parameter of at least one second video window.
[0035] In this step, a connection is established between the virtual camera and at least one first video device and at least one second video device. Specifically, the video conferencing software in the first video device and the second video device interact and establish a video connection through the Internet.
[0036] The first size ratio and the first coordinate parameter of the first video window are read through the communication interface between the virtual camera and the first video window; the second size ratio and the second coordinate parameter of the second video window are read through the communication interface between the virtual camera and the second video window.
[0037] S10: Read parameters of interactively operable elements in different presentation modes of at least one first video window.
[0038] The first video window can realize different interactive operations in different presentation modes. Interactive elements include trigger click, drag and drop zoom, move and other elements; the parameters of interactive elements include the area coordinates of the interactive elements relative to the first video window, element size and the like.
[0039] In this step, the parameters of the interactively operable elements in different demonstration modes of the first video window are read via the communication interface between the virtual camera and the first video window.
[0040] S20: Generate a transparent operation window that can simulate interactive operations according to the read parameters of the interactively operable elements in different demonstration modes of at least one first video window.
[0041] This step includes:
[0042] S201: Simulate and generate transparent element blocks of interactively operable elements;
[0043] S202: Overlaying the transparent element block with a transparent image canvas to generate a transparent operation window that can simulate interactive operations.
[0044] Among them, the area coordinates and element size of the transparent element block relative to the transparent image canvas are the same as the area coordinates and element size of the interactive element relative to the first video window.
[0045] S30: Attach the transparent operation window to the second video window.
[0046] In this step, the transparent operation window is scaled proportionally to the same height as the second video window and centered to achieve positioning fit between the transparent operation window and the second video window.
[0047] Normally, the video data and window data of the first video window transmitted by the virtual camera can only be displayed in the second video window, and interactive operations such as clicking cannot be performed; the embodiment of the present invention reads the parameters of the interactive operation elements of the first video window, simulates and generates a transparent operation window that can simulate interactive operations according to the interactive parameters, and simultaneously reads the coordinate size of the second video window, matches and fits the transparent operation window with the second video window, thereby realizing interactive operations of the second video window that receives video data.
[0048] At the same time, the embodiment of the present invention makes the virtual video stream image layer transparent, blocks the interactive elements, reads the coordinate size of the video conference software image window, matches and fits the transparent layer with the conference image layer, and then fits the interactive elements to the video conference window. It is not necessary to frequently switch the software end to control the image in the video conference and other capabilities of the conference software end.
[0049] Figure 2 The schematic diagram of the structure of the video acquisition device of the present invention is shown as follows: Figure 2 As shown, the device comprises:
[0050] A reading module, reading parameters of at least one interactively operable element in different presentation modes of the first video window;
[0051] A generating module, generating a transparent operating window capable of simulating interactive operations according to the parameters of the interactively operable elements in different demonstration modes of at least one first video window read;
[0052] The fitting module fits the transparent operation window with the second video window.
[0053] Furthermore, the reading module is also used to read a first size ratio and a first coordinate parameter of at least one first video window, and a second size ratio and a second coordinate parameter of at least one second video window.
[0054] Furthermore, the generating module comprises:
[0055] Simulation unit, which simulates transparent element tiles that generate interactive elements;
[0056] The overlay unit overlays the transparent element block on the transparent image canvas to generate a transparent operation window that can simulate interactive operations.
[0057] An embodiment of the present invention further provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the computer program is executed in the processor to implement any of the above methods.
[0058] An embodiment of the present invention further provides a storage medium storing a computer program, wherein the computer program can be executed in a processor to implement any of the above methods.
[0059] It should be noted that any of the methods provided in the above embodiments are within the protection scope of the present invention, and any use or storage of these methods is prohibited without permission.
[0060] The embodiments of the present invention are described in detail above, but the contents described are only preferred embodiments of the present invention and cannot be considered to limit the scope of implementation of the present invention. All equivalent changes and improvements made within the scope of the present invention should still fall within the scope of this patent.
Claims
1. A video acquisition method, characterized in that: The method comprises: S10: Reading parameters of at least one interactive element operable in different presentation modes of the first video window; S20: generating a transparent operation window capable of simulating interactive operation according to the parameters of the interactively operable elements in different demonstration modes of the at least one first video window read; S30: Attaching the transparent operation window to the second video window; wherein the first video device has the first video window, the second video device has the second video window, and the video data transmitted between the first video device and the second video device includes the video data acquired by the camera of the first video device and / or the window data of the first video window acquired by the virtual camera; Step S20: The method for generating a transparent operation window capable of simulating interactive operation according to the parameters of the interactively operable elements in different demonstration modes of at least one first video window read includes: S201: Simulate and generate transparent element blocks of interactively operable elements; S202: superimposing the transparent element block on the transparent image canvas to generate a transparent operation window that can simulate interactive operations; The parameters of the interactively operable element include the area coordinates of the interactively operable element relative to the first video window and the element size; The area coordinates and element size of the transparent element block relative to the transparent image canvas are the same as the area coordinates and element size of the interactive element relative to the first video window; Before step S10, the method further includes step S00: reading a first size ratio and a first coordinate parameter of at least one first video window, and a second size ratio and a second coordinate parameter of at least one second video window; In step S30, the transparent operation window is scaled proportionally to be equal in height to the second video window and centered to achieve positioning fit between the transparent operation window and the second video window.
2. A video acquisition device, characterized in that: The device comprises: A reading module, reading parameters of at least one interactively operable element in different presentation modes of the first video window; A generating module, generating a transparent operating window capable of simulating interactive operations according to the parameters of the interactively operable elements in different demonstration modes of at least one first video window read; A pasting module, pasting the transparent operation window with the second video window; wherein the first video device has the first video window, the second video device has the second video window, and the video data transmitted between the first video device and the second video device includes the video data acquired by the camera of the first video device and / or the window data of the first video window acquired by the virtual camera; The generation module comprises: Simulation unit, which simulates transparent element tiles that generate interactive elements; A superimposing unit, superimposing the transparent element block on the transparent image canvas to generate a transparent operation window that can simulate interactive operations; The parameters of the interactively operable element include the area coordinates of the interactively operable element relative to the first video window and the element size; The area coordinates and element size of the transparent element block relative to the transparent image canvas are the same as the area coordinates and element size of the interactive element relative to the first video window; The reading module is specifically used to: read a first size ratio and a first coordinate parameter of at least one first video window, and a second size ratio and a second coordinate parameter of at least one second video window; The superimposing unit is used to proportionally scale the transparent operation window to the same height as the second video window and align them in the center to achieve positioning fit between the transparent operation window and the second video window.
3. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: The computer program is executed in the processor to implement the method of claim 1.
4. A storage medium storing a computer program, characterized in that: The computer program is executed in a processor to implement the method of claim 1.
Citation Information
Patent Citations
Method and device for providing video interaction
CN104301788A
Concurrent use of multiple user interface devices
CN106293755A