Real-time video display method, electronic whiteboard and readable medium

Abstract

The present application relates to real-time display control, in particular to a real-time video display method, an electronic whiteboard and a readable medium.A real-time video display method applied to an electronic whiteboard, comprising: obtaining a first background image before a meeting starts; receiving first change image data and a first position parameter of the first change image data during the meeting; and splicing the first change image data into the first background image based on the first position parameter to display.The video data displayed in the current electronic whiteboard is obtained by splicing the first change image data and the first background image, and the first change image data is essentially part of the obtained real-time video of the meeting, so that the size of the data amount can be reduced, that is, efficient transmission can be performed on a low-speed network, network delay is reduced, and user experience is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to real-time display control, in particular to a real-time video display method, an electronic whiteboard and a readable medium. BACKGROUND

[0002] Due to the restrictions of distance or social status (such as epidemic situation, etc.), more and more business meetings are carried out online. The existing online meeting process is that the electronic whiteboard sends the video data of the current conference room to the electronic whiteboard in the conference room of the opposite party, and receives the video data sent by the electronic whiteboard of the opposite party, so as to realize the visual online meeting interaction. However, with the progress of technology, the current cleaning degree requirement is higher, so that a larger bandwidth is required for data transmission to normally complete the online meeting, otherwise delay, lag and other phenomena will occur. Therefore, the current online meeting field needs to be improved and improved. SUMMARY

[0003] In view of the shortcomings of the prior art, the purpose of the present application is to provide a real-time video display method, an electronic whiteboard and a readable medium, which can improve the flow degree of online meeting.

[0004] In order to achieve the above purpose, the present application adopts the following technical scheme:

[0005] On the one hand, the present application provides a real-time video display method applied to an electronic whiteboard, comprising:

[0006] Before the start of the meeting, a first background image is obtained;

[0007] During the meeting, first change image data and a first position parameter of the first change image data are received; and the first change image data is spliced into the first background image based on the first position parameter for display.

[0008] Further, it further comprises:

[0009] Real-time video data is obtained; and each frame of image data of the real-time video data is compared with a second background image to obtain corresponding second change image data and a second position parameter of the second change image;

[0010] The second change image data is spliced into a third background image based on the second position parameter for display.

[0011] Further, it further comprises:

[0012] Before the start of the meeting, the second background image or the third background image of the current electronic whiteboard is sent to the target electronic whiteboard;

[0013] In the conference, the second changed image data of the current electronic whiteboard and the second position parameter of the second changed image are sent to the target electronic whiteboard.

[0014] Further, the first background image is sent by the target electronic whiteboard, and is a first captured image obtained when the target electronic whiteboard is started, or a second captured image obtained when no one is in a predetermined space where the target electronic whiteboard is located, or a first preset background.

[0015] The second background image is a third captured image obtained when the current electronic whiteboard is started, or a fourth captured image obtained when no one is in a predetermined space where the current electronic whiteboard is located.

[0016] The third background image is the same as the second background image, or a second preset background.

[0017] Further, the electronic whiteboard has a first display area and a second display area.

[0018] The first display area is used to display the spliced first background image, and the second display area is used to display the spliced third background image.

[0019] Further, the generation process of the second changed image data and the second position parameter includes:

[0020] Comparing each pixel between the image data and the second background image;

[0021] Deleting the pixels with the same pixel value, retaining the pixels with different pixel values in the image data to obtain the second changed image data, and recording the coordinate data of the center pixel of the changed image as the second position parameter.

[0022] In another aspect, the present application provides an electronic whiteboard, comprising:

[0023] An interaction module, configured to obtain a first background image before the conference starts, and receive first changed image data and a first position parameter of the first changed image data during the conference.

[0024] A processing module, configured to splice the first changed image data into the first background image based on the first position parameter to display.

[0025] Further, the electronic whiteboard further comprises a camera.

[0026] The camera is configured to obtain real-time video data, and extract each frame of image data of the real-time video data to compare with a second background image to obtain corresponding second changed image data and a second position parameter of the second changed image.

[0027] The processing module is further configured to stitch the second variation image data into a third background image based on the second position parameter to display.

[0028] In another aspect, the present application provides an electronic whiteboard comprising:

[0029] a memory storing a computer program;

[0030] a processor configured to implement the real-time video display method when executing the computer program.

[0031] In another aspect, the present application provides a computer readable medium storing a computer program, which is configured to implement the real-time video display method when executed by a processor.

[0032] Compared with the prior art, the real-time video display method, the electronic whiteboard and the computer readable medium provided by the present application have the following beneficial effects:

[0033] The video data displayed in the current electronic whiteboard is obtained by stitching the first variation image data and the first background image, and the first variation image data is actually part of the conference real-time video, which can reduce the data size, i.e., the high-efficiency transmission in low-speed network, reduce the network delay and improve the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0034] Figure 1 is a flowchart of the real-time video display method provided by the present application.

[0035] Figure 2 is a structural block diagram of the electronic whiteboard provided by the present application. DETAILED DESCRIPTION

[0036] To make the objects, technical solutions and effects of the present application clearer and more explicit, the present application is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific examples described herein are only used to explain the present application and are not intended to limit the present application.

[0037] Those skilled in the art should understand that the foregoing general description and the following detailed description are exemplary and illustrative specific embodiments of the present application, and are not intended to limit the present application.

[0038] As used herein, the terms "comprises," "comprising," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process or method that comprises a list of steps may include not only those steps but may also include other steps not expressly listed or inherent to such process or method. Similarly, a reference to one or more devices or subsystems, elements or structures or components preceded by "comprising ... a" does not, without further limitations, preclude the presence of other devices or other subsystems or other elements or other structures or other components or other devices or other subsystems or other elements or other structures or other components. Throughout this specification, appearances of the phrases "in one embodiment," "in another embodiment," and similar language may, but do not necessarily, all refer to the same embodiment.

[0039] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0040] See also Figure 1 The present invention provides a real-time video display method, which is applied to an electronic whiteboard. The electronic whiteboard is a commonly used electronic whiteboard product in the field, and has components such as a processor, a memory, an interaction module, a camera, and a display module. The present invention does not limit the specific component selection.

[0041] This electronic whiteboard is used for online meetings. The electronic whiteboard in the current meeting room is used as the current electronic whiteboard, and the electronic whiteboard at the other end of the online meeting is used as the target electronic whiteboard. If multiple meeting rooms hold an online meeting together, the electronic whiteboards in all meeting rooms except the current meeting room are used as target electronic whiteboards.

[0042] The real-time video display method comprises:

[0043] Before the meeting starts, a first background image is obtained; that is, before the online meeting starts, the first background image is received from the target electronic whiteboard or transmitted from a host computer, which includes a server, a computer, etc.

[0044] During a conference, first changing image data and first position parameters of the first changing image data are received; and based on the first position parameters, the first changing image data is spliced ​​onto the first background image for display. In other words, the video data currently displayed on the electronic whiteboard is obtained by splicing, and the first changing image data is essentially a portion of the real-time conference video. This reduces data size, enabling efficient transmission over low-speed networks, reducing network latency, and improving user experience.

[0045] Furthermore, in some embodiments, the video data of the current conference room captured by the current electronic whiteboard is directly captured by the camera without any other processing.

[0046] Further, as a preferred solution, the embodiment also includes:

[0047] Obtaining real-time video data; and extracting each frame of image data of the real-time video data and the second background image for comparison to obtain corresponding second change image data and a second position parameter of the second change image. Specifically, the real-time video data is obtained through a camera, and in the embodiment, the camera has a second background image. After obtaining each frame of image data, a processing operation of the second change image is performed once.

[0048] The second change image data is spliced into a third background image based on the second position parameter for display. In the embodiment, the third background image is stored in the processor of the current electronic whiteboard, and the real-time video of the current conference room displayed by the current electronic whiteboard is also spliced to achieve. In this way, the data between the camera and the processor is only change data, which greatly reduces the data transmission amount and improves the display rate.

[0049] Further, the first change data and the first position parameter are generated by a target electronic whiteboard, and the specific generation process includes:

[0050] Obtaining real-time video data; and extracting each frame of image data of the real-time video data and the second background image for comparison to obtain corresponding second change image data and a second position parameter of the second change image. Specifically, the real-time video data is obtained through a camera, and in the embodiment, the camera has a second background image. After obtaining each frame of image data, a processing operation of the second change image is performed once.

[0051] Further, as a preferred solution, the embodiment also includes:

[0052] Before the meeting starts, the second background image or the third background image of the current electronic whiteboard is sent to the target electronic whiteboard. That is, the public background image of the current electronic whiteboard is sent to the target electronic whiteboard, which has the same function as the first background image received by the current electronic whiteboard, and details are not repeated here.

[0053] During the meeting, the second change image data of the current electronic whiteboard and the second position parameter of the second change image are sent to the target electronic whiteboard. That is, the transmission content between the current electronic whiteboard and the target electronic whiteboard is only change data, the data source is small, the network demand is small, the data transmission speed is greatly improved, and the user experience is improved.

[0054] Further, as a preferred solution, in the embodiment, the first background image is obtained by a target electronic whiteboard, and is a first captured image obtained when the target electronic whiteboard is started, or a second captured image obtained when no one is in a predetermined space where the target electronic whiteboard is located, or a first preset background image.

[0055] The second background image is a third captured image obtained when the current electronic whiteboard is started, or a fourth captured image obtained when no one is in a predetermined space where the current electronic whiteboard is located.

[0056] The third background image is the same as the second background image, or a second preset background image. Specifically, the first / second preset background image can be manually set, for example, a picture of a pure color or a scenery picture, so that the conference effect has a certain operability and increases a certain interestingness.

[0057] Further, as a preferred solution, in the embodiment, the electronic whiteboard has a first display area and a second display area.

[0058] The first display area is used for displaying the spliced first background image, and the second display area is used for displaying the spliced third background image. If there are multiple target electronic whiteboards, there are multiple first display areas. In this way, each image has an independent display position, which is convenient for participants to watch.

[0059] Further, as a preferred solution, in the embodiment, the generation process of the second changed image data and the second position parameter includes:

[0060] Comparing each pixel between the image data and the second background image.

[0061] Deleting the pixels with the same pixel value, retaining the pixels with different pixel values in the image data to obtain the second changed image data, and recording the coordinate data of the center pixel of the changed image as the second position parameter. In the embodiment, no optimization operation of the image is involved, and the comparison operation can be performed after general preprocessing operation. Since the same device is used to capture images in the same position for the same conference room, the number of changed positions is small, the number of changed images to be transmitted is small, the amount of data to be calculated is also small, and the calculation amount is small, so that the normal operation of the electronic whiteboard is not affected.

[0062] Correspondingly, please refer to Figure 2 The application provides an electronic whiteboard, which comprises:

[0063] An interaction module is configured to acquire a first background image before a conference starts, and receive first changed image data and a first position parameter of the first changed image data during the conference.

[0064] A processing module is configured to splice the first changed image data into the first background image based on the first position parameter for display.

[0065] Further, as a preferred solution, the embodiment further comprises a camera.

[0066] The camera is configured to acquire real-time video data, and extract each frame of image data of the real-time video data to compare with a second background image to obtain corresponding second changed image data and a second position parameter of the second changed image data.

[0067] The processing module is further configured to splice the second changed image data into a third background image based on the second position parameter for display.

[0068] Correspondingly, the application provides an electronic whiteboard, comprising:

[0069] A memory is configured to store a computer program.

[0070] A processor is configured to execute the computer program to realize the real-time video display method of any embodiment.

[0071] Correspondingly, the application provides a computer readable medium, which is characterized by storing a computer program, and the computer program is executed by a processor to realize the real-time video display method of any embodiment.

[0072] More specific examples of computer readable storage mediums can include but are not limited to an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0073] In this application, a computer readable storage medium can be any tangible medium that can contain, or store computer readable program codes. In this application, a computer readable signal medium can include a data signal traveling in baseband or traveling as part of a carrier wave. Such a propagated data signal can take a wide variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof.

[0074] It can be understood that, for those skilled in the art, equivalent substitutions or changes can be made to the technical solutions and the inventive concept of the present application, and all such changes or substitutions shall fall within the protection scope of the appended claims of the present application.

Claims

1. A real-time video display method, characterized in that: Applied to electronic whiteboards, including: Before the meeting begins, obtain a first background image; During a conference, receiving first changing image data and a first position parameter of the first changing image data; and splicing the first changing image data into the first background image for display based on the first position parameter; The method also includes: Acquire real-time video data; and extract each frame of image data of the real-time video data and compare it with the second background image to obtain corresponding second changing image data and second position parameters of the second changing image; splicing the second changing image data into a third background image based on the second position parameter for display, wherein the third background image is the same image as the second background image or is a second preset background; Before the meeting starts, the second background image or the third background image of the current electronic whiteboard is sent to the target electronic whiteboard; During the meeting, the second changing image data of the current electronic whiteboard and the second position parameter of the second changing image are sent to the target electronic whiteboard; wherein, each pixel between the image data and the second background image is compared; pixels with the same pixel values ​​are deleted, and pixels with different pixel values ​​in the image data are retained to obtain the second changing image data, and the coordinate data of the center pixel of the second changing image is recorded as the second position parameter.

2. The real-time video display method according to claim 1, wherein: The first background image is obtained by being sent by the target electronic whiteboard, and is a first captured image obtained when the target electronic whiteboard is turned on, or a second captured image when no one is in the predetermined space where the target electronic whiteboard is located, or a first preset background; The second background image is a third captured image obtained when the current electronic whiteboard is powered on, or a fourth captured image when no one is in the predetermined space where the current electronic whiteboard is located.

3. The real-time video display method according to claim 1, wherein: The electronic whiteboard has a first display area and a second display area; The first display area is used to display the spliced ​​first background image; the second display area is used to display the spliced ​​third background image.

4. The real-time video display method according to claim 1, wherein: The process of generating the second changing image data and the second position parameter includes: comparing each pixel between the image data and a second background image; Pixels with the same pixel value are deleted, and pixels with different pixel values ​​in the image data are retained to obtain the second changed image data, and the coordinate data of the center pixel of the changed image is recorded as the second position parameter.

5. An electronic whiteboard, characterized in that: include: The interactive module is used to obtain a first background image before the meeting starts; During a conference, receiving first changing image data and a first position parameter of the first changing image data; a processing module, configured to splice the first changing image data into the first background image for display based on the first position parameter; Camera, used to obtain real-time video data; and extracting each frame of image data of the real-time video data and comparing it with the second background image to obtain corresponding second changing image data and second position parameters of the second changing image; The processing module is further configured to splice the second changing image data into a third background image based on the second position parameter for display, wherein the third background image is the same image as the second background image or is a second preset background; Before the meeting starts, the second background image or the third background image of the current electronic whiteboard is sent to the target electronic whiteboard; During the meeting, the second changing image data of the current electronic whiteboard and the second position parameter of the second changing image are sent to the target electronic whiteboard; wherein, each pixel between the image data and the second background image is compared; pixels with the same pixel values ​​are deleted, and pixels with different pixel values ​​in the image data are retained to obtain the second changing image data, and the coordinate data of the center pixel of the second changing image is recorded as the second position parameter.

6. An electronic whiteboard, characterized in that: include: a memory storing a computer program; A processor, which implements the real-time video display method according to any one of claims 1 to 4 when executing the computer program.

7. A computer-readable medium, characterized in that A computer program is stored, and when the computer program is executed by a processor, the real-time video display method according to any one of claims 1 to 5 is implemented.

Images