Image processing method and device

Abstract

The embodiment of the invention provides an image processing method and device, and the method comprises the steps: a first conference terminal receives a picture superposition instruction which is transmitted by a first server for flow adjustment in a first network conference and is used for carrying out the superposition display of video image data of a spokesman conference terminal and spokesman image data, the picture superposition instruction is generated for a first conference control operation of the conference control terminal; obtaining video image data and spokesman image data in the first network conference based on the picture superposition instruction; performing fusion based on the video image data and the spokesman image data to generate superimposed image data; and sending the superimposed image data to a first server, so that the first server forwards the superimposed image data to a second conference terminal in the first network conference. Through the embodiment of the invention, the video image data and the spokesman image data can be fused, the visual effect and interactivity of the video conference are improved, the operation process is simplified, the conference efficiency is improved, and the method is suitable for various video conference scenes.

Description

Technical Field

[0001] The present invention relates to the field of image data processing, and in particular to an image processing method and device. Background Art

[0002] When sharing PPT, traditional video conferencing systems often cannot clearly display both the PPT content and the speaker's video at the same time, which limits the interactivity and efficiency of the meeting. Summary of the invention

[0003] In view of the above problems, an image processing method and apparatus are proposed to overcome the above problems or at least partially solve the above problems, including:

[0004] An image processing method, applied to a first conference terminal, comprising:

[0005] The first conference terminal receives a screen overlay instruction for overlaying and displaying video image data of the speaker conference terminal and speaker image data, which is forwarded by a first server for stream modulation in a first network conference, wherein the screen overlay instruction is generated by a first conference control operation of the conference control terminal;

[0006] The first conference terminal acquires the video image data and the speaker image data in the first network conference based on the picture overlay instruction;

[0007] The first conference terminal generates superimposed image data by fusing the video image data and the speaker image data;

[0008] The first conference terminal sends the overlay image data to the first server, so that the first server forwards the data to the second conference terminal in the first network conference.

[0009] Optionally, the first conference terminal generates superimposed image data by fusing the video image data and the speaker image data, including:

[0010] The first conference terminal sends the video image data and the speaker image data to a second server for image fusion, so that the second server fuses the video image data and the speaker image data to generate superimposed image data;

[0011] Receive the overlay image data sent by the second server.

[0012] Optionally, it also includes:

[0013] The first conference terminal responds to the image parameter adjustment operation on the superimposed image data and adjusts the image parameters of the superimposed image data according to the image parameter adjustment operation.

[0014] Optionally, it also includes:

[0015] The first conference terminal receives a closing instruction forwarded by the first server for closing the overlay image data;

[0016] According to the closing instruction, the fusion process of the video image data and the speaker image data is stopped.

[0017] Optionally, it also includes:

[0018] When the first conference terminal is the target speaking terminal, auxiliary stream following is enabled based on the screen overlay instruction to synchronize the video image data with the speaker image data.

[0019] An image processing method, applied to a conference control terminal, comprises:

[0020] The conference control terminal generates a screen overlay instruction for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data in response to a first conference control operation in the first network conference terminal for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data;

[0021] The conference control terminal sends the screen overlay instruction to the first server, so that the first server forwards the screen overlay instruction to the first conference terminal in the first network conference, and the first conference terminal is used to obtain the video image data and the speaker image data in the first network conference based on the screen overlay instruction; the first conference terminal fuses the video image data and the speaker image data to generate overlay image data, and the first conference terminal sends the overlay image data to the first server.

[0022] Optionally, it also includes:

[0023] The conference control terminal generates a closing instruction in response to a second conference control operation for closing the overlay image data in the first network conference;

[0024] The conference control terminal sends the closing instruction to the first server, so that the first server forwards it to the first conference terminal.

[0025] Optionally, it also includes:

[0026] The conference control terminal generates a speaker switching instruction in response to a third conference control operation of switching a speaker in the first network conference terminal;

[0027] The speaker switching instruction is sent to the first server, so that the first server switches the current speaker in the first network conference to the speaker corresponding to the speaker switching instruction.

[0028] An image superposition device, applied to a first conference terminal, comprising:

[0029] A screen overlay instruction receiving module, used to receive a screen overlay instruction for overlaying and displaying video image data of a speaker conference terminal and speaker image data, forwarded by a first server used for stream modulation in a first network conference, wherein the screen overlay instruction is generated by a first conference control operation of a conference control terminal;

[0030] An image data acquisition module, used to acquire video image data and speaker image data in the first network conference based on the screen overlay instruction;

[0031] An image fusion module, configured for the first conference terminal to fuse the video image data and the speaker image data to generate superimposed image data;

[0032] The overlay image sending module is used to send the overlay image data to the first server, so that the first server forwards it to the second conference terminal in the first network conference.

[0033] An image overlay device is applied to a conference control terminal, and the method includes:

[0034] A screen overlay instruction generating module, for generating a screen overlay instruction for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data in response to a first conference control operation for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data in the first network conference terminal;

[0035] A screen overlay instruction sending module is used to send the screen overlay instruction to the first server, so that the first server forwards the screen overlay instruction to the first conference terminal in the first network conference, and the first conference terminal is used to obtain the video image data and the speaker image data in the first network conference based on the screen overlay instruction; the first conference terminal fuses the video image data and the speaker image data to generate overlay image data, and the first conference terminal sends the overlay image data to the first server.

[0036] The embodiments of the present invention have the following advantages:

[0037] In an embodiment of the present invention, a first conference terminal receives a screen overlay instruction for superimposing and displaying video image data of a spokesperson conference terminal and speaker image data, which is forwarded by a first server for stream modulation in a first network conference. The screen overlay instruction is generated for a first conference control operation of the conference control terminal; based on the screen overlay instruction, video image data and speaker image data in the first network conference are obtained; superimposed image data is generated based on the fusion of the video image data and the speaker image data; the superimposed image data is sent to the first server, so as to be forwarded by the first server to the second conference terminal in the first network conference, thereby realizing the fusion of video image data and speaker image data, improving the visual effect and interactivity of the video conference, simplifying the operation process, and improving the conference efficiency, which is applicable to a variety of video conferencing scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solution of the present invention, the accompanying drawings required for use in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0039] Figure 1 is a flowchart of a method for image processing provided by an embodiment of the present invention;

[0040] Figure 2 is a flowchart of another image processing method provided by an embodiment of the present invention;

[0041] Figure 3 is a structural schematic diagram of an image superposition device provided by an embodiment of the present invention;

[0042] Figure 4 It is a schematic structural diagram of another image superposition device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0043] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0044] Reference Figure 1 , shows a flowchart of an image processing method provided by an embodiment of the present invention, which is applied to a first conference terminal and may specifically include the following steps:

[0045] Step S101, a first conference terminal receives a screen overlay instruction for overlaying and displaying video image data of a speaker conference terminal and speaker image data, which is forwarded by a first server for stream modulation in a first network conference, and the screen overlay instruction is generated by a first conference control operation of the conference control terminal;

[0046] In practical applications, the first conference terminal may be a current speaking terminal or a non-speaking terminal that can obtain speaker image data and video image data in the conference.

[0047] In the first network conference, the conference control terminal can be used to control the first network conference. The conference control content includes starting a conference, stopping a conference, interrupting a conference, switching speakers, etc. In the embodiment of the present invention, the conference control terminal can also control turning on or off screen overlay.

[0048] The first server may be connected to a conference control terminal, and may also be connected to one or more conference terminals. A conference control instruction of the conference control terminal may be sent to the first server, and the first server schedules video streams between the multiple conference terminals according to the conference control instruction.

[0049] In the embodiment of the present invention, the conference controller of the conference control terminal performs the first conference control operation to enable the screen overlay function in the first network conference, and the screen overlay function can enable the conference terminal to present the overlay screen of the conference video data and the speaker image data. Therefore, the conference video data and the speaker image data can be viewed simultaneously on the conference terminal interface.

[0050] The conference controlling terminal can generate a screen overlay instruction in response to the first conference controlling operation, and then send the screen overlay instruction to the first server. The first server can send the screen overlay instruction to each conference terminal in the first network conference, including the first conference terminal, so that each conference terminal determines to turn on the screen overlay function.

[0051] Among them, the first network is a visual network, the first network conference is a visual network conference, the conference control terminal can be a Pamir conference control terminal, the first server can be an integrated management server in the visual network, and the first conference terminal can be a visual network conference terminal in the visual network.

[0052] Step S102, the first conference terminal obtains video image data and speaker image data in the first network conference based on the screen overlay instruction;

[0053] The video image data is the video data shared in the first network conference, such as the PPT data shared by the speaker in real time, and the speaker image data is the image data collected for the speaker, which may include the face image of the current speaker. In practical applications, the speaker image data may be collected by a collection device in the first network conference, and the collection device may be a camera device in the conference venue.

[0054] After receiving the picture overlay instruction, the first conference terminal may start the picture overlay function, and then obtain relevant image data, such as video image data and speaker image data.

[0055] When the first conference terminal is the target speaking terminal, the video image data may be the video image data to be shared by the first conference terminal, and the speaker image data may be the image data collected by an image acquisition device connected to the first conference terminal for the speaker of the first conference terminal. The first conference terminal may obtain the speaker image data from the acquisition device.

[0056] When the first conference terminal is not the target speaking terminal, the video image data and the speaker image data are forwarded from the target speaking terminal to the first conference terminal by the first server.

[0057] In one embodiment of the present invention, when the first conference terminal is the target speaking terminal, auxiliary stream following is enabled based on the screen overlay instruction to synchronize the video image data with the speaker image data.

[0058] In actual applications, when the first conference terminal is the target speaking terminal, auxiliary stream following can be turned on when receiving the screen overlay instruction, so that the video image data can be synchronized with the speaker image data to generate a synchronized overlay screen and optimize the visual experience of the participants.

[0059] Step S103, the first conference terminal fuses the video image data and the speaker image data to generate superimposed image data;

[0060] In the first conference terminal, the video image data and the speaker image data can be fused based on its own image processing technology.

[0061] In one embodiment of the present invention, the first conference terminal generates superimposed image data based on the fusion of video image data and speaker image data, including: the first conference terminal sends the video image data and the speaker image data to a second server used for image fusion, so that the second server fuses the video image data and the speaker image data to generate superimposed image data; and receives the superimposed image data sent by the second server.

[0062] In practical applications, the first conference terminal may be connected to a third-party second server for image processing, so that the video image data and the speaker image data may be sent to the second server for image fusion processing.

[0063] In one example, the second server may be an image processing server in a second network, and the second network may be a non-visual network, such as the Internet.

[0064] For example, the video conferencing terminal can collect and encode the PPT video and the speaker's video in real time, and then send it to the second server through the network. After the second server receives the video stream, it first decodes it, and then performs frequency overlap processing on the two video streams through the image processing server. The extracted portrait area is fused with the PPT video screen to form a frequency overlap video screen (i.e., superimposed image data). During the fusion process, the position, size, transparency and other parameters of the portrait window can also be adjusted to meet the needs of different conference scenarios.

[0065] The second server can re-encode the processed superimposed video images and send them to the first conference terminal, and then the first conference terminal can forward them to the display devices of all participants through the first server. Therefore, all participants can see the speaker's image and the PPT superimposed image.

[0066] In one embodiment of the present invention, the first conference terminal responds to the image parameter adjustment operation for the superimposed image data and adjusts the image parameters of the superimposed image data according to the image parameter adjustment operation.

[0067] The image parameters of the superimposed image data may include image parameters such as the position, size and transparency of the portrait window.

[0068] In actual applications, the user of the first conference terminal can adjust the generated superimposed image data to optimize the superimposed image data. Specifically, the image parameter adjustment operation can be performed on the superimposed image data, and then the image parameters of the superimposed image data can be adjusted according to the image parameter adjustment operation to enhance interactivity and personalized experience.

[0069] Step S104: the first conference terminal sends the overlay image data to the first server, so that the first server forwards the overlay image data to the second conference terminal in the first network conference.

[0070] The first conference terminal sends the generated overlay image data to the first server, and then the first server sends it to one or more second conference terminals in the first network conference, so that the second conference can present the overlay image data.

[0071] In one embodiment of the present invention, the first conference terminal receives a closing instruction forwarded by the first server for closing the superimposed image data; and stops the fusion process of the video image data and the speaker image data according to the closing instruction.

[0072] In actual application, when the conference controller of the conference control terminal executes the second control instruction, the conference control terminal responds to the second control instruction and generates a closing instruction for closing the overlay image data. The closing instruction is used to close the screen overlay function of the conference terminal and restore normal video image data display.

[0073] After generating a closing instruction, the conference control terminal can send the closing instruction to the first server, which will then send the closing instruction to one or more conference terminals connected to it, including the first conference terminal. The first conference terminal can then stop the fusion process of the video image data and the speaker image data that is currently being or about to be executed in accordance with the closing instruction.

[0074] In an embodiment of the present invention, a first conference terminal receives a screen overlay instruction for superimposing and displaying video image data of a spokesperson conference terminal and speaker image data, which is forwarded by a first server for stream modulation in a first network conference. The screen overlay instruction is generated for a first conference control operation of the conference control terminal; based on the screen overlay instruction, video image data and speaker image data in the first network conference are obtained; superimposed image data is generated based on the fusion of the video image data and the speaker image data; the superimposed image data is sent to the first server, so as to be forwarded by the first server to the second conference terminal in the first network conference, thereby realizing the fusion of video image data and speaker image data, improving the visual effect and interactivity of the video conference, simplifying the operation process, and improving the conference efficiency, which is applicable to a variety of video conferencing scenarios.

[0075] Reference Figure 2 , shows a flowchart of another image processing method provided by an embodiment of the present invention, which is applied to a conference control terminal and may specifically include the following steps:

[0076] Step S201, the conference control terminal generates a screen overlay instruction for overlaying the video image data of the speaker conference terminal and the speaker image data in response to a first conference control operation in the first network conference terminal for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data;

[0077] In actual applications, the conference control personnel perform the first conference control operation on the conference control terminal to enable the conference terminal to enable the screen overlay function. The conference control terminal can be limited to generating a screen overlay instruction based on the first conference control operation. The screen overlay execution is used to control the conference terminal to overlay and display the video image data of the speaker's conference terminal and the speaker's image data.

[0078] In step S202, the conference control terminal sends the screen overlay instruction to the first server, so that the first server forwards the screen overlay instruction to the first conference terminal in the first network conference. The first conference terminal is used to obtain the video image data and the speaker image data in the first network conference based on the screen overlay instruction; the first conference terminal generates overlay image data based on the fusion of the video image data and the speaker image data, and the first conference terminal sends the overlay image data to the first server.

[0079] The conference control terminal can send the generated screen overlay instruction to the first server, and then the first server can forward the screen overlay instruction to the first conference terminal, and the first conference terminal executes the screen overlay instruction, obtains video image data and speaker image data, and realizes the fusion processing of video image data and speaker image data to obtain overlay image data, and then feeds back the overlay image data to the first server. The first server distributes it to the second conference terminal in the first network conference. Then the conference terminal of the first network conference terminal can present the overlay image data.

[0080] In one embodiment of the present invention, the conference control terminal generates a closing instruction in response to the second conference control operation for closing the overlay image data in the first network conference; the conference control terminal sends the closing instruction to the first server, which is forwarded by the first server to the first conference terminal.

[0081] In one embodiment of the present invention, the conference control terminal generates a speaker switching instruction in response to the third conference control operation of switching the speaker in the first network conference terminal; and sends the speaker switching instruction to the first server so that the first server switches the current speaker in the first network conference to the speaker corresponding to the speaker switching instruction.

[0082] In actual applications, the conference control personnel can switch the speaker on the conference control terminal line and generate a speaker switching instruction.

[0083] In another example, during the first network conference, screen polling can be enabled through the conference control terminal. Specifically, the initial conference terminal to be spoken can be selected in the conference control terminal, and the polling time interval and polling mode (forward polling, reverse polling) can be set to enable screen polling. The conference control terminal can generate a speaker switching instruction based on the polling interval and the polling mode, and push the speaker switching instruction to the first server, so that the first server executes the speaker switching instruction to switch the current speaker.

[0084] When the conference control terminal finishes screen polling, it stops sending the speaker switching instruction to the first server.

[0085] In an embodiment of the present invention, the conference control terminal responds to the first conference control operation in the first network conference terminal for superimposing and displaying the video image data of the speaker conference terminal and the speaker image data, and generates a screen overlay instruction for superimposing and displaying the video image data of the speaker conference terminal and the speaker image data; the conference control terminal sends the screen overlay instruction to the first server, so that the first server forwards the screen overlay instruction to the first conference terminal in the first network conference, and the first conference terminal is used to obtain the video image data and the speaker image data in the first network conference based on the screen overlay instruction; based on the fusion of the video image data and the speaker image data, the superimposed image data is generated, and the superimposed image data is sent to the first server, so that the video image data and the speaker image data can be fused, the visual effect and interactivity of the video conference can be improved, the operation process can be simplified, and the meeting efficiency can be improved, which is suitable for a variety of video conferencing scenarios.

[0086] In an embodiment of the present invention, the conference control terminal responds to the first conference control operation in the first network conference terminal for superimposing and displaying the video image data of the speaker conference terminal and the speaker image data, and generates a screen overlay instruction for superimposing and displaying the video image data of the speaker conference terminal and the speaker image data; the conference control terminal sends the screen overlay instruction to the first server, so that the first server forwards the screen overlay instruction to the first conference terminal in the first network conference, and the first conference terminal is used to obtain the video image data and the speaker image data in the first network conference based on the screen overlay instruction; based on the fusion of the video image data and the speaker image data, the superimposed image data is generated, and the superimposed image data is sent to the first server, so that the video image data and the speaker image data can be fused, the visual effect and interactivity of the video conference can be improved, the operation process can be simplified, and the meeting efficiency can be improved, which is suitable for a variety of video conferencing scenarios.

[0087] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0088] Reference Figure 3 , shows a schematic diagram of the structure of an image processing device provided by an embodiment of the present invention, which may specifically include the following modules:

[0089] A screen overlay instruction receiving module 301 is used to receive a screen overlay instruction for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data, which is forwarded by a first server for stream modulation in a first network conference, wherein the screen overlay instruction is generated by a first conference control operation of the conference control terminal;

[0090] An image data acquisition module 302, configured to acquire video image data and speaker image data in the first network conference based on the screen overlay instruction;

[0091] An image fusion module 303, configured for the first conference terminal to fuse the video image data and the speaker image data to generate superimposed image data;

[0092] The overlay image sending module 304 is used to send the overlay image data to the first server, so that the first server forwards it to the second conference terminal in the first network conference.

[0093] In one embodiment of the present invention, the image fusion module 303 may include:

[0094] An image forwarding processing submodule, used for sending the video image data and the speaker image data to a second server used for image fusion, so that the second server fuses the video image data and the speaker image data to generate superimposed image data;

[0095] The overlay image data receiving submodule is used to receive the overlay image data sent by the second server.

[0096] In one embodiment of the present invention, the device further comprises:

[0097] The image parameter adjustment module is used to respond to the image parameter adjustment operation for the superimposed image data and adjust the image parameters of the superimposed image data according to the image parameter adjustment operation.

[0098] In one embodiment of the present invention, the device further comprises:

[0099] A closing instruction generating module, used for the first conference terminal to receive a closing instruction forwarded by the first server for closing the overlay image data;

[0100] The fusion stopping module is used to stop the fusion process of the video image data and the speaker image data according to the closing instruction.

[0101] In one embodiment of the present invention, the device further comprises:

[0102] The auxiliary stream following starting module is used to start auxiliary stream following based on the picture overlay instruction when the first conference terminal is a target speaking terminal, so as to synchronize the video image data and the speaker image data.

[0103] In an embodiment of the present invention, a first conference terminal receives a screen overlay instruction for superimposing and displaying video image data of a spokesperson conference terminal and speaker image data, which is forwarded by a first server for stream modulation in a first network conference. The screen overlay instruction is generated for a first conference control operation of the conference control terminal; based on the screen overlay instruction, video image data and speaker image data in the first network conference are obtained; superimposed image data is generated based on the fusion of the video image data and the speaker image data; the superimposed image data is sent to the first server, so as to be forwarded by the first server to the second conference terminal in the first network conference, thereby realizing the fusion of video image data and speaker image data, improving the visual effect and interactivity of the video conference, simplifying the operation process, and improving the conference efficiency, which is applicable to a variety of video conferencing scenarios.

[0104] Reference Figure 4 , shows a schematic structural diagram of an image superposition device provided by an embodiment of the present invention, which may specifically include the following modules:

[0105] The screen overlay instruction generating module 401 is used to generate a screen overlay instruction for overlaying the video image data of the speaker conference terminal and the speaker image data in response to a first conference control operation for overlaying the video image data of the speaker conference terminal and the speaker image data in the first network conference terminal;

[0106] The screen overlay instruction sending module 402 is used to send the screen overlay instruction to the first server, so that the first server forwards the screen overlay instruction to the first conference terminal in the first network conference, and the first conference terminal is used to obtain the video image data and the speaker image data in the first network conference based on the screen overlay instruction; the first conference terminal fuses the video image data and the speaker image data to generate overlay image data, and the first conference terminal sends the overlay image data to the first server

[0107] In one embodiment of the present invention, the device further comprises:

[0108] A closing instruction generating module, configured for the conference control terminal to generate a closing instruction in response to a second conference control operation for closing the overlay image data in the first network conference;

[0109] The closing instruction sending module is used for the conference control terminal to send the closing instruction to the first server, so that the first server forwards it to the first conference terminal.

[0110] In one embodiment of the present invention, the device further comprises:

[0111] a speaker switching instruction generating module, configured for the conference control terminal to generate a speaker switching instruction in response to a third conference control operation of switching a speaker in the first network conference terminal;

[0112] The speaker switching module is used to send the speaker switching instruction to the first server, so that the first server switches the current speaker in the first network conference to the speaker corresponding to the speaker switching instruction.

[0113] An embodiment of the present invention further provides an electronic device, which may include a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and the computer program implements the above image processing method when executed by the processor.

[0114] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the above image processing method is implemented.

[0115] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0116] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0117] Those skilled in the art will appreciate that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0118] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0119] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0120] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0121] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0122] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0123] The above is a detailed introduction to the provided image processing method and device. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. An image processing method, characterized in that: Applied to a first conference terminal, the method includes: The first conference terminal receives a screen overlay instruction for overlaying and displaying video image data of the speaker conference terminal and speaker image data, which is forwarded by a first server for stream modulation in a first network conference, wherein the screen overlay instruction is generated by a first conference control operation of the conference control terminal; The first conference terminal acquires the video image data and the speaker image data in the first network conference based on the picture overlay instruction; The first conference terminal generates superimposed image data by fusing the video image data and the speaker image data; The first conference terminal sends the overlay image data to the first server, so that the first server forwards the data to the second conference terminal in the first network conference.

2. The method according to claim 1, characterized in that The first conference terminal generates superimposed image data by fusing the video image data and the speaker image data, including: The first conference terminal sends the video image data and the speaker image data to a second server for image fusion, so that the second server fuses the video image data and the speaker image data to generate superimposed image data; Receive the overlay image data sent by the second server.

3. The method according to claim 1, characterized in that Also includes: The first conference terminal responds to the image parameter adjustment operation on the superimposed image data and adjusts the image parameters of the superimposed image data according to the image parameter adjustment operation.

4. The method according to claim 1, characterized in that: Also includes: The first conference terminal receives a closing instruction forwarded by the first server for closing the overlay image data; According to the closing instruction, the fusion process of the video image data and the speaker image data is stopped.

5. The method according to claim 1, characterized in that Also includes: When the first conference terminal is the target speaking terminal, auxiliary stream following is enabled based on the screen overlay instruction to synchronize the video image data with the speaker image data.

6. An image processing method, characterized in that: Applied to a conference control terminal, the method includes: The conference control terminal generates a screen overlay instruction for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data in response to a first conference control operation in the first network conference terminal for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data; The conference control terminal sends the screen overlay instruction to the first server, so that the first server forwards the screen overlay instruction to the first conference terminal in the first network conference, and the first conference terminal is used to obtain the video image data and the speaker image data in the first network conference based on the screen overlay instruction; the first conference terminal fuses the video image data and the speaker image data to generate overlay image data, and the first conference terminal sends the overlay image data to the first server.

7. The method according to claim 6, characterized in that Also includes: The conference control terminal generates a closing instruction in response to a second conference control operation for closing the overlay image data in the first network conference; The conference control terminal sends the closing instruction to the first server, so that the first server forwards it to the first conference terminal.

8. The method according to claim 6, characterized in that Also includes: The conference control terminal generates a speaker switching instruction in response to a third conference control operation of switching a speaker in the first network conference terminal; The speaker switching instruction is sent to the first server, so that the first server switches the current speaker in the first network conference to the speaker corresponding to the speaker switching instruction.

9. An image processing device, characterized in that: Applied to a first conference terminal, the device includes: A screen overlay instruction receiving module, used to receive a screen overlay instruction for overlaying and displaying video image data of a speaker conference terminal and speaker image data, forwarded by a first server used for stream modulation in a first network conference, wherein the screen overlay instruction is generated by a first conference control operation of a conference control terminal; An image data acquisition module, used to acquire video image data and speaker image data in the first network conference based on the screen overlay instruction; An image fusion module, configured for the first conference terminal to fuse the video image data and the speaker image data to generate superimposed image data; The overlay image sending module is used to send the overlay image data to the first server, so that the first server forwards it to the second conference terminal in the first network conference.

10. An image processing device, characterized in that: Applied to a conference control terminal, the method includes: A screen overlay instruction generating module, for generating a screen overlay instruction for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data in response to a first conference control operation for overlaying and displaying the video image data of the speaker conference terminal and the speaker image data in the first network conference terminal; A screen overlay instruction sending module is used to send the screen overlay instruction to the first server, so that the first server forwards the screen overlay instruction to the first conference terminal in the first network conference, and the first conference terminal is used to obtain the video image data and the speaker image data in the first network conference based on the screen overlay instruction; the first conference terminal fuses the video image data and the speaker image data to generate overlay image data, and the first conference terminal sends the overlay image data to the first server.

Images