Video processing method and device, and storage medium

Abstract

Disclosed in the present disclosure are a video processing method and device, and a storage medium. The method comprises: acquiring an identifier of a target person and a shared data picture, wherein the shared data picture is a video picture corresponding to shared data, the target person is a person who participates in a discussion and / or operates the shared data among conference participants, the conference participants are persons who use conference participation terminals to participate in a video conference and a data conference, and the shared data is data shared in the data conference; superimposing the identifier of the target person onto the shared data picture, so as to obtain a first target video; and sending the first target video to the conference participation terminals.

Description

Video processing method, device and storage medium

[0001] This disclosure claims priority to Chinese patent application No. 202310791399.9, filed on June 29, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present disclosure relates to the field of video processing technology, and in particular to a video processing method, device, and storage medium. Background Art

[0003] Video conferencing enables face-to-face communication remotely through voice and video, while data conferencing enables remote information exchange through shared data screens (such as a shared whiteboard or desktop). In many remote conferencing scenarios, video conferencing and data conferencing need to work together synchronously to meet user needs.

[0004] Summary of the Invention

[0005] On the one hand, a video processing method is provided, including: obtaining the identification of a target person and a shared data screen; the shared data screen is a video screen corresponding to the shared data; wherein the target person is a person among the participants who participates in the discussion and / or operates the shared data; the participant is a person who uses a participant terminal to participate in the video conference and the data conference, and the shared data is the data shared by the data conference; superimposing the identification of the target person on the shared data screen to obtain a first target video; and sending the first target video to the participant terminal.

[0006] On the other hand, a video processing device is provided, including: an acquisition unit for acquiring the identification of a target person and a shared data screen; the shared data screen is a video screen corresponding to the shared data; wherein the target person is a person among the participants who participates in the discussion and / or operates the shared data; the participants are persons who use a participant terminal to participate in the video conference and the data conference, and the shared data is the data shared by the data conference; a processing unit for superimposing the identification of the target person on the shared data screen to obtain a first target video; and a sending unit for sending the first target video to the participant terminal.

[0007] On the other hand, a video processing device is provided, comprising: a memory and a processor; the memory and the processor are coupled; the memory is used to store a computer program; and the processor implements the video processing method described in any one of the above aspects or embodiments when executing the computer program.

[0008] On the other hand, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the video processing method according to any one of the above aspects or embodiments is implemented.

[0009] On the other hand, a computer program product is provided, which includes computer program instructions, and when the computer program instructions are executed by a processor, the video processing method according to any one of the above aspects or embodiments is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the present disclosure, the following briefly introduces the drawings required for use in some embodiments of the present disclosure. Obviously, the drawings described below are only drawings of some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0011] FIG1 is a schematic diagram of an implementation environment involved in a video processing method provided in some embodiments of the present disclosure.

[0012] FIG2 is a flowchart of a video processing method provided by some embodiments of the present disclosure.

[0013] FIG3 is a schematic diagram of a terminal interface provided by some embodiments of the present disclosure.

[0014] FIG4 is a schematic diagram of another terminal interface provided by some embodiments of the present disclosure.

[0015] FIG5 is a schematic diagram of another terminal interface provided by some embodiments of the present disclosure.

[0016] FIG6 is a schematic diagram of another terminal interface provided by some embodiments of the present disclosure.

[0017] FIG7 is a schematic diagram of another terminal interface provided by some embodiments of the present disclosure.

[0018] FIG8 is a schematic diagram of another terminal interface provided by some embodiments of the present disclosure.

[0019] FIG9 is a schematic structural diagram of a video processing device provided by some embodiments of the present disclosure.

[0020] FIG10 is a schematic structural diagram of another video processing device provided in some embodiments of the present disclosure. DETAILED DESCRIPTION

[0021] The following will clearly and completely describe the technical solutions of this disclosure in conjunction with the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of this disclosure, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of this disclosure without making any creative efforts shall fall within the scope of protection of this disclosure.

[0022] It should be noted that in this disclosure, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this disclosure as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present related concepts in some way.

[0023] In the following, the terms "first," "second," etc. are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the quantity of the technical features indicated. Therefore, a feature specified as "first," "second," etc. may explicitly or implicitly include one or more of the features.

[0024] In the description of this disclosure, unless otherwise specified, " / " means "or." For example, A / B can mean A or B. "And / or" herein is simply a way to describe an association relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: only A, only B, and both A and B. Furthermore, "at least one" means one or more, and "a plurality" means two or more.

[0025] Traditionally, video conferencing typically involves adding a secondary video channel to a simultaneous data conference. This method uses the added secondary video channel to display the shared data screen across multiple conference endpoints. Users can see the content written on the shared data screen on the conference endpoint screens. In traditional video and data conferencing, video and shared data are displayed separately, preventing participants from simultaneously viewing the shared data and the individuals discussing / operating on it in the same interface. Furthermore, when multiple participants are discussing or writing on the shared data screen, other participants are unable to immediately determine who is currently speaking or writing, causing inconvenience and diminishing the overall experience and sense of authenticity.

[0026] Based on this, the disclosed embodiments propose a video processing method in which the target person's identifier is superimposed on a shared data screen and sent to a participant terminal. It is understood that the video screen displayed on the participant terminal simultaneously includes the target person's identifier and the shared data screen. When the target person speaks or writes in the shared data screen, the participant terminal will synchronously display the target person's identifier, allowing participants to promptly perceive the identity of the person currently speaking or writing, increasing their sense of reality and experience.

[0027] The implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0028] Please refer to FIG. 1 , which shows an implementation environment involved in a video processing method provided by an embodiment of the present disclosure. The implementation environment includes: a multi-point control unit (MCU) 110 , a data conferencing device 120 and a terminal 130 .

[0029] MCU 110 is a key device in a multi-point video conferencing system. It functions like a switch, separating the information flows from each conference site synchronously and extracting audio, video, data, and signaling information. It then feeds the information and signaling from each conference site into a single processing module, completing processes such as audio mixing or switching, video mixing or switching, data broadcasting and routing, timing, and conference control. Finally, it reassembles the various information required by each conference site and sends it to the corresponding terminal system devices.

[0030] In the disclosed embodiments, the MCU 110 is used to hold video conferences, encode and decode videos, and coordinate communications between various devices. For example, the MCU 110 can support multiple terminals in a video conference. Each terminal participating in the video conference communicates with the MCU 110. The MCU 110 manages video conferencing resources, negotiates between multiple terminals to determine the audio or video encoder / decoder to use, and processes media streams.

[0031] In one possible implementation, MCU 110 includes a decoding module 111 and a data conferencing processing module 112. Decoding module 111 may be a hardware or software module with video decoding and video processing functions. Data conferencing processing module 112 may be a hardware or software module for communicating with data conferencing devices.

[0032] The data conference device 120 is used to hold a data conference and can support multiple terminals to share data. The shared data can include, for example, sharing the content displayed on the desktop or the content displayed on the whiteboard.

[0033] Illustratively, the data conferencing device 120 may be a computing device such as a server, a terminal, a notebook, a desktop computer, or a handheld computer.

[0034] Terminal 130 is used to participate in video and / or data conferences and can send and receive information, video or data conference requests, etc., and can also encode and decode video and directly or indirectly capture video. In the disclosed embodiments, a terminal 130 participating in a video and / or data conference is referred to as a participating terminal, and a terminal among the participating terminals that participates in discussions and / or operates shared data is referred to as a target terminal.

[0035] Exemplarily, the terminal 130 may include a mobile phone, a tablet computer, a desktop computer, a laptop computer, a PDA or other devices.

[0036] In the embodiment of the present disclosure, the MCU 110 and the data conferencing device 120 can be integrated together or independently configured and connected via a network. The embodiment of the present disclosure does not limit the specific configuration of the MCU 110 and the data conferencing device 120.

[0037] In the embodiment of the present disclosure, the MCU 110, the data conferencing device 120 and the terminal 130 can be one or more respectively. Each device can be set up in different places. The devices are connected through the network. The embodiment of the present disclosure does not limit the number of the above devices.

[0038] In one application scenario, multiple terminals 130 conduct a video conference via an MCU 110 and a data conference via a data conferencing device 120. Some of the multiple terminals 130 participate in a discussion or operate a shared data screen. After obtaining the identifiers of the target individuals from these terminals, MCU 110 overlays the identifiers of the target individuals with the shared data screen, and then sends the result to the multiple terminals 130. The screens displayed by the multiple terminals 130 simultaneously contain the identifiers of the multiple target individuals and the shared data screen.

[0039] The following describes the video processing method provided by the embodiment of the present disclosure:

[0040] The video processing method provided in the embodiments of the present disclosure can be applied to the MCU 110. The execution subject of the video processing method provided in the embodiments of the present disclosure can also be a video processing device. The video processing device can be an MCU, or a control module in the MCU for executing the video processing method. The following description uses the method provided in the embodiments of the present disclosure as an example of applying the MCU.

[0041] Please refer to Figure 2, which is a flow chart of a video processing method provided by an embodiment of the present disclosure. As shown in Figure 2, the method may include S101-S109.

[0042] S101: The MCU creates a video conference.

[0043] Video conferencing refers to a meeting in which people in multiple locations have face-to-face conversations using communication equipment and the Internet.

[0044] In some embodiments, the MCU may first receive an operation to create a video conference, and create the video conference in response to the operation.

[0045] In some embodiments, the MCU may receive a request for creating a video conference sent by any participating terminal, and create a video conference in response to the request.

[0046] The above-mentioned participating terminals are terminals that participate in video conferences.

[0047] S102: The MCU establishes a video conference connection with the participating terminals.

[0048] The MCU establishes a video conference connection with the participating endpoint, that is, the participating endpoint joins the video conference created by the MCU.

[0049] The following two methods are proposed for establishing a video conference connection between the MCU and the participating terminals.

[0050] In a possible implementation, the MCU sends a video conference invitation to the participating terminal based on the identifier of the participating terminal. After the participating terminal responds to the video conference invitation, the MCU establishes a video conference connection with the participating terminal.

[0051] The MCU is pre-set with the identifier of the participating terminal. The identifier of the participating terminal pre-set by the MCU can be directly entered on the MCU, can be pre-stored on the MCU, or can be sent by any terminal, and this is not limited in the present embodiment. As an example, the identifier of the participating terminal can be the identifier (identity document, ID) of the participating terminal or the Internet Protocol (IP) address of the participating terminal.

[0052] In one example, the participating terminals are two mobile phones, and the identification of the participating terminals is the mobile phone numbers "18000xxxx01" and "18023xxxx28" of the two mobile phones. After the MCU creates a video conference, it dials the mobile phone numbers "18000xxxx01" and "18023xxxx28" respectively to invite the participating terminals to join the video conference. After the participating terminals accept the invitation sent by the MCU, the MCU completes the establishment of a video conference connection with the participating terminals.

[0053] In another possible implementation, the MCU accepts a request from a participating terminal to join a video conference, so as to establish a video conference connection with the participating terminal.

[0054] In one example, after the MCU creates a video conference, it generates a conference number "AABB0102." Participants using participating terminals can join the video conference by entering "AABB0102" on the conference join interface displayed on the participating terminal. Figure 3 shows a schematic diagram of the interface of a participating terminal with the theme "XX Conference." This diagram includes a location for entering the "Conference Number" input. After entering the video conference number "AABB0102," click "Confirm" to join the video conference.

[0055] S103: The MCU sends a creation request to the data conferencing device.

[0056] The create request is used to create a data conference for participating terminals.

[0057] A data conference is a meeting where people in multiple locations discuss or operate on shared data through communication equipment and networks.

[0058] For example, the process can be implemented through S103a-S103c.

[0059] S103a: The MCU sends a creation request to the data conference device.

[0060] In some embodiments, the MCU may first receive an operation to create a data conference, and in response to the operation, send a creation request to the data conference device.

[0061] In some embodiments, the MCU may receive a request for creating a data conference sent by any participating terminal, and in response to the request, send a creation request to the data conference device.

[0062] S103b: The data conference device creates a data conference in response to the creation request sent by the MCU.

[0063] S103c: The data conferencing device establishes a data conferencing connection with the participating terminal.

[0064] The data conferencing device establishes a data conferencing connection with the participating terminal, indicating that the participating terminal has joined the data conference created by the data conferencing device.

[0065] The following three methods are proposed for establishing a data conference connection between a data conferencing device and a participating terminal.

[0066] In a possible implementation, the data conferencing device sends a data conference invitation to the participating terminal based on the identifier of the participating terminal. After the participating terminal responds to the data conference invitation, the data conferencing device establishes a data conference connection with the participating terminal.

[0067] The identification of the participating terminal may be sent to the data conferencing device by the MCU, or may be sent to the data conferencing device by any terminal. The embodiment of the present disclosure does not limit how the data conferencing device obtains the identification of the participating terminal.

[0068] In one example, the participating terminals are two mobile phones, and the identification of the participating terminals is the mobile phone numbers "18000xxxx01" and "18023xxxx28". After the data conferencing device creates the data conference, it dials the mobile phone numbers "18000xxxx01" and "18023xxxx28" respectively to invite the participating terminals to join the data conference. After the participating terminals accept the invitation sent by the data conferencing device, the data conferencing device establishes a data conference connection with the participating terminals.

[0069] In another possible implementation, the data conferencing device accepts a request from a participating terminal to join a data conference, so as to establish a data conference connection with the participating terminal.

[0070] In one example, after the data conferencing device creates a data conference, it generates a conference number "AABB0101." Participants using participating terminals can join the data conference by entering "AABB0101" on the conference joining interface displayed on the participating terminal. Figure 4 shows a schematic diagram of the interface of a participating terminal with the theme "XX Conference." The diagram includes a location for entering the "Conference Number" field. After entering the conference number "AABB0101," participants click "Confirm" to join the data conference.

[0071] In another possible implementation, after the data conferencing device creates the data conference, it first sends a message to the MCU to notify it of the successful data conference creation. After receiving the message, the MCU sends a prompt message to the participating terminals that have already joined the video conference, prompting them to join the data conference.

[0072] In an example, as shown in Figure 5, Figure 5 shows an interface diagram of a participating terminal with the theme of "XX Conference", which includes a prompt message "Please join the data conference" sent by the MCU to the participating terminal that has joined the video conference. If "Join" is selected in the interface, the participating terminal can join the data conference.

[0073] It is understandable that the MCU may first execute S102 to establish a video conference connection with the participating terminal, or first execute S103 to enable the data conference device to create a data conference, or execute S102 and S103 simultaneously. The embodiment of the present disclosure does not limit the order of executing S102 and S103.

[0074] The embodiment of the present disclosure does not limit the order in which participating terminals join a video conference or a data conference.

[0075] S104 (in some embodiments): The data conferencing device receives a request from a target terminal to participate in a discussion and / or operate shared data, creates a target list, and sends the target list to the MCU.

[0076] The target list is used to record the identifiers of target terminals.

[0077] The target terminal is the terminal used by the target person among the participating terminals. The target terminal can be one terminal or multiple terminals.

[0078] Target participants are those who participate in discussions and / or operate shared data among the conference participants; participants are those who use conference terminals to participate in video conferences and data conferences.

[0079] Shared data refers to the data shared in a data conference. For example, it includes content written on a shared whiteboard or content displayed on a shared desktop (such as a document). The content displayed on the shared desktop can be displayed on any participating endpoint's shared desktop.

[0080] In one example, as shown in FIG6 , FIG6 shows a schematic diagram of a conference interface on a participant terminal with the theme "XX Conference." The interface includes a video display area for displaying a first target video. After the participant terminal establishes a data conference connection with the data conferencing device, a function button for applying for "Participate in Discussion" is displayed on the participant terminal interface. Participants can select "Participate in Discussion" on the participant terminal interface to join the discussion or explain shared data. At this point, the participant terminal that joins the "Participate in Discussion" button is the target terminal, and the person using the target terminal to participate in the discussion or operate shared data is the target person.

[0081] It is understandable that the target list can be updated in real time. When new target terminals join in the discussion or operate shared data at different times, or when target terminals withdraw from the discussion or operate shared data, the data conferencing equipment can add or delete the identification of the target terminal in the target list in real time and send the updated target list to the MCU.

[0082] S105: The MCU obtains the identification of the target person.

[0083] In some embodiments, when the identification of the target person is a video including a picture of the target person, the MCU obtaining the identification of the target person includes: the MCU obtaining a second target video.

[0084] The second target video is a video collected by the target terminal and including a picture of the target person. When there are multiple target terminals, there are correspondingly multiple second target videos.

[0085] The video collected by the target terminal including the target person's screen refers to the video collected by the target terminal's camera or the camera connected to the target terminal when the target terminal conducts a video conference. The video includes the target person's screen, that is, the video includes the screen of the person participating in the discussion or operating the shared data.

[0086] In a possible implementation, an example implementation of S105 may include: S105a-S105b.

[0087] S105a: The MCU sends a request for obtaining the identifier of the target person to the target terminal based on the identifier of the target terminal in the target list.

[0088] In a possible implementation, if there are multiple IP addresses of target terminals in the target list, the MCU sends requests for obtaining the identification of the target person to the IP addresses of the multiple target terminals respectively.

[0089] S105b: After receiving the request for obtaining the identification of the target person sent by the MCU, the target terminal sends the identification of the target person to the MCU.

[0090] In some embodiments, when the target person is identified as a video including a picture of the target person, the target terminal sends the collected second target video to the MCU.

[0091] Correspondingly, the MCU receives the second target video sent by the target terminal.

[0092] Since the video conference is conducted in real time, the second target video is a video stream collected in real time by the target terminal.

[0093] In some embodiments, the identifier of the target person may also be a name, nickname, and / or work number, etc., which is not limited in the embodiments of the present disclosure.

[0094] It is understandable that, generally, participants (including target personnel) participate in video conferences or data conferences by logging into the conference software in the participating terminal. When logging into the conference software, participants need to log in with an account name and password. The account name can be the user's name, mobile phone number, ID card information, nickname or work number, etc. The account name can be used as an identifier for the participant.

[0095] It is understood that the target person identification can be in various forms, and using the target person's image as the target person identification can more intuitively represent the target person. Subsequently, when the first target video containing the target person's image is displayed, the participants can clearly see the target person's movements or expressions, enhancing the participants' experience.

[0096] S106: The MCU obtains the shared data screen.

[0097] Sharing data screens includes: sharing a whiteboard or sharing a desktop.

[0098] In one possible implementation, the shared data screen is a shared whiteboard, and the MCU sends a request to the data conferencing device to obtain the shared whiteboard. After receiving the request from the MCU, the data conferencing device creates a shared whiteboard and sends the shared whiteboard to the MCU.

[0099] In another possible implementation, the shared data screen is a shared desktop. The participating terminal sends the shared desktop to the data conferencing device, and the data conferencing device sends the shared desktop to the MCU after receiving it.

[0100] S107: The MCU superimposes the identification of the target person on the shared data screen to obtain a first target video.

[0101] When the target person is identified as a video including a picture of the target person, a possible implementation method is proposed below, which may include: S107a-S107e.

[0102] S107a: The MCU extracts the image of the target person from the image frame of the second target video to obtain a third target video.

[0103] For example, in the first step, the MCU performs boundary value analysis on the image frame of the second target video to identify the image of the target person in the image frame of the second target video.

[0104] In the second step, the MCU extracts the image of the target person in the image frame of the second target video to obtain a third target video.

[0105] In some embodiments, when there are multiple second target videos, the MCU extracts images of the target person from the image frames of the multiple second target videos respectively, and obtains multiple third target videos accordingly.

[0106] In this possible method, the MCU performs boundary value analysis on each image frame of the second target video, identifies the target person image in each image frame, extracts the target person image in each image frame, and then combines each image frame containing only the target person image into a third target video.

[0107] This method is only one possible implementation mode. Other methods can also be used to extract the image of the target person in the second target video, and this disclosure does not limit this.

[0108] S107b (in some embodiments): The MCU adjusts the size of the target person image in the third target video based on the size of the shared data image to obtain a fourth target video.

[0109] Adjusting the size of the target person picture in the third target video includes: reducing or enlarging the size of the target person picture in the third target video.

[0110] This exemplary step is to prevent the target person's screen size in the third target video from being too large or too small compared to the shared data screen, resulting in a poor superposition effect during subsequent superposition.

[0111] S107c: The MCU determines the target position on the shared data screen.

[0112] The target position is the position where the fourth target video is superimposed on the shared data screen. When there is a fourth target video, there are multiple corresponding target positions.

[0113] The multiple target positions do not overlap each other and can be located on the upper side, lower side, left side or right side of the shared data screen in sequence. The target position can also be set in other ways, based on not blocking the shared data screen, which is not limited in this disclosure.

[0114] S107d: The MCU superimposes the fourth target video on the target position of the shared data screen.

[0115] In some embodiments, the MCU overlays the plurality of fourth target videos on the plurality of target positions of the shared data screen respectively.

[0116] S107e: When there is occlusion between the target person images in the multiple fourth target videos superimposed on the shared data screen, the MCU performs transparency processing on the target person images with occlusion in the multiple fourth target videos respectively to obtain the first target video.

[0117] Since the target persons in the video captured by the target terminal are moving, there is sometimes occlusion between multiple target persons and sometimes no occlusion. The S107e only performs transparency processing on the target persons when there is occlusion between at least two target persons, or only performs partial transparency processing on the occluded part, and no transparency processing is required when there is no occlusion.

[0118] Transparency processing is used to prevent the key actions of the target person who is obscured from being blocked by other target persons. When there is no obstruction, opacity processing is used to allow participants to see the actions of the target person more clearly. This method of dynamically making the target person's image transparent based on the obstruction situation can enhance the experience of participants.

[0119] In one example, if the shared data screen is a shared whiteboard, as shown in Figure 7, Figure 7 shows a schematic diagram of a screen in the first target video displayed on the target terminal, which includes target person A, target person B, target person C, target person D and a shared whiteboard. The "Xxxxxx..." included in the shared whiteboard is the shared data discussed or written by multiple target persons. Since the target person C and the target person D are blocking each other in this screen, the screen of the target person C and the target person D displayed is a transparent screen.

[0120] S107e described above is one possible approach. In practice, the MCU overlays multiple target individuals on the shared data screen. When some target individuals are discussing or manipulating the shared data, their images are displayed at their target locations on the shared data screen. For target individuals not discussing or manipulating the shared data, their names and other identifiers are displayed at their target locations on the shared data screen. This approach can also reduce occlusion to a certain extent and make the screen appear simpler.

[0121] S108: The MCU sends the first target video to the participating terminals.

[0122] In some embodiments, when the first target video is superimposed with the target person's picture, the MCU may also send identifiers such as the name, surname, nickname and / or work number of the target person to the participating terminal.

[0123] It is understandable that the MCU sends the target person's name, nickname and / or work number and other identifiers to the participating terminal, which enables the participating terminal to synchronously display the target person's name, nickname and / or work number and other identifiers on the interface, so that the participants can know who the target persons are in a timely manner, and who is the person currently discussing or operating the shared data, giving the participants a more intuitive experience.

[0124] S109: The participating terminal displays the first target video.

[0125] In one example, as shown in Figure 8, a schematic diagram of the interface for a participating terminal participating in a meeting with the theme "XX Meeting" is shown. The interface displays a first target video and the names of target participants. The first target video includes images of a shared whiteboard and the target participants, whose names are "Zhang xx," "Li xx," "Wang x," and "Zhao x," respectively. Shared data "Xxxxxx..." is displayed on the shared whiteboard. When any of the target participants discusses or operates on the shared data, a "microphone" icon appears to the right of their name.

[0126] In the video processing method proposed in the embodiment of the present disclosure, the MCU can superimpose the identification of the target person on the shared data screen and send it to each participating terminal, so that the screen displayed by the participating terminal contains both the identification of the target person and the shared data screen. When the target person speaks or writes in the shared data screen, the participating terminal will synchronously display the identification of the target person, enabling the participating persons to promptly perceive the identity of the person currently speaking or writing, thereby increasing the sense of reality and experience of the participating persons.

[0127] It is understandable that, in order to implement the above functions, the video processing device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the algorithm steps of each example described in the embodiments of the present disclosure, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present disclosure.

[0128] The embodiment of the present disclosure can divide the functional modules of the video processing device according to the above-mentioned method embodiment. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one functional module. The above-mentioned integrated module can be implemented in the form of hardware or software. It should be noted that the division of modules in the embodiment of the present disclosure is schematic and is only a logical function division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.

[0129] FIG9 is a structural diagram of a video processing device provided by an embodiment of the present disclosure, and the video processing device can execute the video processing method provided by the above-mentioned method embodiment. As shown in FIG9 , the video processing device 200 includes: an acquisition unit 201, which is used to acquire the identification of the target person and the shared data screen; the shared data screen is a video screen corresponding to the shared data; wherein the target person is a person among the conference participants who participates in the discussion and / or operates the shared data; the conference participants are persons who use the conference terminal to participate in the video conference and the data conference, and the shared data is the data shared by the data conference; the processing unit 202 is used to superimpose the identification of the target person on the shared data screen to obtain a first target video; the sending unit 203 is used to send the first target video to the conference terminal. For example, in combination with FIG2 , the acquisition unit 201 can be applied to S105 and S106 in the method embodiment, the processing unit 202 can be applied to S107 in the method embodiment, and the sending unit 203 can be applied to S108 in the method embodiment.

[0130] In some embodiments, the target person is identified as a video including the target person's screen; the acquisition unit 201 can be used to acquire a second target video; the second target video is a video including the target person's screen captured by the target terminal; the target terminal is the terminal used by the target person among the participating terminals.

[0131] In some embodiments, the shared data screen includes: a shared whiteboard or a shared desktop; the shared data includes: content written on the shared whiteboard or content displayed on the shared desktop.

[0132] In some embodiments, the video processing device 200 further includes a connection unit 204 for establishing a video conference connection with a participating terminal before obtaining the target person's identification and sharing the data screen. The sending unit 203 is further configured to initiate a creation request to the data conferencing device, the creation request being used to establish a data conference for the participating terminal. For example, with reference to FIG2 , the connection unit 204 can be applied to S103 in the method embodiment, and the sending unit 203 can be applied to S104 in the method embodiment.

[0133] In some embodiments, the video processing device 200 further includes a receiving unit 205 configured to receive a target list sent by the data conferencing device after initiating a creation request to the data conferencing device; the target list is used to record the identifiers of target terminals; the target terminal is the terminal used by the target person among the participating terminals; the acquiring unit 201 can be configured to receive a shared data screen sent by the data conferencing device; based on the identifiers of the target terminals in the target list, send a request to the target terminal to obtain the identifiers of the target persons; and receive the identifiers of the target persons sent by the target terminal. For example, in conjunction with FIG2 , the receiving unit 205 can be applied to S104 in the method embodiment, and the acquiring unit 201 can be applied to S105a-S105b in the method embodiment.

[0134] In some embodiments, the processing unit 202 can be configured to extract an image of a target person from an image frame of the second target video to obtain a third target video; adjust the size of the image of the target person in the third target video based on the size of the shared data screen to obtain a fourth target video; determine a target position on the shared data screen; and superimpose the fourth target video at the target position on the shared data screen to obtain the first target video. For example, the processing unit 202 can be applied to S107a-S107e in the method embodiment.

[0135] In some embodiments, the processing unit 202 can be configured to, when there are multiple fourth target videos, determine multiple target locations on the shared data screen; overlay the multiple fourth target videos on the multiple target locations on the shared data screen; and, when there is occlusion between the target person images in the multiple fourth target videos overlaid on the shared data screen, perform transparency processing on the target person images in the multiple fourth target videos that are blocked, to obtain the first target video. For example, the processing unit 202 can be applied to S107a-S107e in the method embodiment.

[0136] In some embodiments, the plurality of target locations are located on the upper side, the lower side, the left side, or the right side of the shared data screen.

[0137] In some embodiments, the processing unit 202 can be configured to perform boundary value analysis on the image frames of the second target video to identify an image of a target person in the image frames of the second target video; and extract the image of the target person from the image frames of the second target video to obtain a third target video. For example, the processing unit 202 can be applied to S107a in the method embodiment.

[0138] In the case of implementing the functions of the above-mentioned integrated modules in hardware, the embodiments of the present disclosure provide another possible structure of the video processing device involved in the above-mentioned embodiments. As shown in Figure 10, the video processing device 300 includes: a processor 302 and a bus 304. In some embodiments, the video processing device may also include a memory 301; in some embodiments, the video processing device may also include a communication interface 303.

[0139] The processor 302 can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of the present disclosure. The processor 302 can be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof, and can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of the present disclosure. The processor 302 can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP (Digital Signal Processor) and a microprocessor, etc.

[0140] The communication interface 303 is used to connect to other devices via a communication network, such as Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0141] The memory 301 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0142] As a possible implementation, the memory 301 can exist independently of the processor 302. The memory 301 can be connected to the processor 302 via a bus 304 to store instructions or program codes. When the processor 302 calls and executes the instructions or program codes stored in the memory 301, the video processing method provided in the embodiment of the present disclosure can be implemented.

[0143] In another possible implementation, the memory 301 may also be integrated with the processor 302 .

[0144] Bus 304 can be an Extended Industry Standard Architecture (EISA) bus, etc. Bus 304 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, FIG10 shows only one thick line, but this does not mean that there is only one bus or only one type of bus.

[0145] Some embodiments of the present disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a computer, the computer executes the video processing method described in any of the above embodiments.

[0146] Exemplarily, the above-mentioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes, etc.), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memories (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in the present disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0147] An embodiment of the present disclosure provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is enabled to execute the video processing method described in any one of the above embodiments.

[0148] The above is only a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or replacements within the technical scope disclosed in the present disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A video processing method, comprising: Obtaining the identification of the target person and the shared data screen; the shared data screen is the video screen corresponding to the shared data; wherein the target person is a person among the conference participants who participates in the discussion and / or operates the shared data; the conference participant is a person who uses a conference terminal to participate in the video conference and the data conference, and the shared data is the data shared by the data conference; Superimposing the identification of the target person on the shared data screen to obtain a first target video; Send the first target video to the conference participant terminal.

2. The method according to claim 1, wherein: The identification of the target person is a video including a picture of the target person; obtaining the identification of the target person includes: Acquire a second target video; the second target video is a video including a picture of the target person collected by a target terminal; the target terminal is a terminal used by the target person among the participating terminals.

3. The method according to claim 1 or 2, wherein: The shared data screen includes: a shared whiteboard or a shared desktop; the shared data includes: content written on the shared whiteboard or content displayed on the shared desktop.

4. The method according to claim 1 or 2, wherein: Before obtaining the identification of the target person and the shared data screen, the method further includes: Establishing a video conference connection with the participating terminal; A creation request is initiated to a data conference device, where the creation request is used to create the data conference for the participating terminal.

5. The method according to claim 4, wherein: After initiating the creation request to the data conference device, the method further includes: receiving a target list sent by the data conference device; the target list is used to record the identification of the target terminal; the target terminal is a terminal used by the target person in the participating terminal; Acquiring the identification of the target person and the shared data screen includes: Receiving the shared data screen sent by the data conferencing device; Based on the identification of the target terminal in the target list, sending a request to the target terminal to obtain the identification of the target person; Receive the identification of the target person sent by the target terminal.

6. The method according to claim 2, wherein: The identification of the target person is superimposed on the shared data screen to obtain the first target video, including: Extracting the image of the target person from the image frame of the second target video to obtain a third target video; Based on the size of the shared data screen, adjusting the size of the screen of the target person in the third target video to obtain a fourth target video; determining a target location on the shared data screen; The fourth target video is superimposed on the target position in the shared data screen to obtain the first target video.

7. The method according to claim 6, wherein: In the case where there are a plurality of the fourth target videos, determining the target position on the shared data screen comprises: determining a plurality of target locations on the shared data screen; The step of superimposing the fourth target video on the target position in the shared data screen to obtain the first target video includes: Respectively superimposing a plurality of the fourth target videos on the plurality of target positions in the shared data screen; In the case where there is occlusion between the images of the target persons in the multiple fourth target videos superimposed on the shared data screen, the images of the target persons in the multiple fourth target videos with occlusion are respectively made transparent to obtain the first target video.

8. The method according to claim 6 or 7, wherein: The target position is located at the upper side, the lower side, the left side or the right side of the shared data screen.

9. The method according to claim 6, wherein: Extracting the image of the target person from the image frame of the second target video to obtain the third target video includes: Performing boundary value analysis on the image frame of the second target video to identify the image of the target person in the image frame of the second target video; The image of the target person in the image frame of the second target video is extracted to obtain the third target video.

10. A video processing device, comprising a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, the computer program code comprising computer instructions; wherein, When the processor executes the computer instructions, the video processing device executes the video processing method according to any one of claims 1-9.

11. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer instructions; wherein, when the computer instructions are executed on a video processing device, the video processing device executes the video processing method according to any one of claims 1-9.

Images