Method and apparatus for displaying electronic nameplates in video conferencing

Abstract

The application relates to the field of artificial intelligence, and discloses a display method and device of an electronic nameplate in a video conference. The method comprises the following steps: acquiring the position of a face of a participant in a video picture and identity information of the participant; determining the display position and size of an electronic nameplate in the video picture according to the position of the face in the video picture; and displaying the identity information of the participant through the electronic nameplate. The method realizes adaptive adjustment of the electronic nameplate according to the position of the face, the electronic nameplate can be displayed in a more intuitive manner, and the conference efficiency is improved.

Description

Technical Field

[0001] This application relates to the fields of artificial intelligence and smart terminals, and in particular to a method and apparatus for displaying electronic nameplates in video conferencing. Background Technology

[0002] With the continuous development of internet and communication technologies, time and location are no longer obstacles to human communication. Human communication methods are becoming increasingly diverse, and face-to-face communication has become an indispensable part of daily life. With the expansion of business operations and the rapid development of the information age, more and more companies are choosing remote video conferencing for real-time communication to reduce travel expenses, save time, and improve meeting quality and work efficiency.

[0003] As the application scenarios of video conferencing continue to expand, video conferencing is no longer limited to single-location meetings but has evolved into multi-party meetings. In multi-party meetings, most participants may not know each other beforehand, and may not be able to recall names or greet each other, leading to an awkward "stranger" atmosphere and even missing important speeches from leaders, resulting in low meeting efficiency. Therefore, meeting organizers would place paper nameplates for participants on the tables beforehand, allowing everyone to find their assigned seat. However, paper nameplates have low recycling rates, are wasteful, and are not environmentally friendly. Subsequently, LED desktop electronic nameplates emerged, which reduced paper waste, but were expensive and inconvenient to carry.

[0004] Therefore, there is an urgent need for a method and device for displaying electronic nameplates in video conferencing, which can reduce resource waste and facilitate the understanding of participant identity information. Summary of the Invention

[0005] In view of this, embodiments of this application provide a method and apparatus for displaying electronic nameplates in video conferencing, which can realize adaptive adjustment and display of electronic nameplates of participants in different meeting scenarios.

[0006] In a first aspect, embodiments of this application provide a method for displaying electronic nameplates in a video conference, comprising:

[0007] Obtain the location of the attendees' faces in the video frame and the attendees' identity information;

[0008] The display position and size of the electronic nameplate in the video frame are determined based on the position of the face in the video frame.

[0009] The identity information is displayed on the electronic nameplate.

[0010] In conjunction with the implementation of the first aspect, in the first possible implementation of the first aspect, determining the display position and size of the electronic nameplate in the video frame based on the position of the face in the video frame includes:

[0011] The distribution of the faces is determined based on their positions in the video frame;

[0012] The display position and size of the electronic nameplate in the video frame are determined based on the position and distribution of the face in the video frame.

[0013] In conjunction with the first aspect, or the first possible implementation of the first aspect, in the second possible implementation of the first aspect, the method further includes: determining the color of the electronic nameplate, the transparency of the electronic nameplate, the outline of the electronic nameplate, the font of the text or symbols in the electronic nameplate, and the color of the text or symbols in the electronic nameplate.

[0014] In conjunction with the first aspect, or the first to second possible implementations of the first aspect, in the third possible implementation of the first aspect, the method further includes: acquiring an input message, the input message being used to instruct the user on display requirements for the electronic nameplate, the input message including manual input by the user and / or voice input by the user.

[0015] In conjunction with the first aspect, or the first to third possible implementations of the first aspect, in the fourth possible implementation of the first aspect, the method further includes: obtaining the skin color and / or clothing color of the participants, and determining the color of the electronic nameplate and / or the transparency of the electronic nameplate based on the skin color and / or clothing color of the participants.

[0016] In conjunction with the first aspect, or the first to fourth possible implementations of the first aspect, in the fifth possible implementation of the first aspect, after displaying the identity information through the electronic nameplate, the method further includes:

[0017] The system detected an overlap or intersection between the electronic nameplate and the face region of the attendee or another electronic nameplate.

[0018] Display the electronic nameplate and / or another electronic nameplate in a new location.

[0019] In conjunction with the first aspect, or the first to fifth possible implementations of the first aspect, in the sixth possible implementation of the first aspect, the electronic nameplate is connected to the face region of the corresponding participant by a straight line or an arrow.

[0020] In conjunction with the first aspect, or the first to sixth possible implementations of the first aspect, in the seventh possible implementation of the first aspect, after displaying the identity information through the electronic nameplate, the method further includes:

[0021] It was detected that at least one of the participants spoke for a duration longer than a first preset duration or shorter than a second preset duration.

[0022] Replace the electronic nameplate corresponding to the at least one first person with at least one new electronic nameplate.

[0023] In conjunction with the first aspect, or the first to seventh possible implementations of the first aspect, in the eighth possible implementation of the first aspect, after displaying the identity information through the electronic nameplate, the method further includes:

[0024] It was detected that among the participants, a second person spoke for a shorter period of time within a third preset time period than a fourth preset time period, where the third preset time period was greater than the fourth preset time period;

[0025] Remove the electronic nameplate corresponding to the second person from display.

[0026] In conjunction with the first aspect, or the first to eighth possible implementations of the first aspect, in the ninth possible implementation of the first aspect, after displaying the identity information through the electronic nameplate, the method further includes:

[0027] Start a timer. When the timer reaches a preset time point, determine at least one third person among the participants corresponding to the input audio stream.

[0028] Confirm whether the electronic nameplate corresponding to the first person is in the display state. If the electronic nameplate corresponding to the first person is not in the display state, then display the electronic nameplate corresponding to the third person.

[0029] In conjunction with the first aspect, or the first to ninth possible implementations of the first aspect, in the tenth possible implementation of the first aspect, after confirming whether the electronic nameplate corresponding to the third person is in a display state, the method further includes:

[0030] Remove the electronic nameplates of other participants from the display. Other participants are those who are not third parties.

[0031] In conjunction with the first aspect, or the first to tenth possible implementations of the first aspect, in the eleventh possible implementation of the first aspect, after confirming whether the electronic nameplate corresponding to the third person is in a display state, the method further includes:

[0032] The timer restarts for the third person.

[0033] In conjunction with the first aspect, or the first to eleventh possible implementations of the first aspect, in the twelfth possible implementation of the first aspect, after confirming whether the electronic nameplate corresponding to the third person is in a display state, the method further includes:

[0034] When a fourth person is detected speaking among the other participants, the electronic nameplate corresponding to the second person will be displayed.

[0035] In conjunction with the first aspect, or the first to twelfth possible implementations of the first aspect, in the thirteenth possible implementation of the first aspect, the identity information includes one or more of the following: name, age, contact information, place of origin, work unit, position, and educational background.

[0036] Secondly, embodiments of this application also provide a display device for an electronic nameplate in a video conference, including: an acquisition module, a configuration module, and a display module;

[0037] The acquisition module is used to acquire the position of the attendee's face in the video frame and the attendee's identity information;

[0038] The configuration module is used to determine the display position and size of the electronic nameplate in the video frame based on the position of the face in the video frame;

[0039] The display module is used to display the identity information through the electronic nameplate.

[0040] In conjunction with the implementation of the second aspect, in the first possible implementation of the second aspect, the configuration module determines the display position and size of the electronic nameplate in the video frame based on the position of the face in the video frame, including:

[0041] The distribution of the faces is determined based on their positions in the video frame;

[0042] The display position and size of the electronic nameplate in the video frame are determined based on the position and distribution of the face in the video frame.

[0043] In conjunction with the second aspect, or the first possible implementation of the second aspect, in the second possible implementation of the second aspect, the configuration module is further configured to: determine the color of the electronic nameplate, the transparency of the electronic nameplate, the outline of the electronic nameplate, the font of the text or symbols in the electronic nameplate, and the color of the text or symbols in the electronic nameplate.

[0044] In conjunction with the second aspect, or the first or second possible implementation of the second aspect, in the third possible implementation of the second aspect, the acquisition module is further configured to:

[0045] Obtain input messages, which are used to indicate the user's display requirements for the electronic nameplate, and the input messages include manual input by the user and / or voice input by the user.

[0046] In conjunction with the second aspect, or the first to third possible implementations of the second aspect, in the fourth possible implementation of the second aspect, the acquisition module is further configured to: acquire the skin color and / or clothing color of the attendees, and determine the color and / or transparency of the electronic nameplate based on the skin color and / or clothing color of the attendees.

[0047] In conjunction with the second aspect, or the first to fourth possible implementations of the second aspect, in the fifth possible implementation of the second aspect, the device further includes a first detection module;

[0048] The first detection module is used to detect whether the electronic nameplate overlaps or intersects with the face area of ​​the attendee or another electronic nameplate:

[0049] If the first detection module detects that the electronic nameplate overlaps with the face area of ​​the attendee or another electronic nameplate;

[0050] The display module will then display the electronic nameplate or another electronic nameplate in a new position.

[0051] In conjunction with the second aspect, or the first to fifth possible implementations of the second aspect, in the sixth possible implementation of the second aspect, the electronic nameplate is connected to the face region of the corresponding participant by a straight line or an arrow.

[0052] In conjunction with the second aspect, or the first to sixth possible implementations of the second aspect, in the seventh possible implementation of the second aspect, the device further includes a second detection module;

[0053] The second detection module is used to detect whether at least one of the participants has a speaking time longer than a first preset time or shorter than a second preset time.

[0054] If the second detection module detects that the speaking time of at least one of the first participants is longer than the first preset time or shorter than the second preset time;

[0055] Then the display module will replace the electronic nameplate corresponding to the at least one first person with a new electronic nameplate.

[0056] In conjunction with the second aspect, or the first to seventh possible implementations of the second aspect, in the eighth possible implementation of the second aspect, the second detection module is further configured to detect whether any of the participants has a speaking time shorter than the fourth preset time within the third preset time period, wherein the third preset time period is longer than the fourth preset time period.

[0057] If the second detection module detects that a second participant speaks for a shorter period of time than a fourth preset period of time within a third preset period of time, then the third preset period of time is greater than the fourth preset period of time.

[0058] The display module will then remove the electronic nameplate corresponding to the second person from the video screen.

[0059] In conjunction with the second aspect, or the first to eighth possible implementations of the second aspect, in the ninth possible implementation of the second aspect, the device further includes a timing module and an audio detection module:

[0060] The timing module is used to keep track of the participants;

[0061] The audio detection module is used to: detect at least one third person among the participants corresponding to the input audio stream when the timing module reaches a preset time point;

[0062] The display module is also used to confirm whether the electronic nameplate corresponding to the third person is in the display state. If the electronic nameplate corresponding to the third person is not in the display state, the display module displays the electronic nameplate corresponding to the third person.

[0063] In conjunction with the second aspect, or the first to ninth possible implementations of the second aspect, in the tenth possible implementation of the second aspect, the display module is further configured to cancel the display of the electronic nameplates corresponding to other participants, wherein the other participants are participants who are not third parties.

[0064] In conjunction with the second aspect, or the first to tenth possible implementations of the second aspect, in the eleventh possible implementation of the second aspect, the timing module is further used to time the third person again.

[0065] In conjunction with the second aspect, or the first to eleventh possible implementations of the second aspect, in the twelfth possible implementation of the second aspect, the audio detection module is further used to detect whether there is a fourth person speaking among the other participants:

[0066] If the audio detection module detects that a fourth person is speaking among the other participants;

[0067] The display module will then display the electronic nameplate corresponding to the fourth person.

[0068] Thirdly, embodiments of this application also provide a time display method in a video conference, including:

[0069] Start the timer. When the timer reaches the preset time point, determine whether there is a first person to speak among the participants based on the input audio stream. The input audio stream is the audio stream input from the start of the timer to the preset time point.

[0070] Display the electronic nameplate corresponding to the first person, and undisplay the electronic nameplates corresponding to the other participants. The other participants are those who are not the first person.

[0071] In conjunction with the implementation of the third aspect, in the first possible implementation of the third aspect, the timer is restarted for the first person, and the timer for other participants is not required.

[0072] In conjunction with the third aspect, or the first possible implementation of the third aspect, in the second possible implementation of the third aspect, if a second participant is detected speaking, their corresponding electronic nameplate is displayed. Once a second participant is detected speaking, their electronic nameplate is immediately displayed, and the timer for that second participant can be started again.

[0073] This application provides a method for displaying electronic nameplates in video conferencing. This method controls the display of electronic nameplates by detecting whether participants speak and timing their speaking time. By canceling unnecessary electronic nameplates, resource waste is reduced. This is especially useful in complex environments where electronic nameplates can avoid occupying too much video screen space.

[0074] Fourthly, embodiments of this application also provide an electronic nameplate display device, including: a memory, one or more processors, a transceiver, a display screen, and a camera;

[0075] The memory is used to store program instructions;

[0076] The camera is used to capture video images of the attendees;

[0077] The transceiver is used to obtain the identity information of the participants;

[0078] The processor is used to execute the program instructions to perform: based on the position of the attendee's face in the video frame, determine the display position and size of the electronic nameplate in the video frame;

[0079] The display screen is used to display the identity information through the electronic nameplate.

[0080] In conjunction with the possible implementations of the fourth aspect, in the first possible implementation of the fourth aspect, the processor determining the display position and size of the electronic nameplate in the video frame based on the position of the face in the video frame includes:

[0081] The processor determines the distribution of the face based on the position of the face in the video frame;

[0082] The processor determines the display position and size of the electronic nameplate in the video frame based on the position and distribution of the face in the video frame.

[0083] In conjunction with the fourth aspect, or the first possible implementation of the fourth aspect, in the second possible implementation of the first aspect, the processor is further configured to: determine the color of the electronic nameplate, the transparency of the electronic nameplate, the outline of the electronic nameplate, the font of the text or symbols in the electronic nameplate, and the color of the text or symbols in the electronic nameplate.

[0084] In conjunction with the fourth aspect, or the first or second possible implementation of the fourth aspect, in the third possible implementation of the first aspect, the transceiver is further configured to:

[0085] Receive input messages, which are used to indicate the user's display requirements for the electronic nameplate, and the input messages include manual input and / or voice input by the user.

[0086] In conjunction with the fourth aspect, or the first to third possible implementations of the fourth aspect, in the fourth possible implementation of the fourth aspect, the processor is further configured to: acquire the skin color and / or clothing color of the participants in the video frame, and determine the color and / or transparency of the electronic nameplate based on the skin color and / or clothing color of the participants.

[0087] In conjunction with the fourth aspect, or the first to fourth possible implementations of the fourth aspect, in the fifth possible implementation of the fourth aspect, the processor is further configured to determine whether the electronic nameplate overlaps or intersects with the face region of the participant or another electronic nameplate:

[0088] If the processor determines that the electronic nameplate overlaps with the face area of ​​the attendee or another electronic nameplate;

[0089] The processor then determines the new display position and new size of the electronic nameplate or another electronic nameplate.

[0090] In conjunction with the fourth aspect, or the first to fifth possible implementations of the fourth aspect, in the sixth possible implementation of the fourth aspect, the device further includes a timer and a microphone:

[0091] The timer is used to keep track of the participants;

[0092] The microphone is used to collect audio streams input within a preset time period;

[0093] The processor is also configured to determine at least one first person among the participants corresponding to the input audio stream;

[0094] The display screen is also used to confirm whether the electronic nameplate corresponding to the first person is in the display state. If the electronic nameplate corresponding to the first person is not in the display state, the display screen will display the electronic nameplate corresponding to the first person.

[0095] In combination with the fourth aspect, or the first to sixth possible implementations of the fourth aspect, in the seventh possible implementation of the fourth aspect, the timer is also used to time the speaking duration of the participants;

[0096] The processor determines whether any participant has a speaking time longer than a first preset time or shorter than a second preset time. If the processor determines that a second participant has a speaking time longer than the first preset time or shorter than the second preset time, the processor determines a new electronic nameplate corresponding to the second participant, and the display screen replaces the electronic nameplate corresponding to the second participant with the new electronic nameplate for display.

[0097] In conjunction with the fourth aspect, or the first to seventh possible implementations of the fourth aspect, in the eighth possible implementation of the fourth aspect, when the processor determines that the speaking duration of the second person is shorter than the second preset duration, the display screen will cancel the display of the electronic nameplate corresponding to the second person.

[0098] Fifthly, this application provides a readable storage medium storing execution instructions, wherein when at least one processor of a message processing device executes the execution instructions, the electronic nameplate display device performs the method executed by the processor or transceiver in the fourth aspect and any possible implementation of the fourth aspect.

[0099] Sixthly, this application provides a program product including executable instructions stored in a readable storage medium. At least one processor of an electronic nameplate display device can read the executable instructions from the readable storage medium, and the at least one processor executes the executable instructions to cause the electronic nameplate display device to implement the methods executed by the processor or transceiver in the fourth aspect and any possible implementation of the fourth aspect. Attached Figure Description

[0100] To more clearly illustrate the embodiments of this application or the technical solutions in the prior art, the accompanying drawings used in describing the background technology and embodiments will be briefly introduced below. Obviously, the following drawings describe only a part of the embodiments of this application. For those skilled in the art, other drawings or embodiments can be obtained based on these drawings and descriptions without creative effort, and this application is intended to cover all such derived drawings or embodiments.

[0101] Figure 1 A schematic diagram of a video conferencing device provided in an embodiment of this application;

[0102] Figure 2 A flowchart illustrating the display of an electronic nameplate in a video conference, provided as an embodiment of this application;

[0103] Figure 3 A schematic diagram illustrating a scenario of electronic nameplate display in a video conference, provided as an embodiment of this application;

[0104] Figure 4 A schematic diagram illustrating a scenario of electronic nameplate display in a video conference, provided as an embodiment of this application;

[0105] Figure 5 A schematic diagram illustrating a scenario of electronic nameplate display in a video conference, provided as an embodiment of this application;

[0106] Figure 6 This is a schematic diagram illustrating a method for determining the position of an electronic nameplate, as provided in an embodiment of this application.

[0107] Figure 7 This application provides a method for displaying electronic nameplates in a video conference.

[0108] Figure 8 This application provides a method for displaying electronic nameplate timing in a video conference.

[0109] Figure 9 A schematic diagram of an electronic nameplate display device for video conferencing provided in an embodiment of this application;

[0110] Figure 10 This is a schematic diagram of an electronic nameplate display device for video conferencing, provided as an embodiment of this application. Detailed Implementation

[0111] The device configurations and business scenarios described in this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. Those skilled in the art will understand that, with the evolution of device configurations and the emergence of new business scenarios, the technical solutions provided in this application are also applicable to similar technical problems.

[0112] This application provides a conferencing device for video conferencing, such as... Figure 1 As shown, the conference device includes a conference terminal 110 and a server 120. This device can be used in multiple conference rooms located in different locations, with one conference terminal placed in each room. Multiple conference rooms can share a server or have a dedicated server. This device allows participants in multiple conference rooms to get to know each other more quickly and conveniently.

[0113] The conference terminal 110 includes a screen 111, a camera 112, and an array microphone 113. The camera 112 captures images of the conference venue and performs facial recognition, the screen 111 displays the images, and the array microphone 113 plays audio or captures audio input from the venue. The server 120 includes cloud and offline terminals for storing facial feature information and identity information of participants. Based on facial feature information, a participant is identified in the image captured by the camera 112. The participant's identity information is then retrieved from the server 120 and superimposed onto the currently displayed video image using a video conferencing subtitle overlay device. The video image is then decoded in real-time and displayed on the screen 111. The electronic nameplate mentioned in this embodiment can be the participant's nameplate displayed on the screen 111 via the superimposed subtitle overlay device.

[0114] It is conceivable that the facial feature information of the participant to be identified obtained from the currently displayed video image information in this embodiment may also include the iris and iris prints. When the facial feature information includes the iris or iris prints, the iris or iris prints can be collected using the video conferencing camera. The identity information of the participant to be identified can be determined by comparing the iris or iris prints of the participant to be identified with the preset iris or iris prints of other participants. However, given the limitations of existing technology, iris or iris print recognition not only requires specialized recognition software but also the cooperation of the participant, who must bring their eyes close to the camera. This not only increases the cost of recognition but also causes inconvenience to the participant. Therefore, in this embodiment, a preferred method is to use facial recognition technology to identify the facial feature information of the participant in the currently displayed video image information.

[0115] In addition, the identity information mentioned in the embodiments of this application includes, but is not limited to, the names, ages, contact information, places of origin, work units, positions, and educational backgrounds of the participants.

[0116] It should be noted that the terms "first," "second," etc., used in this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in an order not described in this application. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. The specific operational methods in the method embodiments can also be applied to the device embodiments. Furthermore, to more clearly illustrate the relationships between components in different embodiments, this application uses the same drawing numbers to represent components with the same or similar functions in different embodiments.

[0117] It should also be noted that, unless otherwise specified, the specific description of certain technical features in one embodiment can also be used to interpret the corresponding technical features mentioned in other embodiments. For example, the design example of the facial information or identity information of the participants in one embodiment can be applied to the facial information in all other embodiments.

[0118] Figure 2 A flowchart illustrating the display of an electronic nameplate in a video conference, as provided in this application embodiment, is shown below. Figure 2 As shown, the display process of an electronic nameplate in a video conference includes:

[0119] S201, Video Processing;

[0120] The camera captures images to obtain a video stream, which undergoes video preprocessing. Video preprocessing includes operations such as image acquisition, noise reduction, epipolar correction, resolution and frame rate adjustment, and then outputs the video stream to the subsequent face detection S202.

[0121] S202, Face Detection;

[0122] The input for face detection is a pre-processed video frame. Face detection of the video frame yields face detection information, including the position or coordinates of the face within the video frame, and the face size. The face size of attendees can be calculated based on their face coordinates. Furthermore, face detection information can also include skin tone and clothing color.

[0123] S203, Facial Recognition;

[0124] The face recognition system receives the face image obtained in step S202 and sends it to the server. The server extracts the facial feature information from the face image for face recognition.

[0125] S204, Scene Detection;

[0126] Scene detection takes face detection information as input. By analyzing the position or coordinate information within these face detections, the distribution of people or faces is determined to obtain scene information. For example, if the centers of most attendees' faces are on the same straight line, it can be determined that the attendees are sitting in a row; or if the faces are symmetrically distributed, it can be determined that the attendees are sitting in a circle. In practice, a certain error range can be set. Within this range, faces approximately on a straight line or approximately symmetrically distributed can be considered as belonging to the above categories.

[0127] S205, Scenario-based decision-making;

[0128] The input for scene decision-making is scene information, and the obtained scene decision information is provided to the S206 nameplate for calculation. To make the display effect of the electronic nameplates of the participants more aesthetically pleasing and intuitive, special processing can be performed for some special scenarios, generally including the following situations: If the detected scene information is that the participants are sitting in a row, the electronic nameplates are distributed in a straight line below their faces; if the detected scene information is a round table meeting, the electronic nameplates are displayed near the faces in a symmetrical arrangement, including but not limited to facing both sides; if the detected scene information is a close-up of a participant, only the nameplate of that person in the close-up is displayed. If the detected scene information is irregular, the electronic nameplate is generally placed below the face.

[0129] S206, Nameplate Calculation;

[0130] 2061. Calculation of nameplate position and size:

[0131] The location and size of the nameplate are calculated based on the received face detection information, location or coordinate information, and scene decision information.

[0132] When the scenario decision determines that the electronic nameplate of the participant is appropriate, or if no scenario decision information is received, the electronic nameplate is positioned in a fixed area below each participant's face at a certain distance, based on the face's location. The size of the electronic nameplate is adjusted according to the size of the face area. Figure 3 As shown in Figure a, participant B has a larger facial area, therefore participant B's electronic nameplate will also be larger. Since the electronic nameplate is positioned at a fixed distance below the face, therefore... Figure 3 The electronic nameplates of each participant in the meeting will also vary.

[0133] When the scenario decision determines that the electronic nameplates of the attendees should be displayed in a row, such as... Figure 3 As shown in b, at this point, the electronic nameplates of the participants will be aligned in a straight line, taking into account the position and size of the faces, and ensuring that the height of the electronic nameplates of the participants is consistent.

[0134] When the scenario decision determines that the electronic nameplates of the attendees should be displayed symmetrically near their faces, such as... Figure 4 As shown in a, at this time, the electronic nameplate will take into account the symmetry of the face position coordinates, and the size of the electronic nameplate will be adjusted according to the size of the face area;

[0135] When the scene decision determines to display the electronic nameplate of the person in close-up, the electronic nameplates of other participants will be removed from the display.

[0136] 2062. Nameplate obstruction judgment:

[0137] Based on the location or coordinate information from the received face detection data and the position and size information of the electronic nameplate, calculations are performed to determine whether the nameplate of a participant overlaps with the faces of other participants or the electronic nameplates of other participants. If overlap is detected, for example, if two people are too close together due to movement during the meeting, the overlapping electronic nameplates can be recalculated with a new position and size for display. Figure 4 As shown in b, due to the movement of participant G, the face area of ​​participant G overlaps with the electronic nameplate of participant E. At this time, the electronic nameplate of participant E is moved to a new position for display. Since the moved position may be a bit far from participant E, arrows can be used to guide the way for a clearer view.

[0138] 2063. Nameplate transparency calculation:

[0139] The transparency of the nameplate is calculated based on skin tone and clothing color information from face detection. The color of the electronic nameplate can be gradient, including but not limited to darker colors in the center and lighter colors at the edges. The transparency of the nameplate is automatically adjusted according to the shade of clothing color.

[0140] S207, Audio Processing;

[0141] The microphone array acquires the audio stream and performs audio preprocessing. The input multi-channel audio data is processed by 3A processing, which includes Acoustic Echo Cancelling (AEC), Automatic Gain Control (AGC), and Active Noise Control (ANC, also known as noise cancellation or noise suppression). These processing methods are commonly referred to as 3A processing.

[0142] S208, Sound source localization;

[0143] Based on the processed audio stream, the speaker's location information is located and used to match face detection information to determine the speaker.

[0144] S209, Nameplate display;

[0145] Based on the calculated location, size, and identity information of the electronic nameplate, the identity information is added to the electronic nameplate. Then, the electronic nameplate is overlaid on the image to generate an image with the nameplate, which is then displayed on the screen.

[0146] Optionally, the electronic nameplates of speakers identified in S208 that are currently speaking can be highlighted. Highlighting methods include bolding the font, changing the font color, or altering the outline of the electronic nameplate, to distinguish speakers from non-speakers, improve attendees' attention, and prevent them from missing important speeches. Furthermore, the electronic nameplates of non-speakers can be hidden or their display style can be changed. The display style includes the brightness, color, outline, transparency, and the font and color of the text or symbols on the electronic nameplate. Figure 5 As shown, if participants D and G are speaking or speaking frequently, their electronic nameplates will be highlighted, while the electronic nameplates of other participants will be hidden.

[0147] Optionally, the participants' time can be recorded. If a participant fails to speak for more than a preset time or speaks for less than another preset time, the participant's electronic nameplate can be removed from display or its display style can be changed.

[0148] Attendees or users can also issue commands via voice assistant. The voice assistant performs speech recognition on the input speech, converting it into the user's intent commands. These intent commands include showing / canceling electronic nameplates, displaying attendee identification information, and changing the display style of electronic nameplates. For example, if a user requests "show the name and employee number of the third person from the left in meeting room 2," the voice assistant will recognize that the user's intent is to display the person's name and employee number, and this person is the third face from the left in meeting room 2. If a user requests "cancele the nameplate of the largest face in meeting room 2," the voice assistant will recognize that the user's intent is to cancel the nameplate, and this nameplate corresponds to the largest face in meeting room 2.

[0149] This application provides a meeting terminal and electronic nameplate display process method in video conferencing, which can realize adaptive adjustment of the display of electronic nameplates of participants in different meeting scenarios. The electronic nameplates can be displayed in a more intuitive way, improving meeting efficiency and solving the problems of current electronic nameplate displays being monotonous, lacking in differentiation and user-friendliness.

[0150] Figure 6 This is a schematic diagram illustrating a method for determining the position of an electronic nameplate, as provided in an embodiment of this application. Figure 6As shown, this method establishes a coordinate system XOY in the upper left corner of the video frame. Points A and B are the geometric centers of the face and the electronic nameplate, respectively. The physical meaning of each parameter is shown in Table 1 below.

[0151] parameter Physical meaning <![CDATA[x a ]]> The x-coordinate of point A (geometric center of the face) <![CDATA[y a ]]> The ordinate of point A (geometric center of the face) W Face width H Face height <![CDATA[x b ]]> The x-coordinate of point B (geometric center of the electronic nameplate) <![CDATA[y b ]]> The ordinate of point B (geometric center of the electronic nameplate) l Width of electronic nameplate h Height of electronic nameplate <![CDATA[w1]]> Electronic nameplate reserved length <![CDATA[w2]]> Identity information display width <![CDATA[h2]]> Identity information display height

[0152] Table 1. Parameters and their physical meanings

[0153] A(x) is obtained after face detection. a ,y a First, determine w1, w2, and h2 based on the name and face size of the attendee to be displayed. For example, if the attendee's name is "Zhang Sanfeng" and the face size is calculated to be 100 square centimeters, the text size corresponding to "Zhang Sanfeng" can be obtained by referring to the pre-set face size, text or symbol size, and electronic nameplate reserved length table. Then, w1, w2, and h2 can be determined for "Zhang Sanfeng". In practice, the rules for setting text or symbol sizes may differ for Chinese, English, or other languages. It's also important to note that w2 and h2 correspond to the display width and height of the identity information, including not only the name but also other information. The reserved length w1 is a semi-transparent blank space next to the identity information, making the electronic nameplate display more aesthetically pleasing and intuitive.

[0154] Then, the geometric center B(x) of the electronic nameplate is calculated according to the following calculation rules. b ,y b ,l,h):

[0155] l = w2 + 2w1

[0156] h = h2

[0157] x b =x a -c1*l

[0158] y b =y a +c2*H

[0159] Where c1 and c2 are constants, which can be adjusted according to the actual situation. Preferably, c1 = 0.5 and c2 = 1.

[0160] Similarly, the geometric centers B1, B2, etc. of the electronic nameplates corresponding to other faces can be obtained using the above method. Based on the coordinates of these geometric centers, it is possible to calculate whether there is overlap between different electronic nameplates or between electronic nameplates and faces, that is, whether the electronic nameplates obscure faces.

[0161] When the scene decision information is received to display all electronic nameplates in a row, the coordinates of B, B1, B2... need to be adjusted to ensure that the y-coordinate of the geometric center of each electronic nameplate is aligned. b The value of h is equal to the value of h.

[0162] The method for determining the position of an electronic nameplate provided in this application uses two-dimensional rectangular coordinates. In addition, similarly, two-dimensional rectangular coordinates can be replaced with polar coordinates or cylindrical coordinates.

[0163] The present application provides a method for determining the position of an electronic nameplate, which provides a possible method for calculating the position size of the electronic nameplate using face position. In specific practical situations, other similar algorithms or similar design parameters may be used to implement it, such as neural network algorithms. It should be understood that these algorithms that use other similar algorithms or similar design parameters should be included within the scope of protection of this application.

[0164] Figure 7 This application provides a method for displaying electronic nameplates in a video conference, such as... Figure 7 As shown, the method includes:

[0165] S701. Obtain face detection information and identity information;

[0166] Among them, obtaining face detection information involves performing face detection on the video footage of the meeting venue captured by the camera. The obtained face detection information includes the position of the face in the video footage, which can be presented as coordinates.

[0167] Specifically, face detection can also detect the skin tone and clothing color of attendees.

[0168] Specifically, obtaining identity information includes: (1) extracting facial features from the video footage of the meeting captured by the camera to obtain the facial feature information of the participants; (2) sending the facial feature information to the server for matching and recognition, where the server stores the facial feature information and identity information of the participants and their corresponding relationships; and (3) receiving the identity information sent by the server.

[0169] S702. Determine the electronic nameplate based on face detection information;

[0170] Determining the electronic nameplate based on face detection information includes determining the position and size of the electronic nameplate based on the position information in the face detection information. Specifically, the coordinates of the electronic nameplate can be determined by the coordinates of the face.

[0171] Optionally, determining the position and size of the electronic nameplate based on the location information in the face detection information includes determining the distribution of attendees based on the location information in the face detection information, and determining the position and size of the electronic nameplate based on the distribution of attendees.

[0172] Furthermore, determining the electronic nameplate based on face detection information may also include determining the display style of the electronic nameplate based on the skin color or clothing color information of the participants in the face detection information. The display style of the electronic nameplate includes the brightness, color, outline shape, transparency, font and color of the text or symbols in the electronic nameplate, etc.

[0173] Before step S702, a user instruction can also be obtained. This user instruction can be input manually or by voice. The user can be a participant or other personnel. The user instruction is used to instruct the user on the display requirements of the electronic nameplate. For example, if a participant requests that the transparency of the electronic nameplate be reduced, then based on the face detection information, it is determined that the electronic nameplate also needs to reduce its display transparency according to the user instruction.

[0174] S703. Display identity information via electronic nameplate.

[0175] Identity information is added to the electronic nameplate for display.

[0176] After the electronic nameplate is initially displayed, subsequent meetings may experience overlap or obstruction between the electronic nameplate and faces due to personnel movement. If an electronic nameplate is detected to overlap with the face area of ​​a participant or another electronic nameplate, the position of the electronic nameplate will be recalculated and displayed.

[0177] Specifically, the position of the electronic nameplate is recalculated and displayed by searching for the optimal position of the nameplate within a preset neighborhood of the face. This preset neighborhood is determined based on the coordinates, width, and height of the face, as well as the width and height of the nameplate. Within the preset neighborhood, the distance s1 between the center point of the new location nameplate and the center point of the original nameplate, as well as the overlapping area s2 of the new location nameplate with other nameplates or faces, are calculated. The new location nameplate with the smallest weighted average of s1 and s2 is determined as the nameplate with the optimal position within the neighborhood.

[0178] Furthermore, the electronic nameplate and the corresponding face area of ​​the attendee can be connected by a straight line or an arrow.

[0179] Optionally, after the electronic nameplate is first displayed, the participants' speeches are detected. If it is detected that the speaking time of some participants is longer than the first preset time or shorter than the second preset time, the electronic nameplates corresponding to those participants are replaced with new electronic nameplates. Here, the new electronic nameplates include changing the display style of the original electronic nameplates.

[0180] Optionally, after the electronic nameplate is first displayed, the participants' speeches are detected. If it is detected that the speaking time of another group of participants is shorter than the third preset time, the electronic nameplates corresponding to that other group of participants are removed from the video screen.

[0181] This application provides a method for displaying electronic nameplates in video conferencing. This method calculates the position and size of the electronic nameplate based on the face position, enabling adaptive adjustment of the electronic nameplate display for participants in different meeting scenarios. The electronic nameplate can be displayed in a more intuitive way, improving meeting efficiency.

[0182] Figure 8 This application provides a method for displaying electronic nameplate timing in a video conference, such as... Figure 7 As shown, this method requires the use of sound source localization and detection technology, and the method includes:

[0183] S801. Start the timer. When the timer reaches the preset time point, determine whether there is a first person to speak among the participants based on the input audio stream.

[0184] The input audio stream is the audio stream input during the time from the start of the timer to the preset time point.

[0185] S802. Display the electronic nameplate corresponding to the first person and undisplay the electronic nameplates corresponding to other participants. The other participants are those who are not the first person among the participants.

[0186] S803, Restart timing for the first person;

[0187] This step is optional. After the first person has spoken and their electronic nameplate has been displayed, the timer for the first person will be restarted immediately. At this time, the timer for other participants can be stopped.

[0188] S804. If a second person is detected speaking among other participants, display the electronic nameplate corresponding to the second person.

[0189] This step is optional. Once a second person is detected speaking among other participants, their electronic nameplate will be displayed immediately, and the second person can be timed again.

[0190] This application provides a method for displaying electronic nameplates in video conferencing. This method controls the display of electronic nameplates by detecting whether participants speak and timing their speaking time. By canceling unnecessary electronic nameplates, resource waste is reduced. This is especially useful in complex environments where electronic nameplates can avoid occupying too much video screen space.

[0191] Figure 9 A schematic diagram of an electronic nameplate display device for video conferencing is provided as an embodiment of this application, as shown below. Figure 9 As shown, the electronic nameplate display device 90 includes: an acquisition module 91, a configuration module 92, and a display module 93.

[0192] The acquisition module 91 is used to acquire face detection information, which includes the position of the participants in the video frame;

[0193] Configuration module 92 is used to determine the electronic nameplate configuration information, which includes the display position and size of the electronic nameplate in the video frame and is associated with the face detection information.

[0194] Display module 93 is used to display the electronic nameplate in the video screen according to the electronic nameplate configuration information.

[0195] Specifically, the electronic nameplate configuration information may also include one or more of the following: the color of the electronic nameplate, the transparency of the electronic nameplate, the outline of the electronic nameplate, the font of the text or symbols in the electronic nameplate, and the color of the text or symbols in the electronic nameplate.

[0196] Specifically, the configuration module 92 determines the electronic nameplate configuration information by: determining the display position and size of the electronic nameplate in the video frame based on the position of the face in the video frame. Further, the configuration module 92 also determines the electronic nameplate configuration information by detecting and judging the distribution of the face in the video frame based on the position coordinates of the face, and determining the display position and size of the electronic nameplate in the video frame based on this distribution.

[0197] Optionally, the acquisition module 91 is further configured to acquire a first input message, which is used to indicate the user's display requirements for the electronic nameplate. The first input message includes manual input by the user and / or voice input by the user, and includes the display style of the electronic nameplate desired by the user.

[0198] Optionally, the face detection information also includes the attendee's skin color and / or clothing color, and the color and / or transparency of the electronic nameplate are determined based on the attendee's skin color and / or clothing color.

[0199] In one possible design, the electronic nameplate display device 90 further includes a first detection module 94, which is used to detect whether the location of the electronic nameplate overlaps with the face area of ​​a participant or another electronic nameplate.

[0200] If the first detection module 94 detects that the location of a certain electronic nameplate overlaps with the face area of ​​a participant or another electronic nameplate;

[0201] The display module 93 then displays the new position of the electronic nameplate or another electronic nameplate in the video frame.

[0202] In one possible design, the electronic nameplate display device 90 further includes a second detection module 95, which is used to detect whether any participant has a speaking time longer than a first preset time or shorter than a second preset time.

[0203] If the second detection module 95 detects that the speaking time of the first person among the participants is longer than the first preset time or shorter than the second preset time, the display module 93 replaces the electronic nameplate corresponding to the first person with a new electronic nameplate.

[0204] Optionally, if the second detection module 95 detects that a second participant's speaking time is shorter than the second preset time, the display module 93 can also remove the electronic nameplate corresponding to that second participant from the video screen.

[0205] As an optional solution, the electronic nameplate display device 90 also includes an audio detection module 96 and a timing module 97.

[0206] Timing module 97 is used to keep track of the participants' time.

[0207] The audio detection module 96 is used to: detect at least one third person corresponding to the input audio stream when the timing module 97 reaches a preset time point;

[0208] The display module 93 is also used to confirm whether the electronic nameplate corresponding to the at least one third person is in the display state. If the electronic nameplate corresponding to the at least one third person is not in the display state, the display module 93 displays the electronic nameplate corresponding to the at least one third person.

[0209] Furthermore, the display module 93 is also used to cancel the display of electronic nameplates corresponding to other participants, wherein the other participants are participants who are not third parties.

[0210] Optionally, the timing module 97 is also used to time the at least one third person again.

[0211] Furthermore, the audio detection module 96 is also used to detect whether a fourth person is speaking among the other participants:

[0212] If the audio detection module 96 detects that a fourth person is speaking among the other participants;

[0213] Then the display module 93 displays the electronic nameplate corresponding to the fourth person.

[0214] The timing module 97 is also used to start timing for the fourth person.

[0215] Optionally, the acquisition module 91 is further configured to acquire a second input message, which is used to instruct at least one designated electronic nameplate to be de-displayed or replaced with at least one new electronic nameplate. The second input message includes manual input by the user and / or voice input by the user.

[0216] Figure 10 This application provides a schematic diagram of an electronic nameplate display device 100 for video conferencing. The electronic nameplate display device 100 includes a display screen 101, one or more processors 102, a camera 103, a microphone 104, a memory 105, and a transceiver 106. The processor 102, also known as a processing unit, can implement certain control functions. The processor 102 can be a general-purpose processor or a dedicated processor, such as a baseband processor or a central processing unit. The baseband processor can process communication protocols and communication data, while the central processing unit can control communication devices (such as base stations, baseband chips, DUs, or CUs), execute software programs, and process data from the software programs. The transceiver 103, also known as a transceiver unit, transceiver, transceiver circuit, or transceiver, is used to implement the transceiver functions of the communication device.

[0217] An electronic nameplate display device 100 for video conferencing includes:

[0218] Memory 105 is used to store program instructions 109;

[0219] Camera 103 is used to capture video footage of the attendees;

[0220] Transceiver 106 is used to obtain the identity information of the participants;

[0221] The processor 102 is used to run the program instructions 109 to execute: to determine the display position and size of the electronic nameplate in the video frame based on the position of the attendee's face in the video frame;

[0222] The display screen 101 is used to display the identity information of the participants via electronic nameplates.

[0223] Specifically, the processor 102 determines the display position and size of the electronic nameplate in the video frame based on the position of the face in the video frame, including: the processor 102 determines the distribution of the face based on the position of the face in the video frame, and the processor 102 determines the display position and size of the electronic nameplate in the video frame based on the position and distribution of the face in the video frame.

[0224] The processor 102 can also determine the color of the electronic nameplate, the transparency of the electronic nameplate, the outline of the electronic nameplate, the font of the text or symbols in the electronic nameplate, and the color of the text or symbols in the electronic nameplate.

[0225] Optionally, the transceiver 106 is also configured to receive input messages that indicate the user's display requirements for the electronic nameplate, including input via manual input and / or voice input by the user.

[0226] The processor 102 is also used to acquire the skin color and / or clothing color of the participants in the video frame, and to determine the color and / or transparency of the electronic nameplate based on the skin color and / or clothing color of the participants.

[0227] The processor 102 is also used to determine whether the electronic nameplate overlaps with the face area of ​​the attendee or another electronic nameplate: if the processor 102 determines that an electronic nameplate overlaps with the face area of ​​the attendee or another electronic nameplate, the processor 102 determines the new display position and new size of the electronic nameplate or another electronic nameplate, and the display screen 101 displays the electronic nameplate or another electronic nameplate at the new display position and the new size.

[0228] As an optional solution, the electronic nameplate display device 100 may also include a timer 107 and a microphone 104:

[0229] Timer 107 is used to keep track of the participants' time.

[0230] Microphone 104 is used to capture the audio stream input within a preset time period;

[0231] The processor 102 is also used to determine at least one first person among the participants corresponding to the input audio stream;

[0232] The display screen 101 is also used to confirm whether the electronic nameplate corresponding to the first person is in the display state. If the electronic nameplate corresponding to the first person is not in the display state, the display screen 102 will display the electronic nameplate corresponding to the first person.

[0233] Optionally, the timer 107 is also used to time the speaking duration of the participants; the processor 102 determines whether any participant has a speaking duration longer than the first preset duration or shorter than the second preset duration: if the processor 102 determines that a second participant has a speaking duration longer than the first preset duration or shorter than the second preset duration, then the processor 102 determines a new electronic nameplate corresponding to the second participant, and the display screen 101 replaces the electronic nameplate corresponding to the second participant with the new electronic nameplate for display.

[0234] Furthermore, when the processor 102 determines that the speaking time of the second person is shorter than the second preset time, the display screen 101 can also cancel the display of the electronic nameplate corresponding to the second person.

[0235] In one possible design, the processor 102 may also store instructions 108 that can be executed by the processor 102 to cause the display device 100 of the electronic nameplate to perform the method executed by the processor 102.

[0236] In another possible design, the display device 100 of the electronic nameplate may include circuitry that can perform the methods described above for the processor 102, transceiver 106, or timer 107.

[0237] Optionally, the display device 100 of the electronic nameplate may include one or more memories 105, which may also store other related data or intermediate data. Optionally, the processor 102 may also store instructions and / or data. The processor 102 and the memory 105 may be set separately or integrated together.

[0238] This application also provides a readable storage medium storing execution instructions. When at least one processor of the electronic nameplate display device 100 executes the execution instructions, the electronic nameplate display device 100 performs the aforementioned actions. Figure 10 The method executed by processor 102 in the corresponding device embodiment.

[0239] This application also provides a program product including executable instructions stored in a readable storage medium. At least one processor of the electronic nameplate display device 100 can read the executable instructions from the readable storage medium, and the at least one processor executes the executable instructions to cause the electronic nameplate display device 100 to perform the above-described actions. Figure 10 The method executed by processor 102 in the corresponding device embodiment.

[0240] The same or similar parts between the various embodiments in this specification can be referred to mutually. In particular, the device embodiments are basically similar to the method embodiments, so the description is relatively simple. For relevant parts, please refer to the description of the method embodiments.

[0241] It is obvious to those skilled in the art that the modules or steps of the present invention described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. Optionally, they can be implemented using computer-executable program code, thereby storing them in a storage medium (ROM / RAM, magnetic disk, optical disk) for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those presented herein, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Therefore, the present invention is not limited to any particular hardware and software combination.

[0242] Finally, it should be noted that the above description is only a specific embodiment of this application, and the protection scope of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application.

Claims

1. A method of displaying an electronic nameplate in a video conference, characterized by, The method comprises the following steps: acquiring the position of the face of a participant in a video frame and the identity information of the participant; determining the display position and size of an electronic nameplate in the video frame according to the position of the face in the video frame; displaying the identity information of the participant through the electronic nameplate; updating the display style of the electronic nameplate according to the voice state of the participant; the updating of the display style of the electronic nameplate comprises: canceling the display of the electronic nameplate or redisplaying the electronic nameplate.

2. The method of claim 1, wherein, The method comprises the following steps: determining the distribution of the face according to the position of the face in the video frame; determining the display position and size of the electronic nameplate in the video frame according to the position of the face in the video frame and the distribution of the face.

3. The method of claim 1 or 2, wherein, The method further comprises the following steps:

4. The method of claim 1 or 2, wherein, determining the color of the electronic nameplate, the transparency of the electronic nameplate, the outline form of the electronic nameplate, the font of the characters or symbols in the electronic nameplate and the color of the characters or symbols in the electronic nameplate.

5. The method of claim 3, wherein, The method further comprises the following steps:

6. The method of claim 1 or 2, wherein, acquiring an input message, the input message being used for indicating the display requirement of a user for the electronic nameplate, the input message comprising manual input by the user and / or voice input by the user. The method further comprises the following steps: acquiring the skin color and / or the clothing color of the participant, and determining the color of the electronic nameplate and / or the transparency of the electronic nameplate according to the skin color and / or the clothing color of the participant.

7. The method of claim 1 or 2, wherein, After the identity information is displayed through the electronic nameplate, the method further comprises the following steps:

8. The method of claim 1 or 2, wherein, detecting that the electronic nameplate overlaps with the face region of the participant or another electronic nameplate, displaying the electronic nameplate and / or another electronic nameplate at a new position. The electronic nameplate and the face region of the corresponding participant are connected through a straight line or an arrow.

9. The method of claim 1 or 2, wherein, After the identity information is displayed through the electronic nameplate, the method further comprises the following steps: detecting that the speech duration of at least one first participant is longer than a first preset duration or shorter than a second preset duration; replacing the electronic nameplate corresponding to the at least one first participant with new electronic nameplates.

10. The method of claim 1 or 2, wherein, After the identity information is displayed through the electronic nameplate, the method further comprises the following steps: detecting that the speech duration of a second participant is shorter than a fourth preset duration within a third preset duration, the third preset duration being longer than the fourth preset duration; canceling the display of the electronic nameplate corresponding to the second participant.

11. The method of claim 1 or 2, wherein, After the identity information is displayed through the electronic nameplate, the method further comprises the following steps:

12. A display device of electronic nameplates in a video conference, characterized by, starting a timer, and determining at least one third participant corresponding to the input audio stream according to the input audio stream when the timer reaches a preset time point; confirming whether the electronic nameplate corresponding to the third participant is in a display state, and displaying the electronic nameplate corresponding to the third participant if the electronic nameplate corresponding to the third participant is not in the display state. The identity information comprises one or more of the following information: name, age, contact information, place of origin, work unit, position, educational background. The method comprises the following steps: The memory, one or more processors, transceiver, display screen, camera; The memory is used to store program instructions; The camera is used to obtain a video picture of a participant; The transceiver is used to obtain identity information of the participant; The processor is used to run the program instructions to perform: determining a display position and size of an electronic nameplate in the video picture according to a position of a face of the participant in the video picture and according to the position of the face in the video picture; The display screen is used to display the identity information through the electronic nameplate; According to a voice state of the participant, updating a display style of the electronic nameplate; the updating of the display style of the electronic nameplate includes: canceling display of the electronic nameplate or redisplaying the electronic nameplate.

13. The apparatus of claim 12, wherein, The processor determines the display position and size of the electronic nameplate in the video picture according to the position of the face in the video picture includes: The processor determines a distribution of the face according to the position of the face in the video picture; The processor determines the display position and size of the electronic nameplate in the video picture according to the position of the face in the video picture and the distribution of the face.

14. The apparatus of claim 12 or 13, wherein, The processor is further used to determine a color of the electronic nameplate, a transparency of the electronic nameplate, a contour form of the electronic nameplate, a font of a character or symbol in the electronic nameplate, and a color of the character or symbol in the electronic nameplate.

15. The apparatus of claim 12 or 13, wherein, The transceiver is further used to: receive an input message, the input message being used to indicate a display requirement of a user for the electronic nameplate, the input message including manual input by the user and / or voice input by the user.

16. The apparatus of claim 14, wherein, The processor is further used to: obtain a skin color and / or a dressing color of the participant in the video picture, and determine the color and / or the transparency of the electronic nameplate according to the skin color and / or the dressing color of the participant.

17. The apparatus of claim 12 or 13, wherein, The processor is further used to judge whether the electronic nameplate overlaps with a face region of the participant or another electronic nameplate: If the processor judges that the electronic nameplate overlaps with the face region of the participant or another electronic nameplate; Then the processor determines a new display position and a new size of the electronic nameplate or another electronic nameplate.

18. The apparatus of claim 12 or 13, wherein, The device further includes a timer and a microphone: The timer is used to time the participant; The microphone is used to collect an audio stream input within a preset time period; The processor is further used to judge at least one first person among the participants corresponding to the input audio stream; The display screen is further used to confirm whether an electronic nameplate corresponding to the first person is in a display state, and if the electronic nameplate corresponding to the first person is not in the display state, the display screen displays the electronic nameplate corresponding to the first person.

19. The apparatus of claim 18, wherein, The timer is further used to time a speaking duration of the participant; The processor determines whether a speaking time of the participant is longer than a first preset time length or shorter than a second preset time length; if the processor determines that a speaking time of a second participant is longer than the first preset time length or shorter than the second preset time length, the processor determines a new electronic nameplate corresponding to the second participant, and the display screen displays the new electronic nameplate corresponding to the second participant.

20. The apparatus of claim 19, wherein, When the processor determines that the speaking time of the second participant is shorter than the second preset time length, the display screen cancels display of the electronic nameplate corresponding to the second participant.

21. An electronic nameplate display device in a video conference, characterized by The electronic nameplate display device comprises an acquisition module, a configuration module and a display module. The acquisition module is configured to acquire a position of a face of a participant in a video picture and identity information of the participant. The configuration module is configured to determine a display position and size of an electronic nameplate in the video picture according to the position of the face in the video picture. The display module is configured to display the identity information through the electronic nameplate, and update a display style of the electronic nameplate according to a voice state of the participant; the updating of the display style of the electronic nameplate comprises canceling display of the electronic nameplate or redisplaying the electronic nameplate.

22. The apparatus of claim 21, wherein, The configuration module determines the display position and size of the electronic nameplate in the video picture according to the position of the face in the video picture, and comprises: determining a distribution of the face according to the position of the face in the video picture; determining the display position and size of the electronic nameplate in the video picture according to the position of the face in the video picture and the distribution of the face.

Images