Display method for video conference picture, and device and storage medium

Abstract

Provided in the present application are a display method for a video conference picture, and a device and a storage medium. The method comprises: detecting that a target participant in a conference room is speaking; and when a video conference picture of the conference room does not display, in real time, a conference-participating video of the target participant, displaying on the video conference picture the conference-participating video of the target participant. Compared with the related prior art, since the total number of conference-participating videos that can be simultaneously displayed on a video conference picture is less than the total number of participants in a conference room, a larger sub-picture is occupied by each conference-participating video, and the scale of a participant displayed in the sub-picture is also increased correspondingly, thereby ameliorating the problem of it being difficult to clearly see the details of the participant, such as expressions and movements, due to the sub-picture being relatively small.

Description

Video conference screen display method, device and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on November 2, 2023, with application number 202311451839.2 and invention name “Method, device and storage medium for displaying video conference screen”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application belongs to the field of artificial intelligence technology, and for example relates to a method, device and storage medium for displaying video conference screens. Background Art

[0003] Video conferencing enables geographically dispersed users to exchange information and collaborate through images, sounds, and other means, greatly shortening spatial distance and facilitating real-time and intuitive communication between collaborative members.

[0004] Currently, when multiple participants sit in a conference room for a video conference, since most conference rooms only have one camera, only one video conference screen is captured. The video conference screen shows all the participants in the conference room, and the proportion of each participant in the screen is very small, so there is a problem of not being able to see the details such as the participant's expressions and movements clearly.

[0005] Summary of the Invention

[0006] The present application proposes a method, device and storage medium for displaying video conference screens, which can alleviate the problem in related technologies of unclear details such as expressions and movements of participants.

[0007] The embodiment of the first aspect of the present application provides a method for displaying a video conference screen, comprising:

[0008] Detecting that the target participant in the conference room is speaking;

[0009] If the video conference screen of the conference room does not display the target participant's video in real time, display the target participant's video on the video conference screen;

[0010] Among them, when the video conference screen is in a stable state, the total number of participating videos displayed simultaneously on the video conference screen is less than the total number of participants in the conference room, and the stable state is used to represent that the identities of the participants displayed on the video conference screen have not changed.

[0011] Optionally, displaying the target participant's video on the video conference screen includes:

[0012] Detecting the number of participating videos currently being displayed on the video conference screen;

[0013] In the case where the number is less than the total number, compressing the current sub-screen occupied by the currently displayed participant video to obtain a compressed sub-screen; displaying the participant video of the target participant on a sub-screen other than the compressed sub-screen on the video conference screen;

[0014] When the number is greater than or equal to the total number, based on the participation process parameters of the displayed participants in the currently displayed participant video, the participant to be replaced is selected from the displayed participants; the display of the participant video to be replaced in the video conference screen is ended, and the participant video of the target participant is displayed on the video conference screen.

[0015] Optionally, compressing the current sub-picture occupied by the currently displayed conference participant video to obtain a compressed sub-picture includes:

[0016] Obtaining a first relative position relationship between the target conference participant and the conference participant in the currently displayed conference video in the conference room;

[0017] determining a compression direction for compressing the current sub-picture based on the first relative position relationship;

[0018] The current sub-picture is compressed according to the compression direction to obtain the compressed sub-picture.

[0019] Optionally, ending the display of the participant video of the participant to be replaced on the video conference screen and displaying the participant video of the target participant on the video conference screen includes:

[0020] The display of the participant video of the participant to be replaced on the video conference screen is ended by wiping, and the participant video of the target participant is displayed on the video conference screen by wiping.

[0021] Optionally, it also includes:

[0022] During the process of ending the display of the participant video of the participant to be replaced on the video conference screen by wiping, a first arrow mark is displayed on the first sub-screen displaying the participant video of the participant to be replaced, where the first arrow mark is used to indicate a direction in which the first sub-screen is reduced;

[0023] In the process of displaying the target participant's video on the video conference screen in a wiping manner, a second arrow mark is displayed on the second sub-screen displaying the target participant in the wiping manner, and the second arrow mark is used to indicate the direction in which the second sub-screen is expanded.

[0024] Optionally, displaying the target participant's video on the video conference screen in a wiping manner includes:

[0025] Detecting and obtaining a second relative positional relationship between the target participant and the remaining participants displayed on the video conference screen in the conference room; the remaining participants are the participants in the video conference screen excluding the participant to be replaced;

[0026] Based on the relative position relationship, determining a wipe start position and an expansion direction of the second sub-screen on the video conference screen;

[0027] From the wipe start position, the video of the target participant is displayed by wiping in the expansion direction.

[0028] Optionally, it also includes:

[0029] During the process of swiping to display the participant video of the target participant, if the position of the third sub-screen displaying the participant videos of the remaining participants changes, determining the direction of the change in the position of the third sub-screen based on the expansion direction;

[0030] During the process of the position change of the third sub-picture, a third arrow mark is displayed on the third sub-picture, and the third arrow mark is used to indicate the direction of the position change of the third sub-picture.

[0031] An embodiment of a second aspect of the present application provides a device for displaying a video conference screen, including:

[0032] A detection module is used to detect the target participant speaking in the conference room;

[0033] A display module is used to display the target participant's video on the video conference screen when the video conference screen of the conference room does not display the target participant's video in real time;

[0034] Among them, when the video conference screen is in a stable state, the total number of participating videos displayed simultaneously on the video conference screen is less than the total number of participants in the conference room, and the stable state is used to represent that the identities of the participants displayed on the video conference screen have not changed.

[0035] An embodiment of the third aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method described in the first aspect above.

[0036] An embodiment of the fourth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the program is executed by a processor to implement the method described in the first aspect above.

[0037] The technical solutions provided in the embodiments of this application have at least the following technical effects or advantages:

[0038] In the solution provided by this embodiment, the total number of participating videos that can be displayed simultaneously on the video conference screen is less than the total number of participants in the conference room. Compared with related technologies, the size of the sub-screen occupied by each participating video becomes larger, and correspondingly, the proportion of participants displayed in the sub-screen also becomes larger, thereby alleviating the problem that the expressions, movements and other details of the participants are difficult to see due to the small size of the sub-screen.

[0039] Additional aspects and advantages of the present application will be given in part in the description below and in part will become apparent from the description below or learned through practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Various other advantages and benefits will become apparent to those skilled in the art upon reading the detailed description of the embodiments below. The accompanying drawings are for illustration purposes only and are not to be considered as limiting the present application. The same reference symbols are used throughout the drawings to represent the same components. In the drawings:

[0041] FIG1 is a schematic diagram of a video conferencing screen shown in the related art;

[0042] FIG2 is another schematic diagram of a video conferencing screen shown in the related art;

[0043] FIG3 is a flow chart of a method for displaying a video conference screen according to an embodiment of the present application;

[0044] FIG4a is a schematic diagram of a video conferencing screen provided in an embodiment of the present application;

[0045] FIG4 b is another schematic diagram of a video conferencing screen provided in an embodiment of the present application;

[0046] FIG4c is another schematic diagram of a video conferencing screen provided in an embodiment of the present application;

[0047] FIG5 is another flow chart of a method for displaying a video conference screen according to an embodiment of the present application;

[0048] FIG6a is another schematic diagram of a video conferencing screen provided in an embodiment of the present application;

[0049] FIG6 b is another schematic diagram of a video conference screen provided in an embodiment of the present application;

[0050] FIG7 is a schematic diagram of the structure of a display device for a video conference screen provided in an embodiment of the present application;

[0051] FIG8 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0052] FIG9 shows a schematic diagram of a storage medium provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] The following describes exemplary embodiments of the present application in more detail with reference to the accompanying drawings. Although exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. Instead, these embodiments are provided to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.

[0054] It should be noted that, unless otherwise specified, the technical or scientific terms used in this application should have the common meanings understood by those skilled in the art to which this application belongs.

[0055] In the current state of the art, when multiple participants sit in a conference room for a video conference, most conference rooms only have a single camera, resulting in a single captured video conference screen. In this scenario, the current video conference screen displays participants in two ways: one, as shown in Figure 1, does not have a split screen; the video conference screen is actually the original screen captured by the camera; the other, as shown in Figure 2, consists of multiple sub-screens, the same number of which as the number of participants in the room, with each sub-screen displaying the video of a participant.

[0056] In the first display mode, each participant's screen size is very small, making it difficult to see details such as their expressions and movements. In the second display mode, when there are more participants in the room, the number of split screens increases accordingly, and each person's split screen is smaller. Therefore, it is still difficult to see details such as participants' expressions and movements, making it difficult to distinguish who is speaking.

[0057] In order to alleviate the problems existing in the related art, an embodiment of the present application provides a method for displaying a video conferencing screen, which can be applied to an electronic device, which electronic device can be a terminal device or a server, wherein a video acquisition device is deployed in the terminal device, and the video acquisition device includes but is not limited to a fixed-focus camera, a zoom camera or a combination of the two; the terminal device supports video conferencing, and the terminal device includes but is not limited to a mobile phone, a tablet computer, a laptop computer, a monitor, etc., and the server includes but is not limited to a cloud server.

[0058] As shown in FIG3 , the method may include the following steps:

[0059] Step 301: Detecting that a target participant in the conference room is speaking;

[0060] Step 302: If the video conference screen of the conference room does not display the target participant's video in real time, display the target participant's video on the video conference screen;

[0061] Among them, when the video conference screen is in a stable state, the total number of participating videos displayed simultaneously on the video conference screen is less than the total number of participants in the conference room. The stable state is used to indicate that the identities of the participants displayed on the video conference screen have not changed.

[0062] The target participant is any participant in the conference room.

[0063] In this embodiment, a microphone array is installed in the electronic device. The microphone array can collect the audio of the conference participants and calculate the sound source orientation angle of the participants relative to the microphone array based on the audio. In applications, the microphone array can be arranged in a linear array, a planar array, or a three-dimensional array, which is not specifically limited in this embodiment.

[0064] In this embodiment, the original image captured by the video capture device includes images of all conference participants in the conference room, as shown in FIG1 . Based on the image coordinate system, the position of each conference participant in the original image can be determined. When a target conference participant is detected in the conference room, the location of the participant is determined based on the sound source orientation angle. This location is then compared with the locations of the conference participants currently displayed on the video conference screen. If the locations of the conference participants currently displayed on the video conference screen do not include the target participant, it can be determined that the target conference participant's video is not being displayed in real time on the video conference screen.

[0065] It should be understood that while the video conference screen is in a stable state, the identities of the participants displayed on the video conference screen do not change. For example, if the video conference screen displays the videos of three participants, A, B, and C, the video conference screen will always display the videos of A, B, and C during the stable state, and will not display the videos of other participants.

[0066] It should be understood that when the video conference screen displays the participating videos of at least two participants, each participating video occupies a sub-screen, and the sub-screens occupied by the participating videos of at least two participants constitute the entire video conference screen.

[0067] In this embodiment, when the video conference screen is in a stable state, the total number of participating videos that can be displayed simultaneously on the video conference screen can be pre-set based on the display screen size of the electronic device. For example, the total number can be set to 3.

[0068] In the solution provided by this embodiment, the total number of participating videos that can be displayed simultaneously on the video conference screen is less than the total number of participants in the conference room. Compared with related technologies, the size of the sub-screen occupied by each participating video becomes larger, and correspondingly, the proportion of participants displayed in the sub-screen also becomes larger, thereby alleviating the problem that the expressions, movements and other details of the participants are difficult to see due to the small size of the sub-screen.

[0069] In some embodiments, displaying the target participant's video on the video conference screen may include the following steps:

[0070] Detect the number of participating videos currently displayed on the video conference screen;

[0071] If the number is less than the total number, compress the current sub-screen occupied by the currently displayed participant video to obtain a compressed sub-screen; display the participant video of the target participant on the sub-screen other than the compressed sub-screen on the video conference screen;

[0072] When the number is greater than or equal to the total number, the participant to be replaced is selected from the displayed participants based on the participation process parameters of the participant displayed in the currently displayed participant video; the display of the participant video to be replaced in the video conference screen is ended, and the participant video of the target participant is displayed on the video conference screen.

[0073] In the application, the compression of the current sub-picture includes but is not limited to the compression of the width of the current sub-picture, the compression of the height of the current sub-picture, or the compression of the width and height of the current sub-picture at the same time, which is not specifically limited in this embodiment.

[0074] To enhance the conference video reception experience for those on the receiving end, this embodiment uses a gentle switching effect to display the target participant's video on sub-screens other than the compressed sub-screen on the video conference screen. In some embodiments, this includes, but is not limited to, displaying the target participant's video using a wipe. Wipe, also known as sweep, uses an electronic screen-pull method to complete image transitions. When replacing screen A with screen B, screen A should first appear as a certain outline in a portion of screen B, then gradually expand until it completely replaces screen B. This is a screen-pull switching.

[0075] In this embodiment, in order to ensure the accuracy of the eye contact and movement direction of the people on the screen when communicating, the relative position relationship between the sub-screen displaying the target participant's video and the compressed sub-screen is consistent with the relative position relationship between the target participant and the participant displayed on the compressed sub-screen in the conference room. For example, if the target participant is A and the participant displayed on the compressed sub-screen is B, and A is to the left of B in the conference room, then the sub-screen displaying A's video on the video conference screen should also be to the left of the sub-screen displaying B's video on the video conference screen. In order to achieve this purpose, when compressing the current sub-screen to obtain the compressed sub-screen, the following steps are followed:

[0076] Obtaining a first relative position relationship between the target participant and the participant in the currently displayed conference video in the conference room;

[0077] Determining a compression direction for compressing the current sub-picture based on the first relative position relationship;

[0078] Compress the current sub-picture according to the compression direction to obtain the compressed sub-picture.

[0079] The first relative position relationship may be determined based on the position of the target participant in the original image and the position of the participant in the currently displayed conference video.

[0080] In this embodiment, the conference process parameters are used to indicate the degree of participation of the participants in the conference. The conference process parameters include but are not limited to historical speaking duration, speaking frequency and / or average single speaking duration.

[0081] In this embodiment, the participant to be replaced is the participant with the lowest level of participation in the meeting among the displayed participants. For example, the participant to be replaced can be the participant with the shortest historical speaking time, the participant with the lowest speaking frequency, or the participant with the shortest average single speaking time among the displayed participants.

[0082] In this embodiment, the user may not be aware of the end of the display of the participant video of the participant to be replaced and the display of the participant video of the target participant on the video conference screen, that is, the entire process of ending the display of the participant video of the participant to be replaced and the display of the participant video of the target participant on the video conference screen is almost instantaneous. In actual applications, in order to improve the user experience, the user may also be able to see the end process of the participant video of the participant to be replaced and the process of gradually switching the participant video of the target participant through a gentle switching effect. In this scenario, it includes but is not limited to ending the display of the participant video of the participant to be replaced on the video conference screen by wiping, and displaying the participant video of the target participant on the video conference screen by wiping.

[0083] In one example, as shown in Figures 4a, 4b, and 4c, a video conference screen in a stable state can display up to three participant videos simultaneously. The target participant is the man with glasses (Figure 4c). Before he speaks, as shown in Figure 4a, the video conference screen displays the man in the T-shirt, the woman with glasses, and the man with stripes. After the man speaks, as shown in Figure 4b, the woman with glasses is identified as the participant to be replaced. A swipe is used to gradually replace the woman's video while terminating the display of the man's video.

[0084] In this embodiment, in order to enable the opposite user to quickly understand which participant is exiting the video conference screen and which participant is joining the video conference screen, the video conference display method may further include the following steps:

[0085] During the process of ending the display of the participant video of the participant to be replaced on the video conference screen by wiping, a first arrow mark is displayed on the first sub-screen displaying the participant video of the participant to be replaced, the first arrow mark being used to indicate the direction in which the first sub-screen is reduced;

[0086] In the process of displaying the target participant's video on the video conference screen in a wiping manner, a second arrow mark is displayed on the second sub-screen displaying the target participant, and the second arrow mark is used to indicate the direction of expansion of the second sub-screen.

[0087] It should be understood that the directions indicated by the first arrow mark and the second arrow mark are different. In addition, in actual applications, in order to improve the prompt effect, the first arrow mark and the second arrow mark can also be displayed using different display effects, such as using different colors for display, or using lines of different thicknesses for display, etc.

[0088] It should be understood that as the first sub-screen shrinks, the first arrow mark can be synchronously reduced in size until it disappears. Similarly, as the second sub-screen expands, the second arrow mark can be synchronously increased in size. When the second sub-screen no longer changes, the prompt function of the second arrow mark ends. In this case, the display of the second arrow mark can be terminated.

[0089] In the application, for ease of operation, the target participant's video can be directly displayed in a sub-screen that displays the participant's video to be replaced. In this embodiment, in order to ensure the accuracy of eye contact and movement direction when the participants on the screen communicate, the target participant's video can be displayed on the video conference screen based on the second relative position relationship between the target participant and the remaining participants displayed on the video conference screen in the conference room. In an optional embodiment, the target participant's video can be displayed on the video conference screen by wiping, which can include the following steps:

[0090] Detecting and obtaining a second relative position relationship between the target participant and the remaining participants displayed on the video conference screen in the conference room; the remaining participants are the participants in the video conference screen excluding the participant to be replaced;

[0091] Based on the relative position relationship, determining a wipe start position and an expansion direction of the second sub-screen on the video conference screen;

[0092] From the wipe start position, wipe in the zoom direction to display the target participant's video.

[0093] In this embodiment, if the target participant's video is displayed by swiping with reference to the second relative position relationship, the position of the third sub-screen displaying the remaining participant's video may change. In this case, in order to enable the user to distinguish the third sub-screen from the second sub-screen and know which screen has the participant video originally displayed and which has been newly switched to display, an arrow mark may be displayed on the third sub-screen. In an optional embodiment, the method for displaying the video conference screen may further include:

[0094] During the process of swiping to display the participant video of the target participant, if the position of the third sub-screen displaying the participant videos of the remaining participants changes, the direction of the change in the position of the third sub-screen is determined based on the expansion direction;

[0095] During the process of the position change of the third sub-picture, a third arrow mark is displayed on the third sub-picture, and the third arrow mark is used to indicate the direction of the position change of the third sub-picture.

[0096] Still taking Figure 4b as an example, in the process of swiping to display the reference video of the man with glasses, the position of the sub-screen displaying the video of the man with stripes attending the meeting changes. In this case, a translation arrow can be displayed on the sub-screen displaying the video of the man with stripes attending the meeting to indicate the direction in which the position of the sub-screen changes.

[0097] It should be understood that in actual applications, in addition to displaying the target participant's video on the video conference screen in the manner mentioned in the above embodiment, you can also randomly select a participant from the displayed participants and end the display of the participant's video so that the target participant's video can be displayed on the sub-screen displaying the participant.

[0098] For ease of understanding, taking the example of displaying a maximum of three participating videos on a video conference screen in a stable state, a method for displaying a video conference screen as shown in FIG5 is provided. The method may include the following steps:

[0099] Step 501: Detecting that a new participant is speaking;

[0100] Step 502: Determine whether the number of participants currently displayed on the video conference screen is less than 3. If so, proceed to step 503; otherwise, proceed to step 504.

[0101] Step 503: The new participant joins the video conference screen by swiping, and the screen width of the previous participants is compressed to accommodate the video of the new participant;

[0102] As shown in Figures 6a and 6b, Figure 6a is a schematic diagram based on Figure 6b, showing that after the woman with glasses speaks as a new participant, her participation video is added to the video conference screen.

[0103] Step 504: First, based on historical speaking time, speaking frequency, average single speaking time and other information, determine which of the three currently displayed people needs to be replaced, then mark the new participant as a joining colleague and the replaced person as an exit colleague.

[0104] As an example, step 504 can be seen in Figures 4a-4c.

[0105] The present application also provides a video conference screen display device, which is used to execute the video conference screen display method provided in any of the above embodiments. As shown in Figure 7, the device includes:

[0106] Detection module 71, used to detect the target participant speaking in the conference room;

[0107] Display module 82, used for displaying the target participant's video on the video conference screen when the video conference screen of the conference room does not display the target participant's video in real time;

[0108] Among them, when the video conference screen is in a stable state, the total number of participating videos displayed simultaneously on the video conference screen is less than the total number of participants in the conference room. The stable state is used to indicate that the identities of the participants displayed on the video conference screen have not changed.

[0109] The display module 72 is used to:

[0110] Detect the number of participating videos currently displayed on the video conference screen;

[0111] If the number is less than the total number, compress the current sub-screen occupied by the currently displayed participant video to obtain a compressed sub-screen; display the participant video of the target participant on the sub-screen other than the compressed sub-screen on the video conference screen;

[0112] When the number is greater than or equal to the total number, the participant to be replaced is selected from the displayed participants based on the participation process parameters of the participant displayed in the currently displayed participant video; the display of the participant video to be replaced in the video conference screen is ended, and the participant video of the target participant is displayed on the video conference screen.

[0113] The display module 72 is used to:

[0114] Obtaining a first relative position relationship between the target participant and the participant in the currently displayed conference video in the conference room;

[0115] Determining a compression direction for compressing the current sub-picture based on the first relative position relationship;

[0116] Compress the current sub-picture according to the compression direction to obtain the compressed sub-picture.

[0117] The display module 72 is used to:

[0118] The display of the participant video of the participant to be replaced on the video conference screen is ended by wiping, and the participant video of the target participant is displayed on the video conference screen by wiping.

[0119] During the process of ending the display of the participant video of the participant to be replaced on the video conference screen by wiping, a first arrow mark is displayed on the first sub-screen displaying the participant video of the participant to be replaced, the first arrow mark being used to indicate the direction in which the first sub-screen is reduced;

[0120] In the process of displaying the target participant's video on the video conference screen in a wiping manner, a second arrow mark is displayed on the second sub-screen displaying the target participant, and the second arrow mark is used to indicate the direction of expansion of the second sub-screen.

[0121] The display module 72 is used to:

[0122] Detecting and obtaining a second relative position relationship between the target participant and the remaining participants displayed on the video conference screen in the conference room; the remaining participants are the participants in the video conference screen excluding the participant to be replaced;

[0123] Based on the relative position relationship, determining a wipe start position and an expansion direction of the second sub-screen on the video conference screen;

[0124] From the wipe start position, wipe in the zoom direction to display the target participant's video.

[0125] The device is also used to:

[0126] During the process of swiping to display the participant video of the target participant, if the position of the third sub-screen displaying the participant videos of the remaining participants changes, the direction of the change in the position of the third sub-screen is determined based on the expansion direction;

[0127] During the process of the position change of the third sub-picture, a third arrow mark is displayed on the third sub-picture, and the third arrow mark is used to indicate the direction of the position change of the third sub-picture.

[0128] The display device for the video conference screen provided in the embodiment of the present application and the display method for the video conference screen provided in the embodiment of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, operated or implemented therein.

[0129] The embodiments of the present application also provide an electronic device to perform the above-mentioned method for displaying a video conference screen. Please refer to Figure 8, which shows a schematic diagram of an electronic device provided by some embodiments of the present application. As shown in Figure 8, the electronic device 8 includes: a processor 800, a memory 801, a bus 802 and a communication interface 803. The processor 800, the communication interface 803 and the memory 801 are connected via the bus 802; the memory 801 stores a computer program that can be run on the processor 800, and when the processor 800 runs the computer program, it executes the method for displaying a video conference screen provided by any of the aforementioned embodiments of the present application.

[0130] The memory 801 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage. The communication connection between the device network element and at least one other network element is achieved through at least one communication interface 803 (which may be wired or wireless), and may use the Internet, a wide area network, a local area network, a metropolitan area network, etc.

[0131] Bus 802 may be an ISA bus, a PCI bus, or an EISA bus. Buses may be classified as address buses, data buses, and control buses. Memory 801 is used to store programs, and processor 800 executes the programs upon receiving execution instructions. The method for displaying a video conference screen disclosed in any of the aforementioned embodiments of the present application may be applied to or implemented by processor 800.

[0132] The processor 800 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits in the processor 800 or by software instructions. The above processor 800 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), an off-the-shelf field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in conjunction with the embodiments of this application can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory 801 , and the processor 800 reads the information in the memory 801 and completes the steps of the above method in combination with its hardware.

[0133] The electronic device provided in the embodiment of the present application and the method for displaying the video conference screen provided in the embodiment of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, operated or implemented therein.

[0134] An embodiment of the present application also provides a computer-readable storage medium corresponding to the method for displaying a video conference screen provided in the aforementioned embodiment. Please refer to Figure 9, which shows that the computer-readable storage medium is a CD 30, on which a computer program (i.e., a program product) is stored. When the computer program is run by the processor, it will execute the method for displaying a video conference screen provided in any of the aforementioned embodiments.

[0135] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media, which are not listed here one by one.

[0136] The computer-readable storage medium provided in the above-mentioned embodiments of the present application and the method for displaying a video conference screen provided in the embodiments of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.

[0137] It should be noted that:

[0138] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known structures and technologies are not shown in detail so as not to obscure the understanding of this description.

[0139] Similarly, it should be understood that in order to streamline the present application and aid in understanding one or more of the various application aspects, in the above description of the exemplary embodiments of the present application, the various features of the present application are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the following schematic diagram: the claimed application requires more features than the features explicitly recited in each claim. Rather, as reflected in the claims below, the application aspects lie in less than all the features of the individual embodiments disclosed above. Therefore, the claims following the detailed description are hereby expressly incorporated into the detailed description, with each claim itself serving as a separate embodiment of the present application.

[0140] Furthermore, those skilled in the art will appreciate that although some embodiments described herein include certain features included in other embodiments but not other features, combinations of features from different embodiments are intended to be within the scope of this application and to form different embodiments. For example, in the claims below, any of the claimed embodiments may be used in any combination.

[0141] The above are merely some embodiments of the present application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for displaying a video conference screen, wherein: include: It is detected that the target participant in the conference room is speaking; In the case where the video conference screen of the conference room does not display the participating video of the target participant in real time, displaying the participating video of the target participant on the video conference screen; Among them, when the video conference screen is in a stable state, the total number of participating videos displayed simultaneously on the video conference screen is less than the total number of participants in the conference room, and the stable state is used to represent that the identities of the participants displayed on the video conference screen have not changed.

2. The method according to claim 1, wherein: Displaying the target participant's video on the video conference screen includes: Detecting the number of participating videos currently being displayed on the video conference screen; In the case where the number is less than the total number, compressing the current sub-screen occupied by the currently displayed participant video to obtain a compressed sub-screen; displaying the participant video of the target participant on a sub-screen other than the compressed sub-screen on the video conference screen; In the case that the number is greater than or equal to the total number, based on the participation process parameters of the displayed participants in the currently displayed participant video, select the participant to be replaced from the displayed participants; end the display of the participant video of the participant to be replaced in the video conference screen, and display the participant video of the target participant on the video conference screen.

3. The method according to claim 2, wherein: Compressing the current sub-screen occupied by the currently displayed conference participant video to obtain a compressed sub-screen, including: Obtaining a first relative position relationship between the target conference participant and the conference participant in the conference video currently being displayed in the conference room; Based on the first relative position relationship, determining a compression direction for compressing the current sub-picture; The current sub-picture is compressed according to the compression direction to obtain the compressed sub-picture.

4. The method according to claim 2, wherein: Ending the display of the conference video of the participant to be replaced on the video conference screen, and displaying the conference video of the target participant on the video conference screen, includes: The display of the conference video of the participant to be replaced on the video conference screen is ended by wiping, and the conference video of the target participant is displayed on the video conference screen by wiping.

5. The method according to claim 4, wherein: Also includes: The video conference screen ends displaying the video of the participant to be replaced by wiping. During the process, a first arrow mark is displayed on the first sub-screen displaying the conference participant video of the conference participant to be replaced, and the first arrow mark is used to indicate the direction in which the first sub-screen is reduced; In the process of displaying the participating video of the target participant on the video conference screen in a wiping manner, a second arrow mark is displayed on the second sub-screen displaying the target participant in the wiping manner, and the second arrow mark is used to indicate the direction in which the second sub-screen is expanded.

6. The method according to claim 5, wherein: The method of displaying the target participant's video on the video conference screen in a wiping manner includes: Detecting and obtaining a second relative position relationship between the target participant and the remaining participants displayed in the video conference screen in the conference room; the remaining participants are the participants in the video conference screen except the participant to be replaced; Based on the relative position relationship, determining a wipe start position and an expansion direction of the second sub-screen on the video conference screen; From the wipe start position, the video of the target participant is displayed by wiping in the enlargement direction.

7. The method according to claim 6, wherein: Also includes: In the process of swiping to display the participating video of the target participant, if the position of the third sub-screen displaying the participating videos of the remaining participants changes, determining the direction in which the position of the third sub-screen changes based on the expansion direction; During the process of the position change of the third sub-picture, a third arrow mark is displayed on the third sub-picture, and the third arrow mark is used to indicate the direction of the position change of the third sub-picture.

8. A display device for a video conference screen, wherein: include: A detection module is used to detect the target participant speaking in the conference room; A display module, configured to display the target conference participant's conference video on the video conference screen when the conference room's video conference screen does not display the target conference participant's conference video in real time; Among them, when the video conference screen is in a stable state, the total number of participating videos displayed simultaneously on the video conference screen is less than the total number of participants in the conference room, and the stable state is used to represent that the identities of the participants displayed on the video conference screen have not changed.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: The processor runs the computer program to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, wherein: The program is executed by a processor to implement the method according to any one of claims 1 to 7.

Images