Video Call Interface Display Control Method, Apparatus, Storage Medium, and Device

Abstract

The embodiments of the present disclosure disclose a video call interface display control method, device, storage medium, and device. The method includes: determining a current layout mode in which a video call interface is located; detecting a gesture operation acting on the video call interface; and controlling the video call interface to switch to a corresponding different layout mode if it is determined that the gesture operation satisfies a preset switching condition corresponding to the current layout mode. By adopting the above technical solution, the layout mode of a video call interface can be switched efficiently and conveniently using gesture operations, and switching inputs such as buttons can be omitted, thereby saving space on the video call interface and making the video call interface more beautiful.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of computer technology, and particularly to a method, apparatus, storage medium, and device for controlling the display of a video call interface.

Background Art

[0002] With the rapid development of the Internet and intelligent terminals, the video call function is becoming increasingly popular. In a video call interface, usually, multiple video windows are used to simultaneously display the video screens of both or multiple call parties. However, since the display method of each window may all affect the final display effect, it is necessary to reasonably control the display of the video call interface.

[0003] For example, different layout modes can be set for multiple windows and switched according to the actual situation. Currently, the technical solutions for realizing the switching of the video call interface layout need to be realized depending on controls such as buttons fixed on the video call interface. Since the buttons not only occupy the space of the video call interface but also affect the aesthetics of the video call interface, the conventional video call interface display control solutions are not perfect and need to be improved.

Summary of the Invention

Problems to be Solved by the Invention

[0004] Embodiments of the present disclosure provide a method, apparatus, storage medium, and device for controlling the display of a video call interface, which can optimize the conventional video call interface display control solutions.

Means for Solving the Problems

[0005] According to a first aspect, embodiments of the present disclosure provide a method for controlling the display of a video call interface. The method includes: The steps include determining the current layout mode in which the video call interface is located, The steps include detecting gesture operations that act on the video call interface, The process includes the step of controlling the video call interface to switch to a different layout mode if it determines that the gesture operation satisfies a preset switching condition corresponding to the current layout mode.

[0006] According to a second aspect, an embodiment of the present disclosure provides a video call interface display control device. In the device, The aforementioned video call interface includes at least two windows for displaying the video screen. The aforementioned device is A layout mode determination module for determining the current layout mode in which the video call interface is located, A gesture detection module for detecting gesture operations acting on the aforementioned video call interface, The system includes a display control module for controlling the video call interface to switch to a different layout mode if it determines that the gesture operation satisfies a preset switching condition corresponding to the current layout mode.

[0007] According to a third aspect, an embodiment of the present disclosure provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the program is executed by a processor, it realizes a video call interface display control method according to an embodiment of the present disclosure.

[0008] According to a fourth aspect, an embodiment of the present disclosure provides an electronic device. The electronic device includes a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein when the processor executes the computer program, it realizes a video call interface display control method according to an embodiment of the present disclosure.

[0009] According to a fifth aspect, an embodiment of the present disclosure provides a computer program product. The computer program product includes a computer program, the computer program is stored in a readable storage medium, at least one processor of an electronic device is able to read the computer program from the readable storage medium, the at least one processor executes the computer program, and the electronic device is able to perform the first aspect described above. Mr. / Ms. Make them carry out the method.

[0010] According to a sixth aspect, an embodiment of the present disclosure provides a computer program. The computer program is stored in a readable storage medium, at least one processor of an electronic device is able to read the computer program from the readable storage medium, and the at least one processor executes the computer program and provides the electronic device with the first aspect. Mr. / Ms. Make them carry out the method.

[0011] The video call interface display control method according to the embodiment of this disclosure determines the current layout mode in which the video call interface is located, detects gesture operations acting on the video call interface, and controls the video call interface to switch to a corresponding alternative layout mode if it determines that the gesture operation satisfies a preset switching condition corresponding to the current layout mode. By adopting the above method, the layout mode of the video call interface can be switched efficiently and conveniently using gesture operations, and switching entries such as buttons are omitted, saving space on the video call interface and making the video call interface more aesthetically pleasing. [Brief explanation of the drawing]

[0012] [Figure 1] This is a flowchart of a video call interface display control method according to an embodiment of the present disclosure. [Figure 2]This is a flowchart of yet another video call interface display control method according to an embodiment of the present disclosure. [Figure 3] This is a schematic diagram of the layout mode switching process according to an embodiment of the present disclosure. [Figure 4] This is a flowchart of another video call interface display control method according to an embodiment of the present disclosure. [Figure 5] This is a schematic diagram of yet another layout mode switching process according to an embodiment of the present disclosure. [Figure 6] This is a structural block diagram of a video call interface display control device according to an embodiment of the present disclosure. [Figure 7] This is a structural block diagram of an electronic device according to an embodiment of the present disclosure. [Modes for carrying out the invention]

[0013] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. While the accompanying drawings illustrate some embodiments of the present disclosure, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, these embodiments are provided to allow for a more transparent and complete understanding of the present disclosure. It should be understood that the accompanying drawings and embodiments of the present disclosure are not intended to be used to limit the scope of protection of the present disclosure, but are used solely for illustrative purposes.

[0014] It should be understood that the steps described in the embodiments of the methods of this disclosure may be performed in different orders and / or in parallel. Furthermore, embodiments of the methods may include additional steps and / or omit the execution of the indicated steps. The scope of this disclosure is not limited in this respect.

[0015] As used herein, the term "comprising" and its variations are non-limiting inclusion, i.e., "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment", the term "another embodiment" means "at least one another embodiment", and the term "some embodiments" means "at least some embodiments". Related definitions of other terms are given in the following description.

[0016] It should be noted that concepts such as "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions executed by these devices, modules or units.

[0017] It should be understood that the modifications of "one" and "a plurality" mentioned in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that they can be understood as "one or a plurality" unless specifically pointed out clearly in the context.

[0018] The names of messages or information that interact between multiple devices in the embodiments of this disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0019] In each of the following embodiments, optional features and examples are provided simultaneously in each embodiment, and each feature described in the embodiment can be combined to form a plurality of optional technical solutions, and each numbered embodiment should not be regarded as only one technical solution.

[0020] Figure 1 is a flowchart of a video call interface display control method according to an embodiment of the present disclosure, the method may be performed by a video call interface display control device, which can be implemented by software and / or hardware and can generally be integrated into an electronic device. Here, the electronic device may be a device equipped with video call functionality, such as a mobile phone, tablet PC, laptop computer, and personal digital assistant.

[0021] As shown in Figure 1, the method includes the following:

[0022] Step 101: Determine the current layout mode in which the video call interface is located.

[0023] For example, a video call function can typically support a one-on-one two-person call mode, and can also support a multi-person call mode. Generally, a video call interface may include at least two windows for displaying video screens. For example, in a two-person call mode, there may be two video windows (hereinafter simply referred to as windows) to display the video screens of both parties in the call. In a multi-person call mode, there may be two or more windows to display the video screens of at least both parties in the call. Of course, depending on the actual requirements, only one window may be displayed, for example, the window of one party, the caller. The video screen is generally a real-time call screen, and is an image collected in real time by an image acquisition device (e.g., a camera) in an electronic device used by the caller.

[0024] For example, to further diversify the video call interface and better meet the diverse needs of users, a video call interface can typically have two or more layout modes. In different layout modes, the window layout rules are different. Here, the layout rules may include at least one or a combination of several aspects, such as nesting relationships between windows, adjacency relationships between windows, planar arrangement order of windows, stacking order of windows in the hierarchy, display position of windows, display size of windows, and shape of windows.

[0025] Step 102: Detect gesture operations that affect the video call interface.

[0026] For example, the screen of the electronic device may be a touchscreen, and the gesture operation may be a touch gesture operation that acts on a video call interface displayed on the screen. Alternatively, the screen of the electronic device may be of another type, in which case the gesture operation may be a remote gesture operation corresponding to a video call interface displayed on the screen. Of course, if it is a touchscreen, the gesture operation may be a remote gesture operation. The detection methods corresponding to different types of gesture operations may also be different and may be set specifically according to the circumstances. For example, a touch gesture operation can be detected by a touchscreen. A remote gesture operation can be detected by a component on the electronic device, such as an ultrasonic sensor.

[0027] Step 103: If it is determined that the gesture operation satisfies a preset switching condition corresponding to the current layout mode, control the video call interface to switch to the corresponding other layout mode.

[0028] For example, switching conditions may be predefined for switching between different layout modes, and these switching conditions may include specific gesture operation information. Here, the gesture operation information may include the gesture type (e.g., click, double-click, long press, drag, and multi-point touch gestures such as pinch or multi-slide), and may further include the slide trajectory, gesture action area, and gesture action duration.

[0029] Note that there may be one or more pre-set switching conditions for switching from one layout mode to another. If there are multiple conditions, the switch may occur when any one of them is met. For ease of understanding, the following explanation will use the example of a single condition.

[0030] Assume there are two layout modes: a first layout mode and a second layout mode. Switching from the first layout mode to the second layout mode corresponds to a first pre-set switching condition, and switching from the second layout mode to the first layout mode corresponds to a second pre-set switching condition.

[0031] Assume there are three layout modes: a first layout mode, a second layout mode, and a third layout mode. Switching from the first layout mode to the second layout mode corresponds to a first pre-set switching condition, and switching from the second layout mode to the first layout mode corresponds to a second pre-set switching condition. Switching from the first layout mode to the third layout mode corresponds to a third pre-set switching condition, switching from the third layout mode to the first layout mode corresponds to a fourth pre-set switching condition, switching from the second layout mode to the third layout mode corresponds to a fifth pre-set switching condition, and switching from the third layout mode to the second layout mode corresponds to a sixth pre-set switching condition.

[0032] After determining the current layout mode, it is possible to determine which layout mode the current layout mode can be switched to, and further, the detected gesture operation can be compared with the corresponding pre-configured switching conditions. If the corresponding pre-configured switching conditions are met, the video call interface can be controlled to switch to the corresponding other layout mode. For example, assuming that there are three layout modes as described above, if the current layout mode is the first layout mode, there is a possibility of switching to the second or third layout mode, and the pre-configured switching conditions that need to be compared can be determined to be the first pre-configured switching condition and the third pre-configured switching condition.

[0033] The video call interface display control method according to the embodiment of this disclosure includes a video call interface in which at least two windows for displaying a video screen are included, determines the current layout mode in which the video call interface is located, detects a gesture operation acting on the video call interface, and controls the video call interface to switch to another corresponding layout mode if it is determined that the gesture operation satisfies a preset switching condition corresponding to the current layout mode. By adopting the above technical method, the layout mode of the video call interface can be switched efficiently and conveniently using gesture operations, and switching entries such as buttons are omitted, saving space on the video call interface and making the video call interface more aesthetically pleasing.

[0034] In one embodiment, the video call interface has at least a first layout mode and a second layout mode. The first layout mode includes one main window and at least one sub-window, the at least one sub-window nested within the main window, and the second layout mode includes at least two parallel windows, each displaying the full video screen of the caller. The advantage of this configuration is that the two modes largely meet the usage requirements in different scenarios, reducing computational load and improving switching speed. Here, in the first layout mode, the main window generally fills the entire video call interface, and if each window corresponds to a layer, the main window is located in the lower layer, and the sub-windows are located in the upper or middle layer, and the display size of the sub-windows is generally relatively small, for example, 1 / 16th of the main window, so that the sub-windows only cover a relatively small portion of the video screen within the main window. In the second layout mode, the arrangement of the parallel windows is not limited and can be determined according to the screen size or display method of the electronic device (such as landscape or portrait display). Taking the example of two parallel windows, they may be arranged vertically, for example, the first parallel window occupying the upper half of the video call interface and the second parallel window occupying the lower half of the video call interface, and they may also be arranged horizontally.Taking the example of four parallel windows, the four windows may be arranged in a grid pattern, and the display sizes of the four windows may or may not be equal.

[0035] In one embodiment, if the current layout mode is a first layout mode, and it is determined that the gesture operation satisfies a preset switching condition corresponding to the current layout mode, the step of controlling the video call interface to switch to another corresponding layout mode includes, if it is determined that the first subwindow is dragged within a first preset area range in the center of the video call interface based on the gesture operation, switching the main window to display it as a first parallel window in the second layout mode, and at the same time displaying the first subwindow in the video box corresponding to the second parallel window according to its original size; and, after it is determined that the first subwindow is released based on the gesture operation, switching the first subwindow to display it so as to fill the video box. The advantage of this configuration is that switching from the first layout mode to the second layout mode can be achieved conveniently and accurately. Furthermore, the position of the first parallel window can be determined based on the position of the first subwindow within the first preset area range. Here, the first pre-defined area range may be set according to the actual requirements. For example, the video call interface may be divided into three equal parts from left to right, and the area corresponding to the middle section may be the first pre-defined area range. The drag operation can be understood as pressing and sliding, and may be a single or multi-operation. The video box may be understood as the edge corresponding to the second parallel window, or as an identifier of the corresponding result given by the system, and presents the display effect after the switch to the user. The background of the video box is not limited and may be, for example, black or white. If the user is satisfied with the effect after the switch, they can release their finger, and thus the size of the first sub-window becomes the same as the video box, and the final switch is complete.

[0036] In one embodiment, if the current layout mode includes a second subwindow, the configuration further includes the steps of displaying the first subwindow in the video box corresponding to the second parallel window, and simultaneously displaying the second subwindow in the video box corresponding to the third parallel window according to its original size, or switching the second subwindow to display as the third parallel window. The advantage of this configuration is that it can be applied to multi-party video call scenes. Here, the second subwindow can refer to any subwindow other than the first subwindow, and the specific number may be one or more. The third parallel window can refer to any parallel window other than the first and second parallel windows, and the specific number may be one or more. The number of second subwindows and third parallel windows may generally be the same.

[0037] In one embodiment, if the current layout mode is a second layout mode, and it is determined that the gesture operation satisfies a preset switching condition corresponding to the current layout mode, the step of controlling the video call interface to switch to the corresponding other layout mode includes, if it is determined that the first parallel window is dragged within a second preset area on both sides of the video call interface based on the gesture operation, switching the second parallel window to display as the main window in the first layout mode, and simultaneously switching the first parallel window to display as the first sub-window; and after it is determined that the first sub-window is released based on the gesture operation, fixing the display position of the first sub-window. The advantage of this configuration is that switching from the second layout mode to the first layout mode can be achieved conveniently and accurately. Furthermore, the display position of the first sub-window after it is fixed can be determined based on its position before it is released. Here, the second pre-configured area range may be set according to the actual requirements. For example, after dividing the video call interface described above into three equal parts from left to right, the ranges corresponding to the left and right regions may be set as the second pre-configured area range.

[0038] In one embodiment, after the step of detecting a gesture operation acting on the video call interface, if it is determined that the gesture operation is a scaling operation acting on the first window, the further step includes adjusting the display size of the first window based on the scaling operation. The advantage of this configuration is that the display size of the windows can be adjusted using the gesture operation, making the display of each window more flexible, applicable to more usage scenarios, and able to meet more user demands. Here, the scaling operation may be, for example, pinch scaling or multi-scaling, where, for example, an enlargement operation refers to sliding outward from the touch point after a pinch or multi-touch touches the screen, and a shrinkment operation refers to sliding inward from the touch point after a pinch or multi-touch touches the screen. The first window may be a window in any layout mode. The display size of the first window may change dynamically in response to the scaling operation, and when the first window is released, the display size of the first window is fixed. If the first window is a window in a second layout mode, when the size of the first window changes, the sizes of other parallel windows can be adaptively adjusted.

[0039] In one embodiment, if the current layout mode is a first layout mode, and the gesture operation determines that a preset switching condition corresponding to the current layout mode is met, the step of controlling the video call interface to switch to a corresponding other layout mode includes, if the gesture operation determines that the size of the first sub-window is to be expanded to a first preset size threshold, switching the main window to display as a first parallel window in the second layout mode, and at the same time displaying the first sub-window in the video box corresponding to the second parallel window according to its current size; and, after determining that the first sub-window is to be released based on the gesture operation, switching the first sub-window to display so as to fill the video box. The advantage of this configuration is that switching from the first layout mode to the second layout mode can be achieved conveniently and accurately, and can be combined with the technique of adjusting the window display size by the scaling operation described above. The first preset size threshold may be set according to the actual requirements and can be characterized by length, width, or area, for example, the area corresponding to the first preset size threshold is one-third of the video call interface. The position of the first parallel window can be determined based on the position of the first sub-window after it has been enlarged.

[0040] In one embodiment, if the current layout mode is a second layout mode, and the gesture operation determines that a preset switching condition corresponding to the current layout mode is met, the step of controlling the video call interface to switch to the corresponding other layout mode includes, if the gesture operation determines that the size of the first parallel window is reduced to a second preset size threshold, switching the second parallel window to display as the main window in the first layout mode, and simultaneously switching the first parallel window to display as the first sub-window; and, after determining that the first sub-window is to be released based on the gesture operation, fixing the display position of the first sub-window. The advantage of this configuration is that switching from the second layout mode to the first layout mode can be achieved conveniently and accurately, and can be combined with the technique of adjusting the window display size by the scaling operation described above. The second preset size threshold may be set according to actual requirements and can be characterized by length, width, or area, for example, the area corresponding to the second preset size threshold is one-quarter of the video call interface. The position of the first subwindow can be determined based on the position of the first parallel window after it has been reduced in size.

[0041] In one embodiment, if the current layout mode includes a second subwindow, the first subwindow is Original size The process may further include the step of displaying the second sub-window in the video box corresponding to the second parallel window, while simultaneously displaying the second sub-window in the video box corresponding to the third parallel window according to its original size, or switching the second sub-window to display as the third parallel window. The advantage of this configuration is that it can be applied to multi-party video call scenes.

[0042] In one embodiment, the display position of a window can be adjusted using gesture operations. Selectively, if the current layout mode is a second layout mode, and after the step of detecting a gesture operation acting on the video call interface, if it is decided based on the gesture operation that the first parallel window should move to the second parallel window so that the overlapping area of ​​the first and second parallel windows reaches a first area threshold, the further step includes swapping the display positions of the first and second parallel windows. The advantage of this configuration is that the display positions of the parallel windows can be easily adjusted, improving the flexibility of this layout mode. The first area threshold may be a fixed value, the product of the area of ​​the first or second parallel window and a preset coefficient, or it may be set according to actual requirements.

[0043] Selectively, if the current layout mode is the first layout mode, the process further includes the step of detecting a gesture operation acting on the video call interface, and if it is detected that the first subwindow is being dragged, the display position of the first subwindow is changed in real time during the drag, and if it is detected that the first subwindow is being released, the first subwindow is fixed. The advantage of this configuration is that the display position of the subwindow can be easily adjusted, improving the flexibility of this layout mode. In addition, to improve compatibility with the technical proposal for switching layout modes, the determination of the length of stay or the number of fingers performing the drag operation may be increased. For example, if it is determined that the first subwindow is dragged into a first preset area in the center of the screen based on a gesture operation and the length of stay reaches a first preset time, the main window is switched to be displayed as the first parallel window in the second layout mode. Or, for example, if it is determined that the first subwindow is dragged with a pinch gesture into a first preset area in the center of the screen based on a gesture operation, the main window is switched to be displayed as the first parallel window in the second layout mode.

[0044] In one embodiment, if the current layout mode is the first layout mode, and after the step of detecting a gesture operation acting on the video call interface, if it is determined that the first subwindow should be dragged into a third preset area range in the main window based on the gesture operation, the further step includes swapping the display positions of the first subwindow and the main window. The advantage of this configuration is that it enriches the main window switching method and makes the operation process more intuitive. The center of the third preset area range may overlap with the center of the main window, and the specific edges may be set according to actual requirements.

[0045] In one embodiment, if the current layout mode is the first layout mode and there are at least two subwindows, after the step of detecting a gesture operation acting on the video call interface, if a first preset gesture operation acting on the first subwindow is detected, the steps of hiding the other subwindows below the first subwindow are further included: if a second preset gesture operation acting on the first subwindow is detected, the video screens of the first subwindow and the second subwindow hidden below the first subwindow are swapped; and if a third preset gesture operation acting on the first subwindow is detected, all subwindows hidden below the first subwindow are switched to the top level of the video call interface and displayed. The advantage of this configuration is that in a multi-side call mode, subwindows corresponding to some of the calling sides can be stacked, reducing the occupancy of the main window display area, and the stacking method and stacking order can be flexibly controlled using gesture operations. The three pre-set gesture operations described above may be freely configured. For example, the first pre-set gesture operation may be a long press, the second pre-set gesture operation may be a click, and the third pre-set gesture operation may be a long press.

[0046] Figure 2 is a flowchart of yet another video call interface display control method according to an embodiment of the present disclosure, and as shown in Figure 2, the method includes the following, using a one-to-one call mode as an example:

[0047] Step 201, determine that the current layout mode in which the video call interface is located is the first layout mode.

[0048] Figure 3 is a schematic diagram of the layout mode switching process according to an embodiment of the present disclosure, and the video call interface in the first layout mode (also called the large / small screen mode) is as shown in interface a in Figure 3, and here includes a main window 301 (i.e., the large screen, shown in diagonal shading) and a sub-window 302 (the small screen).

[0049] Step 202: Detect gesture operations that affect the video call interface.

[0050] Step 203, if it is determined that the sub-window is dragged within the first pre-defined area in the center of the video call interface based on the gesture operation, the main window is switched to display as the first parallel window in the second layout mode, and at the same time, the sub-window is displayed in the video box corresponding to the second parallel window according to its original size.

[0051] As shown in the b interface in Figure 3, the video call interface is divided into three areas by two dashed lines, where the middle area may correspond to a first pre-set area range. Exemplarily, the display position of the sub-window can be changed in real time during the dragging process. When the sub-window 302 is dragged into the first pre-set area range, the main window is displayed as the first parallel window 303 in the second layout mode (in this mode, there are two parallel windows distributed vertically, also called the vertical screen mode). Since the sub-window 302 has been dragged to the upper half of the first pre-set area range, the main window is displayed as the first parallel window 303 located in the lower half of the entire video call interface, the video box 304 corresponding to the position of the second parallel window located in the upper half is displayed, and the sub-window 302 can be displayed within the video box 304. In this way, the user can see the expected effect after switching more intuitively, which is more in line with the user's intuition than switching by directly clicking a button.

[0052] Step 204: After deciding to release the subwindow based on the gesture operation, switch the subwindow to display it so that it fills the video box.

[0053] For example, the user can release their finger when they feel the switching meets their expectations, and complete the switch from the first layout mode to the second layout mode. The effect after the switch is as shown in the c interface in Figure 3, where the subwindow 302 fills the video box and then becomes the second parallel window 305 in the second layout mode.

[0054] In the first layout mode, the display size of subwindows can be further dynamically adjusted by applying scaling operations to subwindows using pinch gestures. Furthermore, during the switching or display size adjustment process, the video screen displayed within can be adaptively adjusted according to the transformation of the window size, and when the size becomes smaller, the display of video screens other than people can be reduced.

[0055] Step 205, if it is decided based on the gesture operation that the first parallel window should move to the second parallel window so that the overlapping area of ​​the first and second parallel windows reaches the first area threshold, swap the display positions of the first and second parallel windows.

[0056] In the second layout mode, gesture operations such as dragging can be used to move one of the parallel windows to another, further enabling the swapping of the display positions of both windows. As shown in the d interface in Figure 3, the first parallel window 303 can be dragged to the second parallel window 305, and during the movement process, it is possible to allow a portion of the window to be hidden. For example, the display area of ​​the first parallel window 303 in the d interface is smaller than the display area of ​​the first parallel window 303 in the c interface. When the overlapping area of ​​the first parallel window 303 and the second parallel window 305 reaches a first area threshold, their positions are swapped. Selectively, it is also possible to swap their positions after detecting that the first parallel window has been released. The display effect is as shown in the e interface in Figure 3.

[0057] Step 206, if it is determined based on the gesture operation that the first parallel window is dragged within a second preset area on either side of the video call interface, the second parallel window is switched to be displayed as the main window in the first layout mode, and at the same time, the first parallel window is switched to be displayed as a sub-window.

[0058] As shown in the f interface in Figure 3, if the left and right regions of the three regions divided by the dashed lines all correspond to a second pre-set region range, then when the first parallel window 303 in the f interface is dragged into the second pre-set region range, the second parallel window 305 can be switched and displayed as a new main window 306 in the first layout mode. At the same time, as shown in the g interface in Figure 3, the first parallel window 303 is switched and displayed as a new sub-window 307.

[0059] Step 207: After determining that the first subwindow should be released based on the gesture operation, the display position of the first subwindow is fixed.

[0060] The video call interface display control method according to the embodiment of this disclosure flexibly and conveniently switches between large / small screen layout mode and vertical screen layout mode using gesture operations such as dragging, and also allows for flexible adjustment of the display size or position of each window using gesture operations in different layout modes, thereby diversifying the display methods of the video call interface and eliminating switching entries such as buttons, saving space in the video call interface and making the video call interface more aesthetically pleasing.

[0061] Figure 4 is a flowchart of another video call interface display control method according to an embodiment of the present disclosure. As an example of a multi-party call mode (for convenience of explanation, let's consider it a three-way call), the method includes the following, as shown in Figure 4.

[0062] Step 401: Determine that the current layout mode in which the video call interface is located is the first layout mode.

[0063] Figure 5 is a schematic diagram of yet another layout mode switching process according to an embodiment of the present disclosure, where the video call interface in the first layout mode is shown in interface a in Figure 5, and includes a main window 501, a first sub-window 502, and a second sub-window 503.

[0064] For example, in this layout mode, you can hide the second subwindow 503 behind the first subwindow 502 by using a gesture (for example, by long-pressing the first subwindow 502), you can switch the stack order of the second subwindow 503 and the first subwindow 502 (for example, by clicking the first subwindow 502), that is, you can hide the first subwindow 502 behind the second subwindow 503, and you can also restore the display of both subwindows by long-pressing the currently displayed subwindow.

[0065] Step 402: Detect gesture operations that affect the video call interface.

[0066] Step 403, if it is determined that the size of the first sub-window should be expanded to a first preset size threshold based on the gesture operation, the main window is switched to be displayed as the first parallel window in the second layout mode, the second sub-window is switched to be displayed as the third parallel window in the second layout mode, and at the same time, the first sub-window is displayed in the video box corresponding to the second parallel window according to its current size.

[0067] As shown in the b interface in Figure 5, when the first sub-window 502 is enlarged to reach a first preset size threshold, the main window 501 is switched and displayed as the first parallel window 504 in the second layout mode, and the second sub-window is switched and displayed as the third parallel window 505, while the first sub-window 502 is displayed in the video box 506 corresponding to the second parallel window according to its current size.

[0068] Step 404: After deciding to release the subwindow based on the gesture operation, switch to displaying the first subwindow to fill the video box.

[0069] For example, when the user feels that the switching meets their expectations, they can release their finger and complete the switch from the first layout mode to the second layout mode, and the effect after the switch is as shown in the c interface in Figure 5. First Subwindow 502, after filling the video box, becomes the second parallel window 507 in the second layout mode.

[0070] Step 405, if it is determined based on the gesture operation that the size of the first parallel window should be reduced to a second preset size threshold, the second parallel window is switched to be displayed as the main window in the first layout mode, the first parallel window is switched to be displayed as the first sub-window, and the third parallel window is switched to be displayed as the second sub-window.

[0071] As shown in the d interface in Figure 5, the size of the first parallel window 504 is reduced to reach a second preset size threshold. As shown in the e interface in Figure 5, when the second preset size threshold is reached, the second parallel window is switched and displayed as a new main window 508 in the first layout mode, the first parallel window 504 is switched and displayed as a new first sub-window 509, and the third parallel window 505 is switched and displayed as a new second sub-window 510. Here, the position of the new second sub-window 510 may preferentially be restored to its original position, i.e., the position in the a interface, but of course it may be in any other position, or it may be set according to the actual requirements.

[0072] Step 406: After determining that the first subwindow should be released based on the gesture operation, the display positions of the first and second subwindows are fixed.

[0073] The video call interface display control method according to the embodiments of this disclosure can flexibly and conveniently switch between large / small screen layout mode and vertical screen layout mode using gesture operations such as finger scaling, and can flexibly adjust the display size or display position of each window using gesture operations in different layout modes, thereby diversifying the display methods of the video call interface, and by omitting switching entries such as buttons, it saves space in the video call interface and makes the video call interface more aesthetically pleasing.

[0074] Figure 6 is a structural block diagram of a video call interface display control device according to an embodiment of the present disclosure, which can be implemented by software and / or hardware, can generally be integrated into electronic equipment, and can control the display of a video call interface by executing a video call interface display control method. As shown in Figure 6, the device is A layout mode determination module 601 for determining the current layout mode in which the video call interface is located, A gesture operation detection module 602 for detecting gesture operations acting on the video call interface, The system includes a display control module 603 for controlling the video call interface to switch to a different layout mode if it determines that the gesture operation satisfies a preset switching condition corresponding to the current layout mode.

[0075] The video call interface display control device according to the embodiment of this disclosure can efficiently and conveniently switch the layout mode of the video call interface using gesture operation, and eliminates switching entries such as buttons, thereby saving space in the video call interface and making the video call interface more aesthetically pleasing.

[0076] Selectively, the video call interface has at least a first layout mode and a second layout mode, the first layout mode comprising one main window and at least one sub-window, the at least one sub-window nested within the main window, and the second layout mode comprising at least two parallel windows, each of which displays the full video screen of the caller.

[0077] Selectively, display control module 603This may be used, when the current layout mode is the first layout mode, and it is determined based on the gesture operation that the first subwindow is dragged into a first preset area in the center of the video call interface, to switch the main window to display it as the first parallel window in the second layout mode, and at the same time display the first subwindow in the video box corresponding to the second parallel window according to its original size, and after it is determined based on the gesture operation that the first subwindow is released, to switch the first subwindow to display it so as to fill the video box.

[0078] Selectively, the display control module 603 This is further used, when the current layout mode includes a second subwindow, to display the first subwindow in the video box corresponding to the second parallel window, and at the same time display the second subwindow in the video box corresponding to the third parallel window according to its original size, or to switch the second subwindow and display it as the third parallel window.

[0079] Selectively, display control module 603 If the current layout mode is the second layout mode, and it is determined based on the gesture operation that the first parallel window will be dragged into a second set of area ranges on both sides of the video call interface, then the second parallel window may be switched to be displayed as the main window in the first layout mode, and at the same time, the first parallel window may be switched to be displayed as the first sub-window, and after it is determined based on the gesture operation that the first sub-window will be released, the display position of the first sub-window may be fixed.

[0080] Selectively, display control module 603This may be used when, if the current layout mode is the first layout mode, it is determined based on the gesture operation that the size of the first sub-window should be expanded to a first preset size threshold, the main window is switched to be displayed as the first parallel window in the second layout mode, and at the same time, the first sub-window is displayed in the video box corresponding to the second parallel window according to its current size, and after it is determined based on the gesture operation that the first sub-window should be released, the first sub-window is switched to be displayed so as to fill the video box.

[0081] Selectively, display control module 603 If the current layout mode is the second layout mode, and it is determined based on the gesture operation that the size of the first parallel window should be reduced to a second preset size threshold, the second parallel window may be switched to be displayed as the main window in the first layout mode, and at the same time, the first parallel window may be switched to be displayed as the first sub-window, and after it is determined based on the gesture operation that the first sub-window should be released, the display position of the first sub-window may be fixed.

[0082] Selectively, display control module 603 If the current layout mode is the second layout mode, and after the step of detecting a gesture operation acting on the video call interface, it is decided based on the gesture operation that the first parallel window should move to the second parallel window so that the overlapping area of ​​the first parallel window and the second parallel window reaches the first area threshold, this may be used to swap the display positions of the first parallel window and the second parallel window.

[0083] Selectively, display control module 603If, after the step of detecting a gesture operation acting on the video call interface, it is determined that the gesture operation is a scaling operation acting on the first window, then it may be used to adjust the display size of the first window based on the scaling operation.

[0084] Selectively, display control module 603 If the current layout mode is the first layout mode, and after the step of detecting a gesture operation acting on the video call interface, it is determined that the first subwindow should be dragged into a third preset area range in the main window based on the gesture operation, this may be used to swap the display positions of the first subwindow and the main window.

[0085] Selectively, display control module 603 This may be used, if the current layout mode is the first layout mode and there are at least two subwindows, after the step of detecting a gesture operation acting on the video call interface, if a first preset gesture operation acting on the first subwindow is detected, the other subwindows may be hidden below the first subwindow; if a second preset gesture operation acting on the first subwindow is detected, the video screens of the first subwindow and the second subwindow hidden below the first subwindow may be swapped; and if a third preset gesture operation acting on the first subwindow is detected, all subwindows hidden below the first subwindow may be switched to display on the top floor of the video call interface.

[0086] Referring below to Figure 7, which shows a schematic diagram of the structure of an electronic device 700 for realizing an embodiment of the present disclosure. The electronic device in the embodiment of the present disclosure may include, but is not limited to, mobile devices such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 7 is merely an example, and no arbitrary restrictions should be placed on the functions and scope of use of the embodiment of the present disclosure.

[0087] As shown in Figure 7, the electronic device 700 may include a processing unit (e.g., a central processor, graphics processor, etc.) 701, which can perform various appropriate operations and processes based on a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. Various programs and data necessary for the operation of the electronic device 700 are stored in the RAM 703. The processing unit 701, ROM 702, and RAM 703 are connected to each other by a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0088] Typically, input devices 706, such as touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, and gyroscopes; output devices 707, such as liquid crystal displays (LCDs), speakers, and vibrators; storage devices 708, such as magnetic tapes and hard disks; and communication devices 709 can be connected to the I / O interface 705. The communication device 709 can enable the electronic device 700 to exchange data with other devices via wireless or wired communication. While Figure 7 shows an electronic device 700 with various devices, it should be understood that it is not required to implement or include all shown devices. More or fewer devices may be implemented or included as alternatives.

[0089] In particular, based on embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product which includes a computer program contained on a non-temporary computer-readable medium, and the computer program includes program code for performing the method shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network by a communication device 709, or installed from a storage device 708, or installed from a ROM 702. When the computer program is executed by a processing unit 701, it performs the functions limited to the methods of embodiments of the present disclosure.

[0090] The computer-readable medium in this disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of both. The computer-readable storage medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of more than these. More specific examples of computer-readable storage mediums may include, but are not limited to, electrical connections having one or more wires, portable computer magnetic disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact magnetic disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this disclosure, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in conjunction with an instruction execution system, apparatus, or device. However, in this disclosure, the computer-readable signal medium may be included in the baseband, or may be a data signal on which part of the carrier is propagated, thereby containing computer-readable program code. Such propagated data signals may take multiple forms and may include, but are not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, and such computer-readable signal medium may transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including, but are not limited to, electric wires, optical cables, RF (radio frequency), or any suitable combination thereof.

[0091] The computer-readable medium described above may be included in the electronic device described above, or it may exist separately without being incorporated into the electronic device.

[0092] The computer-readable medium contains one or more programs, and when the one or more programs are executed by the electronic device, the electronic device is instructed to determine the current layout mode in which the video call interface is located, to detect gesture operations acting on the video call interface, and, if it determines that the gesture operation satisfies a preset switching condition corresponding to the current layout mode, to control the video call interface to switch to another corresponding layout mode.

[0093] Computer program code for performing the operations of the Disclosure can be written in one or more programming languages ​​or a combination thereof, and such programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java®, Smalltalk®, and C++, as well as general procedural programming languages ​​such as the "C" language or similar programming languages. The program code may run entirely on a user computer, partially on a user computer, run as a single, independent software package, run partially on a user computer and partially on a remote computer, or run entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user computer by any type of network, including a local area network (LAN) or a wide area network (WAN), or it may be connected to an external computer (for example, connected via the Internet using an Internet service provider).

[0094] Embodiments of the present disclosure further provide a computer program, the computer program stored in a readable storage medium, at least one processor of an electronic device capable of reading the computer program from the readable storage medium, the at least one processor executing the computer program and causing the electronic device to perform the method according to any one of the embodiments described above.

[0095] The flowcharts and block diagrams in the accompanying drawings illustrate the systematic architecture, functions, and operations that can be realized according to the systems, methods, and computer program products of various embodiments of this disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or portion of code, which includes one or more executable instructions for realizing a defined logical function. It should be noted that in some alternative realizations, the functions noted in a block may occur in a different order than those noted in the accompanying drawings. For example, two consecutively displayed blocks may actually be executed essentially in parallel, and they may also be executed in reverse order depending on the related functions. It should be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be realized based on a system of dedicated hardware that performs the defined function or operation, or in combination of dedicated hardware and computer instructions.

[0096] The modules described in the embodiments of this disclosure and relating thereto may be implemented in software or in hardware. Herein, the names of the modules do not in some cases constitute a limitation on the module itself; for example, the layout mode determination module may be further described as "a module that determines the current layout mode in which the video call interface is located."

[0097] The functions described herein can be performed by at least partially one or more hardware logic components. For example, exemplary types of hardware logic components that can be used without limitation include field programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), system-on-chip (SOCs), and complex programmable logic devices (CPLDs).

[0098] In the context of this disclosure, an instrument-readable medium may be a tangible medium that contains or stores a program for use by or in conjunction with an instruction execution system, device, or apparatus. An instrument-readable medium may be an instrument-readable signal medium or an instrument-readable storage medium. An instrument-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any appropriate combination of the above. More specific examples of instrument-readable storage media include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any appropriate combination of the above.

[0099] The above description is merely an explanation of preferred embodiments and operational technical principles of the present disclosure. A person skilled in the art should understand that the scope of the present disclosure is not limited to technical solutions comprising specific combinations of the above technical features, but should also include other technical solutions formed by any combination of the above technical features or their equivalents, without departing from the concepts disclosed above. For example, technical solutions formed by substituting the above features with (but not limited to) similar functional technical features disclosed herein.

[0100] While each operation is described in a specific procedure, it should not be understood that these operations are required to be performed in a specific procedure or sequence indicated. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes some specific implementation details, these should not be construed as limitations on the scope of this disclosure. Any feature described in the context of an individual embodiment may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may be implemented individually or in any suitable subcombination in multiple embodiments.

[0101] While this subject matter is described using language specific to structural features and / or methodological logic, it should be understood that the subject matter limited to the attached claims is not necessarily limited to the specific features or behaviors described above. Conversely, the specific features and behaviors described above are merely illustrative forms of realizing the claims.

[0102] This application claims priority to Chinese Patent Application No. 202010458529.3, filed with the China National Intellectual Property Administration on 25 May 2020, with the title "Video Call Interface Display Control Method, Apparatus, Storage Medium and Device," the entirety of which is incorporated herein by reference.

Claims

1. A video call interface display control method, comprising: determining a current layout mode in which a video call interface is located; detecting a gesture operation acting on the video call interface; and controlling the video call interface to switch to a corresponding different layout mode when determining that the gesture operation satisfies a preset switching condition corresponding to the current layout mode.

2. the video call interface has at least a first layout mode and a second layout mode; the first layout mode includes one main window and at least one sub-window, the at least one sub-window being nested within the main window; 2. The method of claim 1, wherein the second layout mode includes at least two parallel windows, each of the parallel windows displaying a complete video screen of a calling party.

3. When the current layout mode is the first layout mode, if it is determined that the gesture operation satisfies a preset switching condition corresponding to the current layout mode, controlling the video call interface to switch to a corresponding another layout mode includes: when determining that a first sub-window is dragged within a first preset area range in the center of the video call interface based on the gesture operation, switching the main window to display it as a first parallel window in the second layout mode, and simultaneously displaying the first sub-window in a video box corresponding to the second parallel window according to its original size; 3. The method of claim 2, further comprising: after determining that the first subwindow is to be released based on the gesture operation, switching the first subwindow to display so as to fill the video box.

4. If the current layout mode includes a second sub-window, the first sub-window is displayed in a video box corresponding to the second parallel window according to its original size, while the method includes:

4. The method of claim 3, further comprising the step of: displaying the second subwindow in a video box corresponding to a third parallel window according to its original size; or switching the second subwindow to be displayed as the third parallel window.

5. When the current layout mode is the second layout mode, if it is determined that the gesture operation satisfies a preset switching condition corresponding to the current layout mode, controlling the video call interface to switch to a corresponding another layout mode includes: when determining that a first parallel window is dragged into a second preset area range on both sides of the video call interface based on the gesture operation, switching the second parallel window to be displayed as a main window in the first layout mode, and simultaneously switching the first parallel window to be displayed as a first sub-window; 3. The method of claim 2, further comprising: fixing a display position of the first subwindow after determining that the first subwindow is to be released based on the gesture operation.

6. When the current layout mode is the first layout mode, if it is determined that the gesture operation satisfies a preset switching condition corresponding to the current layout mode, controlling the video call interface to switch to a corresponding another layout mode includes: when determining that the size of a first sub-window is to be enlarged to a first preset size threshold based on the gesture operation, switching the main window to be displayed as a first parallel window in the second layout mode, and simultaneously displaying the first sub-window in a video box corresponding to a second parallel window according to its current size; 3. The method of claim 2, further comprising: after determining that the first subwindow is to be released based on the gesture operation, switching the first subwindow to display so as to fill the video box.

7. When the current layout mode is the second layout mode, if it is determined that the gesture operation satisfies a preset switching condition corresponding to the current layout mode, controlling the video call interface to switch to a corresponding another layout mode includes: when determining that the size of the first parallel window is reduced to a second preset size threshold based on the gesture operation, switching the second parallel window to be displayed as a main window in the first layout mode, and simultaneously switching the first parallel window to be displayed as a first sub-window; 3. The method of claim 2, further comprising: fixing a display position of the first subwindow after determining that the first subwindow is to be released based on the gesture operation.

8. If the current layout mode is a second layout mode, after the step of detecting a gesture operation acting on the video call interface, the method further comprises:

8. The method according to claim 2, further comprising: when determining, based on the gesture operation, to move a first parallel window to a second parallel window so that an overlapping area between the first parallel window and the second parallel window reaches a first area threshold, swapping display positions of the first parallel window and the second parallel window.

9. After the step of detecting a gesture operation acting on the video call interface, the method further comprises:

8. The method of claim 2, further comprising: if it is determined that the gesture operation is a scaling operation acting on a first window, adjusting a display size of the first window based on the scaling operation.

10. If the current layout mode is a first layout mode, after the step of detecting a gesture operation acting on the video call interface, the method further comprises:

8. The method according to claim 2, further comprising: exchanging display positions of the first subwindow and the main window when it is determined based on the gesture operation that the first subwindow is dragged into a third preset area range of the main window.

11. When the current layout mode is a first layout mode and there are at least two sub-windows, after the step of detecting a gesture operation acting on the video call interface, the method includes: hiding other sub-windows under the first sub-window when detecting a first preset gesture operation acting on the first sub-window; When a second preset gesture operation acting on the first sub-window is detected, swapping video screens of the first sub-window and a second sub-window hidden under the first sub-window; 8. The method according to claim 2, further comprising: when detecting a third preset gesture operation acting on the first subwindow, switching all subwindows hidden under the first subwindow to be displayed on the top level of the video call interface.

12. A video call interface display control device, a layout mode determination module for determining a current layout mode in which the video call interface is located; a gesture operation detection module for detecting a gesture operation acting on the video call interface; and a display control module for controlling the video call interface to switch to a corresponding different layout mode when determining that the gesture operation satisfies a preset switching condition corresponding to the current layout mode.

13. A computer-readable storage medium having stored thereon a computer program, which, when executed by a processor, implements the method of any one of claims 1 to 11.

14. 12. An electronic device comprising a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein when the processor executes the computer program, the method of any one of claims 1 to 11 is implemented.

15. A computer program product comprising computer program instructions, said computer program instructions causing a computer to carry out the method of any one of claims 1 to 11.

16. A computer program, characterized in that the computer program causes a computer to carry out the method according to any one of claims 1 to 11.

Images