Image display method

The image display method addresses screen layout changes in video conferences by using dynamic effects to maintain participant image positions, improving interaction efficiency and user experience.

JP2026512186AActive Publication Date: 2026-04-15GUANGZHOU SHIYUAN ELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-02-22
Publication Date
2026-04-15

AI Technical Summary

Technical Problem

Participants in video conferences face difficulties in finding interested participants due to sudden changes in screen layouts caused by additions, removals, or positional changes of participants, leading to reduced interaction efficiency.

Method used

An image display method that uses dynamic special effects to update the screen layout in response to changes in participant number or position, ensuring the relative positions of images on the screen correspond to the actual positions of participants, enhancing the visibility of these changes.

Benefits of technology

The method improves interaction efficiency by allowing participants to quickly locate interested parties on the screen, reducing clutter and enhancing the overall video conference experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026512186000001_ABST
    Figure 2026512186000001_ABST
Patent Text Reader

Abstract

Embodiments of this application disclose an image display method applicable to a video conferencing scene. The image display method includes the steps of: displaying images and relative positions of multiple participants on a target page; triggering an update command for the target page when an increase in the number of participants is detected; adding an image corresponding to a new participant to the target page using dynamic special effects, adjusting the images and relative positions of the original multiple participants on the target page accordingly to form a new target page, and displaying an image corresponding to the new participant and the images and relative positions of the original multiple participants on the new target page, wherein the relative positions of the images of the new participant and the original multiple participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the conference room. By adopting embodiments of this application, the efficiency of interaction between participants and multiple images can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of image processing, and particularly to an image display method.

Background Art

[0002] With the development of computer technology, video conferencing technology, which enables people in different locations to conduct face-to-face communication via communication devices and networks, has been widely applied in fields such as entertainment, education, training, marketing, and advertising. In realizing a video conference, participants collect video data through corresponding video terminals and aggregate and display it on a video conference interface. For example, on the video conference interface, multiple screens obtained by dividing the entire interface are displayed, and an image representing a participant is displayed on each screen.

[0003] However, as the meeting progresses, the number or position of participants may change. As a result, the screens displaying the images of participants on the video conference interface change, and participants cannot timely find the participants they are interested in within the changed screens, which affects the participants' experience of participating in the video conference and reduces the interaction efficiency based on the video conference.

Summary of the Invention

Means for Solving the Problems

[0004] Embodiments of this application provide an image display method that can improve the interaction efficiency between a user and multiple images. The technical solutions are as follows: In a first aspect, an image display method applied to a video conference scene according to an embodiment of this application includes: displaying images and relative positions of a plurality of participants on a target page, where the target page is a preset page for aggregating and displaying images of each participant in a meeting room; If an increase in the number of participants is detected, the step of triggering an update command for the target page, wherein the target page includes multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room. The steps include adding an image corresponding to a new participant to the target page using dynamic special effects, adjusting the images and relative positions of the original multiple participants on the target page accordingly to form a new target page, and displaying the image corresponding to the new participant and the images and relative positions of the original multiple participants on the new target page, wherein the relative positions of the images of the new participant and the original multiple participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the meeting room.

[0005] In a second aspect, the image display method applied to a video conferencing scene according to the embodiment of this application is: A step of displaying images and relative positions of multiple participants on a target page, wherein the target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room; If a decrease in the number of participants is detected, the step of triggering an update command for the target page, wherein the target page includes multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room. The steps include: removing the image corresponding to the participant to be removed from the target page using dynamic special effects; adjusting the images and relative positions of the remaining participants accordingly to form a new target page; and displaying the images and relative positions of the remaining participants on the new target page, wherein the relative positions of the images of the remaining participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the meeting room.

[0006] In a third aspect, the image display method applied to a video conferencing scene according to the embodiment of this application is: A step of displaying images and relative positions of multiple participants on a target page, wherein the target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room; If a change in the relative positions of multiple participants is detected, the step of triggering an update command for the target page is to include multiple images corresponding to multiple participants, wherein the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room. The steps include updating the target page with images corresponding to participants whose relative positions have changed using dynamic special effects, adjusting the updated participant images and relative positions accordingly to form a single target page, and displaying the updated participant images and relative positions on the new target page, wherein the relative position of the updated participant image on the new target page corresponds one-to-one with the relative position of the corresponding participant in the meeting room.

[0007] The beneficial effects of the technical solutions provided by some embodiments of this application include at least the following: This application displays multiple images on a target page according to the relative positions of multiple participants, and the positional relationships between the multiple images on the target page correspond to the positional relationships between the multiple participants corresponding to the multiple images. When a change in the number and / or positional relationships of the multiple participants is detected, an update command for the target page is triggered, and the target image corresponding to the update command is updated and displayed on the target page using dynamic special effects. In this way, participants can observe the adjustments to the video conference screen in a timely manner, thereby promptly discovering the video conference participant they are interested in from the screen, and thereby improving the efficiency of interaction between participants and multiple images. [Brief explanation of the drawing]

[0008] To more clearly explain the embodiments of this application or the technical solutions in the prior art, the following is a brief introduction of the drawings necessary for describing the embodiments or the prior art. However, it is clear that the drawings in the following description are only a few embodiments of this application, and those skilled in the art can obtain other drawings based on these without requiring any creative effort. [Figure 1] This is a schematic diagram of a scene of an image display method according to an embodiment of this application. [Figure 2] This is a flowchart of the image display method according to the embodiment of this application. [Figure 3] This is a flowchart of an image processing method according to an embodiment of this application. [Figure 4] This is a schematic diagram of a scene in which the number of participants increases according to the embodiment of this application. [Figure 5A] This is a schematic diagram of an image display page according to an embodiment of this application. [Figure 5B] This is a schematic diagram of an image display page according to an embodiment of this application. [Figure 6] This is a flowchart of the image display method according to the embodiment of this application. [Figure 7] This is a schematic diagram of a scene in which the number of participants decreases according to the embodiment of this application. [Figure 8A] This is a schematic diagram of an image display page according to an embodiment of this application. [Figure 8B] This is a schematic diagram of an image display page according to an embodiment of this application. [Figure 9] This is a flowchart of the image display method according to the embodiment of this application. [Figure 10] This is a schematic diagram of a scene in which the positions of multiple participants change according to an embodiment of this application. [Figure 11] This is a schematic diagram of an image display page according to an embodiment of this application. [Figure 12] This is a schematic diagram of an image display device according to an embodiment of this application. [Figure 13]This is a schematic diagram of an image display device according to an embodiment of this application. [Figure 14] This is a schematic diagram of an image display device according to an embodiment of this application. [Figure 15] This is a schematic diagram of the electronic device according to an embodiment of this application. [Modes for carrying out the invention]

[0009] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the drawings of the embodiments of this application, and it is clear that the embodiments described are only a part of the embodiments of this application, not all of them. Any other embodiments that a person skilled in the art can obtain without creative effort based on the embodiments of this application are all within the scope of protection of this application.

[0010] It should be understood that in this description, terms such as “first,” “second,” etc., are for descriptive purposes only and should not be understood as indicating or implying relative importance. In this description, unless otherwise explicitly stated and limited, “includes” and “has,” and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus including a series of steps or units may, optionally, include, but is not limited to, the steps or units shown, further steps or units not shown, or may optionally include, further other steps or units specific to these processes, methods, products, or devices. A person skilled in the art will understand the specific meaning of the above terms in this application depending on the specific context. Also, in this description, unless otherwise specified, “plural” means two or more. “And / or” is solely for describing the relationship between related objects and indicates that three types of relationships are possible; for example, A and / or B can indicate three situations: A existing alone, A and B existing simultaneously, or B existing alone. The character " / " generally indicates that the objects before and after it are related by the "or" sign.

[0011] The present application will be described in detail below with reference to specific embodiments.

[0012] It should be noted that all the information (including but not limited to the user's device information, personal information, etc.) related to the embodiments in this specification, data (including but not limited to data for analysis, memory data, display data, etc.), and signals have been approved by the user or fully approved by all relevant parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the images and location information related to this specification are obtained when fully approved.

[0013] With the development of computer technology, video conferencing technology, in which people in different locations conduct face-to-face communication through communication devices and networks, has been widely applied in fields such as entertainment, education, training, marketing, and advertising. To realize a video conference, participants collect video data through corresponding video terminals and aggregate and display it on a video conference interface. For example, on the video conference interface, multiple screens containing some or all of the participants from the video data are displayed, and an image representing the participant is displayed on each screen.

[0014] As shown in FIG. 1, it is a schematic diagram of an image display scene according to an embodiment of the present application. The schematic diagram of the scene includes a processor 101, a target page 102 on a display device, and a plurality of participants. In the embodiments of the present application, a person is exemplified as a participant. That is, as shown in FIG. 1, the plurality of participants include user 1031, user 1032, user 1033, and user 1034.

[0015] The processor 101 communicates with the display device and may be integrated on the display device or located on the cloud or other network server. When the processor 101 receives a video conference trigger command or other similar command, it displays a virtual same-frame screen of the video conference on the display device, and this virtual same-frame screen is the target page 102. The target page 102 displays images and relative positions of multiple participants (or users, also called participants), and the target page 102 is a pre-configured page for aggregating and displaying the images of each participant in the conference room. Relative positions can be in various situations, and the target page 102 displays the relative positions for at least one situation. For example, in the lower left diagram of Figure 1, A is located above C and simultaneously to the right of C, but the target page 102 in the upper right diagram of Figure 1 only displays the relative positional relationship that A is located above C. The target page contains multiple virtual positions (e.g., rectangular frames) as images for accommodating users, i.e., each virtual position corresponds to each user, and the arrangement of the virtual positions is the same as the arrangement of the actual positions of the users. Alternatively, the target page displays multiple adaptive profiles, each profile is matched to a specific user, and the positional relationships between the profiles correspond to the positions between the images.

[0016] It is understandable that the multiple images included on the target page may be of any shape and may be dynamic or static images, and the images on the target page 101 may be understood as embodied representations of codes representing the user on the display device. Figure 1 is illustrative only, and the present application does not limit it in any way. In some embodiments, after one or more cameras capture an actual scene, the processor identifies multiple participants, such as faces or heads, from the captured video stream (which may be video streams captured and generated by each camera, or a single video stream formed by fusing video streams captured and generated by multiple cameras), and then performs image processing (e.g., cutting out the identified faces or heads from the frames of the video stream) to generate a video conferencing screen that aggregates and displays images of each face or head so that, for example, each participant, such as a head or face, is located in a corresponding rectangular frame.

[0017] As shown in Figure 1, in an actual scene, the positional relationship between multiple participants is such that, as shown in the lower left of Figure 1, user 1031 is to the left of user 1032, user 1033 is in front of user 1031, and user 1034 is in front of user 1032 and to the right of user 1033. After capturing the actual scene with one or more cameras, the processor 101 identifies multiple participants, such as faces or heads, from the captured video stream and then performs image processing to generate a target page 102 for the video conference to aggregate and display each face or head, and the target page 102 can be displayed on a display device as shown in the upper right of Figure 1. In the target page 102, user 1031 corresponds to image A, user 1032 corresponds to image B, user 1033 corresponds to image C, and user 1034 corresponds to image D. On target page 102, the positional relationship between multiple images is as follows: Image A is located to the left of Image B, Image C is located below Image A, and Image D is located below Image B and to the right of Image C.

[0018] The display device can collect video stream data or image data, and the type of display device is not limited to various personal computers, notebook computers, smartphones, tablet computers, IoT devices, and portable wearable devices. IoT devices may include smart speakers, smart TVs, smart air conditioners, smart in-car devices, etc. Portable wearable devices may include smartwatches, smart bracelets, head-mounted devices, etc. The processor 101 may be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server for providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDNs, big data, and artificial intelligence platforms. This application is not limited thereto.

[0019] The video conferencing technology described in this application is a specific method for realizing cloud conferencing. Cloud conferencing is an efficient, convenient, and low-cost form of meeting based on cloud computing technology. Users can collect video or sound data through a display device and quickly and efficiently synchronize and share audio, data files, and video with teams and customers around the world simply by performing simple and easy-to-do operations.

[0020] However, as the meeting progresses, participants may move around, changing their relative positions. Alternatively, participants may leave the meeting or new participants may join, potentially changing the number or location of participants. As a result, while the screen layout on the video conferencing interface may not change, the specific content of the screen may change, or both the screen layout and the specific content may change. Some technologies adjust the video conferencing screen in response to these changes in participants. However, if the adjustment is sudden, the resulting adjustment will be displayed on the video conferencing interface in real time. From the participant's perspective, this sudden screen adjustment prevents them from finding the participant they are interested in in a timely manner. The suddenly adjusted screen is very cluttered for participants watching the video conference, impacting their video conference experience and reducing the efficiency of video conference interaction.

[0021] For example, in a multi-person meeting, participant A might have been focusing on participant B through the video conferencing interface before the screen layout was adjusted. However, with the addition of a new participant, the video conferencing screen layout suddenly changes instantly. Participant A becomes very confused at this point because the adjusted screen layout is completely new to them. They cannot determine where participant B has been positioned on the screen layout and therefore have to struggle to find participant B in the adjusted layout, which affects the efficiency of the video conference and becomes particularly problematic in multi-person meetings.

[0022] Based on the above problems, the inventors conducted research and experiments and discovered that when adjusting the screen, if the process of the before-and-after changes in the image of the participant being adjusted (for example, a newly joined participant or a remote participant) is presented on the video conference screen using a dynamic effect, this dynamic effect makes it easier for the user to observe the adjustment of the video conference screen in a timely manner and thereby find the video conference participant they are interested in on the screen, improving the efficiency of the video conference.

[0023] This application provides an image display method to solve this problem. With this image display method, after screen adjustment, participants can find the participant of interest in the adjusted screen in a timely manner, thereby improving the efficiency of video conferencing. In one embodiment, as shown in Figure 2, is a flowchart of the image display method according to an embodiment of this application, and this method may be implemented relying on a computer program executable on an image display device based on a von Neumann system. This computer program may be integrated into an application or run as a standalone tool or application.

[0024] Specifically, this image display method is applied to video conferencing scenes and includes the following steps: S101 displays images and relative positions of multiple participants on the target page. The target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room.

[0025] S102, if it is detected that the number and / or location of multiple participants has changed, trigger a refresh command for the target page.

[0026] After the camera collects video data of the actual conference room scene, the processor 101 detects participants from the video data. The detection frequency is preset, and for example, the video data can be detected every 2 frames or 60ms. In the case of detecting multiple participants, an ID number is assigned to each detected participant, and each participant has their own ID. Then, the number of IDs can be statistically counted to determine a change in the number of participants. In the case of changes in the positions of multiple participants, the relative position change of multiple participants (such as coordinates corresponding to the participants) can be determined. Taking head detection as an example, there are coordinates corresponding to each head, and if it is detected that the coordinate of head a has moved from the left of the coordinate of head b to the right of the coordinate of head b, it is determined that the relative position of head a and head b has changed from a left, b right to a right, b left, i.e., the relative position has changed. Naturally, in order to make a more accurate and stable determination, a preset time (e.g., 1 s) can be set, and if the duration of the state after the change in the relative position of the participants exceeds this preset time, it is determined that the relative position has changed.

[0027] The target page contains multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room. The target page refers to a page used to display images corresponding to each participant in a meeting together within the same frame on a display device. As shown in target image 102 in Figure 1, the target page of a video conference on a display device displays images corresponding to four participants together within the same frame. Repeated explanations are omitted here.

[0028] In one embodiment, the target page also includes a virtual scene, where images corresponding to multiple participants are displayed within the virtual scene. The virtual scene refers to a virtual background or defocused background within the target page. The defocused background can protect privacy, and the virtual background can include multiple different virtual scenes to accommodate video conferences on various themes. Specifically, the virtual scene can include various scenes such as symposiums and seminars. By setting different virtual scenes, it is possible to create an atmosphere that corresponds to the theme of the video conference, which helps to enhance the sense of presence in the video conference and thereby improves the efficiency of video conference interaction.

[0029] The virtual positions on the target page may be locations for accommodating the corresponding participants, and specifically, they may take various forms such as rectangular frames, small houses, marker frames, or seats. At each virtual position on the target page, an image corresponding to the participant may be displayed outside the image, and after the participant is identified by facial recognition technology, information about the participant corresponding to the image may be displayed on the image, such as various information such as the name, account, title, and network status of the meeting member, thereby displaying rich meeting member information on the target page, making it easier for users to quickly and intuitively obtain meeting member information.

[0030] A virtual location is a position for accommodating a corresponding participant, and specifically, it may take various forms such as a rectangular frame, a small house, a marked frame, or a seat. The form of the virtual location may be pre-defined according to the needs of the virtual scene. For example, in the case of a symposium virtual scene, the corresponding virtual location may be a small virtual house separating different groups of meeting members. A virtual location can accommodate a corresponding meeting member; for example, if a virtual location is a virtual seat, the person's image in the real-time image of the corresponding meeting member can occupy that virtual seat, thereby indicating that the meeting member is sitting in that seat. In one specific application, as shown in Figure 4, a virtual scene includes multiple virtual locations, the specific form of which is a virtual seat, and the virtual seat can accommodate meeting members in a video conference, thereby creating the atmosphere of meeting members sitting in seats in a conference room and communicating.

[0031] S103, in response to an update command, the target image corresponding to the update command is updated and displayed on the target page using dynamic special effects, and the target image includes at least one of the images corresponding to added or deleted participants, images corresponding to participants whose relative position has changed, and at least one of the images of the plurality of such participants.

[0032] In response to a target page update command, the target image corresponding to the update command is updated and displayed on the target page using dynamic special effects, then a new target page is formed, and the relative positions of the updated images on the new target page correspond one-to-one with the relative positions of the corresponding participants in the conference room. The participant corresponding to the target image may be understood as at least one participant related to a participant that changes the number and / or position of the multiple participants. For example, an image corresponding to a new participant that increases the number of multiple participants is a target image, an image corresponding to a participant removed from the multiple participants that decreases the number of multiple participants is a target image, and an image corresponding to at least one participant among the multiple participants that changes the positional relationship between the multiple participants is a target image.

[0033] In some embodiments, the number of detected participants is related to the screen layout of the target page; that is, the number of participants corresponds to the layout of the target page. For example, if the number of participants is 3, the page layout is a 3-screen parallel layout of "left, center, right" or a screen layout with 1 screen at the top and 2 screens at the bottom (see the lower diagram in Figure 8A). For example, if the number of participants is 4, the page layout is a 2x2 grid screen layout, i.e., a 2x2 grid screen layout (see the upper right diagram in Figure 1). The correspondence between the number of participants and the screen layout of the target page can be pre-set. For example, the corresponding page layout when the number of participants is 4 is a 2x2 grid screen layout, and the corresponding page layout when the number of participants is 3 is a 1x3 grid screen layout of "left, center, right". After a change in the number of participants is detected, the screen layout of the target page is adjusted.

[0034] Dynamic special effects may be understood as dynamic display effects that dynamically display a target image on a target page. Dynamic special effects may include at least one of the following: movement, transformation, marking, fade-in, and fade-out. A dynamic special effect whose content is movement may be understood as moving the target image from a first position on the target page along a certain movement trajectory until it is moved to a second position on the target page. A dynamic special effect whose content is transformation may be understood as transforming the target image from a first shape to a second shape along a certain transformation trajectory, the transformation of which may be a transformation of the image's size and / or outline. A dynamic special effect whose content is marking may be understood as changing the color of the target image or causing a dynamic mark to appear on the target image.

[0035] It is understandable that the dynamic special effects on the target image may be any combination of the aforementioned movement, transformation, marking, fade-in, and fade-out. For example, the dynamic special effect may be movement and transformation of the target image, or movement and marking of the target image, or change and marking of the target image, or movement, transformation, and marking of the target image.

[0036] For example, "movement" refers to an image moving from one location to another (in the case of an image corresponding to a new participant, it could suddenly appear outside or within the target page).

[0037] Furthermore, deformation can refer to a change in the size of a target image, and may include, for example, extrusion deformation and stretch deformation. Extrusion deformation can refer to a reduction in the size of an image; for example, deformation by being extruded to the left means that the right edge of the image moves to the left, and the left edge of the image comes into contact with the edge of another image or a predetermined boundary, thereby making the image appear to be extruded to the left and shortened. Stretch deformation can refer to an increase in the size of an image; for example, deformation by being stretched to the right means that the right edge of the image moves to the right, and the left edge of the image comes into contact with the edge of another image or a predetermined boundary, thereby making the image appear to be stretched to the right and lengthened.

[0038] Dynamic special effects are matched to the size of the area where the target page is located on the display device, and / or the size of the area where the target image is located on the target page. For example, depending on the size of the target image, the size of the image marks included in the corresponding dynamic special effect is adjusted to suit the size of the target image, or depending on the size of the target page, the movement trajectory of the movement special effect included in the corresponding dynamic special effect is adjusted to suit the size of the target page. In this embodiment, by adjusting the dynamic special effects, harmony and unity are achieved when the target image is displayed on the target page by the dynamic special effect, the sense of presence reflected on the target page when the number and / or position of multiple participants changes is enhanced, and cluttered situations caused by multiple images are avoided.

[0039] This application displays multiple images on a target page of a display device according to the positional relationship (relative positional relationship) between multiple participants. When the positional relationship between the multiple images on the target page corresponds to the positional relationship between the multiple participants corresponding to the multiple images, and a change in the number and / or positional relationship of the multiple participants is detected, an update command for the target page is triggered. Furthermore, the target image corresponding to the update command is updated and displayed on the target page using dynamic special effects. In other words, by dynamically displaying the target image on the target page using dynamic special effects, the display effect of the multiple images on the target page is optimized, the change in the number and / or positional relationship of the multiple participants corresponding to the multiple images is dynamically displayed, the interaction efficiency between the user and multiple participants is improved, and the user can more quickly and easily obtain information on the change in the number and / or position of multiple participants through the target image and the dynamic special effects corresponding to the target image.

[0040] In one embodiment, as shown in Figure 3, is a flowchart of an image display method according to an embodiment of the present application, which may be implemented relying on a computer program executable on an image display device based on a von Neumann system. The computer program may be integrated into the application or run as a standalone tool or application.

[0041] Specifically, this image display method is applied to video conferencing scenes and includes the following steps: S201 displays images and relative positions of multiple participants on the target page. The target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room. The target page was explained in the above embodiment, so a repeated explanation will be omitted here.

[0042] S202, when it detects an increase in the number of participants, triggers a command to refresh the target page. The target page contains multiple images corresponding to the multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room.

[0043] If a change in the number of participants in a meeting room is detected, and that change is an increase in the number of participants, the system determines the new participant who is increasing the number of participants, i.e., the new participant does not belong to the original group of participants, and triggers a refresh command for the target page.

[0044] The new participant may be the same or different type as the original multiple participants, and the increase in the number of multiple participants may be determined by collecting video or sound data, and whether or not there is a new participant who does not belong to the original multiple participants may be detected, for example, by comparing video screens or sounds collected based on a predetermined time period. It is understood that this application does not impose any limitations on the technical means for determining the increase in the number of multiple participants.

[0045] For example, as shown in Figure 4, Figure 4 is a schematic diagram of a scene in which the number of participants has increased according to an embodiment of the present application, where users 2011, 2012, 2013, and 2014 are the original participants, and the video data collected by the camera includes four images corresponding to users 2011, 2012, 2013, and 2014. When the processor detects from the collected video data that user 202 has joined the meeting of users 2011, 2012, 2013, and 2014, it triggers a target page update command, and the positional relationship between user 202 and users 2011, 2012, 2013, and 2014 is such that user 202 is positioned behind the midpoint between users 2011 and 2012.

[0046] S203, in response to the update command, updates the target page by adding an image corresponding to the new participant using dynamic special effects.

[0047] The images and relative positions of the original multiple participants on the target page are adjusted accordingly to form a new target page, and the new target page displays the image corresponding to the new participant and the images and relative positions of the original multiple participants. The relative positions of the images of the new participant and the original multiple participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the aforementioned meeting room.

[0048] For example, target page 102 in the upper right corner of Figure 1 forms a new target page as shown in the lower part of Figure 5A after going through the adjustment screen (new participant E) shown in the upper part of Figure 5A. The relative position between the new participant's image and the images of the other participants corresponds to the actual relative position between the new participant and the other participants in the meeting room. For example, as shown in Figure 4, the positional relationship between user 202, who is a new participant, and users 2011, 2012, 2013, and 2014 is such that user 202 is located behind the midpoint between users 2011 and 2012, and the relative position between the image corresponding to the new participant (user 202) and the images of the other participants (users 2011 and 2012) corresponds to the actual positional relationship in the meeting room as described above.

[0049] Among multiple images on the target page, at least one image that is adjacent to the image corresponding to the new participant is an adjacent image, and in some embodiments, the adjacent image may be updated and displayed on the target page by dynamic special effects. In some embodiments, the image corresponding to the new participant and the adjacent image are all target images that are to be updated.

[0050] In this embodiment, it is determined that an image corresponding to a new participant, which changes the number of multiple participants, is one of the target images. By displaying the target image on the target page using dynamic special effects, the user can quickly notice the target image, and the dynamic special effects will make it clear that the participant corresponding to the target image is a new participant for multiple participants, and that a new participant has appeared for multiple participants, for example, that a new participant has appeared in the meeting process.

[0051] In one embodiment, the target image corresponding to the update command includes an image corresponding to a new participant and at least one adjacent image, wherein the adjacent image is an image among several images that is adjacent to the image corresponding to the new participant. In response to the update command, the image corresponding to the new participant is updated and displayed on the target page by a first dynamic special effect, and at least one adjacent image is updated and displayed on the target page by a second dynamic special effect, the first and second dynamic special effects may be the same or different.

[0052] In some embodiments, among multiple images included on a target page, two adjacent images are referred to as the first image located on the relative left and the second image located on the relative right, respectively, and these first and second images are adjacent images to the image corresponding to the new participant. The second dynamic special effect includes the first image being pushed to the left and deforming, and the second image being pushed to the right and deforming, and the corresponding first dynamic special effect includes the image corresponding to the new participant being displayed synchronously in the gap created by the deformation between the first and second images when the first and second images are deformed. As shown in the upper part of Figure 5A, the first image is image A, the second image is image B, and the image corresponding to the new participant is image E. Unlike the method of moving image E from top to bottom and inserting it between images A and B in the upper part of Figure 5A, in this embodiment, the image corresponding to the new participant is displayed synchronously from the gap created by the deformation between image A and image B. In some embodiments, the deformation of the first and second images ends when the first and / or second images are pushed out and deformed according to a predetermined condition, or when the gap between the first and second images is deformed according to a predetermined condition.

[0053] For example, the deformation of the first and second images ends when the right edge of the first image moves to the left of the first predetermined boundary (the left edge of the first image remains fixed and does not move), and at this time, the left edge of the second image moves to the right of the second predetermined boundary (the right edge of the second image remains fixed and does not move). Alternatively, for example, the deformation of the first and second images ends when the gap between the first and second images deforms to the left of the first predetermined boundary and to the right of the second predetermined boundary. The deformation of the first image, the second image, and the image corresponding to the new participant is performed synchronously, the image corresponding to the new participant appears between the first and second images, the size of the image corresponding to the new participant is matched with the size of the gap between the first and second images, and in the implementation process, the size of the image corresponding to the new participant (e.g., an image cut out from a video stream frame) can be determined based on the real-time changing size of the gap between the first and second images.

[0054] In some embodiments, among multiple images included on a target page, two adjacent images are referred to as the first image located on the relative left and the second image located on the relative right, respectively, where the first image is adjacent to the image corresponding to the new participant, and the image corresponding to the new participant appears to the left of the first image. The second dynamic special effect includes the first and second images being pushed and deformed synchronously to the right, and the corresponding first dynamic special effect includes the image corresponding to the new participant being displayed synchronously in the gap left by the deformation of the first image to the left as the first and second images are deformed. In some embodiments, the deformation of the first and second images ends when the first and / or second images are pushed and deformed according to a predetermined condition.

[0055] For example, the deformation of the first and second images ends when the left edge of the first image moves to the right of the first predetermined boundary (the right edge of the first image contacts the left edge of the second image and moves to the right following the deformation of the second image), and at this time, the left edge of the second image moves to the right of the second predetermined boundary (the right edge of the second image remains fixed and does not move). The deformation of the first image, the second image, and the image corresponding to the new participant is performed synchronously, the image corresponding to the new participant appears to the left of the first image, and the size of the image corresponding to the new participant matches the size of the gap created by the deformation of the left side of the first image. In the implementation process, the size of the image corresponding to the new participant (e.g., an image cut out from a video stream frame) can be determined based on the real-time changing size of the gap created by the deformation of the left side of the first image.

[0056] Alternatively, in some embodiments, among multiple images included on the target page, two adjacent images are referred to as the first image located on the relative left and the second image located on the relative right, respectively, where the second image is an adjacent image, and the image corresponding to the new participant appears to the right of the second image. The second dynamic special effect includes the first and second images being synchronously pushed to the left and deformed, and the corresponding first dynamic special effect includes the image corresponding to the new participant being synchronously displayed in the gap created by the deformation to the right of the second image when the first and second images are deformed. In some embodiments, the deformation of the first and second images ends when the first and / or second images are pushed and deformed according to a predetermined condition. This embodiment is similar to the above embodiment (where the image corresponding to the new participant appears to the left of the first image), so a repeated explanation is omitted here.

[0057] As shown in Figure 5, Figure 5A is a schematic diagram of an image display page according to an embodiment of the present application, and in response to an update command, the target image corresponding to the update command includes image E corresponding to a new participant, and further includes images A and B corresponding to users 2011 and 2012 adjacent to user 202, who is a new participant.

[0058] Furthermore, an image E corresponding to a new participant is displayed on the target page using a first dynamic special effect, and adjacent images A and B are displayed on the target page using a second dynamic special effect, the first dynamic special effect being different from the second dynamic special effect. Specifically, the first dynamic special effect is that image E moves from top to bottom, and the second dynamic special effect is that image A deforms horizontally to the left, and image B deforms horizontally to the right. This process continues until a target page containing images A, B, C, D, and E is obtained, as shown in the lower diagram of Figure 5A. Images A, B, C, D, and E are reasonably distributed on the target page according to pre-set image layout rules, and the positional relationships between images A, B, C, D, and E correspond to the actual positional relationships between users 2011, 2012, 2022, 2023, 2024, and 202 shown in Figure 4. It is understandable that the first and second dynamic special effects shown in Figure 5A are merely illustrative examples.

[0059] In another embodiment, the first dynamic special effect corresponding to image E, which represents a new participant, is that image E moves vertically from top to bottom or horizontally from left to right (or right to left), and the second dynamic special effect is that images A, B, C, and D are deformed vertically from top to bottom until images A, B, C, D, and E are simultaneously present on the target page. In this embodiment, the position of the target page occupied by the combination of images A, B, C, and D before the target page is updated is the same as the position of the target page occupied by the combination of images A, B, C, D, and E after the target page is updated.

[0060] In this embodiment, an image corresponding to a new participant and at least one adjacent image are used as target images, and the target images are updated and displayed on the target page using dynamic special effects. This allows users to visually and quickly understand how the new participant is added to the multiple participants in the target interface, and specifically where the new participant is added among the multiple participants in the target interface. This makes it easier for users to quickly find the user they are interested in, thereby increasing the sense of presence and improving the user experience.

[0061] In one embodiment, the target image corresponding to the update command is the image corresponding to the new participant, and in response to the update command, the image corresponding to the new participant is updated and displayed on the target page by a dynamic special effect, the dynamic special effect includes at least one of movement, transformation, marking, fade-in, and fade-out. It is understandable that the dynamic special effect of the target image includes any combination of the above movement, transformation, marking, fade-in, and fade-out. For example, the dynamic special effect of the target image includes movement of the target image, transformation of the target image, marking of the target image, movement and marking of the target image, change and marking of the target image, or movement, transformation, and marking of the target image.

[0062] As shown in Figure 5B, Figure 5B is a schematic diagram of an image display page according to an embodiment of the present application, which responds to an update command, and the target image corresponding to the update command includes image E corresponding to a new participant. Furthermore, image E corresponding to the new participant is updated and displayed on the target page by dynamic special effects. Specifically, these dynamic special effects are marking and movement, and image E is dynamically displayed on the target page by marking image E with a star pattern that is clearly distinguishable from other images and moving image E horizontally from right to left. This continues until a target page containing images A, B, C, D, and E is obtained, as shown in the lower part of Figure 5B, where images A, B, C, D, and E are reasonably distributed on the target page according to a pre-set image layout rule, and the positional relationship between images A, B, C, D, and E corresponds to the actual positional relationship between users 2011, 2012, 2013, 2014 and user 202 shown in Figure 4. It is understood that the dynamic special effects shown in Figure 5B are merely illustrative.

[0063] In this embodiment, an image corresponding to a new participant is used as the target image, and the target image is updated and displayed on the target page using dynamic special effects. This allows the user to notice the new participant among multiple participants. In this embodiment, since only the target image of the new participant is displayed on the target page using dynamic special effects, the impact on the original multiple images is reduced, the computational load on the system is reduced, and the problem of page clutter due to excessive dynamic special effects is avoided.

[0064] This application displays multiple images on a target page of a display device according to the relative positions of multiple participants in a meeting room. When the relative positions of the multiple images on the target page correspond to the relative positions of the multiple participants corresponding to the multiple images in the meeting room, and an increase in the number of participants in the meeting is detected, an update command for the target page is triggered, and the target images are updated and displayed on the target page using dynamic special effects. In other words, by adding and displaying images corresponding to new participants on the target page using dynamic special effects, and dynamically displaying the process of changes in the number of new participants in the target page adjustment process, the user can observe the changes in the number of multiple participants more quickly and easily using dynamic special effects.

[0065] In one embodiment, as shown in Figure 6, is a flowchart of an image display method according to an embodiment of the present application, which may be implemented relying on a computer program executable on an image display device based on a von Neumann system. The computer program may be integrated into an application or run as an application such as a standalone tool.

[0066] Specifically, this image display method is applied to video conferencing scenes and includes the following steps: S301 displays images and relative positions of multiple participants on the target page. The target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room. The target page was explained in the above embodiment, so a repeated explanation will be omitted here.

[0067] S302, if a decrease in the number of participants is detected, triggers a refresh command for the target page.

[0068] The target page contains multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room.

[0069] If a change in the number of participants in a meeting room is detected, and the change is a decrease in the number of participants, it is determined that a participant has been removed from the group of participants, and a refresh command for the target page is triggered. The decrease in the number of participants is determined by collecting video or sound data, and it is detected, for example, that a participant has been removed or disappeared from the original group of participants by comparing collected video or sound based on a preset time period. It is understood that this application does not limit the technical means for determining the decrease in the number of participants.

[0070] As shown in Figure 7, Figure 7 is a schematic diagram of a scene in which the number of participants has decreased according to an embodiment of the present application. The original multiple participants include users 3011, 3012, 3013, and 3014. In the meeting process, user 3012 leaves the meeting, i.e., user 3012 is used as a deleted participant, and the participants become users 3011, 3013, and 3014 as shown in the lower part of Figure 7, with no change in the relative positions of users 3011, 3013, and 3014.

[0071] S303, in response to the update command, removes the image corresponding to the participant to be deleted from the target page using dynamic special effects.

[0072] The images and relative positions of the remaining participants are adjusted accordingly to form a new target page, and the images and relative positions of the remaining participants are displayed on the new target page. The relative positions of the remaining participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the meeting room. For example, target page 102 in the upper right corner of Figure 1 forms a new target page as shown in the lower part of Figure 8A after going through the adjustment screen (removing participant B) shown in the upper part of Figure 8A.

[0073] The target page includes an image corresponding to the participant being removed, and the dynamic special effects of the target image may indicate that the participant corresponding to the target image has been removed from multiple participants and no longer belongs to the original multiple participants.

[0074] Among multiple images on the target page, at least one image that is adjacent to the image corresponding to the deleted participant is an adjacent image, and in some embodiments, the adjacent image may be updated and displayed on the target page by dynamic special effects. In some embodiments, the image corresponding to the deleted participant and the adjacent image are all target images that are updated.

[0075] In this embodiment, it is determined that an image corresponding to a participant to be removed, which changes the number of participants, is one of the target images. By displaying the target image on the target page using dynamic special effects, the user can quickly notice the target image, and through the dynamic special effects, it is clear that the participant corresponding to the target image is actively or passively removed from the group of participants. In other words, it is clear that a certain participant among the group of participants has decreased, such as a participant leaving the meeting room during the meeting process.

[0076] In one embodiment, the target image corresponding to the update command includes an image corresponding to the delete participant and at least one adjacent image, wherein the adjacent image is at least one image among a plurality of images whose positional relationship with the image corresponding to the delete participant is adjacent, and in response to the update command, the image corresponding to the delete participant is displayed on the target page by a third dynamic special effect, and at least one adjacent image is displayed on the target page by a fourth dynamic special effect, wherein the third and fourth dynamic special effects may be the same or different.

[0077] In some embodiments, among the multiple images included on the target page, the two images adjacent to the image to be deleted are referred to as the first image located to the relative left and the second image located to the relative right, respectively, with the deleted image being between the first and second images, and the first and second images being adjacent images. The fourth dynamic special effect includes the first image being stretched and deformed to the right and the second image being stretched and deformed to the left, and the corresponding third dynamic special effect includes the deleted image being pushed out and deformed synchronously by the deformation of the first and second images until it disappears. In some embodiments, the deformation of the first and second images continues until the first and second images are close to each other, i.e., until the right edge of the first image and the left edge of the second image come into contact.

[0078] For example, when the first image is deformed, the right edge of the first image moves to the right (the left edge of the first image remains fixed and does not move), when the second image is deformed, the left edge of the second image moves to the left (the right edge of the second image remains fixed and does not move), and when the right edge of the first image and the left edge of the second image come into contact, the deformation of the first and second images is completed, and the deformation of the first image, the second image, and the deleted image is performed synchronously.

[0079] In some embodiments, among multiple images included on a target page, two images adjacent to each other are referred to as the first image located to the left and the second image located to the right, respectively, with the image to be deleted located to the left of the first image and adjacent to the first image, and the first image being an adjacent image. A fourth dynamic special effect includes the first and second images being stretched and deformed simultaneously to the left, and a corresponding third dynamic special effect includes the image to be deleted being pushed out and deformed synchronously with the deformation of the first image until it disappears as the first and second images are deformed. In some embodiments, the deformation of the first and second images ends when the first and / or second images are stretched and deformed to a predetermined condition.

[0080] For example, the deformation of the first and second images ends when the left edge of the first image moves to the left at the third predetermined boundary (the right edge of the first image comes into contact with the left edge of the second image and moves to the left following the deformation of the second image), at which point the left edge of the second image moves to the left at the fourth predetermined boundary (the right edge of the second image remains fixed and does not move). The deformation of the first image, the second image, and the image corresponding to the new participant is performed synchronously, and the first and second images are simultaneously stretched and deformed to the left, while the deleted image is simultaneously pushed to the left and deformed until it disappears (i.e., the left edge of the deleted image does not move, and the right edge moves to the left), and the position of the left edge of the deleted image coincides with the third predetermined boundary.

[0081] Alternatively, in some embodiments, among multiple images included on the target page, two adjacent images are referred to as the first image located to the left and the second image located to the right, respectively, with the image to be deleted located to the right of the second image and adjacent to the second image, and the second image being an adjacent image. A fourth dynamic special effect includes the first and second images being simultaneously stretched and deformed to the right, and a corresponding third dynamic special effect includes the image to be deleted being synchronously pushed out and deformed by the deformation of the second image until it disappears as the first and second images are deformed. In some embodiments, the deformation of the first and second images ends when the first and / or second images are stretched and deformed to a predetermined condition. This embodiment is similar to the above embodiment (where the delete participant is located to the left of the first image and adjacent to the first image), so a repeated explanation is omitted here.

[0082] As shown in Figure 8, Figure 8A is a schematic diagram of an image display page according to an embodiment of the present application, and in response to an update command, the target image corresponding to the update command includes image B corresponding to the delete participant, and further includes image A corresponding to user 3011 adjacent to user 3012, who is a delete participant. It is understandable that the target image may further include image D corresponding to user 3014 adjacent to user 3012, who is a delete participant, and in this embodiment, the target image includes image B and image A as an example.

[0083] Furthermore, image B, corresponding to the deleted participant, is displayed on the target page using a third dynamic special effect, and the adjacent image A is displayed on the target page using a fourth dynamic special effect. Specifically, the third dynamic effect causes image B to move from bottom to top, its size to gradually decrease, and its color to gradually fade. The fourth dynamic effect causes image A to deform horizontally to the right until the target page shown in the lower part of Figure 8A is obtained. The target page shown in the lower part of Figure 8A includes images A, B, and C, and the positional relationship between images A, B, and C corresponds to the positional relationship between users 3011, 3013, and 3014. It should be understood that the third and fourth dynamic special effects shown in Figure 8A are merely illustrative examples.

[0084] In this embodiment, an image corresponding to the participant to be deleted and at least one adjacent image are used as target images, and the target images are updated and displayed on the target page using dynamic special effects. This allows the user to visually and quickly understand how the participant to be deleted disappears from among multiple participants, and the multiple images remaining on the target page after the image corresponding to the participant to be deleted can be distributed in a reasonable and harmonious manner, improving the user's visual experience.

[0085] In one embodiment, the target image corresponding to the update command is the image corresponding to the participant to be deleted, and in response to the update command, the image corresponding to the participant to be deleted is updated and displayed on the target page by a dynamic special effect, the dynamic special effect includes at least one of movement, transformation, marking, fade-in, and fade-out. It is understood that the dynamic special effect of the target image includes any combination of the above movement, transformation, marking, fade-in, and fade-out. For example, dynamic special effects on a target image include moving the target image, transforming the target image, marking the target image, moving and marking the target image, changing and marking the target image, or moving, transforming and marking the target image.

[0086] As shown in Figure 8B, Figure 8B is a schematic diagram of an image display page according to an embodiment of the present application, and in response to an update command, the target image corresponding to the update command is image B, which corresponds to the participant to be deleted. Furthermore, image B, which corresponds to the participant to be deleted, is updated and displayed on the target page by dynamic special effects. Specifically, these dynamic special effects are marking and movement, and by marking image B with a star pattern that is clearly distinguishable from other images and moving image B vertically upward, image B is dynamically displayed on the target page. This continues until the target page shown in the lower part of Figure 8B is obtained, and this target page includes images A, C and D, and the positional relationship between images A, C and D corresponds to the actual positional relationship between users 3011, 3013 and 3014 shown in Figure 7. It is understood that the dynamic special effects shown in Figure 8B are merely illustrative.

[0087] In this embodiment, an image corresponding to a new participant is used as the target image, and the target image is updated and displayed on the target page using dynamic special effects. This allows the user to notice the deleted participant among multiple participants. In this embodiment, only the target image of the deleted participant is displayed on the target page using dynamic special effects, thus reducing the impact on the original multiple images, lowering the system's computational load, and avoiding the problem of page clutter caused by excessive dynamic special effects.

[0088] This application displays multiple images on a target page of a display device according to the relative positions of multiple participants in a meeting room. When the relative positions of the multiple images on the target page correspond to the relative positions of the multiple participants corresponding to the multiple images in the meeting room, and a decrease in the number of participants in the meeting is detected, a command to update the target page is triggered, and the target image is updated and displayed on the target page using dynamic special effects. In other words, by updating and displaying the image corresponding to the deleted participant on the target page using dynamic special effects, and dynamically displaying the process of change in the number of deleted participants in the target page adjustment process, the user can observe the changes in the number of multiple participants more quickly and easily using dynamic special effects.

[0089] In one embodiment, as shown in Figure 9, is a flowchart of an image display method according to an embodiment of the present application, which may be implemented relying on a computer program executable on an image display device based on a von Neumann system. The computer program may be integrated into an application or run as an application such as a standalone tool.

[0090] Specifically, this image display method is applied to video conferencing scenes and includes the following steps: S401 displays images and relative positions of multiple participants on the target page. The target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room. The target page was explained in the above embodiment, so a repeated explanation will be omitted here.

[0091] S402, when a change in the relative positions of multiple participants is detected, triggers a command to update the target page. The target page contains multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room.

[0092] If a change in the relative positions of multiple participants in a meeting room is detected, the system determines which participant caused the change in position, triggers a target page update command, and the target image to be updated is the image corresponding to each of the at least one participant whose position has changed.

[0093] As shown in Figure 10, Figure 10 is a schematic diagram of a scene in which the positions of multiple participants have changed according to an embodiment of the present application. As shown in the upper part of Figure 10, the positions of user 4013 and user 4012 are swapped, resulting in the positional relationship shown in the lower part of Figure 10. Specifically, as shown in the upper part of Figure 10, the positional relationship between the multiple participants is such that user 4011 is located behind user 4013 and to the left of user 4012, user 4013 is located to the left of user 4014, and user 4014 is located in front of user 4012. As shown in the lower part of Figure 10, the positional relationship between the multiple participants has changed as follows: user 4011 is located in front of user 4012 and to the left of user 4013, user 4012 is located to the left of user 4014, and user 4014 is located in front of user 4013. Of course, in other embodiments, user 4012 could also change its position to be between user 4011 and user 4013, in which case only the actual position of user 4012 changed.

[0094] Therefore, the target images corresponding to the update command are images corresponding to the two participants whose positions have changed, namely images B and C, which correspond to user 4012 and user 4013, respectively.

[0095] S403, in response to the update command, the image corresponding to the participant whose relative position has changed is updated on the target page using dynamic special effects. The updated participant's image and relative position are adjusted accordingly to form a new target page, and the updated participant's image and relative position are displayed on the new target page. The updated participant's relative position on the new target page corresponds one-to-one with the relative position of the corresponding participant in the meeting room. For example, target page 102 in the upper right corner of Figure 1 forms the new target page shown in the lower part of Figure 11A after going through the adjustment screen shown in the upper part of Figure 11A (swapping the positions of participant C and participant B).

[0096] Dynamic special effects include at least one of movement, deformation, marking, fade-in, and fade-out. It is understandable that dynamic special effects on a target image include any combination of the above-mentioned movement, deformation, marking, fade-in, and fade-out. For example, dynamic special effects on a target image include movement of the target image, deformation of the target image, marking of the target image, movement and marking of the target image, change and marking of the target image, or movement, deformation, and marking of the target image.

[0097] As shown in Figure 11, Figure 11 is a schematic diagram of an image display page according to an embodiment of the present application. Images B and C, corresponding to the two participants whose positions have changed in the upper part of Figure 11, are updated and displayed on the target page by dynamic special effects until the target page shown in the lower part of Figure 11 is obtained. Specifically, images B and C are distinguished from other images by deformation, and furthermore, image B moves toward the position of image C, and image C moves toward the position of image B, continuing until the target page shown in the lower part of Figure 11 is obtained. The positional relationships between images A, B, C, and D on the target page correspond to the actual positional relationships between users 4011, 4012, 4013, and 4014 in Figure 10.

[0098] In this embodiment, by using an image corresponding to each of the at least one participants whose position has changed as a target image, and updating and displaying the target images on the target page using dynamic special effects, the user can visually and quickly notice at least one participant whose position has changed among multiple participants, understand how the position of at least one participant has changed, and thus improve the user's visual experience.

[0099] This application displays multiple images on a target page of a display device according to the relative positions of multiple participants in a meeting room. The relative positions of the multiple images on the target page correspond to the relative positions of the multiple participants corresponding to the multiple images in the meeting room. When a change in the positional relationship between the multiple participants in the meeting is detected, a command to update the target page is triggered, and the target images are updated and displayed on the target page using dynamic special effects. In other words, by updating and displaying images on the target page corresponding to participants whose relative positions have changed using dynamic special effects, and by dynamically displaying the process of change in the relative positions of participants during the target page adjustment process, the user can observe the changes in the positions of multiple participants more quickly and easily using dynamic special effects.

[0100] In the embodiments of this application, the duration of the dynamic special effect is about 1S so that the user can observe the process of changing the number and / or position of multiple participants more quickly.

[0101] The following are embodiments of the apparatus of this application, which may be used to carry out embodiments of the method of this application. For details not disclosed in the embodiments of the apparatus of this application, refer to the embodiments of the method of this application.

[0102] Referring to Figure 12, it shows a schematic diagram of an image display device according to one exemplary embodiment of the present application. The image display device may be implemented as all or part of a device by software, hardware, or a combination thereof. The image display device comprises a first display module 501, a first trigger module 502, and a first update module 503.

[0103] The first display module 501 is used to display a target page, which displays images and relative positions of multiple participants. The target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room.

[0104] The first trigger module 502 is used to trigger a command to update the target page when it detects an increase in the number of participants. The target page contains multiple images corresponding to the multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room.

[0105] The first update module 503 is used to add an image corresponding to the new participant to the target page using dynamic special effects, adjust the images and relative positions of the original multiple participants on the target page accordingly to form a new target page, and display the image corresponding to the new participant and the images and relative positions of the original multiple participants on the new target page, with the relative positions of the images of the new participant and the original participants on the new target page corresponding one-to-one with the relative positions of the corresponding participants in the meeting room.

[0106] Referring to Figure 13, it shows a schematic diagram of an image display device according to one exemplary embodiment of the present application. The image display device may be implemented as all or part of a device by software, hardware, or a combination thereof. The image display device comprises a second display module 601, a second trigger module 602, and a second update module 603.

[0107] The second display module 601 is used to display a target page, which displays images and relative positions of multiple participants. The target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room.

[0108] The second trigger module 602 is used to trigger a target page update command when it detects a decrease in the number of participants. The target page contains multiple images corresponding to the participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the participants corresponding to the multiple images in the meeting room.

[0109] The second update module 603 is used to remove the image corresponding to the deleted participant from the target page using dynamic special effects, adjust the images and relative positions of the remaining participants accordingly to form a new target page, and display the images and relative positions of the remaining participants on the new target page, with the relative positions of the remaining participants' images on the new target page corresponding one-to-one with the relative positions of the corresponding participants in the meeting room.

[0110] Referring to Figure 14, it shows a schematic diagram of an image display device according to one exemplary embodiment of the present application. The image display device may be implemented as all or part of a device by software, hardware, or a combination thereof. The image display device comprises a third display module 701, a third trigger module 702, and a third update module 703.

[0111] The third display module 701 is used to display a target page, which displays images and relative positions of multiple participants. The target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room. The third trigger module 702 is used to trigger a target page update command when it detects a change in the relative positions of multiple participants. The target page contains multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room.

[0112] The third update module 703 is used to update the target page with images corresponding to participants whose relative positions have changed using dynamic special effects, adjust the updated participant images and relative positions accordingly to form a new target page, and display the updated participant images and relative positions on the new target page, so that the relative positions of the updated participant images on the new target page correspond one-to-one with the relative positions of the corresponding participants in the meeting room.

[0113] This application displays multiple images on a target page of a display device according to the positional relationship between multiple participants. The positional relationship between the multiple images on the target page corresponds to the positional relationship between the multiple participants corresponding to the multiple images. When a change in the number and / or positional relationship of the multiple participants is detected, an update command for the target page is triggered. Furthermore, the target image corresponding to the update command is updated and displayed on the target page using dynamic special effects. In other words, by dynamically displaying the target image on the target page using dynamic special effects, the display effect of the multiple images on the target page is optimized, changes in the number and / or positional relationship of the multiple participants corresponding to the multiple images are dynamically displayed, improving the efficiency of interaction between the user and multiple participants. The user can more quickly and easily obtain information on changes in the number and / or position of multiple participants through the target image and the dynamic special effects corresponding to the target image.

[0114] For the purposes of this explanation, the image display device provided in the above embodiment will be described using only the division of each functional block as an example when performing the image display method. However, in actual applications, the above functions can be assigned and executed by different functional modules according to the needs, that is, the internal structure of the device can be divided into different functional blocks to complete all or some of the above functions. Furthermore, since the image display device provided in the above embodiment belongs to the same concept as the embodiment of the image display method, details of its specific implementation process should be referred to the embodiment of the method, and repeated explanations will be omitted here.

[0115] The above-mentioned numbers for the embodiments in this application are for illustrative purposes only and do not indicate any superiority or inferiority among the embodiments.

[0116] Embodiments of this application further provide a computer storage medium capable of storing multiple instructions, which are loaded by a processor and are suitable for executing the image display method of the embodiment shown in Figures 1 to 11. For specific execution processes, please refer to the detailed description of the embodiment shown in Figures 1 to 11, and a repeated explanation will be omitted here.

[0117] This application further provides a computer program product in which at least one instruction is stored, and at least one instruction is loaded by a processor to execute the image display method of the embodiment shown in Figures 1 to 11. For specific details of the execution process, please refer to the detailed description of the embodiment shown in Figures 1 to 11, and a repeated explanation will be omitted here.

[0118] Referring to Figure 15, it is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. As shown in Figure 15, the electronic device 800 may include at least one processor 801, at least one network interface 804, a user interface 803, a memory 805, and at least one communication bus 802.

[0119] Here, the communication bus 802 is used to enable connection communication between these components.

[0120] Here, the user interface 803 may include a display and a camera, and may also optionally include a standard wired interface and a wireless interface.

[0121] The network interface 804 may optionally include a standard wired interface or a wireless interface (e.g., a Wi-Fi interface).

[0122] Here, the processor 801 may include one or more processing cores. The processor 801 processes data by performing various functions of the server 800 by connecting each part of the server 800 using various interfaces or lines, operating or executing instructions, programs, code sets or instruction sets stored in memory 805, and retrieving data stored in memory 805. Optionally, the processor 801 may be implemented by employing at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), or programmable logic array (PLAF). The processor 801 may integrate one or more types of components, such as a central processing unit (CPU), graphics processing unit (GPU), and modem. Here, the CPU primarily processes the operating system, user interface, and application programs, the GPU is used for rendering and drawing content that needs to be displayed on the display, and the modem is used for handling wireless communication. It is understandable that the above modem does not necessarily have to be integrated into processor 801, and may be implemented on a single chip.

[0123] Here, memory 805 may include random access memory (RAM) and may also include read-only memory. Optionally, memory 805 may include non-transitory computer-readable storage medium. Memory 805 may be used to store instructions, programs, code, code sets, or instruction sets. Memory 805 may include a program storage area and a data storage area, the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, and an image playback function), instructions for implementing embodiments of the above methods, and the data storage area may store data related to embodiments of the above methods. Optionally, memory 805 may be at least one storage device located away from the processor 801. As shown in Figure 15, memory 805 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an image processing application program.

[0124] In one embodiment, the electronic device 800 may be an interactive intelligent panel (IIP). In the electronic device 800 shown in Figure 15, the user interface 803 is mainly used to provide an input interface to the user and to acquire data entered by the user, and the processor 801 may be used to call an image processing application program stored in memory 805 and specifically to perform the following operations: The target page displays images and relative positions of multiple participants, and the target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room. If an increase in the number of participants is detected, a command to refresh the target page is triggered. The target page contains multiple images corresponding to the multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room. An image corresponding to the new participant is added to the target page using dynamic special effects, and the images and relative positions of the original multiple participants on the target page are adjusted accordingly to form a new target page. The new target page displays the image corresponding to the new participant and the images and relative positions of the original multiple participants, and the relative positions of the images of the new participant and the original multiple participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the meeting room.

[0125] In one embodiment, the processor 801 may further call an image processing application program stored in memory 805 and use it to perform the following operations: The target page displays images and relative positions of multiple participants, and the target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room. If a decrease in the number of participants is detected, a command to refresh the target page is triggered. The target page contains multiple images corresponding to the participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the participants corresponding to the images in the meeting room. The image corresponding to the deleted participant is removed from the target page using dynamic special effects, and the images and relative positions of the remaining participants are adjusted accordingly to form a new target page. The images and relative positions of the remaining participants are displayed on the new target page, and the relative positions of the images of the remaining participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the meeting room.

[0126] In one embodiment, the processor 801 may further call an image processing application program stored in memory 805 and use it to perform the following operations: The target page displays images and relative positions of multiple participants, and the target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room. A step in which, when a change in the relative positions of multiple participants is detected, a command to update the target page is triggered, wherein the target page contains multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room. The target page is updated with images corresponding to participants whose relative positions have changed using dynamic special effects. The updated participant images and relative positions are adjusted accordingly to form a new target page. The updated participant images and relative positions are displayed on the new target page, and the relative positions of the updated participant images on the new target page correspond one-to-one with the relative positions of the corresponding participants in the meeting room.

[0127] This application displays multiple images on a target page of a display device according to the positional relationship between multiple participants. The positional relationship between the multiple images on the target page corresponds to the positional relationship between the multiple participants corresponding to the multiple images. When a change in the number and / or positional relationship of the multiple participants is detected, an update command for the target page is triggered. Furthermore, the target image corresponding to the update command is updated and displayed on the target page using dynamic special effects. In other words, by dynamically displaying the target image on the target page using dynamic special effects, the display effect of the multiple images on the target page is optimized, changes in the number and / or positional relationship of the multiple participants corresponding to the multiple images are dynamically displayed, improving the efficiency of interaction between the user and multiple participants. The user can more quickly and easily obtain information on changes in the number and / or position of multiple participants through the target image and the dynamic special effects corresponding to the target image.

[0128] Those skilled in the art will understand that the implementation of all or part of the flows of the above embodiments can be completed by instructing the relevant hardware through a computer program, the program may be stored on a computer-readable recording medium, and the program, when executed, may include the flows of the embodiments of each of the above embodiments. Here, the storage medium may be a magnetic disk, an optical disk, a read-only memory, or a random-access memory, etc.

[0129] The above disclosures are merely preferred embodiments of the present application and, of course, do not limit the scope of the claims of the present application. Accordingly, equivalent modifications made in accordance with the claims of the present application remain within the scope of the present application.

Claims

1. An image display method applied to a video conferencing scene, A step of displaying images and relative positions of multiple participants on a target page, wherein the target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room; If an increase in the number of participants is detected, the step of triggering an update command for the target page is to include a step in which the target page contains multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room. An image display method characterized by the steps of: adding an image corresponding to a new participant to the target page using dynamic special effects; adjusting the images and relative positions of the original multiple participants on the target page accordingly to form a new target page; and displaying the image corresponding to the new participant and the images and relative positions of the original multiple participants on the new target page, wherein the relative positions of the images of the new participant and the original multiple participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the meeting room.

2. An adjacent image is an image among the plurality of images that is adjacent in position to the image corresponding to the new participant. The step of adding an image corresponding to a new participant to the target page using dynamic special effects is: The image display method according to claim 1, characterized by including the steps of updating and displaying an image corresponding to the new participant on the target page using a first dynamic special effect, and updating and displaying at least one adjacent image on the target page using a second dynamic special effect.

3. Of the aforementioned plurality of images, the two images adjacent to each other on the left and right are the first image located on the relative left and the second image located on the relative right, respectively, and the first image and the second image are the adjacent images. The image display method according to claim 2, wherein the second dynamic special effect includes the first image being pushed to the left and deformed, and the second image being pushed to the right and deformed, and the corresponding first dynamic special effect includes the synchronized display of an image corresponding to the new participant in the gap created by the deformation between the first image and the second image when the first image and the second image are deformed.

4. The image display method according to claim 3, characterized in that the deformation of the first image and the second image ends when the first image and / or the second image are pushed out and deformed according to a preset condition, or when the gap between the first image and the second image is deformed according to a preset condition.

5. Of the aforementioned multiple images, the two images adjacent to each other on the left and right are the first image located on the relative left and the second image located on the relative right, respectively, and the first image is the adjacent image. The second dynamic special effect includes the first and second images being synchronously pushed to the right and deformed, and the corresponding first dynamic special effect includes the image corresponding to the new participant being synchronously displayed in the gap created by the deformation on the left side of the first image when the first and second images are deformed. Or, Of the aforementioned multiple images, the two images adjacent to each other on the left and right are the first image located on the relative left and the second image located on the relative right, respectively, and the second image is the adjacent image. The image display method according to claim 2, wherein the second dynamic special effect includes the first image and the second image being pushed to the left and deformed in a synchronous manner, and the corresponding first dynamic special effect includes the synchronous display of an image corresponding to the new participant in the gap created by the deformation of the right side of the second image when the first image and the second image are deformed.

6. The image display method according to claim 5, characterized in that the deformation of the first image and the second image ends when the first image and / or the second image are pushed out and deformed according to a predetermined condition.

7. The image display method according to claim 1, characterized in that the dynamic special effect includes at least one of movement, deformation, marking, fade-in, and fade-out.

8. An image display method applied to a video conferencing scene, A step of displaying images and relative positions of multiple participants on a target page, wherein the target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room; If a decrease in the number of participants is detected, the step of triggering an update command for the target page, wherein the target page includes multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room. An image display method characterized by the steps of: removing the image corresponding to the participant to be deleted from the target page using dynamic special effects; adjusting the images and relative positions of the remaining participants accordingly to form a new target page; and displaying the images and relative positions of the remaining participants on the new target page, wherein the relative positions of the images of the remaining participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the conference room.

9. The adjacent image is at least one image among the plurality of images whose positional relationship with the image corresponding to the deleted participant is adjacent. The step of removing the image corresponding to the participant to be deleted from the target page using dynamic special effects is: The image display method according to claim 8, characterized by including the steps of updating and displaying the image corresponding to the deleted participant on the target page using a third dynamic special effect, and updating and displaying at least one adjacent image on the target page using a fourth dynamic special effect.

10. Of the aforementioned plurality of images, the two images adjacent to the deleted image are the first image located to the left and the second image located to the right, respectively, the deleted image is located between the first image and the second image, and the first image and the second image are the adjacent images. The image display method according to claim 9, characterized in that the fourth dynamic special effect includes the first image being stretched and deformed to the right and the second image being stretched and deformed to the left, and the corresponding third dynamic special effect includes the deletion image being synchronously pushed out and deformed by the deformation of the first and second images until it disappears when the first and second images are deformed.

11. The image display method according to claim 10, characterized in that the deformation of the first image and the second image continues until the first image and the second image become close to each other.

12. Of the aforementioned multiple images, the two images adjacent to each other on the left and right are the first image located to the left and the second image located to the right, respectively, the deleted image is located to the left of the first image and adjacent to the first image, and the first image is the adjacent image. The fourth dynamic special effect includes the first and second images being simultaneously stretched and deformed to the left, and the corresponding third dynamic special effect includes the deletion image being synchronously pushed out and deformed by the deformation of the first image until it disappears when the first and second images are deformed. Or, Of the aforementioned multiple images, the two images adjacent to each other on the left and right are the first image located to the left and the second image located to the right, respectively, the deleted image is located to the right of the second image and is adjacent to the second image, and the second image is the adjacent image. The image display method according to claim 9, characterized in that the fourth dynamic special effect includes the first image and the second image being simultaneously stretched and deformed to the right, and the corresponding third dynamic special effect includes the deletion image being synchronously pushed out and deformed by the deformation of the second image until it disappears when the first image and the second image are deformed.

13. The image display method according to claim 12, characterized in that the deformation of the first image and the second image ends when the first image and / or the second image are stretched and deformed according to a predetermined condition.

14. The image display method according to claim 8, characterized in that the dynamic special effect includes at least one of movement, deformation, marking, fade-in, and fade-out.

15. An image display method applied to a video conferencing scene, A step of displaying images and relative positions of multiple participants on a target page, wherein the target page is a pre-configured page for aggregating and displaying images of each participant in the meeting room; If a change in the relative positions of multiple participants is detected, the step of triggering an update command for the target page is to include multiple images corresponding to multiple participants, and the relative positions of the multiple images on the target page correspond one-to-one with the relative positions of the multiple participants corresponding to the multiple images in the meeting room. An image display method characterized by the steps of updating the target page with images corresponding to participants whose relative positions have changed using dynamic special effects, adjusting the updated participant images and relative positions accordingly to form a single target page, and displaying the updated participant images and relative positions on the new target page, wherein the relative position of the updated participant image on the new target page corresponds one-to-one with the relative position of the corresponding participant in the conference room.

16. The image display method according to claim 15, characterized in that the dynamic special effect includes at least one of movement, deformation, marking, fade-in, and fade-out.

Citation Information

Patent Citations

  • Network video conference processing method and device, electronic equipment and storage medium

    CN115706773A

  • Recording and playback of meetings

    JP2013533987A