Image display methods

Abstract

The embodiments of the present application are applied to a video conference scenario. Disclosed are image display methods. A method comprises: displaying images and relative positions of a plurality of participants on a target page; when it is detected that the number of the plurality of participants is increased, triggering an updating instruction for the target page; adding an image, which corresponds to a newly added participant, to the target page by means of a dynamic special effect, wherein the images and the relative positions of the plurality of original participants on the target page are correspondingly adjusted to form a new target page, the image corresponding to the newly added participant and the images and the relative positions of the plurality of original participants are displayed in the new target page, and the relative positions of the images of the newly added participant and the plurality of original participants on the new target page correspond to the relative positions of the corresponding participants in a conference room on a one-to-one basis. By means of the embodiments of the present application, the interaction efficiency between participants and a plurality of images can be improved.

Description

Image display method Technical Field

[0001] The present application relates to the field of image processing, and in particular to an image display method. Background Art

[0002] With the development of computer technology, video conferencing, which allows people in different locations to communicate face-to-face via communication devices and networks, has gained widespread application in entertainment, education, training, marketing, and advertising. During a video conferencing session, participants collect video data through their respective video terminals and aggregate and display it within the video conferencing interface. For example, the video conferencing interface can be split into multiple screens, each displaying an image representing the participant.

[0003] However, as the meeting progresses, the number or location of participants may change, resulting in changes in the screen displaying the images of the participants on the video conference interface. Participants are unable to find the participants they are interested in in the changed screen in time, which affects the participants' participation experience in the video conference and reduces the interaction efficiency based on the video conference.

[0004] Summary of the Invention

[0005] The present application provides an image display method that can improve the efficiency of interaction between a user and multiple images. The technical solution is as follows:

[0006] In a first aspect, an embodiment of the present application provides an image display method, which is applied in a video conferencing scenario, and the method includes:

[0007] The target page displays the images and relative positions of multiple participants; the target page is a preset page that aggregates and displays the images of each participant in the conference room;

[0008] When an increase in the number of multiple participants is detected, an update instruction for the target page is triggered; the target page includes multiple images corresponding to the multiple participants, and the relative positions of the multiple images in the target page correspond one-to-one to the relative positions of the multiple participants corresponding to the multiple images in the conference room;

[0009] The image corresponding to the newly added participant is added to the target page in the form of dynamic special effects, and the images and relative positions of the original multiple participants on the target page are adjusted accordingly to form a new target page. The new target page displays the image corresponding to the newly added participant and the images and relative positions of the original multiple participants; the relative positions of the images of the newly added participant and the original multiple participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

[0010] In a second aspect, an embodiment of the present application provides an image display method, which is applied in a video conferencing scenario, and the method includes:

[0011] The target page displays the images and relative positions of multiple participants; the target page is a preset page that aggregates and displays the images of each participant in the conference room;

[0012] When it is detected that the number of the plurality of participants decreases, an update instruction for the target page is triggered; the target page includes a plurality of images corresponding to the plurality of participants, and the relative positions of the plurality of images in the target page correspond one-to-one to the relative positions of the plurality of participants corresponding to the plurality of images in the conference room;

[0013] The images corresponding to the removed participants are removed from the target page in a dynamic special effect manner, and the images and relative positions of the remaining participants are adjusted accordingly to form a new target page, which displays the images and relative positions of the remaining participants; the relative positions of the images of the remaining participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

[0014] In a third aspect, an embodiment of the present application provides an image display method, which is applied in a video conferencing scenario, and the method includes:

[0015] The target page displays the images and relative positions of multiple participants; the target page is a preset page that aggregates and displays the images of each participant in the conference room;

[0016] When a change in the relative positions of the plurality of participants is detected, an update instruction for the target page is triggered; the target page includes a plurality of images corresponding to the plurality of participants, and the relative positions of the plurality of images in the target page correspond one-to-one to the relative positions of the plurality of participants corresponding to the plurality of images in the conference room;

[0017] The images corresponding to the participants whose relative positions have changed are updated in the target page in a dynamic special effect manner, and the images and relative positions of the updated participants are adjusted accordingly to form a new target page, which displays the images and relative positions of the updated participants; the relative positions of the images of the updated participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

[0018] The beneficial effects of the technical solutions provided by some embodiments of the present application include at least:

[0019] This application displays multiple images in a target page based on the relative positional relationship between multiple participants, and the positional relationship between the multiple images in the target page corresponds to the positional relationship between the multiple participants corresponding to the multiple images. When a change in the number and / or positional relationship of multiple participants is detected, an update instruction of the target page is triggered, and the target image corresponding to the update instruction is updated and displayed in the target page with dynamic special effects, so that the participants can promptly notice the adjustment of the video conference screen, and thus promptly find the video conference participants they are concerned about from the screen, thereby improving the interaction efficiency between the participants and multiple images. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0021] FIG1 is a schematic diagram of a scene of an image display method provided in an embodiment of the present application;

[0022] FIG2 is a schematic flow chart of an image display method provided in an embodiment of the present application;

[0023] FIG3 is a flow chart of an image processing method provided in an embodiment of the present application;

[0024] FIG4 is a schematic diagram of a scenario in which the number of participants increases according to an embodiment of the present application;

[0025] FIG5A is a schematic diagram of an image display page provided by an embodiment of the present application;

[0026] FIG5B is a schematic diagram of an image display page provided by an embodiment of the present application;

[0027] FIG6 is a schematic flow chart of an image display method provided in an embodiment of the present application;

[0028] FIG7 is a schematic diagram of a scenario in which the number of participants is reduced, provided by an embodiment of the present application;

[0029] FIG8A is a schematic diagram of an image display page provided by an embodiment of the present application;

[0030] FIG8B is a schematic diagram of an image display page provided by an embodiment of the present application;

[0031] FIG9 is a schematic flow chart of an image display method provided in an embodiment of the present application;

[0032] FIG10 is a schematic diagram of a scenario in which the positions of multiple participants change according to an embodiment of the present application;

[0033] FIG11 is a schematic diagram of an image display page provided in an embodiment of the present application;

[0034] FIG12 is a schematic structural diagram of an image display device provided in an embodiment of the present application;

[0035] FIG13 is a schematic structural diagram of an image display device provided in an embodiment of the present application;

[0036] FIG14 is a schematic structural diagram of an image display device provided in an embodiment of the present application;

[0037] FIG15 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0038] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0039] In the description of this application, it should be understood that the terms "first", "second", etc. are used for descriptive purposes only and should not be understood to indicate or imply relative importance. In the description of this application, it should be noted that, unless otherwise expressly specified and limited, "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to the specific circumstances. In addition, in the description of this application, unless otherwise specified, "multiple" refers to two or more. "and / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0040] The present application is described in detail below with reference to specific embodiments.

[0041] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, storage, and display, etc.), and signals involved in the embodiments of this specification are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the images and location information mentioned in this specification are obtained with full authorization.

[0042] With the development of computer technology, video conferencing, which allows people in different locations to communicate face-to-face via communication devices and networks, has gained widespread application in entertainment, education, training, marketing, and advertising. During a video conferencing session, participants collect video data through their respective video terminals and aggregate and display it on the video conferencing interface. For example, the video conferencing interface displays multiple frames, each containing an image representing the participant, after selecting some or all participants from the video data.

[0043] FIG1 is a schematic diagram of an image display scene provided in an embodiment of the present application. The scene diagram includes a processor 101, a target page 102 on a display device, and multiple participants. In this embodiment of the present application, people are used as participants. That is, as shown in FIG1 , the multiple participants include user 1031, user 1032, user 1033, and user 1034.

[0044] The processor 101 communicates with the display device and can be integrated into the display device or placed on the cloud or other network servers. When the processor 101 receives an instruction to trigger a video conference or other similar instructions, a virtual same-frame picture of the video conference is displayed on the display device, and the virtual same-frame picture is the target page 102. The target page 102 displays the images and relative positions of multiple participants (or users, participants). The target page 102 is a preset page that aggregates and displays the images of each participant in the conference room. There may be multiple situations for relative positions, and the target page 102 will display the relative position of at least one situation. For example, in the lower left figure of Figure 1, A is above C and to the right of C at the same time, but in the upper right figure of Figure 1, the target page 102 only shows the relative position relationship of A above C. The target page includes multiple virtual positions (such as rectangular boxes) for accommodating users as images, that is, each virtual position corresponds to each user, and the arrangement of the virtual positions is the same as the arrangement of the user's real positions. Alternatively, multiple adaptive portraits are displayed on the target page, the displayed adaptive portraits match each user, and the positional relationships between the multiple portraits correspond to the positions between the multiple images.

[0045] It is understandable that the multiple images included in the target page can be images of any shape and dynamic or non-dynamic, and the image on the target page 101 can be understood as a concrete expression of the code representing the user on the display device. Figure 1 is for illustration only, and this application does not impose any restrictions on this. In some embodiments, after one or more cameras shoot the actual scene, the processor identifies multiple participants, such as faces or heads, in the captured video stream (which can be a video stream generated by each camera, or a single video stream generated by fusing the video streams generated by multiple cameras), and then, after image processing (for example, cropping the identified faces or heads from the frames of the video stream), a video conference picture of each face or head that is displayed can be generated, for example, each participant, such as a head or face, is in a corresponding rectangular frame.

[0046] As shown in Figure 1 , in a real-world scenario, the positional relationship between multiple participants is as follows: user 1031 is to the left of user 1032, user 1033 is in front of user 1031, and user 1034 is in front of user 1032 and to the right of user 1033 (see the lower left of Figure 1 ). After one or more cameras capture the real-world scene, processor 101 identifies multiple participants, such as faces or heads, in the captured video stream. After image processing, processor 101 generates a target page 102 for the video conference, which aggregates and displays each face or head. Target page 102 is then displayed on a display device (see the upper right of Figure 1 ). On target page 102, user 1031 corresponds to image A, user 1032 to image B, user 1033 to image C, and user 1034 to image D. The positional relationship between the multiple images on target page 102 is as follows: image A is to the left of image B, image C is below image A, and image D is below image B and to the right of image C.

[0047] The display device can collect video data or image data. The type of display device is not limited to various personal computers, laptops, smart phones, tablets, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc. The processor 101 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. This application is not limited here.

[0048] The video conferencing technology involved in this application is a specific implementation of cloud conferencing. Cloud conferencing is an efficient, convenient, and low-cost conferencing format based on cloud computing technology. Users simply capture video or audio data through a display device and perform simple, easy-to-use operations to quickly and efficiently share voice, data files, and videos with teams and clients around the world.

[0049] However, as the meeting progresses, participants may move around, causing their relative positions to change, or participants may leave the meeting, or new participants may join. Therefore, the number or position of participants may change, resulting in the screen layout on the video conference interface remaining unchanged but the specific content of the screen changing, or both the screen layout and the specific content of the screen changing. In some technologies, when the above situation occurs, the video conference screen will be adjusted according to the changes in the participants, but the adjustment is very abrupt. The result of the video conference screen adjustment is immediately displayed on the video conference interface. From the perspective of the participants, this abrupt adjustment will make it impossible for the participants to find certain participants they are concerned about in time from the adjusted screen, because the suddenly adjusted screen is very messy for the participants watching the video conference, affecting the participants' participation experience in the video conference and reducing the interactive efficiency of the video conference.

[0050] For example, in a multi-person conference, participant A is paying attention to participant B through the video conference interface before the screen is adjusted. However, due to the addition of a new participant, the screen layout of the video conference changes suddenly and immediately. Participant A will appear very confused at this time because the adjusted screen layout is a completely new one for him. He does not know where participant B is adjusted to in the screen layout, so he needs to laboriously search for participant B in the adjusted layout, affecting the efficiency of the video conference. This is particularly serious in multi-person conferences.

[0051] Based on the above problems, the inventors have found through research and experiments that when adjusting the picture, the changes in the images of the participants who need to be adjusted (such as newly joined participants or leaving participants) will be presented in the video conference screen in the form of dynamic special effects from before to after the picture adjustment. This dynamic special effect will help users to promptly perceive the picture adjustment of the video conference, so as to promptly find the video conference participants they are concerned about from the screen, thereby improving the efficiency of the video conference.

[0052] This application proposes an image display method to solve this problem. The image display method of this application can enable participants to promptly find the participants they are interested in in the adjusted image after the image is adjusted, thereby improving the efficiency of video conferencing. In one embodiment, as shown in Figure 2, a flow chart of an image display method proposed in an embodiment of this application is provided. This method can be implemented by a computer program and can be run on an image display device based on the von Neumann system. The computer program can be integrated into an application or run as an independent tool application.

[0053] Specifically, the image display method is applied in a video conferencing scenario, including:

[0054] S101. A target page displays images and relative positions of multiple participants. The target page is a preset page that aggregates and displays images of all participants in the conference room.

[0055] S102: When it is detected that the number and / or positions of multiple participants have changed, trigger an update instruction for the target page.

[0056] After the camera captures video data of the actual conference room scene, the processor 101 detects participants in the video data. The detection frequency is pre-set, for example, the video data can be detected once every 2 frames or every 60ms. Detecting multiple participants can be done by assigning ID numbers to the detected participants, each with its own ID, and then counting the number of IDs to determine changes in the number of participants. Position changes of multiple participants can be determined by determining changes in the relative positions of multiple participants (such as the corresponding coordinates of the participants). Taking head detection as an example, each head has corresponding coordinates. If the coordinates of head a are detected to move from the left of the coordinates of head b to the right of the coordinates of head b, the relative positions of heads a and b are determined to have changed from a left b right to a right b left, i.e., the relative positions have changed. Of course, for more accurate and stable determination, a preset duration (e.g., 1 second) can be set. If the state after the relative position change of the participants persists for more than the preset duration, the relative positions are determined to have changed.

[0057] The target page includes multiple images corresponding to multiple participants. The relative positions of the multiple images on the target page correspond one-to-one to the relative positions of the multiple participants in the conference room. The target page refers to a page on the display device that aggregates and displays the images corresponding to each participant in the conference. For example, as shown in FIG1 , target image 102 shows the target page of the video conference on the display device, where the images corresponding to the four participating users are aggregated and displayed in the same frame. This description will not be repeated here.

[0058] In one embodiment, the target page also includes a virtual scene, where multiple images representing participants are placed within the virtual scene. The virtual scene refers to a virtual background or a blurred background within the target page. A blurred background can protect privacy, and the virtual background can include a variety of different virtual scenes that can correspond to video conferences of various themes. Specifically, virtual scenes can include various scenes such as seminars and discussions. By setting up different virtual scenes, it is helpful to create an atmosphere that corresponds to the theme of the video conference, enhance the realism of the video conference, and thus improve the interactive efficiency of the video conference.

[0059] The virtual locations on the target page can be locations used to accommodate corresponding attendees, and can specifically be virtual locations in various forms, such as rectangular frames, small houses, marked frames, and seats. In addition to displaying attendee portraits as images at various virtual locations on the target page, after identifying attendees through facial recognition technology, attendee information corresponding to the portraits can be displayed in the images. For example, various information such as the meeting member's name, account number, position, and network status can be displayed, thereby displaying rich meeting member information on the target page, allowing users to quickly and intuitively obtain meeting member information.

[0060] A virtual position is a position used to accommodate corresponding conference members, and specifically can be a virtual position in various forms such as a rectangular frame, a small house, a marking frame, a seat, etc. The form of the virtual position can be pre-set according to the needs of the virtual scene. For example, for a virtual scene of a symposium, the corresponding virtual position can be a small virtual house that divides different groups of conference members. The virtual position can accommodate the corresponding conference members. For example, when the virtual position is a virtual seat, the portrait of the corresponding conference member in the real-time picture can occupy the virtual seat, thereby indicating that the conference member is sitting in the seat. In a specific application, as shown in FIG4 , the virtual scene includes multiple virtual positions, and the specific form of the virtual position is a virtual seat. The virtual seat can accommodate conference members in a video conference, thereby creating an atmosphere where conference members are sitting in the seats of the conference room to communicate.

[0061] S103. In response to the update instruction, the target image corresponding to the update instruction is updated and displayed in the target page in a dynamic special effect manner, and the target image includes at least one of the following: an image corresponding to an added participant or a removed participant, an image corresponding to a participant whose relative position has changed, and at least one image among the multiple images.

[0062] In response to an update instruction for a target page, the target image corresponding to the update instruction is updated and displayed on the target page through dynamic special effects, and then a new target page is formed. The relative positions of the updated multiple images in the new target page correspond one-to-one with the relative positions of the corresponding participants in the meeting room. The participant corresponding to the target image can be understood as at least one participant related to the participant(s) that cause(s) the change in the number and / or position of multiple participants. For example, the image corresponding to the newly added participant that causes the increase in the number of multiple participants is the target image, the image corresponding to the removed participant that is removed from multiple participants and causes the decrease in the number of multiple participants is the target image, and the images corresponding to at least one participant among multiple participants that cause(s) the change in the positional relationship of multiple participants are the target images respectively.

[0063] In some embodiments, the detected number of participants is related to the screen layout of the target page, that is, the number of participants corresponds to the layout of the target page. For example, when the number of participants is three, the page layout is a layout of three parallel screens of "left, middle, right", or a layout of one screen above and two screens below (as shown in the lower figure of FIG. 8A); for example, when the number of participants is four, the page layout is a layout of two rows and two columns in a "field" shape, that is, a layout of two screens above and two screens below (as shown in the upper right figure of FIG. 1). The corresponding relationship between the number of participants and the screen layout of the target page can be preset. For example, when the number of participants is four, the corresponding page layout is a layout of two rows and two columns in a "field" shape, and when the number of participants is three, the corresponding page layout is a layout of one row and three columns of "left, middle, right". After detecting the change in the number of participants, the screen layout of the target page is adjusted.

[0064] Dynamic special effects can be understood as dynamic display effects that make the target image dynamically displayed on the target page. Dynamic special effects can include at least one of the following special effects: movement, deformation, marking, fade-in, and fade-out. The dynamic special effect with the content of movement can be understood as moving the target image from the first position on the target page along a certain movement trajectory until it moves to the second position on the target page. The dynamic special effect with the content of deformation can be understood as deforming the target image from the first shape along a certain deformation trajectory to the second shape, and the deformation can be the deformation of the size and / or outer contour of the image. The dynamic special effect with the content of marking can be understood as the change in the color of the target image or the appearance of a dynamic identifier on the target image.

[0065] It can be understood that the dynamic special effects for the target image can also be any combination of the above movement, deformation, marking, fade-in, and fade-out. For example, the dynamic special effect is the movement and deformation of the target image, or the dynamic special effect is the movement and marking of the target image, or the dynamic special effect is the change and marking of the target image, or the dynamic special effect is the movement, deformation, and marking of the target image.

[0066] For example, movement refers to the image moving from one position (if it is an image corresponding to a newly added participant, it may suddenly appear outside the target page or at a position within the target page) to another position.

[0067] For example, deformation refers to a change in the size of a target image, and may include squeezing and stretching. Squeezing can reduce the size of an image. For example, squeezing an image to the left means the right edge of the image moves to the left, while the left edge of the image collides with the edge of another image or a preset boundary, giving the image the appearance of being squeezed and shortened to the left. Stretching can increase the size of an image. For example, stretching an image to the right means the right edge of the image moves to the right, while the left edge of the image collides with the edge of another image or a preset boundary, giving the image the appearance of being stretched and elongated to the right.

[0068] The dynamic special effects match the size of the area where the target page is located on the display device, and / or match the size of the area where the target image is located on the target page. For example, according to the size of the target image, the size of the image mark included in the corresponding dynamic special effects is adjusted to adapt to the size of the target image, or according to the size of the target page, the movement trajectory of the moving special effects included in the corresponding dynamic special effects is adjusted to adapt to the size of the target page. In this embodiment, by adjusting the dynamic special effects, the target image is displayed harmoniously and uniformly on the target page with the dynamic special effects, which improves the realism reflected on the target page when the number and / or positions of multiple participants change, and avoids the clutter caused by multiple images.

[0069] The present application displays multiple images on a target page of a display device based on the positional relationship (relative positional relationship) between multiple participants, and the positional relationship between the multiple images on the target page corresponds to the positional relationship between the multiple participants corresponding to the multiple images. When a change in the number and / or positional relationship of the multiple participants is detected, an update instruction of the target page is triggered, and the target image corresponding to the update instruction is further updated and displayed on the target page with dynamic special effects. In other words, by displaying the target image on the target page in a dynamic manner with dynamic special effects, the display effect of the multiple images on the target page is optimized, and the changes in the number and / or positional relationship of the multiple participants corresponding to the multiple images are dynamically displayed, thereby improving the interaction efficiency between the user and the multiple images, and allowing the user to obtain information on changes in the number and / or position of the multiple participants more quickly and easily through the target image and the dynamic special effects corresponding to the target image.

[0070] In one embodiment, FIG3 is a flow chart illustrating an image display method according to an embodiment of the present application. The method can be implemented using a computer program and can be run on an image display device based on a von Neumann architecture. The computer program can be integrated into an application or run as a standalone tool application.

[0071] Specifically, the image display method is applied in a video conferencing scenario, including:

[0072] S201: The target page displays the images and relative positions of multiple participants. The target page is a preset page that aggregates and displays the images of each participant in the conference room. The target page has been described in the above embodiment and will not be repeated here.

[0073] S202: When an increase in the number of participants is detected, triggering an update instruction for a target page, wherein the target page includes multiple images corresponding to the multiple participants, and the relative positions of the multiple images in the target page correspond to the relative positions of the multiple participants in the conference room corresponding to the multiple images.

[0074] When it is detected that the number of multiple participants in the conference room has changed and the change is an increase in the number of multiple participants, the new participant that causes the increase in the number of multiple participants is determined, that is, the new participant does not belong to the original multiple participants, and an update instruction for the target page is triggered.

[0075] The newly added participants can be of the same or different types as the original participants. The increase in the number of participants can be determined by collecting video data or audio data, for example by comparing video images or audio data collected over a preset time period to detect whether there are newly added participants who are not part of the original number of participants. It should be understood that this application does not impose any limitations on the technical means for determining the increase in the number of participants.

[0076] For example, as shown in Figure 4, Figure 4 is a schematic diagram of a scenario in which the number of participants increases provided by an embodiment of the present application. User 2011, user 2012, user 2013 and user 2014 are the original participants. The video data collected by the camera device includes four images corresponding to user 2011, user 2012, user 2013 and user 2014. When the processor detects from the collected video data that user 202 joins user 2011, user 2012, user 2013 and user 2014 to participate in the meeting, an update instruction for the target page is triggered. The positional relationship between user 202 and user 2011, user 2012, user 2013 and user 2014 is that user 202 is located in the middle and behind user 2011 and user 2012.

[0077] S203: In response to the update instruction, the image corresponding to the newly added participant is added and updated and displayed on the target page in a dynamic special effect manner.

[0078] The images and relative positions of the original multiple participants on the target page are adjusted accordingly to form a new target page. The new target page displays the image of the newly added participant and the images and relative positions of the original multiple participants. The relative positions of the images of the newly added participant and the original multiple participants on the new target page correspond one-to-one with the relative positions of the corresponding participants in the conference room.

[0079] For example, target page 102 in the upper right corner of Figure 1 , after undergoing the adjustment screen (adding a new participant E) in the upper figure of Figure 5A , forms a new target page as shown in the lower figure of Figure 5A . The relative positions of the image of the newly added participant and the images of the multiple participants correspond to the actual relative positions of the newly added participant and the multiple participants in the conference room. For example, as shown in Figure 4 , the positional relationship between user 202, the newly added participant, and users 2011, 2012, 2013, and 2014 is that user 202 is located between and behind user 2011 and user 2012. The relative positions of the image corresponding to the newly added participant (user 202) and the images of the multiple participants (users 2011 and 2012) correspond to the aforementioned actual positional relationship in the conference room.

[0080] Among the multiple images on the target page, at least one image that is adjacent to the image corresponding to the newly added participant is considered an adjacent image. In some embodiments, the adjacent image can also be updated and displayed on the target page using dynamic special effects. In some embodiments, both the image corresponding to the newly added participant and the adjacent image are target images that need to be updated.

[0081] In this embodiment, the image corresponding to the new participant who causes the change in the number of multiple participants is determined to be one of the target images, and the target image is displayed in the target page in the form of dynamic special effects, so that the user can quickly notice the target image, and understand through the dynamic special effects that the participant corresponding to the target image is a new participant relative to the multiple participants, that is, it is understood that a new participant has appeared among the multiple participants, for example, a new participant has appeared during the meeting.

[0082] In one embodiment, the target image corresponding to the update instruction includes an image corresponding to the newly added participant and at least one adjacent image; the adjacent image is an image in a plurality of images that is adjacent to the image corresponding to the newly added participant. In response to the update instruction, the image corresponding to the newly added participant is updated and displayed on the target page using a first dynamic effect, and the at least one adjacent image is updated and displayed on the target page using a second dynamic effect. The first dynamic effect and the second dynamic effect can be the same or different.

[0083] In some embodiments, among the multiple images included in the target page, two adjacent images are a first image located on the relatively left and a second image located on the relatively right, respectively. The first and second images are adjacent images to the image corresponding to the newly added participant. A second dynamic special effect includes: the first image is squeezed and deformed to the left, and the second image is squeezed and deformed to the right. The corresponding first dynamic special effect includes: as the first and second images are deformed, the image corresponding to the newly added participant is synchronously displayed in the gap between the first and second images created by the deformation. As shown in the upper figure of Figure 5A, the first image is Image A, the second image is Image B, and the image corresponding to the newly added participant is Image E. Unlike the top-down insertion method of Image E in Figure 5A, in this embodiment, the image corresponding to the newly added participant is synchronously displayed in the gap between Images A and B created by the deformation. In some embodiments, the deformation of the first and second images ends until the first and / or second images are squeezed and deformed to a predetermined condition, or until the gap between the first and second images is deformed to a predetermined condition.

[0084] For example, the deformation of the first image and the second image ends when the right edge of the first image moves to the left to the first preset boundary (the left edge of the first image is fixed), and at this time the left edge of the second image moves to the right to the second preset boundary (the right edge of the second image is fixed). For another example, the deformation of the first image and the second image ends when the gap between the first image and the second image is deformed to the left to the first preset boundary and to the right to the second preset boundary. The deformation of the first image, the second image and the image corresponding to the newly added participant is performed synchronously, and the image corresponding to the newly added participant appears between the first image and the second image. The size of the image corresponding to the newly added participant matches the size of the gap between the first image and the second image. During the implementation process, the size of the image corresponding to the newly added participant (for example, the image of the identified newly added participant is cropped from the frame of the video stream) can be determined based on the real-time changing size of the gap between the first image and the second image.

[0085] In some embodiments, among the multiple images included in the target page, the two adjacent images on the left and right are respectively a first image located on the relatively left and a second image located on the relatively right. The first image is an adjacent image to the image corresponding to the newly added participant, and the image corresponding to the newly added participant will appear to the left of the first image. The second dynamic special effect includes: the first image and the second image are synchronously squeezed and deformed to the right; the corresponding first dynamic special effect includes: when the first image and the second image are deformed, the space on the left side of the first image vacated due to the deformation is synchronously displayed corresponding to the image of the newly added participant. In some embodiments, the deformation of the first image and the second image ends until the first image and / or the second image are squeezed and deformed to a preset condition.

[0086] For example, the deformation of the first image and the second image ends when the left edge of the first image moves to the right to the first preset boundary (the right edge of the first image contacts the left edge of the second image and moves to the right following the deformation of the second image). At this time, the left edge of the second image moves to the right to the second preset boundary (the right edge of the second image remains fixed). The deformation of the first image, the second image, and the image corresponding to the newly added participant is performed synchronously. The image corresponding to the newly added participant appears on the left side of the first image. The size of the image corresponding to the newly added participant matches the size of the space vacated on the left side of the first image due to the deformation. During implementation, the size of the image corresponding to the newly added participant (for example, the image of the identified new participant cropped from the frame of the video stream) can be determined based on the real-time changing size of the space vacated on the left side of the first image due to the deformation.

[0087] Or in some embodiments, among the multiple images included in the target page, the two adjacent images on the left and right are respectively a first image located on the relatively left and a second image located on the relatively right, the second image is an adjacent image, and the image corresponding to the newly added participant will appear on the right side of the second image. The second dynamic special effect includes: the first image and the second image are synchronously squeezed and deformed to the left; the corresponding first dynamic special effect includes: when the first image and the second image are deformed, the space on the right side of the second image vacated due to the deformation synchronously displays the image corresponding to the newly added participant. In some embodiments, the deformation of the first image and the second image ends until the first image and / or the second image are squeezed and deformed to a preset condition. This embodiment is similar to the above embodiment (the image corresponding to the newly added participant will appear on the left side of the first image), and will not be repeated here.

[0088] As shown in Figure 5, Figure 5A is a page diagram of an image display provided in an embodiment of the present application. In response to an update instruction, the target image corresponding to the update instruction includes image E corresponding to the newly added participant, and also includes images A and B corresponding to user 2011 and user 2012 adjacent to user 202 as the newly added participant.

[0089] Furthermore, image E corresponding to the newly added participant is displayed on the target page with a first dynamic effect, and images A and B, which are adjacent images, are displayed on the target page with a second dynamic effect. The first dynamic effect is different from the second dynamic effect. Specifically, the first dynamic effect is image E moving from top to bottom, while the second dynamic effect is image A deforming horizontally to the left and image B deforming horizontally to the right. Finally, the target page shown in the lower figure of Figure 5A is obtained, which includes images A, B, C, D, and E. Images A, B, C, D, and E are reasonably distributed on the target page according to preset image layout rules, and the positional relationship between images A, B, C, D, and E corresponds to the actual positional relationship between users 2011, 2012, 2022, 2023, 2024, and 202 shown in Figure 4. It should be understood that the first and second dynamic effects shown in Figure 5A are for illustration only.

[0090] In another embodiment, the first dynamic effect corresponding to image E corresponding to the newly added participant is image E moving vertically from top to bottom, or horizontally from left to right (or from right to left). The second dynamic effect is image A, image B, image C, and image D deforming vertically from top to bottom until images A, B, C, D, and E are all present on the target page. In this embodiment, the position of the target page occupied by the combination of images A, B, C, and D before the target page is updated is the same as the position of the target page occupied by the combination of images A, B, C, D, and E after the target page is updated.

[0091] In this embodiment, the image corresponding to the newly added participant and at least one adjacent image are used as target images, and the target image is updated and displayed in the target page with dynamic special effects, so that the user can vividly and quickly understand how the newly added participant is added to the multiple participants in the target interface, and the specific position of the newly added participant in the multiple participants in the target interface, which makes it convenient for the user to quickly find the user he is concerned about, improves the sense of reality, and enhances the user experience.

[0092] In one embodiment, the target image corresponding to the update instruction is the image corresponding to the newly added participant. In response to the update instruction, the image corresponding to the newly added participant is updated and displayed on the target page using dynamic special effects; the dynamic special effects include at least one of the following: movement, deformation, marking, fade-in, and fade-out. It is understood that the dynamic special effects for the target image include any combination of the above-mentioned movement, deformation, marking, fade-in, and fade-out. For example, the dynamic special effects for the target image include: movement of the target image, deformation of the target image, marking of the target image, movement and marking of the target image, change and marking of the target image, or movement, deformation, and marking of the target image.

[0093] As shown in FIG5B , FIG5B is a schematic diagram of an image display page provided by an embodiment of the present application. In response to an update instruction, the target image corresponding to the update instruction includes image E corresponding to the newly added participant. Furthermore, image E corresponding to the newly added participant is updated and displayed on the target page using a dynamic special effect. Specifically, the dynamic special effect is a marking and movement effect. This is achieved by marking image E with a star pattern that is clearly distinguishable from other images and moving image E horizontally from right to left, so that image E is dynamically displayed on the target page. The target page shown in the lower figure of FIG5B is obtained. The target page includes image A, image B, image C, image D, and image E. Images A, image B, image C, image D, and image E are reasonably distributed on the target page according to preset image layout rules. The positional relationship between images A, image B, image C, image D, and image E corresponds to the actual positional relationship between users 2011, 2012, 2013, 2014, and 202 shown in FIG4 . It should be understood that the dynamic special effect shown in FIG5B is for illustration only.

[0094] In this embodiment, the image corresponding to the newly added participant is used as the target image, and the target image is updated and displayed on the target page with dynamic special effects, so that the user can notice the new participant relative to multiple participants. In this embodiment, only the target image of the newly added participant is displayed on the target page with dynamic special effects, which reduces the impact on the original multiple images, reduces the system computing power, and avoids the problem of page clutter caused by too many dynamic special effects.

[0095] This application displays multiple images on a target page of a display device based on the relative positions of multiple participants in a conference room. The relative positions of the multiple images on the target page correspond to the relative positions of the multiple participants in the conference room corresponding to the multiple images. When an increase in the number of participants in the conference room is detected, an update instruction for the target page is triggered, and the target images are updated and displayed on the target page in a dynamic special effect manner. In other words, by adding the images corresponding to the newly added participants to the target page in a dynamic special effect manner, the changes in the newly added participants during the adjustment of the target page are dynamically displayed, allowing users to more quickly and easily perceive the changes in the number of multiple participants through dynamic special effects.

[0096] In one embodiment, FIG6 is a flow chart illustrating an image display method according to an embodiment of the present application. The method can be implemented using a computer program and can be run on an image display device based on a von Neumann architecture. The computer program can be integrated into an application or run as a standalone tool application.

[0097] Specifically, the image display method is applied in a video conferencing scenario, including:

[0098] S301: The target page displays the images and relative positions of multiple participants. The target page is a preset page that aggregates and displays the images of each participant in the conference room. The target page has been described in the above embodiment and will not be repeated here.

[0099] S302: When it is detected that the number of the participants decreases, trigger an update instruction for the target page.

[0100] The target page includes multiple images corresponding to multiple participants, and the relative positions of the multiple images in the target page correspond one-to-one to the relative positions of the multiple participants corresponding to the multiple images in the conference room.

[0101] When it is detected that the number of multiple participants in the conference room has changed, and the change is a decrease in the number of multiple participants, the removed participant that caused the decrease in the number of multiple participants is determined, that is, the removed participant is removed from the multiple participants, and an update instruction for the target page is triggered. The reduction in the number of multiple participants is determined by collecting video data or sound data, for example, by comparing the video images or sounds collected based on a preset time period to detect that a participant has been removed or disappeared from the original multiple participants. It is understandable that this application does not impose any restrictions on the technical means for determining the reduction in the number of multiple participants.

[0102] As shown in Figure 7, Figure 7 is a schematic diagram of a scenario in which the number of participants is reduced, provided by an embodiment of the present application. The original multiple participants include user 3011, user 3012, user 3013, and user 3014. During the meeting, user 3012 leaves the meeting, i.e., user 3021 is removed as a participant. The participants are then reduced to user 3011, user 3013, and user 3014, as shown in the lower figure of Figure 7. The positional relationship between user 3011, user 3013, and user 3014 remains unchanged.

[0103] S303: In response to the update instruction, the image corresponding to the removed participant is removed from the target page in a dynamic special effect manner.

[0104] The images and relative positions of the remaining participants are adjusted accordingly to form a new target page. The new target page displays the images and relative positions of the remaining participants. The relative positions of the remaining participants' images in the new target page correspond one-to-one with the relative positions of the corresponding participants in the conference room. For example, target page 102 in the upper right corner of Figure 1, after the adjustment screen in Figure 8A (removing participant B) is formed, forms a new target page as shown in Figure 8A (lower image).

[0105] The target page includes an image corresponding to the removed participant, and the dynamic special effect for the target image can be used to represent that the participant corresponding to the target image is removed from multiple participants and no longer belongs to the original multiple participants.

[0106] Among the multiple images on the target page, at least one image that is adjacent to the image corresponding to the removed participant is considered an adjacent image. In some embodiments, the adjacent image can also be updated and displayed on the target page using dynamic special effects. In some embodiments, both the image corresponding to the removed participant and the adjacent image are target images that need to be updated.

[0107] In this embodiment, the image corresponding to the removed participant that caused the change in the number of multiple participants is determined as one of the target images, and the target image is displayed in the target page in the form of dynamic special effects, so that the user can quickly notice the target image, and understand through the dynamic special effects that the participant corresponding to the target image is actively or passively removed from the multiple participants, that is, it is understood that a participant has been reduced from the multiple participants, for example, a participant left the meeting room during the meeting.

[0108] In one embodiment, the target image corresponding to the update instruction includes an image corresponding to the removed participant and at least one adjacent image; the adjacent image is at least one image among multiple images whose positional relationship with the image corresponding to the removed participant is an adjacent relationship; in response to the update instruction, the image corresponding to the removed participant is displayed in the target page with a third dynamic special effect, and at least one adjacent image is displayed in the target page with a fourth dynamic special effect, and the third dynamic special effect and the fourth dynamic special effect may be the same or different.

[0109] In some embodiments, among the multiple images included in the target page, the two images adjacent to the removed image are a first image located on the relatively left side and a second image located on the relatively right side, the removed image is located between the first image and the second image, and the first image and the second image are adjacent images. The fourth dynamic special effect includes: the first image is stretched and deformed to the right, and the second image is stretched and deformed to the left side; the corresponding third dynamic special effect includes: when the first image and the second image are deformed, the removed image is synchronously squeezed and deformed due to the deformation of the first image and the second image until it disappears. In some embodiments, the deformation of the first image and the second image continues until the first image and the second image are close to each other, that is, the right edge of the first image and the left edge of the second image collide.

[0110] For example, when the first image is deformed, the right edge of the first image moves to the right (the left edge of the first image remains fixed), and when the second image is deformed, the left edge of the second image moves to the left (the right edge of the second image remains fixed). When the right edge of the first image and the left edge of the second image collide, the deformation of the first image and the second image ends. The deformation of the first image, the second image, and the removed image is carried out synchronously.

[0111] In some embodiments, among the multiple images included in the target page, the two adjacent images on the left and right are respectively a first image located on the relatively left side and a second image located on the relatively right side, and the removed image is located on the left side of the first image and adjacent to the first image, and the first image is an adjacent image. A fourth dynamic special effect includes: the first image and the second image are simultaneously stretched and deformed to the left; the corresponding third dynamic special effect includes: when the first image and the second image are deformed, the removed image is synchronously squeezed and deformed due to the deformation of the first image until it disappears. In some embodiments, the deformation of the first image and the second image ends until the first image and / or the second image are stretched and deformed to a preset condition.

[0112] For example, the deformation of the first image and the second image ends when the left edge of the first image moves to the left to the third preset boundary (the right edge of the first image contacts the left edge of the second image and moves to the left following the deformation of the second image). At this time, the left edge of the second image moves to the left to the fourth preset boundary (the right edge of the second image remains fixed). The deformation of the first image, the second image, and the image corresponding to the newly added participant is performed synchronously. While the first image and the second image are simultaneously stretched and deformed to the left, the removed image is also simultaneously squeezed and deformed to the left (that is, the left edge of the removed image remains fixed while the right edge moves to the left) until it disappears. The position of the left edge of the removed image coincides with the third preset boundary.

[0113] Or in some embodiments, among the multiple images included in the target page, the two adjacent images on the left and right are respectively a first image located on the relatively left side and a second image located on the relatively right side, the removed image is located on the right side of the second image and adjacent to the second image, and the second image is an adjacent image. The fourth dynamic special effect includes: the first image and the second image are stretched and deformed to the right at the same time; the corresponding third dynamic special effect includes: when the first image and the second image are deformed, the removed image is synchronously squeezed and deformed due to the deformation of the second image until it disappears. In some embodiments, the deformation of the first image and the second image ends when the first image and / or the second image is stretched and deformed to a preset condition. This embodiment is similar to the above embodiment (the removed image is located on the left side of the first image and adjacent to the first image), and will not be repeated here.

[0114] As shown in FIG8 , FIG8A is a schematic diagram of an image display page provided in an embodiment of the present application. In response to an update instruction, the target image corresponding to the update instruction includes image B corresponding to the removed participant and image A corresponding to user 3011, who is adjacent to user 3012, who is the removed participant. It is understood that the target image may also include image D corresponding to user 3014, who is adjacent to user 3012, who is the removed participant. In this embodiment, the target image includes image B and image A as an example.

[0115] Furthermore, the image B corresponding to the removed participant is displayed on the target page with a third dynamic special effect, and the image A, which is an adjacent image, is displayed on the target page with a fourth dynamic special effect. Specifically, the third dynamic special effect is that image B moves from bottom to top, and the size of image B becomes smaller and smaller and the color becomes lighter and lighter. The fourth dynamic special effect is that image A deforms horizontally to the right until the target page shown in the lower figure in Figure 8A is obtained. The target page shown in the lower figure in Figure 8A includes image A, image B and image C, and the positional relationship between image A, image B and image C corresponds to the positional relationship between user 3011, user 3013 and user 3014. It can be understood that the third dynamic special effect and the fourth dynamic special effect shown in Figure 8A are only for illustration.

[0116] In this embodiment, the image corresponding to the removed participant and at least one adjacent image are used as target images, and the target image is updated and displayed in the target page with dynamic special effects, so that the user can vividly and quickly understand how the removed participant disappears from multiple participants, and after removing the image corresponding to the removed participant, the multiple images can be reasonably and harmoniously distributed in the target page, improving the user experience.

[0117] In one embodiment, the target image corresponding to the update instruction is the image corresponding to the removed participant; in response to the update instruction, the image corresponding to the removed participant is updated and displayed on the target page with dynamic special effects; the dynamic special effects include at least one of the following: movement, deformation, marking, fade-in, and fade-out. It is understood that the dynamic special effects for the target image include any combination of the above-mentioned movement, deformation, marking, fade-in, and fade-out. For example, the dynamic special effects for the target image include: movement of the target image, deformation of the target image, marking of the target image, movement and marking of the target image, change and marking of the target image, or movement, deformation, and marking of the target image.

[0118] As shown in Figure 8B, Figure 8B is a schematic diagram of a page for image display provided by an embodiment of the present application. In response to an update instruction, the target image corresponding to the update instruction is image B corresponding to the removed participant. Further, image B corresponding to the removed participant is updated and displayed on the target page with dynamic special effects. Specifically, the dynamic special effects are marking and moving, by marking a star pattern that is clearly distinguishable from other images on image B, and moving image B upward in the vertical direction, so that image B is dynamically displayed on the target page. Until the target page shown in the lower figure of Figure 8B is obtained, the target page includes image A, image C and image D, and the positional relationship between image A, image C and image D corresponds to the actual positional relationship between user 3011, user 3013 and user 3014 shown in Figure 7. It can be understood that the dynamic special effects shown in Figure 8B are only for illustration.

[0119] In this embodiment, the image corresponding to the newly added participant is used as the target image, and the target image is updated and displayed in the target page with dynamic special effects, so that the user can notice the removed participant among multiple participants. In this embodiment, only the target image of the removed participant is displayed in the target page with dynamic special effects, which reduces the impact on the original multiple images, reduces the system computing power, and avoids the problem of page clutter caused by too many dynamic special effects.

[0120] This application displays multiple images on a target page of a display device based on the relative positions of multiple participants in a conference room, and the relative positions of the multiple images on the target page correspond to the relative positions of the multiple participants corresponding to the multiple images in the conference room. When it is detected that the number of multiple participants in the conference room has decreased, an update instruction for the target page is triggered, and the target image is updated and displayed on the target page in a dynamic special effect manner. In other words, by updating and displaying the image corresponding to the removed participant on the target page in a dynamic special effect manner, the changing process of the removed participant during the adjustment of the target page is dynamically displayed, allowing users to more quickly and easily perceive the changes in the number of multiple participants through dynamic special effects.

[0121] In one embodiment, FIG9 is a flow chart illustrating an image display method according to an embodiment of the present application. The method can be implemented using a computer program and can be run on an image display device based on a von Neumann architecture. The computer program can be integrated into an application or run as a standalone tool application.

[0122] Specifically, the image display method is applied in a video conferencing scenario, including:

[0123] S401: The target page displays the images and relative positions of multiple participants. The target page is a preset page that aggregates and displays the images of each participant in the conference room. The target page has been described in the above embodiment and will not be repeated here.

[0124] S402: When a change in the relative positions of the multiple participants is detected, triggering an update instruction for a target page. The target page includes multiple images corresponding to the multiple participants, and the relative positions of the multiple images in the target page correspond one-to-one to the relative positions of the multiple participants corresponding to the multiple images in the conference room.

[0125] When a change in the relative positions of multiple participants in a conference room is detected, at least one participant among the multiple participants whose position has changed is determined, and an update instruction for the target page is triggered. The target images that need to be updated are the images corresponding to the at least one participant whose position has changed.

[0126] As shown in Figure 10, Figure 10 is a schematic diagram of a scenario in which the positions of multiple participants have changed, provided by an embodiment of the present application. The upper figure in Figure 10 indicates that user 4013 and user 4012 have swapped positions, resulting in the positional relationship shown in the lower figure in Figure 10. Specifically, as shown in the upper figure in Figure 10, the positional relationship between the multiple participants is as follows: user 4011 is behind user 4013 and to the left of user 4012, user 4013 is to the left of user 4014, and user 4014 is in front of user 4012. As shown in the lower figure in Figure 10, the positional relationship between the multiple participants has changed: user 4011 is in front of user 4012 and to the left of user 4013, user 4012 is to the left of user 4014, and user 4014 is in front of user 4013. Of course, in other embodiments, user 4012 may also shift its position to between user 4011 and user 4013, in which case only the actual position of user 4012 has changed.

[0127] Therefore, the target images corresponding to the update instruction are the images corresponding to the two participants whose positions have changed, that is, image B and image C corresponding to user 4012 and user 4013 respectively.

[0128] S403. In response to the update instruction, the images corresponding to the participants whose relative positions have changed are updated in the target page using dynamic special effects. The updated participant's images and relative positions are adjusted accordingly to form a new target page, which displays the updated participant's images and relative positions. The relative positions of the updated participant's images in the new target page correspond one-to-one with the corresponding participant's relative positions in the conference room. For example, target page 102 in the upper right corner of Figure 1, after the adjustment screen shown in Figure 11A (participant C and participant B are swapped), forms a new target page as shown in Figure 11A (lower image).

[0129] Dynamic special effects include at least one of the following: movement, deformation, marking, fade-in, and fade-out. It is understood that dynamic special effects for a target image include any combination of the above-mentioned movement, deformation, marking, fade-in, and fade-out. For example, dynamic special effects for a target image include: movement of the target image, deformation of the target image, marking of the target image, movement and marking of the target image, change and marking of the target image, or movement, deformation, and marking of the target image.

[0130] As shown in FIG11 , FIG11 is a schematic diagram of an image display page provided by an embodiment of the present application. In the upper figure of FIG11 , images B and C corresponding to the two participants whose positions have changed are updated and displayed on the target page in a dynamic special effect manner until the target page shown in the lower figure of FIG11 is obtained. Specifically, images B and C are distinguished from other images by deformation, and image B is further moved toward the position of image C, and image C is moved toward the position of image B, until the target page shown in the lower figure of FIG11 is obtained. The positional relationship between images A, B, C, and D on the target page corresponds to the actual positional relationship between users 4011, 4012, 4013, and 4014 in FIG10 .

[0131] In this embodiment, the image corresponding to at least one participant whose position has changed is used as the target image, and the target image is updated and displayed on the target page in a dynamic special effect manner, so that the user can vividly and quickly notice at least one participant whose position has changed among multiple participants, and understand how the position of the at least one participant has changed, thereby improving the user experience.

[0132] This application displays multiple images on a target page of a display device based on the relative positions of multiple participants in a conference room. The relative positions of the multiple images on the target page correspond to the relative positions of the multiple participants in the conference room corresponding to the multiple images. When a change in the positional relationship of the multiple participants in the conference room is detected, an update instruction for the target page is triggered, and the target image is updated and displayed on the target page in a dynamic special effect manner. In other words, by updating and displaying the images corresponding to the participants whose relative positions have changed on the target page in a dynamic special effect manner, the changing process of the participants whose relative positions have changed during the adjustment of the target page is dynamically displayed, allowing users to more quickly and easily perceive the position changes of multiple participants through dynamic special effects.

[0133] In the embodiment of the present application, the duration of the dynamic special effect is about 1 second, so that the user can more quickly perceive the changes in the number and / or positions of multiple participants.

[0134] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0135] Please refer to Figure 12, which shows a schematic diagram of the structure of an image display device provided by an exemplary embodiment of the present application. The image display device can be implemented as all or part of a device through software, hardware, or a combination of both. The image display device includes a first display module 501, a second display module 502, and a third display module 503.

[0136] The first display module 501 is used to display a target page, which displays the images and relative positions of multiple participants. The target page is a preset page that aggregates and displays the images of each participant in the conference room.

[0137] A first triggering module 502 is configured to trigger an update instruction for a target page upon detecting an increase in the number of participants; the target page includes multiple images corresponding to the multiple participants, and the relative positions of the multiple images in the target page correspond one-to-one to the relative positions of the multiple participants corresponding to the multiple images in the conference room;

[0138] The first update module 503 is used to add the image corresponding to the newly added participant to the target page in the form of dynamic special effects. The images and relative positions of the original multiple participants on the target page are adjusted accordingly to form a new target page. The new target page displays the image corresponding to the newly added participant and the images and relative positions of the original multiple participants; the relative positions of the images of the newly added participant and the original multiple participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

[0139] Please refer to Figure 13, which shows a schematic diagram of the structure of an image display device provided by an exemplary embodiment of the present application. The image display device can be implemented as all or part of the device through software, hardware, or a combination of both. The image display device includes a second display module 601, a second trigger module 602, and a second update module 603.

[0140] The second display module 601 is used to display a target page, which displays the images and relative positions of multiple participants. The target page is a preset page that aggregates and displays the images of each participant in the conference room.

[0141] A second triggering module 602 is configured to trigger an update instruction for a target page upon detecting a decrease in the number of the plurality of participants; the target page includes a plurality of images corresponding to the plurality of participants, and the relative positions of the plurality of images in the target page correspond one-to-one to the relative positions of the plurality of participants corresponding to the plurality of images in the conference room;

[0142] The second update module 603 is used to remove the image corresponding to the removed participant from the target page in a dynamic special effect manner, and the images and relative positions of the remaining participants are adjusted accordingly to form a new target page, which displays the images and relative positions of the remaining participants; the relative positions of the images of the remaining participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

[0143] Please refer to Figure 14, which shows a schematic diagram of the structure of an image display device provided by an exemplary embodiment of the present application. The image display device can be implemented as all or part of the device through software, hardware, or a combination of both. The image display device includes a third display module 701, a third trigger module 702, and a third update module 703.

[0144] The third display module 701 is used to display a target page, which displays the images and relative positions of multiple participants. The target page is a preset page that aggregates and displays the images of each participant in the conference room.

[0145] The third trigger module 702 is configured to trigger an update instruction for a target page upon detecting a change in the relative positions of the plurality of participants; the target page includes a plurality of images corresponding to the plurality of participants, and the relative positions of the plurality of images in the target page correspond one-to-one to the relative positions of the plurality of participants in the conference room corresponding to the plurality of images;

[0146] The third update module 703 is used to update the images corresponding to the participants whose relative positions have changed in the target page in a dynamic special effect manner. The images and relative positions of the updated participants are adjusted accordingly to form a new target page. The new target page displays the images and relative positions of the updated participants; the relative positions of the images of the updated participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

[0147] The present application displays multiple images on a target page of a display device based on the positional relationship between multiple participants, and the positional relationship between the multiple images on the target page corresponds to the positional relationship between the multiple participants corresponding to the multiple images. When a change in the number and / or positional relationship of the multiple participants is detected, an update instruction of the target page is triggered, and the target image corresponding to the update instruction is further updated and displayed on the target page with dynamic special effects. In other words, by displaying the target image on the target page in a dynamic manner with dynamic special effects, the display effect of the multiple images on the target page is optimized, and the changes in the number and / or positional relationship of the multiple participants corresponding to the multiple images are dynamically displayed, thereby improving the efficiency of interaction between the user and the multiple images, and allowing the user to more quickly and easily obtain information on changes in the number and / or position of the multiple participants through the target image and the dynamic special effects corresponding to the target image.

[0148] It should be noted that the image display device provided in the above embodiment, when executing the image display method, is merely illustrated by the division of the above-mentioned functional modules. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the image display device provided in the above embodiment and the image display method embodiment are based on the same concept. The implementation process is detailed in the method embodiment and will not be repeated here.

[0149] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0150] An embodiment of the present application further provides a computer storage medium, which can store multiple instructions. The instructions are suitable for being loaded by a processor and executed as shown in the above-mentioned image display method of the embodiment shown in Figures 1 to 11. The specific execution process can be found in the specific description of the embodiment shown in Figures 1 to 11, which will not be repeated here.

[0151] The present application also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded by a processor and executes the image display method of the embodiment shown in Figures 1 to 11 above. The specific execution process can be found in the specific description of the embodiment shown in Figures 1 to 11, and will not be repeated here.

[0152] 15 , which is a schematic diagram of the structure of an electronic device according to an embodiment of the present application, as shown in FIG15 , the electronic device 800 may include: at least one processor 801 , at least one network interface 804 , a user interface 803 , a memory 805 , and at least one communication bus 802 .

[0153] The communication bus 802 is used to implement the connection and communication between these components.

[0154] The user interface 803 may include a display screen (Display) and a camera (Camera). Optionally, the user interface 803 may also include a standard wired interface and a wireless interface.

[0155] The network interface 804 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0156] The processor 801 may include one or more processing cores. The processor 801 utilizes various interfaces and circuits to connect various components within the server 800. It executes various functions and processes data for the server 800 by running or executing instructions, programs, code sets, or instruction sets stored in the memory 805, as well as accessing data stored in the memory 805. Optionally, the processor 801 may be implemented using at least one hardware form selected from the group consisting of a digital signal processing (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA). The processor 801 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. The CPU primarily processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing the content displayed on the display screen; and the modem handles wireless communications. It is understood that the modem may not be integrated into the processor 801 and may be implemented separately on a separate chip.

[0157] Among them, the memory 805 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 805 includes a non-transitory computer-readable storage medium. The memory 805 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 805 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 805 may also be at least one storage device located away from the aforementioned processor 801. As shown in Figure 15, the memory 805 as a computer storage medium may include an operating system, a network communication module, a user interface module and an image processing application.

[0158] In one embodiment, the electronic device 800 may be an interactive intelligent panel (IIP). In the electronic device 800 shown in FIG15 , the user interface 803 is primarily used to provide an input interface for the user and obtain user input data; and the processor 801 may be used to call an image processing application stored in the memory 805 and specifically perform the following operations:

[0159] The target page displays the images and relative positions of multiple participants; the target page is a preset page that aggregates and displays the images of each participant in the conference room;

[0160] When an increase in the number of participants is detected, an update instruction for a target page is triggered; the target page includes multiple images corresponding to the multiple participants, and the relative positions of the multiple images in the target page correspond one-to-one to the relative positions of the multiple participants corresponding to the multiple images in the conference room;

[0161] The images corresponding to the newly added participants are added to the target page in the form of dynamic special effects, and the images and relative positions of the original multiple participants on the target page are adjusted accordingly to form a new target page. The new target page displays the images corresponding to the newly added participants and the images and relative positions of the original multiple participants; the relative positions of the images of the newly added participants and the original multiple participants in the new target page correspond one to one to the relative positions of the corresponding participants in the conference room.

[0162] In one embodiment, the processor 801 may also be configured to call an image processing application stored in the memory 805 and specifically perform the following operations:

[0163] The target page displays the images and relative positions of multiple participants; the target page is a preset page that aggregates and displays the images of each participant in the conference room;

[0164] When it is detected that the number of the plurality of participants decreases, an update instruction for a target page is triggered; the target page includes a plurality of images corresponding to the plurality of participants, and relative positions of the plurality of images in the target page correspond one-to-one to relative positions of the plurality of participants corresponding to the plurality of images in the conference room;

[0165] The images corresponding to the removed participants are removed from the target page in a dynamic special effect manner, and the images and relative positions of the remaining participants are adjusted accordingly to form a new target page. The new target page displays the images and relative positions of the remaining participants; the relative positions of the images of the remaining participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

[0166] In one embodiment, the processor 801 may also be configured to call an image processing application stored in the memory 805 and specifically perform the following operations:

[0167] The target page displays the images and relative positions of multiple participants; the target page is a preset page that aggregates and displays the images of each participant in the conference room;

[0168] When a change in the relative positions of the multiple participants is detected, an update instruction for the target page is triggered; the target page includes multiple images corresponding to the multiple participants, and the relative positions of the multiple images in the target page correspond one-to-one to the relative positions of the multiple participants corresponding to the multiple images in the conference room;

[0169] The images corresponding to the participants whose relative positions have changed are updated in the target page in a dynamic special effect manner. The images and relative positions of the updated participants are adjusted accordingly to form a new target page. The new target page displays the images and relative positions of the updated participants. The relative positions of the updated participants' images in the new target page correspond one to one with the relative positions of the corresponding participants in the conference room.

[0170] The present application displays multiple images on a target page of a display device based on the positional relationship between multiple participants, and the positional relationship between the multiple images on the target page corresponds to the positional relationship between the multiple participants corresponding to the multiple images. When a change in the number and / or positional relationship of the multiple participants is detected, an update instruction of the target page is triggered, and the target image corresponding to the update instruction is further updated and displayed on the target page with dynamic special effects. In other words, by displaying the target image on the target page in a dynamic manner with dynamic special effects, the display effect of the multiple images on the target page is optimized, and the changes in the number and / or positional relationship of the multiple participants corresponding to the multiple images are dynamically displayed, thereby improving the efficiency of interaction between the user and the multiple images, and allowing the user to more quickly and easily obtain information on changes in the number and / or position of the multiple participants through the target image and the dynamic special effects corresponding to the target image.

[0171] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing related hardware through a computer program. The program can be stored in a computer-readable storage medium, and when executed, the program can include the processes in the above-described method embodiments. The storage medium can be a magnetic disk, an optical disk, a read-only memory, or a random access memory.

[0172] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. An image display method, applied in a video conferencing scenario, characterized in that: The method comprises: The target page displays the images and relative positions of multiple participants; the target page is a preset page that aggregates and displays the images of each participant in the conference room; When an increase in the number of multiple participants is detected, an update instruction for the target page is triggered; the target page includes multiple images corresponding to the multiple participants, and the relative positions of the multiple images in the target page correspond one-to-one to the relative positions of the multiple participants corresponding to the multiple images in the conference room; The image corresponding to the newly added participant is added to the target page in the form of dynamic special effects, and the images and relative positions of the original multiple participants on the target page are adjusted accordingly to form a new target page. The new target page displays the image corresponding to the newly added participant and the images and relative positions of the original multiple participants; the relative positions of the images of the newly added participant and the original multiple participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

2. The image display method according to claim 1, wherein: Adjacent images are images in the plurality of images whose positional relationship with the image corresponding to the newly added participant is adjacent to each other; The step of adding an image corresponding to the newly added participant to the target page in a dynamic special effect manner includes: The image corresponding to the newly added participant is updated and displayed on the target page in a first dynamic special effect manner, and the at least one adjacent image is updated and displayed on the target page in a second dynamic special effect manner.

3. The image display method according to claim 2, wherein: Two adjacent images in the plurality of images are respectively a first image located on the relatively left and a second image located on the relatively right, and the first image and the second image are the adjacent images; The second dynamic special effect includes: the first image is squeezed and deformed to the left, and the second image is squeezed and deformed to the right; the corresponding first dynamic special effect includes: when the first image and the second image are deformed, the image corresponding to the new participant is synchronously displayed in the gap between the first image and the second image due to the deformation.

4. The image display method according to claim 3, wherein: The deformation of the first image and the second image ends until the first image and / or the second image are squeezed and deformed to a preset condition, or until the gap between the first image and the second image is deformed to a preset condition.

5. The image display method according to claim 2, wherein: Two adjacent images in the plurality of images are respectively a first image located on the relatively left and a second image located on the relatively right, and the first image is the adjacent image; The second dynamic special effect includes: the first image and the second image are synchronously squeezed and deformed to the right; correspondingly, the first dynamic special effect includes: when the first image and the second image are deformed, the space on the left side of the first image vacated due to the deformation is synchronously displayed with the image corresponding to the newly added participant; or, Two adjacent images in the plurality of images are respectively a first image located on the relatively left and a second image located on the relatively right, and the second image is the adjacent image; The second dynamic special effect includes: the first image and the second image are synchronously squeezed and deformed to the left; the corresponding first dynamic special effect includes: when the first image and the second image are deformed, the space on the right side of the second image vacated due to the deformation synchronously displays the image corresponding to the new participant.

6. The image display method according to claim 5, wherein: The deformation of the first image and the second image ends when the first image and / or the second image are squeezed and deformed to a preset condition.

7. The image display method according to claim 1, wherein: The dynamic special effects include at least one of the following: movement, deformation, marking, fade-in, and fade-out.

8. An image display method, applied in a video conferencing scenario, characterized in that: The method comprises: The target page displays the images and relative positions of multiple participants; the target page is a preset page that aggregates and displays the images of each participant in the conference room; When it is detected that the number of the plurality of participants decreases, an update instruction for the target page is triggered; the target page includes a plurality of images corresponding to the plurality of participants, and the relative positions of the plurality of images in the target page correspond one-to-one to the relative positions of the plurality of participants corresponding to the plurality of images in the conference room; The images corresponding to the removed participants are removed from the target page in a dynamic special effect manner, and the images and relative positions of the remaining participants are adjusted accordingly to form a new target page, which displays the images and relative positions of the remaining participants; the relative positions of the images of the remaining participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

9. The image display method according to claim 8, wherein: The adjacent image is at least one image in the plurality of images, the positional relationship between which and the image corresponding to the removed participant is an adjacent relationship; The step of removing the image corresponding to the removed participant from the target page in a dynamic special effect manner includes: The image corresponding to the removed participant is updated and displayed on the target page in a third dynamic special effect manner, and the at least one adjacent image is updated and displayed on the target page in a fourth dynamic special effect manner.

10. The image display method according to claim 9, wherein: Two images adjacent to the removed image in the plurality of images are a first image located on the relatively left side and a second image located on the relatively right side, the removed image is located between the first image and the second image, and the first image and the second image are the adjacent images; The fourth dynamic special effect includes: the first image is stretched and deformed to the right, and the second image is stretched and deformed to the left; the corresponding third dynamic special effect includes: when the first image and the second image are deformed, the removed image is synchronously squeezed and deformed due to the deformation of the first image and the second image until it disappears.

11. The image display method according to claim 10, wherein: The deformation of the first image and the second image continues until the first image and the second image are brought into contact with each other.

12. The image display method according to claim 9, wherein: Two adjacent images in the plurality of images are a first image located on the relatively left side and a second image located on the relatively right side, the removed image is located on the left side of the first image and is adjacent to the first image, and the first image is the adjacent image; The fourth dynamic special effect includes: the first image and the second image are simultaneously stretched and deformed to the left; the corresponding third dynamic special effect includes: when the first image and the second image are deformed, the removed image is synchronously squeezed and deformed due to the deformation of the first image until it disappears; or, The two adjacent images in the plurality of images are respectively a first image located on the relatively left side and a second image located on the relatively right side, the removed image is located on the right side of the second image and is adjacent to the second image, and the second image is the adjacent image; The fourth dynamic special effect includes: the first image and the second image are stretched and deformed to the right at the same time; the corresponding third dynamic special effect includes: when the first image and the second image are deformed, the removed image is synchronously squeezed and deformed due to the deformation of the second image until it disappears.

13. The image display method according to claim 12, wherein: The deformation of the first image and the second image ends when the first image and / or the second image are stretched and deformed to a preset condition.

14. The image display method according to claim 8, wherein: The dynamic special effects include at least one of the following: movement, deformation, marking, fade-in, and fade-out.

15. An image display method, applied in a video conferencing scenario, characterized in that: The method comprises: The target page displays the images and relative positions of multiple participants; the target page is a preset page that aggregates and displays the images of each participant in the conference room; When a change in the relative positions of the plurality of participants is detected, an update instruction for the target page is triggered; the target page includes a plurality of images corresponding to the plurality of participants, and the relative positions of the plurality of images in the target page correspond one-to-one to the relative positions of the plurality of participants corresponding to the plurality of images in the conference room; The images corresponding to the participants whose relative positions have changed are updated in the target page in a dynamic special effect manner, and the images and relative positions of the updated participants are adjusted accordingly to form a new target page, which displays the images and relative positions of the updated participants; the relative positions of the images of the updated participants in the new target page correspond one-to-one to the relative positions of the corresponding participants in the conference room.

16. The image display method according to claim 15, wherein: The dynamic special effects include at least one of the following: movement, deformation, marking, fade-in, and fade-out.

Images