Screen display method, device, terminal and storage medium

Abstract

The present application is about a screen display method, device, terminal and storage medium, and relates to the field of screen processing. The method includes: displaying a target interface, the target interface includes a first screen display area and a second screen display area; displaying a first screen portion of a first target screen in the first screen display area; the mapping position of the second screen portion in the first target screen in the target interface is within the second screen display area; displaying a portion of the second target screen in the second screen display area; in response to the presence of a first target object in the second screen portion, superimposing and displaying the first target object in the second screen portion and at least one of the virtual images corresponding to the first target object in the second screen display area. Through the above method, the interaction mode between the first target screen and the second target screen is expanded, thereby improving the interaction effect between the anchors during the live broadcast process.

Description

Technical Field

[0001] The present application relates to the field of picture processing technology, and in particular to a picture display method, device, terminal and storage medium. Background Art

[0002] At present, as the technology in the live broadcast field becomes more and more mature, in order to increase the interaction between anchors during the live broadcast, the video link function can be used.

[0003] In the related art, the video link function is initiated by a host to other live broadcasts. After the other hosts respond to the initiated video link request, the live broadcast interface for the video link is displayed on the host's terminal participating in the video link and the user's terminal watching the host's live broadcast room participating in the video link. The live broadcast interface displays a spliced ​​screen of the independent live broadcast screens corresponding to each host.

[0004] However, when the video link is performed through the above method, the picture displayed on the terminal is a spliced ​​picture of the pictures of each anchor performing a separate live broadcast, which results in poor interaction between the anchors that is expected to be achieved by the video link function. Summary of the invention

[0005] The embodiment of the present application provides a screen display method, device, terminal and storage medium, which can improve the interactive effect of the screen. The technical solution is as follows:

[0006] On the one hand, a screen display method is provided, the method being executed by a first terminal, the method comprising:

[0007] Displaying a target interface, wherein the target interface includes a first screen display area and a second screen display area;

[0008] Displaying a first screen portion of a first target screen in the first screen display area; the first target screen is a captured screen on the first terminal side, and a mapping position of a second screen portion of the first target screen in the target interface is within the second screen display area;

[0009] Displaying a portion of a second target screen in the second screen display area; the second target screen is a captured screen on the second terminal side;

[0010] In response to the presence of a first target object in the second screen portion, the first target object in the second screen portion and at least one of the virtual images corresponding to the first target object are superimposed and displayed in the second screen display area; the first target object is the target object in the first target screen.

[0011] In a possible implementation, in response to the first target object being present in the second screen portion, superimposing and displaying at least one of the first target object in the second screen portion and a virtual image corresponding to the first target object in the second screen display area includes:

[0012] performing image recognition on the second picture portion,

[0013] Dividing the second picture portion into a background portion and a target contour portion;

[0014] Based on the target contour portion, determining an identification object corresponding to the target contour portion;

[0015] In response to determining that the identified object corresponding to the target outline portion is the first target object, the first target object in the second picture portion and at least one of the virtual images corresponding to the first target object are superimposed and displayed in the second picture display area.

[0016] In a possible implementation manner, determining, based on the target contour portion, the identification object corresponding to the target contour portion includes:

[0017] Performing edge enhancement processing on the target contour portion to obtain the processed target contour portion;

[0018] The identified object is determined based on the processed target contour portion.

[0019] In a possible implementation, in response to determining that the identified object corresponding to the target outline portion is the first target object, superimposing and displaying at least one of the first target object in the second screen portion and the virtual image corresponding to the first target object in the second screen display area includes:

[0020] In response to the identified object being the first target object, acquiring the virtual image corresponding to the first target object based on a pre-stored correspondence relationship or a specified algorithm;

[0021] The virtual image corresponding to the first target object is displayed in a superimposed manner in the second screen display area.

[0022] In a possible implementation, in response to the first target object being present in the second screen portion, superimposing and displaying in the second screen display area at least one of the first target object in the second screen portion and a virtual image corresponding to the first target object, includes:

[0023] In response to the presence of the first target object in the second screen portion, and the target interface including at least two second screen display areas, determining a target screen display area based on the mapping position of the second screen portion in the target interface; the target screen display area is at least one of the at least two second screen display areas;

[0024] The first target object in the second screen portion and at least one of the virtual images corresponding to the first target object are superimposed and displayed in the target screen display area.

[0025] In a possible implementation, the method further includes:

[0026] In response to the first target object including a target part and a portion of the second target screen including a target area, a special effect animation is displayed on the target interface; the target area is an area corresponding to the designated part obtained by image recognition.

[0027] In a possible implementation, in response to the first target object including the target part and a portion of the second target screen including the target area, displaying a special effect animation on the target interface includes:

[0028] In response to the first target object including the target part, performing image recognition on a portion of the second target image displayed in the second image display area;

[0029] Acquire the target area on a partial screen of the second target screen;

[0030] In response to the target part included in the first target object and the target area in the second target picture satisfying a specified positional relationship, the special effect animation is displayed.

[0031] In a possible implementation manner, before the method overlays and displays at least one of the first target object in the second screen portion and a virtual image corresponding to the first target object in the target screen display area, the method further includes:

[0032] The first screen part in the first target screen, the virtual image of the first target object, and the mapping position of the virtual image of the first target object in the second screen display area are sent to the server, so that the second terminal obtains the first screen part in the first target screen, the virtual image of the first target object, and the mapping position of the virtual image of the first target object in the second screen display area from the server, and displays the first screen part, the second screen part, and the virtual image of the first target object.

[0033] In a possible implementation, the method further includes:

[0034] In response to receiving the second screen portion, the virtual image of the second target object, and the mapping position of the virtual image of the second target object in the first screen display area sent by the server, the first screen portion and the virtual image of the second target object are displayed in the first screen display area, and the second screen portion is displayed in the second screen display area; the second target object is the target object in the second target screen.

[0035] On the other hand, a screen display device is provided, the device is used in a first terminal, and the device includes:

[0036] An interface display module, used to display a target interface, wherein the target interface includes a first screen display area and a second screen display area;

[0037] A first picture display module is used to display a first picture portion in a first target picture in the first picture display area; the first live picture is a shot picture on the first terminal side, and a mapping position of a second picture portion in the first target picture in the target interface is within the second picture display area;

[0038] A second picture display module, used to display a part of a second target picture in the second picture display area; the second target picture is a picture taken by the second terminal side;

[0039] The first image overlay module is used to respond to the presence of a first target object in the second picture portion, and to overlay and display the first target object in the second picture portion and at least one of the virtual images corresponding to the first target object in the second picture display area; the first target object is the target object in the first target picture.

[0040] In a possible implementation, the first image overlay module includes:

[0041] A region division submodule, used for performing image recognition on the second picture portion, and dividing the second picture portion into a background portion and a target contour portion;

[0042] An object recognition submodule, configured to determine, based on the target contour portion, a recognition object corresponding to the target contour portion;

[0043] The image superimposition submodule is used for, in response to determining that the identified object corresponding to the target outline portion is the first target object, superimposing and displaying the first target object in the second picture portion and at least one of the virtual images corresponding to the first target object in the second picture display area.

[0044] In a possible implementation, the object recognition submodule includes:

[0045] An edge enhancement unit, used for performing edge enhancement processing on the target contour portion to obtain the processed target contour portion;

[0046] The object determination unit is used to determine the recognized object based on the processed target contour portion.

[0047] In a possible implementation, the image overlay submodule includes:

[0048] A first image acquisition unit, configured to acquire the virtual image corresponding to the first target object based on a pre-stored correspondence relationship or a specified algorithm in response to the identified object being the first target object;

[0049] The first image superimposing unit is used to superimpose and display the virtual image corresponding to the first target object in the second picture display area.

[0050] In a possible implementation, the first image overlay module includes:

[0051] a target area determination submodule, configured to determine a target screen display area based on the mapping position of the second screen part in the target interface in response to the presence of the first target object in the second screen part and the target interface including at least two second screen display areas; the target screen display area is at least one of the at least two second screen display areas;

[0052] The superimposition submodule is used to superimpose and display at least one of the first target object and the virtual image corresponding to the first target object in the second picture part in the target picture display area.

[0053] In a possible implementation manner, the device further includes:

[0054] An animation display module is used to display a special effect animation on the target interface in response to the first target object containing a target part and part of the second target screen including a target area; the target area is the area corresponding to the designated part obtained by image recognition.

[0055] In a possible implementation, the animation display module includes:

[0056] a recognition submodule, configured to perform image recognition on a portion of the second target image displayed in the second image display area in response to the first target object containing the target part;

[0057] A target area acquisition submodule, used for acquiring the target area on a part of the second target picture;

[0058] The animation display submodule is used to display the special effect animation in response to the target part included in the first target object and the target area in the second target picture satisfying a specified positional relationship.

[0059] In a possible implementation manner, the device further includes:

[0060] A data sending module is used to send the first screen part in the first target screen, the virtual image of the first target object, and the mapping position of the virtual image of the first target object in the second screen display area to a server before superimposing and displaying the first target object in the second screen part and at least one of the virtual images corresponding to the first target object in the target screen display area, so that the second terminal obtains the mapping position of the first screen part in the first target screen, the virtual image of the first target object, and the virtual image of the first target object in the second screen display area from the server, and displays the first screen part, the second screen part, and the virtual image of the first target object.

[0061] In a possible implementation manner, the device further includes:

[0062] A data receiving module, for displaying the first picture portion and the virtual image of the second target object in the first picture display area, and displaying the second picture portion in the second picture display area in response to receiving the second picture portion, the virtual image of the second target object, and the mapping position of the virtual image of the second target object in the first picture display area sent by the server; the second target object is the target object in the second target picture.

[0063] On the other hand, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set are loaded and executed by the processor to implement the above-mentioned screen display method.

[0064] On the other hand, a computer-readable storage medium is provided, in which at least one instruction, at least one program, a code set or an instruction set is stored, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the above-mentioned screen display method.

[0065] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the screen display method provided in the above various optional implementations.

[0066] The technical solution provided by this application may have the following beneficial effects:

[0067] A second screen portion in a first target screen is obtained. If a first target object exists in the second screen portion, the first target object and at least one of the corresponding virtual images are superimposed and displayed on a partial screen of the second target screen displayed in the second screen display area. Since the second screen portion is in the first target screen and the mapping position is on the second screen display area, the first target object in the second screen portion is directly or indirectly displayed at the mapping position in the second screen display area, thereby expanding the interaction method between the first target screen and the second target screen. When applied in the live broadcast field, the interaction effect between the anchors during the live broadcast process is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0069] Figure 1 A flowchart of a screen display method shown in an exemplary embodiment of the present application is shown;

[0070] Figure 2 A flowchart of a screen display method shown in an exemplary embodiment of the present application is shown;

[0071] Figure 3 yes Figure 2 A schematic diagram of a first target screen and a second target screen involved in the illustrated embodiment;

[0072] Figure 4 yes Figure 2 A schematic diagram of a second screen portion division involved in the illustrated embodiment;

[0073] Figure 5 yes Figure 2A schematic diagram of screen interaction involving superimposed virtual images in the illustrated embodiment;

[0074] Figure 6 A block diagram of a screen display device shown in an exemplary embodiment of the present application is shown;

[0075] Figure 7 is a structural block diagram of a computer device according to an exemplary embodiment;

[0076] Figure 8 A structural block diagram of a computer device shown in an exemplary embodiment of the present application is shown. DETAILED DESCRIPTION

[0077] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0078] It should be understood that the "plurality" mentioned in this article refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0079] The screen display method provided in the present application can be applied to a scenario where at least two users are interacting with each other through video screens.

[0080] For example, the screen display method can be applied to a scenario where at least two anchors on a live broadcast platform conduct a video connection, or can be applied to a scenario where at least two users conduct a video call. When the screen display method is applied to a scenario where at least two anchors on a live broadcast platform conduct a video connection, the live broadcast screen display method can be implemented by a live broadcast system corresponding to the live broadcast screen display method, and the live broadcast system includes: a first terminal, a server, at least one second terminal, and at least one third terminal. The first terminal can be the initiator of the connection function, and the second terminal can be the receiver of the connection function.

[0081] The first terminal has an application installed and running with a live video connection function, the client corresponding to the application is the first client, and the first terminal is a terminal used by the first user. The first user may be the first anchor who is broadcasting live; the second terminal also has the same application installed and running as the first terminal, the client corresponding to the application is the second client, the second terminal is a terminal used by the second user, and the second user may be the second anchor who is also broadcasting live. The third terminal also has the same application installed and running as the first terminal, the client corresponding to the application is the third client, the third terminal is a terminal used by the third user, and the third user may be a viewer who is watching the live broadcast of the first anchor, or a viewer who is watching the live broadcast of the second anchor.

[0082] Optionally, the applications installed on the first terminal, the second terminal, and the third terminal are the same, or the applications installed on the three terminals are the same type of applications on different operating system platforms (Android or IOS). The first terminal may refer to one of the multiple terminals, and the second terminal may refer to another of the multiple terminals. This embodiment is only illustrated by the first terminal, the second terminal, and the third terminal. The device types of the first terminal, the second terminal, and the third terminal are the same or different, and the device types include: at least one of a smart phone, a tablet computer, an e-book reader, an MP3 (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Compression Standard Audio Layer 3) player, an MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Compression Standard Audio Layer 4) player, a laptop portable computer, and a desktop computer.

[0083] The server may be a live broadcast server, and the first terminal, the second terminal and the third terminal may be connected via a wired or wireless network.

[0084] The live broadcast server can transmit data with the content distribution network of the streaming media. The live broadcast server can be a single server, or a server cluster composed of several servers, or the live broadcast server can include one or more virtualization platforms, or the live broadcast server can also be a cloud computing service center.

[0085] Figure 1 A flowchart of a screen display method shown in an exemplary embodiment of the present application is shown. The screen display method can be executed by a computer device, wherein the computer device can be the first terminal in the above-mentioned live broadcast system, such as Figure 1 As shown, the screen display method may include the following steps:

[0086] Step 101, displaying a target interface, wherein the target interface includes a first screen display area and a second screen display area.

[0087] In an embodiment of the present application, the first terminal displays a target interface, in which a first screen display area and a second screen display area are displayed.

[0088] In a possible implementation, the target interface includes at least one second screen display area, and the first screen display area and the at least one second screen display area are displayed in a fixed arrangement position.

[0089] For example, when applied in the field of live broadcasting, a live broadcasting application may be installed on the first terminal, and the first terminal may push the stream through the live broadcasting application. The first screen display area is used to display part of the live broadcasting screen on the first terminal side, and the second screen display area is used to display part of the live broadcasting screen on the second terminal side.

[0090] Among them, the target interface displayed on the first terminal may be a live broadcast interface, and the arrangement position of the first screen display area in the live broadcast interface corresponding to the at least one second screen display area is the same as the arrangement position of each screen display area in the live broadcast interface displayed on at least one second terminal, and the arrangement position of each screen display area in the live broadcast interface displayed on at least one third terminal.

[0091] In one possible implementation, in response to receiving a target triggering operation, a target interface is displayed.

[0092] Among them, in the field of live broadcasting, the target trigger operation can be a trigger operation performed on a target control that initiates a video link request.

[0093] That is to say, in response to the first terminal receiving the target trigger operation, sending a request message for requesting a microphone connection to the server, the server sends the request message to the corresponding second terminal, and in response to the server receiving the request response message sent by the second terminal, the first terminal can display a first screen display area corresponding to the first terminal and a second screen display area corresponding to the second terminal.

[0094] For example, anchor A on the first terminal side initiates a video link-up request to anchor B on the second terminal side and anchor C on the second terminal side. If anchor B and anchor C both agree to the received link-up request, the first terminal displays each screen display area in a fixed arrangement position in the live broadcast interface, where the fixed arrangement position can be that the first screen display area corresponding to anchor A, the initiator of the link-up function, is ranked first from left to right, and then the second screen display areas are next to the first screen display area. The arrangement order corresponding to the second screen display areas can be determined by the order of agreeing to the link-up request. Since anchor B agrees to the video link-up request sent by anchor A before anchor C, the second screen display area next to the first screen display area is the second screen display area corresponding to anchor B, and the second screen display area next to the second screen display area corresponding to anchor B is ranked third.

[0095] Step 102, displaying the first screen portion of the first target screen in the first screen display area; the first target screen is a shooting screen on the first terminal side, and the mapping position of the second screen portion of the first target screen in the target interface is within the second screen display area.

[0096] In an embodiment of the present application, the first terminal has a camera module, through which the first target picture on the first terminal side can be obtained, and the first terminal displays the first picture portion in the first live picture in the first picture display area in the target interface.

[0097] In a possible implementation, the second picture portion is determined by a position of the second picture display area relative to the first picture display area.

[0098] Exemplarily, in response to the second picture display area being located adjacent to the right side of the first picture display area, a first picture portion exists on the right side of the first target picture; in response to the second picture display area being located adjacent to the left side of the first picture display area, a first picture portion exists on the left side of the first target picture; in response to the second picture display area being located adjacent to above the first picture display area, a first picture portion exists above the first live picture; in response to the second picture display area being located adjacent to below the first picture display area, a first picture portion exists below the first target picture.

[0099] Among them, the first target screen excluding the second screen portion may be the first screen portion, and the first screen portion is the first target screen displayed in the first screen display area.

[0100] Step 103, displaying a portion of a second target picture in a second picture display area; the second target picture is a captured picture on the second terminal side.

[0101] In the embodiment of the present application, the first terminal displays a portion of the second target screen corresponding to each other in at least one second screen display area in the target interface.

[0102] The partial picture in the second target picture displayed in the second picture display area may be determined by the position of the second picture display area relative to other picture display areas.

[0103] Exemplarily, in response to the existence of a first screen display area or other second screen display area in a close proximity in a certain direction of the second screen display area, it is determined that there is a second screen portion on the side of the second target screen in that direction, and the portion of the second target screen excluding the second screen portion can be determined as the partial screen of the second target screen displayed in the second screen display area.

[0104] Step 104, in response to the presence of the first target object in the second screen portion, the first target object in the second screen portion and at least one of the virtual images corresponding to the first target object are superimposed and displayed in the second screen display area, wherein the first target object is the target object in the first target screen.

[0105] In an embodiment of the present application, when the first terminal detects that there is a first target object in the second screen portion of the first target screen, a virtual image corresponding to the first target object is determined, and the virtual image is superimposed and displayed at the mapping position of the first target object in the second screen display area.

[0106] In a possible implementation, synchronously displaying the pictures in the first picture display area and the pictures in the second picture display area in each terminal is achieved by mixing streams through a client, or by mixing streams through a server.

[0107] Exemplarily, when applied in a scenario where at least two users are conducting an online video call, the first terminal may be the initiator terminal of the online video call, and the target interface displayed may be a call interface, which includes a first screen display area and a second screen display area. The first screen display area displays a portion of the user's call screen taken by the first terminal, and the second screen display area is used to display a portion of the user's call screen taken by the terminal corresponding to at least one user who receives the call request. When a first target object exists in the second screen portion of the first target screen, the first target object and at least one of the corresponding virtual images are superimposed and displayed in the second screen display area, thereby realizing interaction between the screens corresponding to the users conducting the call in the scenario where the users are conducting an online video call.

[0108] To summarize, the screen display method provided in the embodiment of the present application obtains the second screen portion in the first target screen. If the first target object exists in the second screen portion, the first target object and at least one of the corresponding virtual images are superimposed and displayed on the partial screen of the second target screen displayed in the second screen display area. Since the second screen portion is in the first target screen and the mapping position is on the second screen display area, the first target object in the second screen portion is directly or indirectly displayed at the mapping position of the second screen display area, thereby expanding the interaction mode between the first target screen and the second target screen. When applied in the live broadcast field, the interaction effect between the anchors during the live broadcast process is improved.

[0109] It should be noted that the screen display method provided in the present application can be applied to scenarios in which a live broadcast application realizes the function of connecting to other terminals for live broadcast, and can also be applied to other application scenarios involving the simultaneous display of live broadcast screens of multiple terminals. The present application does not limit the application scenarios.

[0110] Figure 2 A flowchart of a screen display method provided by an exemplary embodiment of the present application is shown. The screen display method can be executed by a computer device, wherein the computer device can be implemented as a terminal. The present application takes the method executed by a first terminal as an example for explanation. Figure 2 As shown, the screen display method may include the following steps:

[0111] Step 201, display the target interface.

[0112] In an embodiment of the present application, the first terminal displays a target interface, which includes at least a first screen display area for displaying a first screen portion of a first target screen on the first terminal side, and a second screen display area for displaying a first screen portion of a second target screen on the second terminal side.

[0113] In a possible implementation, when the first terminal receives a target triggering operation, the target interface is displayed.

[0114] Step 202: Display a first picture portion of a first target picture in a first picture display area.

[0115] In an embodiment of the present application, there is a camera module on the first terminal, and the first target screen on the first terminal side is captured by the camera module. The first target screen may include a first screen part and a second screen part. The first terminal displays the first screen part of the first target screen in the first screen display area in the displayed target interface.

[0116] The first target screen may be a captured screen on the first terminal side, and a mapping position of the second screen portion in the first target screen in the target interface is within the second screen display area.

[0117] In a possible implementation, there are a display area and an interaction area in the first target screen. The display area and the interaction area are pre-set areas of specified position sizes. The screen portion in the display area is used as the first screen portion, and the screen portion in the interaction area is used as the second screen portion.

[0118] Among them, the part of the first target screen located in the display area can be displayed in the first screen display area on the target interface; the part of the first target screen located in the interactive area can be the second screen part, which will not be directly displayed on the target interface.

[0119] In a possible implementation, the display area is located in a middle area of ​​the first target screen, and the interaction area is located in an edge area of ​​the first target screen.

[0120] Exemplarily, in response to the first target screen being a rectangular screen, the display area may be a rectangular area whose distance from the four upper, lower, left and right borders is a specified value; wherein, an area formed by connecting the upper left vertex of the display area, the upper right vertex of the display area, the upper left vertex of the first screen and the upper right vertex of the first screen serves as the interactive area above the first screen; an area formed by connecting the upper left vertex of the display area, the lower left vertex of the display area, the upper left vertex of the first screen and the lower left vertex of the first screen serves as the interactive area on the left side of the first screen; an area formed by connecting the lower left vertex of the display area, the lower right vertex of the display area, the lower left vertex of the first screen and the lower right vertex of the first screen serves as the interactive area below the first screen; an area formed by connecting the upper right vertex of the display area, the lower right vertex of the display area, the upper right vertex of the first screen and the lower right vertex of the first screen serves as the interactive area on the right side of the first screen.

[0121] In response to the first screen being a circular screen, the display area may be a circular area having the same center as the first screen and a radius smaller than the radius of the first screen; wherein the portion of the first screen excluding the display area may be divided into interactive areas corresponding to four directions of up, down, left and right based on an angle.

[0122] Exemplarily, when the target interface includes a first screen display area and a second screen display area, and the first screen display area is located on the left side of the second screen display area, Figure 3 is a schematic diagram of a first target screen and a second target screen involved in an embodiment of the present application. Figure 3As shown, when applied in the live broadcast field, the first target screen 31 is the live broadcast screen captured by the first terminal through the camera module, wherein the first target part in the display area 311 of the first target screen 31 can be directly displayed in the first screen display area in the target interface, and the second screen part in the interactive area 312 of the first target screen 31 is not directly displayed in the first screen display area, and the corresponding virtual image can be superimposed and displayed in the second screen display area according to subsequent steps; the second target screen 32 is the live broadcast screen captured by the second terminal through the camera module, wherein the first screen part in the display area 321 of the second target screen 32 can be directly displayed in the second screen display area in the target interface, and the second screen part in the interactive area 322 of the second target screen 32 is not directly displayed in the first screen display area, and the corresponding virtual image can be superimposed and displayed in the first screen display area according to subsequent steps.

[0123] Step 203: display a portion of the second target image in the second image display area.

[0124] In the embodiment of the present application, the first terminal displays the first screen portion of the second target screen in the second screen display area based on each second target screen pushed by the second terminal.

[0125] In a possible implementation, in response to the absence of the first target object in the second screen portion in the first target screen, the first screen portion in the first target screen and the first screen portion in the second target screen are directly displayed on the target interface.

[0126] Step 204: perform image recognition on the second picture portion, and divide the second picture portion into a background portion and a target contour portion.

[0127] In an embodiment of the present application, the first terminal performs image recognition on the second picture portion of the acquired first target picture to obtain an image recognition result, which may include an identified object existing in the second image portion and position information of the identified object in the second picture portion. Based on the image recognition result, the second picture portion is divided into a background portion and a target contour portion.

[0128] Among them, the first target object can be a pre-set specified type of identification object or a specified part of the identification object. The identification object can be a human body or a specified object obtained by image recognition; when the identification object is a human body, the specified part can be a specified body part of the human body, such as a hand, face, etc.

[0129] The target contour portion may be a contour portion corresponding to the detected identification object, and the background portion is a portion of the second picture portion excluding the identified identification object.

[0130] In one possible implementation, in response to the image recognition result received by the first terminal, the identified object in the second picture part is obtained, the outline of the identified object is used as the target outline part, and the target outline part is extracted from the second picture part, and then the part of the second picture part excluding the target outline part is used as the background part, and the background part is eliminated or set to a transparent color.

[0131] For example, Figure 4 Schematic diagram of a second screen portion division involved in an embodiment of the present application. Figure 4 As shown, when applied in a live broadcast scene, the second picture part 41 in the first target picture can obtain a target contour part 42 and a background part 43 through human edge detection technology.

[0132] Step 205: Based on the target contour portion, determine the identification object corresponding to the target contour portion.

[0133] In the embodiment of the present application, the first terminal performs image recognition on the target contour portion, and can determine the identification object corresponding to the target contour portion or a designated part on the corresponding identification object.

[0134] In a possible implementation manner, the first terminal performs edge enhancement processing on the target contour portion to obtain the processed target contour portion; and determines the recognized object based on the processed target contour portion.

[0135] For example, when performing human body edge detection during image recognition processing, the contour edge of the target contour portion determined by the human body edge detection may not be clear enough, so edge enhancement processing is performed on the target contour portion to obtain the processed target contour portion. Since the clarity of the target contour portion is improved through the edge enhancement processing, the recognition object corresponding to the target contour portion can be more accurately determined based on the target contour portion.

[0136] Step 206 , in response to the identification object being the first target object, superimposing and displaying at least one of the first target object in the second picture portion and the virtual image corresponding to the first target object in the second picture display area.

[0137] In an embodiment of the present application, when it is determined that the identified object corresponding to the target contour portion is the first target object, the first target object is superimposed and displayed in the second screen display area, or, a virtual image corresponding to the target contour portion is determined, and then the virtual image corresponding to the first target object in the second screen portion is superimposed and displayed in the second screen display area, or the first target object in the second screen portion and the virtual image corresponding to the first target object are superimposed and displayed in the second screen display area.

[0138] Among them, after the second picture part is divided into a background part and a target contour part through the above steps, the target contour part is identified to determine the corresponding identification object. If the identified object is the first target object, the image corresponding to the first target object in the second picture part can be directly superimposed and displayed in the second picture display area. Alternatively, in response to the identified object being the first target object, the first terminal can also obtain a virtual image corresponding to the first target object based on a pre-stored correspondence relationship or a specified algorithm, and then superimpose the virtual image and display it in the second picture display area.

[0139] In a possible implementation, in response to the recognition that the object is the first target object, based on a pre-stored correspondence relationship, a virtual image corresponding to the first target object is obtained; and the virtual image corresponding to the first target object is superimposed and displayed in the second screen display area.

[0140] In another possible implementation, in response to the recognition that the object is the first target object, a virtual image corresponding to the first target object is generated based on a specified algorithm; and the virtual image corresponding to the first target object is displayed in a superimposed manner in the second screen display area.

[0141] The pre-stored correspondence relationship may include a correspondence relationship between a target object and a virtual image. The pre-stored correspondence relationship may be stored on the terminal or in a database of a server for query and call by the terminal. The specified algorithm for generating the virtual image corresponding to the first target object may be a comic image generation algorithm.

[0142] For example, when the target object is a human hand, the corresponding virtual image can be a cat paw virtual image based on the pre-stored correspondence relationship, and the cartoon image corresponding to the hand can be generated based on the specified algorithm; when the target object is a human face, the corresponding virtual image can be a pre-stored cartoon character avatar based on the pre-stored correspondence relationship, and the cartoon image corresponding to the face can be generated based on the specified algorithm. The virtual image generated by the specified algorithm can have the relevant features of the first target object.

[0143] In one possible implementation, in response to identifying that the object is a target object, a virtual image corresponding to the target object is obtained based on a pre-stored virtual image material library; the virtual image corresponding to the first target object is superimposed and displayed in the second screen display area, and the virtual image corresponding to the second target object is superimposed and displayed in the first screen display area.

[0144] After edge enhancement processing is performed on the target contour part, the contour similarity between the target contour part and each virtual image stored in the virtual image library can be determined, and then the virtual image with the highest contour similarity can be determined as the virtual image corresponding to the target contour part.

[0145] In one possible implementation, in response to the presence of a first target object in the second screen portion and the target interface including at least two second screen display areas, the target screen display area is determined based on the mapping position of the second screen portion in the target interface, and the first target object in the second screen portion and at least one of the virtual images corresponding to the first target object are superimposed and displayed in the target screen display area.

[0146] Exemplarily, there may be a situation where the first target object in the second screen portion and the virtual image corresponding to the first target object are simultaneously superimposed and displayed in the target screen display area. During the live broadcast, when the first target object in the second screen portion is the anchor's arm on the first terminal side, the real arm image can be superimposed and displayed in the target screen display area, and at the same time, based on a pre-stored correspondence relationship or a specified algorithm, the virtual image corresponding to the hand can be superimposed and displayed near the area corresponding to the hand. This achieves the purpose of combining realism and fun, and improves the interactive effect during the live broadcast.

[0147] The target picture display area is at least one of the at least two second picture display areas.

[0148] In one possible implementation, in response to the interaction area including an upper interaction area, a lower interaction area, a left interaction area, and a right interaction area, the first position information can be used to determine whether the second screen portion is located in the upper interaction area, the lower interaction area, the left interaction area, or the right interaction area.

[0149] The first position information may be used to indicate the position of the second picture portion in the first target picture.

[0150] Since the arrangement positions of the first screen display area and the at least one second screen display area on the target interface are fixed, the target screen display area to which the second screen portion is mapped can be determined based on the first position information.

[0151] Exemplarily, the first screen display area corresponding to the first terminal A is located at the first one from the left in the first row of the target interface; the second screen display area corresponding to the second terminal B is located at the second one from the left in the first row of the target interface, and the left border of the second screen display area corresponding to the second terminal B is spliced ​​with the right border of the first screen display area corresponding to the first terminal A; the second screen display area corresponding to the second terminal C is located at the first one from the left in the second row of the target interface, and the upper border of the second screen display area corresponding to the second terminal C is spliced ​​with the lower border of the first screen display area corresponding to the first terminal A. At this time, when the first position information indicates that the second screen portion is in the lower interactive area of ​​the first target screen, the target screen display area mapped by the second screen portion is determined to be the second screen display area corresponding to the second terminal C; when the first position information indicates that the second screen portion is in the right interactive area of ​​the first target screen, the target screen display area mapped by the second screen portion is determined to be the second screen display area corresponding to the second terminal B.

[0152] In a possible implementation, in response to the first target object including the target part and a portion of the second target screen including the target area, a special effect animation is displayed on the target interface.

[0153] Among them, in response to the target part being included on the first target object, image recognition is performed on a portion of the second target screen displayed in the second screen display area; the target area on the portion of the second target screen is obtained; the target area is the area corresponding to the designated part obtained by image recognition; in response to the target part included in the first target object and the target area in the second target screen satisfying a specified positional relationship, a special effects animation is displayed.

[0154] The target area may be an area corresponding to a designated part obtained by image recognition, and the designated position relationship may be that the target part is located on the target area, or that the distance between the target part and the target area is within a designated threshold interval.

[0155] In one possible implementation, in response to the first target object containing a target part, image recognition is performed on a portion of the second target screen displayed in the second screen display area to obtain the target area on the portion of the second target screen; in response to the target part contained in the first target object being superimposed on the target area in the second live screen, a special effects animation is displayed at the position where the target part is rendered on the second live screen.

[0156] Among them, the target area is the area corresponding to the designated part obtained by image recognition, and the designated part can be a pre-set designated part, such as a face part, an arm part, a circular part, a rectangular part in the picture after image recognition, etc.

[0157] For example, the target area can be the area where the face is located after performing face recognition on the screen in the second screen display area. When the hand of anchor A is used as the first target object, if it is determined that the mapping position of the hand of anchor A in the second screen display area is the face area in the screen displayed in the second screen display area, then when the virtual image corresponding to the hand is superimposed on the second screen display area, the corresponding special effect animation can be added to the contact position between the hand and the face area. In this way, the interactivity of the video broadcast between anchors can be enhanced.

[0158] For example, Figure 5 1 is a schematic diagram of a screen interaction of superimposing a virtual image involved in an embodiment of the present application. Figure 5 As shown, when applied in the live broadcast field, the live broadcast interface 51 is a live broadcast interface watched by the audience following anchor A in the live broadcast room of anchor A. In the live broadcast interface 51, there are a screen display area corresponding to anchor A and a screen display area corresponding to anchor B. When anchor A puts his hand in the interactive area of ​​the live broadcast screen corresponding to anchor A, the hand in the interactive area is edge recognized and enhanced, and then the virtual image corresponding to the hand contour is determined based on the processed hand contour, and the virtual image is displayed at the mapping position of the hand contour in the screen display area of ​​anchor B. At this time, the live broadcast interface 52 is displayed on the audience side terminal.

[0159] In a possible implementation, before the first terminal overlays and displays the virtual image of the first target object in the second screen portion in the target screen display area, the first terminal sends the first screen portion in the first target screen, the virtual image of the first target object, and the mapping position of the virtual image of the first target object in the second screen display area to the server, so that the second terminal obtains the first screen portion in the first live screen, the virtual image of the first target object, and the mapping position of the virtual image of the first target object in the second screen display area from the server, and displays the first screen portion, the second screen portion, and the virtual image of the first target object.

[0160] In one possible implementation, in response to receiving the second screen portion, the virtual image of the second target object, and the mapping position of the virtual image of the second target object in the first screen display area sent by the server, the first screen portion and the virtual image of the second target object are displayed in the first screen display area, and the second screen portion is displayed in the second screen display area.

[0161] That is to say, in response to the mapping position of the second screen part in the first target screen in the target interface being within the second screen display area, and the mapping position of the second screen part in the second target screen in the target interface being within the first screen display area, if there are target objects in both the second screen part in the first target screen and the second screen part in the second target screen, then the corresponding target objects and at least one of the virtual images corresponding to the target objects are displayed simultaneously in the first screen display area and the second screen display area.

[0162] In a possible implementation, in response to the presence of the second target object in the first screen portion, the second target object in the first screen portion and at least one of the virtual images corresponding to the second target object are superimposed and displayed in the first screen display area.

[0163] The second target object is a target object in the second target picture.

[0164] That is to say, the virtual image in the screen on the first terminal side that enters the display area corresponding to the other terminals is processed by the first terminal and synchronized to the other terminals. Correspondingly, the virtual image in the screen on the other terminal side that enters the display area corresponding to the first terminal is processed by the other terminals and synchronized to the first terminal. In addition, for the audience terminal, part of the screen and the virtual image of the first terminal and the second terminal can be directly sent to the audience terminal for playback, or can be sent to the audience terminal for playback after the server synthesizes the screen.

[0165] For example, when the anchors of the video linking include anchor A corresponding to the first terminal and anchor B corresponding to the second terminal, if there is a first target object whose mapping position is in the second screen display area in the screen corresponding to anchor A obtained by the live broadcast on the first terminal side, the first terminal processes the first target object to obtain a corresponding virtual image, and the first terminal sends the virtual image, the mapping position of the virtual image in the second screen display area, and the first screen part in the first live screen to the server; if there is a second target object whose mapping position is in the first screen display area in the screen corresponding to anchor B obtained by the live broadcast on the second terminal side, the second terminal processes the second target object to obtain a corresponding virtual image, and the second terminal sends the virtual image corresponding to the second target object, the mapping position of the virtual image in the first screen display area, and the second screen part in the second live screen to the server. In one case, the server generates a composite screen including the first screen part, the second screen part, the virtual image corresponding to the first target object, and the virtual image corresponding to the second target object, and the server pushes the composite screen to the first terminal, the second terminal, and the audience terminal, and each terminal displays it synchronously. In another case, the first terminal can also obtain the second screen portion, the virtual image corresponding to the second target object, and the corresponding mapping position from the server, and then directly generate a composite screen including the first screen portion, the second screen portion and the superimposed virtual image on the terminal side of the first terminal. The second terminal can obtain the virtual image of the first target object, the mapping position of the virtual image in the second screen display area and the first screen portion from the server, and generate a composite screen on the terminal side of the second terminal. The audience terminal can obtain the virtual images corresponding to the first target object and the second target object, the mapping positions in the first screen display area and the second screen display area, the first screen portion and the second screen portion, respectively, from the server, and generate a composite screen that each audience terminal needs to display on each audience terminal side.

[0166] Exemplarily, the anchors who respond to the video link include anchor A and anchor B. For anchor A, the video frame pushed by anchor A to the server includes the first screen part directly displayed in the screen display area, and the second screen part in the interactive area. At the same time, the terminal or server can perform human edge detection and edge enhancement processing on the second screen part of anchor A, and remove or turn the background part other than the human body obtained by detection into a transparent color, and obtain the target contour part of the second screen part after removing the background and enhancing the human body edge. Then, the human body part in the target contour part is processed by two-dimensional or virtual portrait, so that the target contour part corresponding to anchor A can be converted into a two-dimensional or other cute virtual image. The video frame pushed out by the terminal corresponding to anchor A through the link may include the first screen part and the corresponding virtual image. At the same time, each video frame pushed out also carries the position information of the hands and face in the target contour part. For anchor B, when the terminal corresponding to anchor B receives the first picture part, the corresponding virtual image, and the position information of the hands and face in the target contour part pushed by the terminal corresponding to anchor A, the virtual image is first directly overlaid and rendered on the first image part corresponding to anchor B, thereby achieving the effect of fusing the virtual image with the first image part corresponding to anchor B, generating a fused picture displayed in the image display area corresponding to anchor B, and then merging the fused picture displayed in the image display area with the first image picture corresponding to anchor A to become the picture displayed in the picture display area of ​​the live broadcast interface after the microphone mixing.

[0167] In response to obtaining the position information of the face and hand in the target outline part from the video frame pushed by the terminal corresponding to anchor A, it is detected based on the corresponding position information whether these positions touch the face area of ​​anchor B in the image display area corresponding to anchor B after fusion. If so, the face special effect of anchor B is triggered. In this way, anchor A can cross-border touch the face of anchor B and trigger the display effect of special effects. Similarly, anchor B can also achieve the display effect of cross-border touch the face of anchor A and trigger the special effect through the above steps.

[0168] To summarize, the screen display method provided in the embodiment of the present application obtains the second screen portion in the first target screen. If the first target object exists in the second screen portion, the first target object and at least one of the corresponding virtual images are superimposed and displayed on the partial screen of the second target screen displayed in the second screen display area. Since the second screen portion is in the first target screen and the mapping position is on the second screen display area, the first target object in the second screen portion is directly or indirectly displayed at the mapping position of the second screen display area, thereby expanding the interaction mode between the first target screen and the second target screen. When applied in the live broadcast field, the interaction effect between the anchors during the live broadcast process is improved.

[0169] Figure 6 A block diagram of a screen display device according to an exemplary embodiment of the present application is shown. Figure 6 As shown, the screen display device includes:

[0170] The interface display module 610 is used to display a target interface, wherein the target interface includes a first screen display area and a second screen display area;

[0171] The first picture display module 620 is used to display the first picture portion of the first target picture in the first picture display area; the first live picture is the shooting picture of the first terminal side, and the mapping position of the second picture portion of the first target picture in the target interface is within the second picture display area;

[0172] The second picture display module 630 is used to display a part of the second target picture in the second picture display area; the second target picture is the captured picture of the second terminal side;

[0173] The first image overlay module 640 is used to respond to the presence of a first target object in the second picture portion by overlaying and displaying the first target object in the second picture portion and at least one of the virtual images corresponding to the first target object in the second picture display area; the first target object is the target object in the first target picture.

[0174] In a possible implementation, the first image overlay module 640 includes:

[0175] A region division submodule, used for performing image recognition on the second picture portion, and dividing the second picture portion into a background portion and a target contour portion;

[0176] An object recognition submodule, configured to determine, based on the target contour portion, a recognition object corresponding to the target contour portion;

[0177] The image superimposition submodule is used for, in response to determining that the identified object corresponding to the target outline portion is the first target object, superimposing and displaying the first target object in the second picture portion and at least one of the virtual images corresponding to the first target object in the second picture display area.

[0178] In a possible implementation, the object recognition submodule includes:

[0179] An edge enhancement unit, used for performing edge enhancement processing on the target contour portion to obtain the processed target contour portion;

[0180] The object determination unit is used to determine the recognized object based on the processed target contour portion.

[0181] In a possible implementation, the image overlay submodule includes:

[0182] A first image acquisition unit, configured to acquire the virtual image corresponding to the first target object based on a pre-stored correspondence relationship or a specified algorithm in response to the identified object being the first target object;

[0183] The first image superimposing unit is used to superimpose and display the virtual image corresponding to the first target object in the second picture display area.

[0184] In a possible implementation, the first image overlay module 640 includes:

[0185] a target area determination submodule, configured to determine a target screen display area based on the mapping position of the second screen part in the target interface in response to the presence of the first target object in the second screen part and the target interface including at least two second screen display areas; the target screen display area is at least one of the at least two second screen display areas;

[0186] The superimposition submodule is used to superimpose and display at least one of the first target object and the virtual image corresponding to the first target object in the second picture part in the target picture display area.

[0187] In a possible implementation manner, the device further includes:

[0188] An animation display module is used to display a special effect animation on the target interface in response to the first target object containing a target part and part of the second target screen including a target area; the target area is the area corresponding to the designated part obtained by image recognition.

[0189] In a possible implementation, the animation display module includes:

[0190] a recognition submodule, configured to perform image recognition on a portion of the second target image displayed in the second image display area in response to the first target object containing the target part;

[0191] A target area acquisition submodule, used for acquiring the target area on a part of the second target picture;

[0192] The animation display submodule is used to display the special effect animation in response to the target part included in the first target object and the target area in the second target picture satisfying a specified position relationship.

[0193] In a possible implementation manner, the device further includes:

[0194] A data sending module is used to send the first screen part in the first target screen, the virtual image of the first target object, and the mapping position of the virtual image of the first target object in the second screen display area to a server before superimposing and displaying the first target object in the second screen part and at least one of the virtual images corresponding to the first target object in the target screen display area, so that the second terminal obtains the mapping position of the first screen part in the first target screen, the virtual image of the first target object, and the virtual image of the first target object in the second screen display area from the server, and displays the first screen part, the second screen part, and the virtual image of the first target object.

[0195] In a possible implementation manner, the device further includes:

[0196] A data receiving module, for displaying the first picture portion and the virtual image of the second target object in the first picture display area, and displaying the second picture portion in the second picture display area in response to receiving the second picture portion, the virtual image of the second target object, and the mapping position of the virtual image of the second target object in the first picture display area sent by the server; the second target object is the target object in the second target picture.

[0197] To summarize, the screen display method provided in the embodiment of the present application obtains the second screen portion in the first target screen. If the first target object exists in the second screen portion, the first target object and at least one of the corresponding virtual images are superimposed and displayed on the partial screen of the second target screen displayed in the second screen display area. Since the second screen portion is in the first target screen and the mapping position is on the second screen display area, the first target object in the second screen portion is directly or indirectly displayed at the mapping position of the second screen display area, thereby expanding the interaction mode between the first target screen and the second target screen. When applied in the live broadcast field, the interaction effect between the anchors during the live broadcast process is improved.

[0198] Figure 7 700 is a block diagram of a computer device 700 according to an exemplary embodiment. The computer device 700 may be Figure 1 The terminal shown is, for example, a smart phone, a tablet computer or a desktop computer. The computer device 700 may also be called a target user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0199] Typically, the computer device 700 includes a processor 701 and a memory 702 .

[0200] The processor 701 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 701 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 701 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 701 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 701 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0201] The memory 702 may include one or more computer-readable storage media, which may be non-transitory. The memory 702 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 702 is used to store at least one instruction, which is used to be executed by the processor 701 to implement the method provided in the method embodiment of the present application.

[0202] In some embodiments, the computer device 700 may further optionally include: a peripheral device interface 703 and at least one peripheral device. The processor 701, the memory 702 and the peripheral device interface 703 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 703 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 704, a display screen 705, a camera assembly 706, an audio circuit 707, a positioning assembly 708 and a power supply 709.

[0203] In some embodiments, the computer device 700 further includes one or more sensors 710 , including but not limited to: an acceleration sensor 711 , a gyroscope sensor 712 , a pressure sensor 713 , a fingerprint sensor 714 , an optical sensor 715 , and a proximity sensor 716 .

[0204] Those skilled in the art will understand that Figure 7 The structure shown in the figure does not constitute a limitation on the computer device 700, and the computer device 700 may include more or less components than shown in the figure, or combine some components, or adopt a different arrangement of components.

[0205] Figure 8 The structural block diagram of a computer device 800 shown in an exemplary embodiment of the present application is shown. The computer device can be implemented as a server in the above-mentioned solution of the present application. The computer device 800 includes a central processing unit (CPU) 801, a system memory 804 including a random access memory (RAM) 802 and a read-only memory (ROM) 803, and a system bus 805 connecting the system memory 804 and the central processing unit 801. The computer device 800 also includes a mass storage device 806 for storing an operating system 809, an application program 810 and other program modules 811.

[0206] The mass storage device 806 is connected to the central processing unit 801 via a mass storage controller (not shown) connected to the system bus 805. The mass storage device 806 and its associated computer readable medium provide non-volatile storage for the computer device 800. That is, the mass storage device 806 may include a computer readable medium (not shown) such as a hard disk or a compact disc read-only memory (CD-ROM) drive.

[0207] Without loss of generality, the computer-readable medium may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, Erasable Programmable Read Only Memory (EPROM), Electronically-Erasable Programmable Read-Only Memory (EEPROM) flash memory or other solid-state storage devices, CD-ROM, Digital Versatile Disc (DVD) or other optical storage, cassettes, tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will know that the computer storage medium is not limited to the above. The above-mentioned system memory 804 and mass storage device 806 can be collectively referred to as memory.

[0208] According to various embodiments of the present disclosure, the computer device 800 can also be connected to a remote computer on the network through a network such as the Internet. That is, the computer device 800 can be connected to the network 808 through the network interface unit 807 connected to the system bus 805, or the network interface unit 807 can be used to connect to other types of networks or remote computer systems (not shown).

[0209] The memory also includes at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is stored in the memory. The central processing unit implements all or part of the steps in the screen display method shown in the above-mentioned embodiments by executing the at least one instruction, at least one program, code set or instruction set.

[0210] Those skilled in the art will appreciate that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented with hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein the communication media include any media that facilitates the transmission of a computer program from one place to another. The storage medium can be any available medium that a general or special-purpose computer can access.

[0211] In an exemplary embodiment, a computer-readable storage medium is also provided, which is used to store at least one instruction, at least one program, code set or instruction set, and the at least one instruction, the at least one program, the code set or instruction set is loaded and executed by a processor to implement all or part of the steps in the above-mentioned scene screen display method. For example, the computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0212] In an exemplary embodiment, a computer program product or a computer program is also provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above-mentioned Figure 1 or Figure 2 All or part of the steps of the method shown in any embodiment.

[0213] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0214] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A screen display method, characterized in that: The method is performed by a first terminal, and includes: Displaying a target interface, wherein the target interface includes a first screen display area and a second screen display area; Displaying a first screen portion of a first target screen in the first screen display area; the first target screen is a captured screen on the first terminal side, and a mapping position of a second screen portion of the first target screen in the target interface is within the second screen display area; Displaying a portion of a second target screen in the second screen display area; the second target screen is a captured screen on the second terminal side; In response to the presence of a first target object in the second screen portion, at least one of the first target object in the second screen portion and a virtual image corresponding to the first target object is displayed in a superimposed manner in the second screen display area; the first target object is a target object in the first target screen; In response to the first target object including a target part and a portion of the second target screen including a target area, a special effects animation is displayed on the target interface; the target area is an area corresponding to the designated part obtained by image recognition.

2. The method according to claim 1, characterized in that In response to the first target object existing in the second screen portion, superimposing and displaying at least one of the first target object in the second screen portion and a virtual image corresponding to the first target object in the second screen display area, comprises: Performing image recognition on the second picture portion, dividing the second picture portion into a background portion and a target contour portion; Based on the target contour portion, determining an identification object corresponding to the target contour portion; In response to determining that the identified object corresponding to the target outline portion is the first target object, the first target object in the second picture portion and at least one of the virtual images corresponding to the first target object are superimposed and displayed in the second picture display area.

3. The method according to claim 2, characterized in that The determining, based on the target contour portion, the identification object corresponding to the target contour portion comprises: Performing edge enhancement processing on the target contour portion to obtain the processed target contour portion; The identified object is determined based on the processed target contour portion.

4. The method according to claim 2, characterized in that: In response to determining that the identified object corresponding to the target outline portion is the first target object, superimposing and displaying at least one of the first target object in the second picture portion and the virtual image corresponding to the first target object in the second picture display area, comprises: In response to the identified object being the first target object, acquiring the virtual image corresponding to the first target object based on a pre-stored correspondence relationship or a specified algorithm; The virtual image corresponding to the first target object is displayed in a superimposed manner in the second screen display area.

5. The method according to claim 1, characterized in that In response to the first target object existing in the second screen portion, superimposing and displaying at least one of the first target object in the second screen portion and a virtual image corresponding to the first target object in the second screen display area, comprises: In response to the presence of the first target object in the second screen portion, and the target interface including at least two second screen display areas, determining a target screen display area based on the mapping position of the second screen portion in the target interface; the target screen display area is at least one of the at least two second screen display areas; The first target object in the second screen portion and at least one of a virtual image corresponding to the first target object are superimposed and displayed in the target screen display area.

6. The method according to any one of claims 1 to 5, characterized in that: In response to the first target object including the target part and a portion of the second target screen including the target area, displaying a special effect animation on the target interface includes: In response to the first target object including the target part, performing image recognition on a portion of the second target image displayed in the second image display area; Acquire the target area on a partial screen of the second target screen; In response to the target part included in the first target object and the target area in the second target picture satisfying a specified positional relationship, the special effect animation is displayed.

7. The method according to claim 5, characterized in that Before superimposing and displaying at least one of the first target object and the virtual image corresponding to the first target object in the second screen portion in the target screen display area, the method further includes: The first screen part in the first target screen, the virtual image of the first target object, and the mapping position of the virtual image of the first target object in the second screen display area are sent to the server, so that the second terminal obtains the first screen part in the first target screen, the virtual image of the first target object, and the mapping position of the virtual image of the first target object in the second screen display area from the server, and displays the first screen part, the second screen part, and the virtual image of the first target object.

8. The method according to claim 1, characterized in that The method further comprises: In response to receiving the second screen portion, the virtual image of the second target object, and the mapping position of the virtual image of the second target object in the first screen display area sent by the server, the first screen portion and the virtual image of the second target object are displayed in the first screen display area, and the second screen portion is displayed in the second screen display area; the second target object is the target object in the second target screen.

9. A picture display device, characterized in that: The device is used in a first terminal, and includes: An interface display module, used to display a target interface, wherein the target interface includes a first screen display area and a second screen display area; A first picture display module is used to display a first picture portion of a first target picture in the first picture display area; the first target picture is a captured picture on the first terminal side, and a mapping position of a second picture portion of the first target picture in the target interface is within the second picture display area; A second picture display module, used to display a part of a second target picture in the second picture display area; the second target picture is a picture taken by the second terminal side; A first image superimposing module is used for superimposing and displaying at least one of the first target object in the second image portion and a virtual image corresponding to the first target object in the second image portion in the second image display area in response to the presence of the first target object in the second image portion; the first target object is a target object in the first target image; An animation display module is used to display a special effect animation on the target interface in response to the first target object containing a target part and part of the second target screen including a target area; the target area is the area corresponding to the designated part obtained by image recognition.

10. A computer device, characterized in that: The computer device includes a processor and a memory, the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the screen display method as described in any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The storage medium stores at least one program, and the at least one program is loaded and executed by the processor to implement the screen display method as described in any one of claims 1 to 8.

Images