Screen display method and device, storage medium and electronic device

Abstract

The present application discloses a screen display method and device, a storage medium and an electronic device. The method includes: a server receives a live video and a synthetic image frame sequence sent by a push client, and displays a target video frame in the live video on a pull client; in response to a touch operation on a target video frame, a target operation area of ​​the touch operation in the target video frame is determined; in the synthetic image frame sequence, a target close-up area corresponding to the target operation area is searched; when the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence, a close-up picture in the target close-up area is displayed on the pull client according to the target synthetic image frame. The present application solves the technical problem of low image display clarity after a close-up zoom operation is performed on a local area of ​​a live screen.

Description

Technical Field

[0001] The present invention relates to the field of computers, and in particular to a screen display method and device, a storage medium and an electronic device. Background Art

[0002] In a live broadcast scenario, when a user performs a close-up zoom operation on a local area in the live broadcast screen, the relevant technology usually adopts the method of directly stretching and enlarging a local area of ​​the original image of the live broadcast screen, but the image of the enlarged local area will become blurred and the clarity will be poor, affecting the user experience.

[0003] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0004] The embodiments of the present invention provide a picture display method and device, a storage medium and an electronic device, so as to at least solve the technical problem that the image display clarity is low after a close-up zoom operation is performed on a local area of ​​a live picture.

[0005] According to one aspect of an embodiment of the present invention, a screen display method is provided, comprising: receiving a live video and a synthetic image frame sequence sent by a streaming client through a server, and displaying a target video frame in the live video on a streaming client, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by the streaming client synthesizing at least one close-up area identified in a corresponding video frame in the live video; in response to a touch operation on the target video frame, determining a target operation area of ​​the touch operation in the target video frame; searching for a target close-up area corresponding to the target operation area in the synthetic image frame sequence; and when the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence, displaying a close-up picture in the target close-up area on the streaming client according to the target synthetic image frame.

[0006] According to another aspect of an embodiment of the present invention, a screen display method is also provided, including: obtaining a video frame corresponding to a live video; identifying at least one close-up area in the above video frame; synthesizing at least one close-up area identified in the above video frame to obtain a synthetic image frame sequence; wherein the above close-up area corresponds to an operation area in the above video frame, and the above operation area is used to enable a streaming client to display the above close-up area according to a touch operation; and sending the above live video and the above synthetic image frame sequence to the streaming client via a server.

[0007] According to another aspect of an embodiment of the present invention, a screen display device is also provided, including: a receiving unit, used to receive a live video and a synthetic image frame sequence sent by a streaming client through a server, and display a target video frame in the live video on a streaming client, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in a corresponding video frame in the live video by the streaming client; a determining unit, used to determine a target operation area of ​​the touch operation in the target video frame in response to a touch operation on the target video frame; a searching unit, used to search for a target close-up area corresponding to the target operation area in the synthetic image frame sequence; and a display unit, used to display a close-up picture in the target close-up area on the streaming client according to the target synthetic image frame when the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence.

[0008] According to another aspect of an embodiment of the present invention, a screen display device is also provided, including: an acquisition unit, used to acquire a video frame screen corresponding to a live video; an identification unit, used to identify at least one close-up area in the above video frame screen; a synthesis unit, used to synthesize at least one close-up area identified in the above video frame screen to obtain a synthetic image frame sequence; wherein the above close-up area corresponds to an operation area in the above video frame screen, and the above operation area is used to enable a streaming client to display the above close-up area according to a touch operation; a sending unit, used to send the above live video and the above synthetic image frame sequence to the streaming client through a server.

[0009] According to another aspect of the embodiments of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned screen display method when running.

[0010] According to another aspect of an embodiment of the present invention, there is provided an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the screen display method through the computer program.

[0011] In an embodiment of the present application, a live video and a synthetic image frame sequence sent by a push stream client are received by a server, and a target video frame in the live video is displayed on a pull stream client, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in the corresponding video frame in the live video by the push stream client; in response to a touch operation on the target video frame, a target operation area in the target video frame is determined by the touch operation; in the synthetic image frame sequence, a target close-up area corresponding to the target operation area is searched; in the case where the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence, a close-up image in the target close-up area is displayed on the pull stream client according to the target synthetic image frame, and since only a partial area image (i.e., the above-mentioned close-up image) in the live video is transmitted at the same transmission bit rate, the above-mentioned close-up image has a higher definition than that obtained by enlarging the partial area image. Thus, the purpose of clearly displaying the local area image in the live screen after enlarging the image is achieved, and the technical problem of low image display clarity after the close-up enlargement operation of the local area of ​​the live screen is solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0013] Figure 1 is a schematic diagram of an application environment of an optional screen display method according to an embodiment of the present application;

[0014] Figure 2 is a schematic diagram of an application environment of another optional screen display method according to an embodiment of the present application;

[0015] Figure 3 is a flowchart of an optional screen display method according to an embodiment of the present application;

[0016] Figure 4 It is a schematic diagram of a client interface display of an optional screen display method according to an embodiment of the present application;

[0017] Figure 5 is a flowchart of another optional screen display method according to an embodiment of the present application;

[0018] Figure 6 is a schematic diagram of a client interface display according to another optional screen display method of an embodiment of the present application;

[0019] Figure 7is a schematic diagram of a display interface of another optional screen display method according to an embodiment of the present application;

[0020] Figure 8 is a schematic diagram of a client interface display according to another optional screen display method of an embodiment of the present application;

[0021] Fig. 9 is a schematic diagram of a client interface display according to another optional screen display method of an embodiment of the present application;

[0022] Fig.10 is a schematic structural diagram of an optional picture display device according to an embodiment of the present application;

[0023] Fig.11 is a schematic structural diagram of an optional picture display device according to an embodiment of the present application;

[0024] Fig.12 It is a schematic diagram of the structure of an optional electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0026] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0027] According to one aspect of an embodiment of the present application, a screen display method is provided. Optionally, as an optional implementation, the above screen display can be but is not limited to being applied to: Figure 1In the environment shown. The application environment includes: a terminal device 102 for human-computer interaction with a user, a network 104, and a server 106. The terminal device 102 may include but is not limited to vehicle-mounted electronic devices, handheld terminals, wearable devices, portable devices, etc. Human-computer interaction can be performed between the user 108 and the terminal device 102, and a screen display application client is running in the terminal device 102. The above-mentioned terminal device 102 includes a human-computer interaction screen 1022, a processor 1024 and a memory 1026. The human-computer interaction screen 1022 is used to display live video, target close-up areas and close-up images in the target close-up areas. The processor 1024 is used to determine the target operation area of ​​the touch operation in the target video frame in response to a touch operation on the target video frame; the memory 1026 is used to store a synthetic image frame sequence matching the above-mentioned target close-up area and the live video.

[0028] In addition, the server 106 includes a database 1062 and a processing engine 1064, wherein the database 1062 is used to store live video, target close-up area and close-up pictures in the target close-up area. The processing engine 1064 is used to search for a target close-up area corresponding to the target operation area in a synthetic image frame sequence matching the live video, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in a corresponding video frame picture in the live video by the streaming client; when the target close-up area is found in the synthetic image frame sequence, the close-up picture in the target close-up area is displayed on the playback client, wherein the close-up picture in the target close-up area includes the target object processed by special effects.

[0029] The specific process is as follows: Assume that Figure 1The terminal device 102 shown in the figure has a screen display application client running, and the user 108 operates the human-computer interaction screen 1022 to manage and operate the song, such as step S102, and displays the target video frame in the live video on the playback client. Then, step S104 is executed, and in response to the touch operation on the target video frame, the target operation area of ​​the touch operation in the target video frame is determined; step S106, the above target operation area is sent to the server 106 through the network 104. After receiving the request, the server 106 executes steps S108 to S110, and searches for a target close-up area corresponding to the target operation area in a synthetic image frame sequence that matches the live video, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by synthesizing, by the streaming client, at least one close-up area identified in a corresponding video frame in the live video; when the target close-up area is found in the synthetic image frame sequence, a close-up picture in the target close-up area is displayed on the playback client, wherein the close-up picture in the target close-up area includes the target object processed by special effects; and as in step S112, the terminal device 102 is notified through the network 104 to return the above-mentioned close-up picture; step S112, the close-up picture in the target close-up area is displayed on the terminal device 102.

[0030] As another optional implementation, the above screen display method of the present application can be applied to Figure 2 In the application environment shown. Figure 2 As shown, human-computer interaction can be performed between user 202 and user device 204. User device 204 includes memory 206 and processor 208. In this embodiment, user device 204 can refer to but not be limited to executing the operations performed by the above terminal device 102 to obtain the above close-up picture.

[0031] Optionally, in this embodiment, the terminal device 102 and the user device 204 may include but are not limited to at least one of the following: a mobile phone (such as an Android phone, an iOS phone, etc.), a laptop, a tablet computer, a PDA, a MID (Mobile Internet Devices), a PAD, a desktop computer, a smart TV, etc. The target client may be a video client, an instant messaging client, a browser client, an education client, etc. The network 104 may include but is not limited to: a wired network, a wireless network, wherein the wired network includes: a local area network, a metropolitan area network and a wide area network, and the wireless network includes: Bluetooth, WIFI and other networks that implement wireless communication. The server may be a single server, or a server cluster consisting of multiple servers, or a cloud server. The above is only an example, and this embodiment does not impose any limitation on this.

[0032] Optionally, as an optional implementation, as Figure 3 As shown, the above screen display method includes:

[0033] S302, receiving, through the server, the live video and the synthesized image frame sequence sent by the streaming client, and displaying the target video frame in the live video on the streaming client, wherein each synthesized image frame in the synthesized image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in a corresponding video frame in the live video by the streaming client;

[0034] S304, in response to the touch operation on the target video frame, determining a target operation area of ​​the touch operation in the target video frame;

[0035] S306, searching for a target close-up area corresponding to the target operation area in the synthetic image frame sequence;

[0036] S308 , when the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence, a close-up picture in the target close-up area is displayed on the streaming client according to the target synthetic image frame.

[0037] In step S302, in actual application, the current live video may be played through devices such as mobile phones, laptops, tablet computers, PDAs, MIDs (Mobile Internet Devices), PADs, and desktop computers. The high-end target video frames in the live video may be recorded in real time by electronic devices such as mobile phones and laptops, and transmitted through streaming media, without any limitation. Figure 4 As shown, in the playback client 400 of the electronic device, a live video is displayed, and the characters in the live video are recorded in real time by the electronic device and displayed in the live client 400 through streaming media.

[0038] In step S304, in actual application, in response to the touch operation on the target video frame, a target operation area of ​​the touch operation in the target video frame is determined; Figure 4 As shown, after clicking the close-up zoom button 404, the target operation area 406 of the touch operation in the target video frame is determined, that is, the head portrait area of ​​the person in the live image and the area of ​​the object held by the person;

[0039] In step S306, in actual application, Figure 4As shown, in the synthetic image frame sequence 402 matching the live video, the target close-up area corresponding to the target operation area 406 is searched, wherein each synthetic image frame in the synthetic image frame sequence 400 is an image frame obtained by synthesizing at least one close-up area identified in the corresponding video frame in the live video by the streaming client, Figure 4 There are two target close-up areas corresponding to the target operation area 406, namely, a person's head image and a camera area.

[0040] In one embodiment, when Figure 4 When there is one target close-up area corresponding to the target operation area 406, or one of the character portrait areas or the camera areas, there is also one target close-up area corresponding to the target operation area 406. Each synthetic image frame in the synthetic image frame sequence 400 synthesizes a character portrait area or a camera close-up area identified in the corresponding video frame in the live video to obtain an image frame.

[0041] In step S308, in actual application, Figure 4 As shown, when the above-mentioned target close-up area (character portrait area and / or camera area) is found in the target synthetic image frame of the above-mentioned synthetic image frame sequence 400, the close-up picture within the above-mentioned target close-up area 408 is displayed on the playback client 400, and the close-up picture within the target close-up area includes the target object (character portrait or camera) processed by special effects.

[0042] In the embodiments of the present application, Figure 4 As shown, in the synthetic image frame sequence, the candidate video frame pictures carrying the above-mentioned target object (such as the target person and the camera) are identified; the display area where the above-mentioned target object is located (the target close-up area 406) is extracted from each of the above-mentioned candidate video frame pictures; the above-mentioned target object in the above-mentioned display area is processed in close-up to obtain the above-mentioned close-up area, wherein the encoding bit rate of the close-up picture in the above-mentioned close-up area is greater than the encoding bit rate of the display picture in the above-mentioned display area, for example, the encoding bit rate of the close-up area in the close-up area is 3500Kbps, and the image resolution that can be supported is 1280*720, and the encoding bit rate of the display picture in the display area is 1800Kbps, and the image resolution that can be supported is 720*480. Obviously, the image display of the close-up area is clearer. Each of the above-mentioned candidate video frame pictures is synthesized in sequence corresponding to the above-mentioned close-up area to obtain the above-mentioned synthetic image frame (that is, the head portrait close-up area and the camera area are synthesized); each of the above-mentioned synthetic image frames is arranged in sequence to obtain the above-mentioned synthetic image frame sequence 402.

[0043] In an embodiment of the present application, a live video and a synthetic image frame sequence sent by a push stream client are received by a server, and a target video frame in the live video is displayed on a pull stream client, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in the corresponding video frame in the live video by the push stream client; in response to a touch operation on the target video frame, a target operation area in the target video frame is determined by the touch operation; in the synthetic image frame sequence, a target close-up area corresponding to the target operation area is searched; in the case where the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence, a close-up picture in the target close-up area is displayed on the pull stream client according to the target synthetic image frame, and since only a partial area image (i.e., the above-mentioned close-up picture) in the live video is transmitted at the same transmission bit rate, the above-mentioned close-up picture has a higher definition than that obtained by enlarging the partial area image. Thus, the purpose of clearly displaying the local area image in the live screen after enlarging the processing is achieved, and the technical problem of low image display clarity after the close-up enlargement operation of the local area of ​​the live screen is solved.

[0044] In one or more embodiments, step S306, searching for a target close-up area corresponding to the target operation area in the synthetic image frame sequence includes:

[0045] S1, determining the frame number of the target video frame and the operation position of the target operation area;

[0046] S2, searching for a target synthetic image frame corresponding to the frame sequence number in the synthetic image frame sequence, and searching for a close-up position corresponding to the operation position in the found target synthetic image frame;

[0047] S3: Determine the close-up area indicated by the close-up position as the target close-up area.

[0048] In the embodiments of the present application, Figure 4 As shown, the frame number of the target video screen is determined, that is, the frame number of the frame image contained in the target video screen is obtained, and the position of the target operation area 404 is recorded, and the above-mentioned target synthetic image frame corresponding to the above-mentioned frame number is searched in the above-mentioned synthetic image frame sequence 402, and the special effect position corresponding to the above-mentioned operation position is searched in the above-mentioned target synthetic image frame found, for example, the special effect position corresponding to the character head portrait area position and / or the camera area is searched; the above-mentioned character head portrait area position and / or the corresponding area of ​​the camera area is determined as the above-mentioned target close-up area.

[0049] Through one or more embodiments provided by the present application, by determining the frame number of the target video frame and the operation position of the target operation area; searching for the target synthetic image frame corresponding to the frame number in the synthetic image frame sequence, and searching for the close-up position corresponding to the operation position in the found target synthetic image frame; determining the close-up area indicated by the close-up position as the target close-up area, a synthetic image of the target close-up area can be accurately obtained.

[0050] In one or more embodiments, displaying a close-up image in a target close-up area on a streaming client according to a target synthesized image frame includes:

[0051] The close-up picture is displayed according to a first resolution preset for the synthetic image frame sequence, and the pictures in the target video frame except the close-up picture are displayed according to a second resolution selected for the live video; wherein the first resolution is greater than the second resolution.

[0052] Optionally, in this embodiment, the synthetic image frame sequence should be selected by the streaming side and relatively fixed, then the resolution of the synthetic image frame sequence can be but is not limited to being preset by the streaming side, and the streaming side acts as a selection end to select from existing and preset content (such as image frames, resolution).

[0053] Optionally, in this embodiment, there may be, but are not limited to, multiple types of first resolutions. In this case, selection can also be performed on the stream pulling side.

[0054] In one or more embodiments, receiving, by a server, a live video and a synthetic image frame sequence sent by a streaming client includes:

[0055] S1, receiving a synthetic image frame sequence sent by a streaming client, wherein the synthetic image frame sequence is streamed to a streaming client by the streaming client at a preset first bit rate of the synthetic image frame sequence;

[0056] S2, receiving a target video frame sent by a streaming client, wherein the target video frame is streamed from the streaming client to the streaming client at a preset second bit rate for the target video frame, and the first bit rate is greater than the second bit rate.

[0057] Optionally, in this embodiment, the resolution can be understood as, but not limited to, the theoretical maximum fineness of the image of the video frame, and the bit rate can be understood as, but not limited to, the data transmission rate when transmitting the video frame; wherein, both the resolution and the bit rate will affect the actual fineness of the video frame, such as the actual fineness of the video frame with high resolution is high, but if the bit rate is too low, the actual fineness of the video frame with high resolution will not reach the theoretical maximum value; therefore, under the premise of high resolution, a sufficiently large bit rate should also be matched to present the video frame with the theoretical maximum fineness, such as the resolution and bit rate of the synthesized image frame sequence can be, but not limited to, greater than the resolution and bit rate of the video frame of the target video frame, and thus the fineness presented by the synthesized image frame sequence will be higher than the video frame of the target video frame. In other words, in addition to different resolutions, data transmission can also be performed by configuring different bit rates, but not limited to, to present a finer video frame.

[0058] Optionally, as an optional implementation, as Figure 5 As shown, the above screen display method also includes:

[0059] S502, obtaining a video frame corresponding to the live video;

[0060] S504, identifying at least one close-up area in the video frame;

[0061] S506, synthesizing at least one close-up area identified in the video frame to obtain a synthetic image frame sequence; wherein the close-up area corresponds to an operation area in the video frame, and the operation area is used to enable the streaming client to display the close-up area according to a touch operation;

[0062] S508: Send the live video and the synthesized image frame sequence to the streaming client through the server.

[0063] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0064] In an embodiment of the present application, by obtaining a video frame corresponding to a live video; identifying at least one close-up area in the video frame; synthesizing at least one close-up area identified in the video frame to obtain a synthetic image frame sequence; wherein the close-up area corresponds to the operation area in the video frame, and the operation area is used to enable the streaming client to display the close-up area according to the touch operation; the live video and the synthetic image frame sequence are sent to the streaming client through the server. Since only partial area images (i.e., the above-mentioned close-up images) in the live video are transmitted at the same transmission bit rate, the above-mentioned close-up images have a higher definition than those obtained by enlarging the partial area images. Thus, the purpose of clearly displaying the partial area images in the live screen after enlarging the images is achieved, and the technical problem of low image display clarity after the close-up enlargement operation of the partial area of ​​the live screen is solved.

[0065] As an optional solution, identifying at least one close-up area in a video frame includes:

[0066] S1, identifying candidate video frames carrying a target object in each video frame of a live video;

[0067] S2, extracting the display area where the target object is located from each candidate video frame;

[0068] S3, performing close-up processing on the target object in the display area to obtain a close-up area, wherein the encoding bit rate of the special effect picture in the close-up area is greater than the encoding bit rate of the display picture in the display area.

[0069] Optionally, in an embodiment of the present application, the target object that needs special effects processing may be a forehead image of a person, or a specific item, such as a product recommended by a merchant, etc., without any limitation here.

[0070] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0071] As an optional solution, at least one close-up area identified in the video frame is synthesized to obtain a synthesized image frame sequence, including:

[0072] S1, synthesizing the close-up regions corresponding to each candidate video frame in sequence to obtain a synthesized image frame;

[0073] S2, arranging the synthesized image frames in sequence to obtain a synthesized image frame sequence.

[0074] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0075] As an optional solution, a close-up processing is performed on the target object in the display area, and the close-up area obtained includes at least one of the following:

[0076] S1, enlarging the display size of the target object in the display area from a first size to a second size, wherein the display clarity of the target object in the second size is greater than the display clarity of the target object in the first size;

[0077] S2, adding additional display resources for the target object in the display area, wherein the additional display resources are used to highlight the target object.

[0078] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0079] As an optional solution, before identifying at least one close-up area in the video frame, the method includes:

[0080] Configure the target object to be processed in the live video.

[0081] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0082] As an optional solution, the target object to be processed in close-up in the live video includes at least one of the following:

[0083] S1, identifying a face region from a live video, and configuring a head position indicated by the identified face region as a target object;

[0084] S2, identifying a target object area from the live video, and configuring an object indicated in the target object area as the target object, wherein the target object area is determined based on an object image imported into the streaming client;

[0085] S3, identifying a fixed screen area from the live video, and configuring the graphic primitive object indicated in the fixed screen area as a target object.

[0086] like Figure 6 As shown, in the playback client 600, the face area can be identified through the neural network model, and the head position indicated by the identified face area is configured as the first target object 602 and the second target object 604.

[0087] like Figure 7As shown, in the playback client 700, by clicking the target image import button 706, the target object area is determined based on the object image imported into the above-mentioned playback client, and the target object area includes a first target object area 702 (the area where the camera is located), and a second target object area 704 (that is, the area where the computer is located). The target object area is identified from the above-mentioned live video, and the object object indicated in the above-mentioned target object area is configured as the above-mentioned target object (camera and computer).

[0088] like Figure 8 As shown, in the playback client 800, a fixed screen area 802 is identified from the live video, and the graphic primitive object indicated in the fixed screen area 802 is configured as the target object (camera).

[0089] One or more embodiments provided by the present application can identify target object areas in live video in different ways, and can flexibly and conveniently select different target objects for close-up magnification.

[0090] Optionally, in this embodiment, additional display resources are added to the target object in the display area, wherein the additional display resources are used to highlight the target object.

[0091] like Figure 8 As shown, additional display resources can be Figure 8 The rectangular display box in Fig. 9 As shown, additional display resources can be Fig. 9 The oval display frame and the triangular pendant in the image are shown in FIG. Through the above additional display resources, the target close-up area corresponding to the target object can be highlighted.

[0092] Optionally, in an embodiment of the present application, for example, the close-up picture is displayed at a first resolution of 1920*1080, and the pictures other than the close-up picture in the target video frame are displayed at a second resolution of 1080*720. In other words, the resolution of the close-up picture is greater than the resolution of the original live picture.

[0093] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0094] As an optional solution,

[0095] Send live video and synthetic image frame sequences to the streaming client through the server, including:

[0096] S1, streaming a target synthetic image frame based on a first bit rate preset for the synthetic image frame sequence;

[0097] S2, streaming the video frame of the target video frame based on a second bit rate preset for the video frame of the target video frame, wherein the first bit rate is greater than the second bit rate.

[0098] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0099] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence, because according to the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

[0100] In some live broadcast scenes in the related technology, viewers have the option of clicking on a certain part of the screen to zoom in on it. However, if a local area of ​​the original picture of the live broadcast screen is captured and directly stretched to make it larger, the image of the enlarged local area will become blurred and have poor clarity, affecting the user experience.

[0101] In order to solve the above technical problems, the embodiment of the present application provides a screen display method including the following contents:

[0102] S1, the anchor uses the streaming client (the above-mentioned playback client) to start broadcasting, turns on the close-up HD function, and selects the close-up area. Multiple close-up areas are supported. There are several ways to select the close-up area:

[0103] 1) The first method is to intelligently identify the face area as the close-up area. Face recognition is performed on several people in the live broadcast screen to obtain each face area. Then, the dotted frame position is obtained according to a certain ratio to represent the head position of each person, and the head position is used as the close-up area position.

[0104] 2) The second method is to intelligently identify the object area. You need to import the object image on the client as a comparison image. During the live broadcast, the client will use the comparison image to compare with the live broadcast screen in real time to obtain the matching image area, which is the matching object, as the close-up area position.

[0105] 3) The third method is that the anchor manually selects the close-up area position on the client. The close-up position selected in this way cannot be dynamically adjusted according to the movement of the actual face or object, and the position is fixed. The intelligent recognition methods 1) and 2) can update the position of the close-up area in real time based on the movement of the face or object.

[0106] S2, after obtaining the close-up area through step S1, the playback client copies the close-up area and reassembles it into a new special effect composite image. The resolution p of the new composite image is recorded, and the position s1 of each close-up area in the composite image and the position s0 of the close-up area in the original image are recorded.

[0107] S3, after the client starts the special effects HD function, each time one stream is pushed as a close-up (streaming media), two streams are pushed at the same time, one is the original image video stream, and the other is the regional composite image video stream. The close-up image video stream can be pushed at a high bit rate, and the image clarity it pushes will be better than the close-up area image in the original image.

[0108] S4, in the original image video stream in step S3, for each video frame, the position s1 of the close-up area in the synthetic image obtained in step S2 and the position s0 of the close-up area in the original image are carried.

[0109] S5, for the audience streaming end (i.e., streaming media player end), Figure 4 As shown, when the viewer clicks on a screen position, the streaming client obtains the special effect original image position s0 from the original image video stream, and then determines whether the viewer's click position is within s0. If so, it means that the viewer clicks on the close-up area. At this time, the streaming client pulls the close-up area composite picture video stream, finds the matching close-up area in the composite picture, extracts the matching close-up area picture from the composite picture, and then enlarges it for display.

[0110] In an embodiment of the present application, a target video frame in a live video is displayed on a playback client; in response to a touch operation on the target video frame, a target operation area of ​​the touch operation in the target video frame is determined; in a synthetic image frame sequence matching the live video, a target close-up area corresponding to the target operation area is searched, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in the corresponding video frame in the live video; when the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence, a close-up image in the target close-up area is displayed on the playback client, wherein the close-up image in the target close-up area includes a target object processed by special effects; the image of the target close-up area is synthesized into a sequence frame matching the original target video frame, and since only a partial area image (i.e., the above-mentioned close-up image) in the target video frame is transmitted at the same transmission bit rate, the above-mentioned close-up image has higher clarity than that obtained by enlarging the partial area image. Thereby, the purpose of clearly displaying the local area of ​​the live screen after zooming in is achieved, and the technical problem of low image display clarity after close-up zooming in on the local area of ​​the live screen is solved.

[0111] According to another aspect of the embodiments of the present invention, a screen display device for implementing the above screen display method is also provided. Fig.10 As shown, the device comprises:

[0112] The receiving unit 1002 is used to receive the live video and the synthesized image frame sequence sent by the push streaming client through the server, and display the target video frame in the live video on the pull streaming client, wherein each synthesized image frame in the synthesized image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in the corresponding video frame in the live video by the push streaming client;

[0113] A determination unit 1004 is used to determine a target operation area of ​​the touch operation in the target video frame in response to the touch operation on the target video frame;

[0114] A searching unit 1006, configured to search for a target close-up area corresponding to a target operation area in a synthetic image frame sequence;

[0115] The display unit 1008 is used to display the close-up picture in the target close-up area on the streaming client according to the target synthetic image frame when the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence.

[0116] In step S302, in actual application, the current live video may be played through devices such as mobile phones, laptops, tablet computers, PDAs, MIDs (Mobile Internet Devices), PADs, and desktop computers. The high-end target video frames in the live video may be recorded in real time by electronic devices such as mobile phones and laptops, and transmitted through streaming media, without any limitation. Figure 4 As shown, in the playback client 400 of the electronic device, a live video is displayed, and the characters in the live video are recorded in real time by the electronic device and displayed in the live client 400 through streaming media.

[0117] In step S304, in actual application, in response to the touch operation on the target video frame, a target operation area of ​​the touch operation in the target video frame is determined; Figure 4 As shown, after clicking the close-up zoom button 404, the target operation area 406 of the touch operation in the target video frame is determined, that is, the head portrait area of ​​the person in the live image and the area of ​​the object held by the person;

[0118] In step S306, in actual application, Figure 4As shown, in the synthetic image frame sequence 402 matching the live video, the target close-up area corresponding to the target operation area 406 is searched, wherein each synthetic image frame in the synthetic image frame sequence 400 is an image frame obtained by synthesizing at least one close-up area identified in the corresponding video frame in the live video by the streaming client, Figure 4 There are two target close-up areas corresponding to the target operation area 406, namely, a person's head image and a camera area.

[0119] In one embodiment, when Figure 4 When there is one target close-up area corresponding to the target operation area 406, or one of the character portrait areas or the camera areas, there is also one target close-up area corresponding to the target operation area 406. Each synthetic image frame in the synthetic image frame sequence 400 synthesizes a character portrait area or a camera close-up area identified in the corresponding video frame in the live video to obtain an image frame.

[0120] In step S308, in actual application, Figure 4 As shown, when the above-mentioned target close-up area (character portrait area and / or camera area) is found in the target synthetic image frame of the above-mentioned synthetic image frame sequence 400, the close-up picture within the above-mentioned target close-up area 408 is displayed on the playback client 400, and the close-up picture within the target close-up area includes the target object (character portrait or camera) processed by special effects.

[0121] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0122] In an embodiment of the present application, a live video and a synthetic image frame sequence sent by a push stream client are received by a server, and a target video frame in the live video is displayed on a pull stream client, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in the corresponding video frame in the live video by the push stream client; in response to a touch operation on the target video frame, a target operation area in the target video frame is determined by the touch operation; in the synthetic image frame sequence, a target close-up area corresponding to the target operation area is searched; in the case where the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence, a close-up image in the target close-up area is displayed on the pull stream client according to the target synthetic image frame, and since only a partial area image (i.e., the above-mentioned close-up image) in the live video is transmitted at the same transmission bit rate, the above-mentioned close-up image has a higher definition than that obtained by enlarging the partial area image. Thus, the purpose of clearly displaying the local area image in the live screen after enlarging the image is achieved, and the technical problem of low image display clarity after close-up enlarging the local area of ​​the live screen is solved.

[0123] In one or more embodiments of the present application, the search unit 1006 includes:

[0124] A first determination module is used to determine the frame number of the target video frame and the operation position of the target operation area;

[0125] A search module, used to search for a target synthetic image frame corresponding to the frame sequence number in the synthetic image frame sequence, and to search for a close-up position corresponding to the operation position in the searched target synthetic image frame;

[0126] The second determining module is used to determine the close-up area indicated by the close-up position as the target close-up area.

[0127] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0128] In one or more embodiments of the present application, the display unit 1008 includes:

[0129] A display module is used to display close-up images according to a first resolution preset in the synthetic image frame sequence, and to display images other than close-up images in the target video frame according to a second resolution selected for the live video; wherein the first resolution is greater than the second resolution.

[0130] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0131] In one or more embodiments of the present application, the receiving unit 1002 includes:

[0132] A first receiving module is used to receive a synthetic image frame sequence sent by a streaming client, wherein the synthetic image frame sequence is pushed to a streaming client by the streaming client at a preset first bit rate of the synthetic image frame sequence;

[0133] The second receiving module is used to receive the target video frame picture sent by the push streaming client, wherein the video frame of the target video frame picture is pushed to the pull streaming client by the push streaming client through the second channel bit rate preset by the target video frame picture, and the first channel bit rate is greater than the second channel bit rate.

[0134] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0135] According to another aspect of the embodiments of the present invention, a screen display device for implementing the above screen display method is also provided. Fig.11 As shown, the device comprises:

[0136] An acquisition unit 1102 is used to acquire a video frame corresponding to a live video;

[0137] The identification unit 1104 is used to identify at least one close-up area in the video frame;

[0138] A synthesis unit 1106 is used to synthesize at least one close-up area identified in the video frame to obtain a synthetic image frame sequence; wherein the close-up area corresponds to an operation area in the video frame, and the operation area is used to enable the streaming client to display the close-up area according to a touch operation;

[0139] The sending unit 1108 is used to send the live video and the synthesized image frame sequence to the streaming client through the server.

[0140] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0141] In an embodiment of the present application, by obtaining a video frame corresponding to a live video; identifying at least one close-up area in the video frame; synthesizing at least one close-up area identified in the video frame to obtain a synthetic image frame sequence; wherein the close-up area corresponds to the operation area in the video frame, and the operation area is used to enable the streaming client to display the close-up area according to the touch operation; the live video and the synthetic image frame sequence are sent to the streaming client through the server. Since only partial area images (i.e., the above-mentioned close-up images) in the live video are transmitted at the same transmission bit rate, the above-mentioned close-up images have a higher definition than those obtained by enlarging the partial area images. Thus, the purpose of clearly displaying the partial area images in the live screen after enlarging the images is achieved, and the technical problem of low image display clarity after the close-up enlargement operation of the partial area of ​​the live screen is solved.

[0142] In one or more embodiments of the present application, the identification unit 1104 includes:

[0143] The recognition module is used to identify the candidate video frames carrying the target object in each video frame of the live video;

[0144] An extraction module, used to extract the display area where the target object is located from each candidate video frame;

[0145] The processing module is used to perform close-up processing on the target object in the display area to obtain a close-up area, wherein the encoding bit rate of the special effect picture in the close-up area is greater than the encoding bit rate of the display picture in the display area.

[0146] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0147] In one or more embodiments of the present application, the synthesis unit 1106 includes:

[0148] A synthesis module, used for sequentially synthesizing the close-up regions corresponding to each candidate video frame to obtain a synthesized image frame;

[0149] The sorting module is used to arrange the synthesized image frames in sequence to obtain a synthesized image frame sequence.

[0150] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0151] In one or more embodiments of the present application, the processing module includes at least one of the following:

[0152] An enlargement submodule, used to enlarge the display size of the target object in the display area from a first size to a second size, wherein the display clarity of the target object at the second size is greater than the display clarity of the target object at the first size;

[0153] The adding submodule is used to add additional display resources to the target object in the display area, wherein the additional display resources are used to highlight the target object.

[0154] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0155] In one or more embodiments of the present application, including:

[0156] The configuration module is used to configure the target object to be processed in close-up in the live video before identifying at least one close-up area in the video frame.

[0157] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0158] In one or more embodiments of the present application, the configuration module includes at least one of the following:

[0159] The first recognition submodule is used to recognize a face region from the live video, and configure the head position indicated by the recognized face region as a target object;

[0160] A configuration submodule is used to identify a target object area from the live video, and configure the object indicated in the target object area as the target object, wherein the target object area is determined based on an object image imported into the streaming client;

[0161] The second identification submodule is used to identify a fixed screen area from the live video and configure the graphic primitive object indicated in the fixed screen area as a target object.

[0162] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0163] In one or more embodiments of the present application, the sending unit 1108 includes:

[0164] A first streaming module, configured to stream a target synthetic image frame based on a first bit rate preset for the synthetic image frame sequence;

[0165] The second streaming module is used to stream the video frame of the target video frame based on a second bit rate preset for the video frame of the target video frame, wherein the first bit rate is greater than the second bit rate.

[0166] For the specific implementation, reference may be made to the example shown in the above screen display method, which will not be described in detail in this example.

[0167] According to another aspect of the embodiments of the present invention, an electronic device for implementing the above-mentioned screen display method is also provided. The electronic device may be Figure 1 The terminal device or server shown in the figure. This embodiment is described by taking the electronic device as a server as an example. Fig.12 As shown, the electronic device includes a memory 1202 and a processor 1204. The memory 1202 stores a computer program, and the processor 1204 is configured to execute the steps in any of the above method embodiments through the computer program.

[0168] Optionally, in this embodiment, the electronic device may be located in at least one network device among a plurality of network devices of a computer network.

[0169] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

[0170] S1, receiving a live video and a synthesized image frame sequence sent by a streaming client through a server, and displaying a target video frame in the live video on the streaming client, wherein each synthesized image frame in the synthesized image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in a corresponding video frame in the live video by the streaming client;

[0171] S2, in response to a touch operation on a target video frame, determining a target operation area of ​​the touch operation in the target video frame;

[0172] S3, searching for a target close-up area corresponding to the target operation area in the synthetic image frame sequence;

[0173] S4, when the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence, a close-up image in the target close-up area is displayed on the streaming client according to the target synthetic image frame. Or,

[0174] S1, obtaining a video frame corresponding to a live video;

[0175] S2, identifying at least one close-up area in the video frame;

[0176] S3, synthesizing at least one close-up area identified in the video frame to obtain a synthetic image frame sequence; wherein the close-up area corresponds to an operation area in the video frame, and the operation area is used to enable the streaming client to display the close-up area according to a touch operation;

[0177] S4, sending the live video and the synthesized image frame sequence to the streaming client through the server.

[0178] Alternatively, a person skilled in the art may understand that: Fig.12 The structure shown is for illustration only, and the electronic device may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a PDA, a mobile Internet device (MID), a PAD, and other terminal devices. Fig.12 The electronic device and the electronic equipment described above are not limited in structure. Fig.12 More or fewer components (such as network interfaces, etc.) as shown in, or with Fig.12 Different configurations are shown.

[0179] Among them, the memory 1202 can be used to store software programs and modules, such as the program instructions / modules corresponding to the screen display method and device in the embodiment of the present invention. The processor 1204 executes various functional applications and data processing by running the software programs and modules stored in the memory 1202, that is, realizing the above-mentioned screen display method. The memory 1202 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 1202 may further include a memory remotely arranged relative to the processor 1204, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Among them, the memory 1202 can be specifically, but not limited to, used to display close-up images within a target close-up area. As an example, such as Fig.12As shown, the memory 1202 may include, but is not limited to, the receiving unit 1002, the determining unit 1004, the searching unit 1006, and the display unit 1008 (or Fig.12 In the figure, there are shown an acquisition unit 1102, a recognition unit 1104, a synthesis unit 1106 and a sending unit 1108). In addition, other module units in the above-mentioned image display device may also be included but are not limited to, which will not be repeated in this example.

[0180] Optionally, the transmission device 1206 is used to receive or send data via a network. Specific examples of the network may include a wired network and a wireless network. In one example, the transmission device 1206 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers via a network cable so as to communicate with the Internet or a local area network. In one example, the transmission device 1206 is a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0181] In addition, the electronic device further includes: a display 1208 for displaying the close-up image; and a connection bus 1212 for connecting various module components in the electronic device.

[0182] In other embodiments, the terminal device or server may be a node in a distributed system, wherein the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting the multiple nodes through network communication. Among them, the nodes may form a peer-to-peer (P2P, Peer To Peer) network, and any form of computing device, such as a server, terminal and other electronic devices, may become a node in the blockchain system by joining the peer-to-peer network.

[0183] In one or more embodiments, the present application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above-mentioned screen display method. Wherein, the computer program is configured to execute the steps of any of the above-mentioned method embodiments when running.

[0184] Optionally, in this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:

[0185] S1, receiving a live video and a synthesized image frame sequence sent by a streaming client through a server, and displaying a target video frame in the live video on the streaming client, wherein each synthesized image frame in the synthesized image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in a corresponding video frame in the live video by the streaming client;

[0186] S2, in response to a touch operation on a target video frame, determining a target operation area of ​​the touch operation in the target video frame;

[0187] S3, searching for a target close-up area corresponding to the target operation area in the synthetic image frame sequence;

[0188] S4, when the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence, a close-up image in the target close-up area is displayed on the streaming client according to the target synthetic image frame. Or,

[0189] S1, obtaining a video frame corresponding to a live video;

[0190] S2, identifying at least one close-up area in the video frame;

[0191] S3, synthesizing at least one close-up area identified in the video frame to obtain a synthetic image frame sequence; wherein the close-up area corresponds to an operation area in the video frame, and the operation area is used to enable the streaming client to display the close-up area according to a touch operation;

[0192] S4, sending the live video and the synthesized image frame sequence to the streaming client through the server.

[0193] Optionally, in this embodiment, a person skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing the hardware related to the terminal device through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include: a flash disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc. The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages and disadvantages of the embodiments.

[0194] If the integrated units in the above embodiments are implemented in the form of software functional units and sold or used as independent products, they can be stored in the above computer-readable storage medium. Based on such understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling one or more computer devices (which can be personal computers, servers or network devices, etc.) to perform all or part of the steps of the above methods of various embodiments of the present invention.

[0195] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0196] In the several embodiments provided in the present application, it should be understood that the disclosed client can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0197] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0198] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0199] The above are only preferred embodiments of the present invention. It should be pointed out that, for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A screen display method, characterized in that: include: Receive a synthetic image frame sequence sent by a streaming client, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in a corresponding video frame in a live video by the streaming client, the synthetic image frame sequence is pushed to a streaming client by the streaming client through a preset first bit rate of the synthetic image frame sequence, the close-up area is obtained by performing close-up processing on a target object in a display area, the display area is an area where the target object is located extracted from each video frame of the live video carrying the target object, the target object is an object object indicated in a target object area, the target object area is identified from the live video and determined according to an object picture imported into the streaming client, the close-up area corresponds to an operation area in the video frame, the operation area is used to enable the streaming client to display the close-up area according to a touch operation, and the encoding bit rate of the close-up picture in the close-up area is greater than the encoding bit rate of the display picture in the display area; Receiving a target video frame picture sent by the streaming client, wherein the video frame of the target video frame picture is streamed to the streaming client by the streaming client at a second bit rate preset for the target video frame picture, and the first bit rate is greater than the second bit rate; In response to a touch operation on the target video frame, determining a target operation area of ​​the touch operation in the target video frame; In the synthetic image frame sequence, searching for a target close-up area corresponding to the target operation area; When the target close-up region is found in the target synthetic image frame of the synthetic image frame sequence, a close-up picture in the target close-up region is displayed on the streaming client according to the target synthetic image frame.

2. The method according to claim 1, characterized in that In the synthetic image frame sequence, searching for a target close-up area corresponding to the target operation area comprises: Determine the frame number of the target video frame and the operation position of the target operation area; Searching for the target synthetic image frame corresponding to the frame sequence number in the synthetic image frame sequence, and searching for a close-up position corresponding to the operation position in the searched target synthetic image frame; A close-up area indicated by the close-up position is determined as the target close-up area.

3. The method according to any one of claims 1 to 2, characterized in that The step of displaying a close-up image in the target close-up area on the streaming client according to the target synthesized image frame comprises: The close-up picture is displayed according to a first resolution preset for the synthetic image frame sequence, and the pictures in the target video frame except the close-up picture are displayed according to a second resolution selected for the live video; wherein the first resolution is greater than the second resolution.

4. A screen display method, characterized in that: The method comprises: Get the video frame corresponding to the live video; Identify a target object region from the live video, and configure the object indicated in the target object region as the target object, wherein the target object region is determined based on an object image imported into the streaming client; Configuring the target object to be processed in close-up in the live video; In each video frame of the live video, identifying a candidate video frame that carries the target object; Extracting the display area where the target object is located from each of the candidate video frames; Performing close-up processing on the target object in the display area to obtain a close-up area, wherein the close-up area corresponds to an operation area in the video frame, the operation area is used to enable the streaming client to display the close-up area according to a touch operation, and the encoding bit rate of the close-up picture in the close-up area is greater than the encoding bit rate of the display picture in the display area; synthesizing at least one of the close-up areas to obtain a synthesized image frame sequence; Sending the live video and the synthesized image frame sequence to the streaming client through the server; The step of sending the live video and the synthesized image frame sequence to the streaming client through the server includes: Based on a first bit rate preset for the synthetic image frame sequence, streaming a target synthetic image frame in the synthetic image frame sequence; The video frames of the video frame picture are streamed based on a second bit rate preset for the video frames of the video frame picture, wherein the first bit rate is greater than the second bit rate.

5. The method according to claim 4, characterized in that The step of synthesizing at least one close-up area identified in the video frame to obtain a synthesized image frame sequence includes: Combining each of the candidate video frames in sequence with the close-up area to obtain the composite image frame; Arrange the synthesized image frames in sequence to obtain the synthesized image frame sequence.

6. The method according to claim 4, characterized in that The close-up processing of the target object in the display area to obtain the close-up area includes at least one of the following: Enlarging the display size of the target object in the display area from a first size to a second size, wherein the display clarity of the target object at the second size is greater than the display clarity of the target object at the first size; Additional display resources are added for the target object in the display area, wherein the additional display resources are used to highlight the target object.

7. The method according to claim 4, characterized in that The target object to be processed in close-up in the live video also includes: A face region is identified from the live video, and a head position indicated by the identified face region is configured as the target object.

8. A screen display device, characterized in that: include: A receiving unit, configured to receive a live video and a synthetic image frame sequence sent by a streaming client through a server, and display a target video frame in the live video on a streaming client, wherein each synthetic image frame in the synthetic image frame sequence is an image frame obtained by synthesizing at least one close-up area identified in a corresponding video frame in the live video by the streaming client, and the synthetic image frame sequence is streamed to the streaming client by the streaming client at a preset first bit rate through the synthetic image frame sequence, the close-up area is obtained by performing close-up processing on a target object in a display area, the display area is an area where the target object is located extracted from each video frame carrying the target object in the live video, the target object is an object indicated in a target object area, the target object area is identified from the live video and determined according to an object picture imported into the streaming client, the close-up area corresponds to an operation area in the video frame, the operation area is used to enable the streaming client to display the close-up area according to a touch operation, and the encoding bit rate of the close-up picture in the close-up area is greater than the encoding bit rate of the display picture in the display area; a determining unit, configured to determine, in response to a touch operation on the target video frame, a target operation area of ​​the touch operation in the target video frame; A searching unit, configured to search for a target close-up area corresponding to the target operation area in the synthetic image frame sequence; A display unit, configured to display a close-up image in the target close-up area on the streaming client according to the target synthetic image frame when the target close-up area is found in the target synthetic image frame of the synthetic image frame sequence; The receiving unit comprises: A first receiving module is used to receive the synthetic image frame sequence sent by the streaming client, wherein the synthetic image frame sequence is pushed to the streaming client by the streaming client at a preset first bit rate of the synthetic image frame sequence; The second receiving module is used to receive the target video frame picture sent by the push client, wherein the video frame of the target video frame picture is pushed to the pull client by the push client through the second path bit rate preset by the target video frame picture, and the first path bit rate is greater than the second path bit rate.

9. A screen display device, characterized in that: include: An acquisition unit, used to acquire a video frame corresponding to a live video; The device is also used to identify a target object area from the live video, and configure the object object indicated in the target object area as the target object, wherein the target object area is determined based on an object picture imported into a streaming client; configure the target object to be processed in close-up in the live video; identify candidate video frames carrying the target object in each video frame of the live video; extract the display area where the target object is located from each of the candidate video frames; perform close-up processing on the target object in the display area to obtain a close-up area, wherein the close-up area corresponds to an operation area in the video frame, and the operation area is used to enable the streaming client to display the close-up area according to a touch operation, and the encoding bit rate of the close-up picture in the close-up area is greater than the encoding bit rate of the display picture in the display area; A synthesis unit, used for synthesizing at least one of the close-up areas to obtain a synthetic image frame sequence; a sending unit, used for sending the live video and the synthetic image frame sequence to a streaming client through a server; The sending unit comprises: A first streaming module, configured to stream a target synthetic image frame in the synthetic image frame sequence based on a first bit rate preset for the synthetic image frame sequence; The second streaming module is used to stream the video frames of the video frame picture based on a second bit rate preset for the video frames of the video frame picture, wherein the first bit rate is greater than the second bit rate.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the program executes the method described in any one of claims 1 to 3 or 4 to 7.

11. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to execute the method described in any one of claims 1 to 3 or 4 to 7 through the computer program.

Images