Interface interaction method and apparatus, device and storage medium

Abstract

The embodiments of the present disclosure relate to an interface interaction method and apparatus, a device and a storage medium. The method provided herein comprises: presenting a playback interface of media content, the playback interface displaying a picture of the media content; in response to receiving instruction information, displaying a target panel in a first area of the playback interface; and, in response to the picture containing a target object, presenting a first portion of the picture of the media content in a second area of the playback interface, the first portion being at least determined on the basis of at least one display attribute of the target object in the picture. On the basis of the method, when the panel is displayed, the embodiments of the present disclosure can adaptively adjust the display of the picture according to the display attribute of the target object in the picture, thereby improving user experience.

Description

Method, device, apparatus and storage medium for interface interaction

[0001] The present application claims priority to the Chinese patent application No. 202311056088.4, filed on August 21, 2023, entitled “Method, device, apparatus and storage medium for interface interaction”, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to a method, device, apparatus and computer readable storage medium for interface interaction. BACKGROUND

[0003] With the development of computer technology, the Internet has become an important source for people to obtain various content. Live streaming technology for content dissemination using the Internet and streaming media technology is increasingly prosperous, and it gradually becomes the mainstream expression of the Internet because it integrates rich elements such as images, texts, and sounds.

[0004] SUMMARY

[0005] In a first aspect of the present disclosure, a method for interface interaction is provided. The method comprises: presenting a play interface of media content, the play interface displaying a frame of the media content; in response to receiving indication information, displaying a target panel in a first region of the play interface; and in response to the frame including a target object, presenting a first part of the frame of the media content in a second region of the play interface, the first part being determined based on at least one display attribute of the target object in the frame.

[0006] In a second aspect of the present disclosure, a device for interface interaction is provided. The device comprises: an interface presentation module configured to present a play interface of media content, the play interface displaying a frame of the media content; a panel display module configured to, in response to receiving indication information, display a target panel in a first region of the play interface; and a frame presentation module configured to, in response to the frame including a target object, present a first part of the frame of the media content in a second region of the play interface, the first part being determined based on at least one display attribute of the target object in the frame.

[0007] In a third aspect of the present disclosure, an electronic device is provided. The device comprises at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the device to perform the method of the first aspect.

[0008] In a fourth aspect of the present disclosure, a computer readable storage medium is provided. The computer readable storage medium has stored thereon a computer program, which is executable by a processor to implement the method of the first aspect.

[0009] It should be understood that nothing in the Summary is to be construed as a limitation on the scope of the embodiments of the present disclosure. Other features of the present disclosure will be apparent from the detailed description that follows. BRIEF DESCRIPTION OF DRAWINGS

[0010] The above and other features, aspects and advantages of embodiments of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings. In the drawings similar elements are denoted by similar reference numerals, in which:

[0011] FIGS. 1A to 1C illustrate example interfaces according to a conventional picture adjustment scheme;

[0012] FIG. 2 illustrates a schematic diagram of an example environment in which example embodiments according to the present disclosure can be implemented;

[0013] FIGS. 3A and 3B illustrate example interfaces according to some embodiments of the present disclosure;

[0014] FIGS. 4A and 4B illustrate example interfaces according to some embodiments of the present disclosure;

[0015] FIGS. 5A and 5B illustrate example interfaces according to some embodiments of the present disclosure;

[0016] FIGS. 6A and 6B illustrate example interfaces according to some embodiments of the present disclosure;

[0017] FIG. 7 illustrates a flowchart of an example process of interface interaction according to some embodiments of the present disclosure;

[0018] FIG. 8 illustrates a schematic structural block diagram of an apparatus for interface interaction according to some embodiments of the present disclosure; and

[0019] FIG. 9 illustrates a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0020] Embodiments of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings. While certain embodiments of the present disclosure will be shown and described, it will be clear to those having ordinary skill in the art that the present disclosure can be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather should be construed as including all embodiments that are within the scope of the present disclosure. It will be understood that the drawings and detailed description thereto are not intended to limit the scope of the present disclosure.

[0021] It should be noted that the headings provided in any section / subsection of the disclosure herein are not limitations. Various embodiments are described throughout this document and any type of embodiment can be included under any section / subsection. Furthermore, embodiments described in any section / subsection can be combined with any other embodiment described in the same section / subsection and / or a different section / subsection in any manner.

[0022] In the description of embodiments of the disclosure, the term "includes" and its derivatives, such as "including," should be understood in an open-ended way, that is, "including but not limited to." The term "based on" should be understood as "based at least in part on." The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment." The term "some embodiments" should be understood as "at least some embodiments." Other explicit or implicit definitions can also be included below. The terms "first," "second," and the like can refer to different or the same objects. Other explicit and implicit definitions can also be included below.

[0023] In some embodiments of the disclosure, data related to users, acquisition and / or use of data, etc. can be involved. These aspects all comply with the corresponding laws and regulations and relevant provisions. In some embodiments of the disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms. Accordingly, in the implementation of various embodiments of the disclosure, the type of data or information that can be involved, the scope of use, the use scenario, etc. should be notified to the user and authorized by the user in a proper manner according to the relevant laws and regulations. The specific notification and / or authorization mode can vary according to the actual situation and application scenario, and the scope of the disclosure is not limited in this regard.

[0024] In the specification and embodiments, if personal information processing is involved, it will be processed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the scope of the provisions or agreement. Users refuse to process personal information other than the necessary information required for basic functions, which will not affect the user's use of basic functions.

[0025] As introduced above with reference, people can utilize electronic devices to acquire various types of media content. Such media content may, for example, include picture content, video content, live content, etc.

[0026] FIG. 1A illustrates an example interface 100A for acquiring media content. The interface 100A may, for example, be used to display a frame of media content 110. In some cases, a user can trigger display of a panel 120 through a particular interaction within the interface 100A.

[0027] In the case that the panel 120 is triggered to be displayed, the area for displaying the media content 110 will be correspondingly reduced. As shown in FIG. IB, according to some conventional schemes, such panel 120 can be directly overlaid onto the frame of the media content 110, which can cause the object 115 of interest of the user in the media content 110 to be occluded by the panel 120, thereby affecting the viewing experience of the user.

[0028] According to some conventional schemes, as shown in FIG. 1C, the frame of the media content 110 will be correspondingly translated with the triggering of the panel 120. For example, the frame of the media content 110 is correspondingly translated upwards. However, this can cause the object 115 of interest of the user to be translated out of the frame, thereby affecting the viewing experience of the user.

[0029] In view of this, embodiments of the present disclosure propose a scheme for interface interaction. According to the scheme, a playback interface of media content can be presented. Such playback interface displays a frame of the media content. Further, in response to receiving indication information, a target panel is displayed in a first area of the playback interface. If the frame includes a target object, a first portion of the frame of the media content is presented in a second area of the playback interface, wherein the first portion is determined based on at least one display attribute of the target object in the frame.

[0030] In this way, in the case that the panel is triggered to be displayed, embodiments of the present disclosure can adaptively adjust the display of the frame according to the display attribute of the target object in the frame, thereby improving the user experience.

[0031] Various example implementations of the scheme are described in further detail below in conjunction with the accompanying drawings.

[0032] Example Environment

[0033] FIG. 2 shows a schematic diagram of an example environment 200 in which embodiments of the present disclosure can be implemented. As shown in FIG. 2, the example environment 200 can include an electronic device 210.

[0034] In this example environment 200, the electronic device 210 can run an application 220 for providing, viewing media content. The application 220 can be any appropriate type of application for providing, viewing media content, examples of which can include but are not limited to: an online video application, a live streaming application. A user 240 can interact with the application 220 via the electronic device 210 and / or its attached devices. The user 240 can be, for example, a user providing live streaming content (also referred to as a host), a user viewing live streaming (also referred to as a viewer).

[0035] In the environment 200 of FIG. 2, if the application 220 is in an active state, the electronic device 210 can present a live streaming interface 250 via the application 220.

[0036] In some embodiments, the electronic device 210 communicates with the server 230 to implement provisioning of services of the application 220. The electronic device 210 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media player, a multimedia tablet, a palmtop computer, a portable gaming terminal, a VR / AR device, a Personal Communication System (PCS) terminal, a personal navigation device, a Personal Digital Assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including an accessory or peripheral device thereof or any combination thereof. In some embodiments, the electronic device 210 can also support any type of interface to the user (such as “wearable” circuitry, etc.).

[0037] The server 230 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The server 230 may, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 230 can provide background services for the application 220 in the electronic device 210 that supports a virtual scene.

[0038] A communication connection can be established between the server 230 and the electronic device 210. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 230 and the electronic device 210 can implement signaling interaction through the communication connection therebetween.

[0039] It should be understood that the structure and function of the various elements in the environment 200 are described for illustrative purposes only, and do not imply any limitation on the scope of the present disclosure.

[0040] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0041] Example interface

[0042] Some example embodiments of the present disclosure will be hereinafter described with continuous reference to the drawings. FIG. 3A shows a play interface 300A of media content according to some embodiments of the present disclosure, which can be provided by the electronic device 210, for example.

[0043] As shown in FIG. 3A, the play interface 300A can be used to play the media content 310 to display a frame of the media content 310. In some embodiments, such media content 310 can include any appropriate media content with corresponding visual content (i.e., frame), examples of which can include picture content, video content, etc. Exemplarily, the play interface 300A can be configured to display the frame of the media content 310 in a full-screen mode. As another example, the terminal device 210 can also display the frame of the media content 310 in a non-full-screen mode.

[0044] In some embodiments, such media content 310 can be a live video stream. Accordingly, the play interface 300A can be a live page of a live room, for example.

[0045] In some embodiments, the electronic device 210 can trigger the display of the target panel in the play interface in response to receiving the indication information.

[0046] In some embodiments, such indication information can be generated based on a preset operation of the user 240. For example, the user 240 can trigger the display of the input panel by clicking the input control; or the user 240 can trigger the display of the gift panel by clicking the gift control.

[0047] In yet some embodiments, such indication information can also be generated by the electronic device 210 or the server 230. For example, in a live scenario, if the user 240 is a spectator user, the electronic device 210 can receive the indication information generated by the server 230 according to a specific operation of the host, for example, and accordingly trigger the display of the corresponding panel.

[0048] As shown in FIG. 3B, the electronic device 210 can display the panel 345 in the first area 340 in response to receiving the indication information. Such panel 345 can include any appropriate type of panel, and the present disclosure is not intended to be limited in this regard.

[0049] In some embodiments, if the frame of the media content 310 includes a target object of a specific type, the electronic device 210 can determine the frame part 325 (also referred to as the first part) of the second area 320 of the interface 300B according to at least one display attribute of the target object in the frame.

[0050] In some embodiments, it can be determined by the electronic device 210 and / or the server 230 whether a specific type of target object is included in a frame of the media content 310. Such target object may, for example, include a host object, a commodity object, and the like. In some examples, such target object can be a preset object, or may, for example, be configured by a relevant user (e.g., a host) of the media content 310.

[0051] Taking FIG. 3B as an example, a target object 315 may, for example, be included in a frame of the media content 310. Further, at least one display attribute of the target object 315 in the frame can be determined by the electronic device 210 and / or the server 230, and based on the at least one display attribute, a partial frame 325 to be displayed in the interface 300B can be determined.

[0052] In some embodiments, the at least one display attribute of the target object 315 can include position information of the target object 315 in the frame. Such position information may, for example, include a position of an edge of the target object 315 in the frame (which may, for example, be represented by a curve equation or a plurality of edge position points), a center position of the target object 315 in the frame, or a position of one or more key points associated with the target object 315.

[0053] Further, the electronic device 210 can determine the partial frame 325 according to the position information, so that at least one reference position associated with the target object 315 is included in the frame portion 325. Such at least one reference position may, for example, include any appropriate position associated with the target object 315, such as one or more key points associated with the target object 315, one or more edge position points associated with the target object 315, a frame center point of the target object 315, and the like. In this way, embodiments of the present disclosure can ensure that a key part of the target object can be revealed in the adjusted frame, thereby improving the viewing experience of the user.

[0054] Taking FIG. 3B as an example, the electronic device 210 can determine the frame portion 325 based on a reference position (e.g., a first position 330) associated with the target object, so that the first position 330 is included in the frame portion 325. The first position 330 may, for example, correspond to a top portion of the target object 315 in a preset direction of the frame.

[0055] In some embodiments, the at least one display attribute of the target object 315 includes a ratio of the target object 315 in the frame of the media content 310. Illustratively, the electronic device 210 and / or the server 230 can determine the display size of the target object 315 according to the area of the target object 315 (e.g., by detecting the bounding box), and determine the ratio of the target object 315 to the frame size, thereby determining the ratio of the target object 315 in the frame. Further, the electronic device 210 can determine the partial frame 325 based on the comparison of the ratio and a preset threshold.

[0056] In some embodiments, if the ratio of the target object 315 in the frame is less than the preset threshold, the electronic device 210 can determine the partial frame 325 based on the position information of the target object 315 in the frame. It should be appreciated that such a preset threshold can be a fixed threshold, or can be dynamically variable according to the frame size of the media content 310, or can also be pre-configured by the relevant user.

[0057] In some examples, such position information can indicate a first position 330 of the target object 315 in the frame. The first position 330, for example, corresponds to the top of the target object 315 in a preset direction of the frame.

[0058] In some embodiments, the preset direction can correspond to the arousing direction of the panel 345. Taking FIG. 3B as an example, the preset direction is the vertically upward direction, and the first position 330 can be the top position of the target object 315 in the vertically upward direction.

[0059] Further, the electronic device 210 can determine the partial frame 325 to be displayed in the second area 320 based on the first position 330, so that the first position 330 is included in the partial frame 325.

[0060] Thus, the embodiments of the present disclosure can ensure that the target object can be displayed as completely as possible in the partial frame, thereby improving the viewing experience of the user.

[0061] Considering that the top of some interfaces usually also needs to reserve a certain control area, in some scenarios, the electronic device 210 can also make the distance from the first position 330 to the upper edge 335 of the second area 320 in the preset direction greater than or equal to a preset distance. Taking FIG. 3B as an example, the electronic device 210 can, for example, always ensure that the top position of the target object 315 (i.e., the first position 330) has at least a preset distance (e.g., distance d) to the top of the second area 320. Thus, the embodiments of the present disclosure can further avoid the target object 315 being blocked by other controls, thereby improving the viewing experience of the user.

[0062] In yet some embodiments, the electronic device 210 may, for example, also enable the target object 315 to be displayed as centered in the second region as much as possible.

[0063] As shown in FIG. 4A, the electronic device 210 and / or the server 230 may, for example, determine a first position 430 and a second position 435 of the target object 315. The first position 430 may, for example, correspond to a top of the target object 315 in a preset direction of the frame, and the second position 435 may, for example, correspond to a bottom of the target object 315 in the preset direction of the frame.

[0064] Further, the electronic device 210 may, for example, determine the candidate portion 415 of the frame based on the first position 430 and the second position 435 of the target object 315, such that a difference between a distance from the first position 430 to an upper edge of the second region 410 in the preset direction and a distance from the second position 435 to a lower edge of the second region 410 in the preset direction is less than a threshold value.

[0065] For example, the electronic device 210 may, for example, enable the target object 315 to be displayed as substantially vertically centered in the second region 410. That is, the electronic device 210 enables a distance from the top position (i.e., the first position 430) of the target object 315 to the upper edge of the second region 410 to be equal to a distance from the bottom position (i.e., the second position 435) of the target object 315 to the lower edge of the second region 410.

[0066] In some embodiments, the electronic device 210 may, for example, directly determine the candidate portion 415 as the partial frame to be presented in the second region 410.

[0067] Thus, embodiments of the present disclosure may, for example, enable a user to more easily view the target object through the displayed partial frame, thereby improving the user’s viewing experience.

[0068] In some embodiments, in the case of displaying the target object 315 as centered, it may, for example, result in its top position being too close to or beyond the upper edge of the second region. Thus, if a distance from the first position 410 to the upper edge of the second region 410 in the preset direction is greater than or equal to a preset distance, the electronic device 210 may, for example, determine a first portion of the frame based on the candidate portion 415. For example, the electronic device 210 may, for example, determine the candidate portion 415 as the partial frame to be displayed in the second region 410.

[0069] Conversely, if the distance from the first position 410 to the upper edge of the second region 410 in the preset direction is less than the preset distance, the electronic device 210 may, for example, further adjust the candidate portion 415. Taking FIG. 4A as an example, in the case of centered display, the distance from the first position 430 of the target object 315 to the upper edge of the second region 410 is less than the preset distance (e.g., the distance d).

[0070] Further, as shown in FIG. 4B, the electronic device 210 can adjust the candidate portion 415 in an opposite direction (e.g., a vertical downward direction) of the preset direction, such that a distance from the first position 430 to an upper edge of the second region 410 in the preset direction reaches a preset distance (e.g., the distance d). Taking FIG. 4B as an example, the electronic device 210 can adjust the candidate portion 415 downward, such that a distance from a top position (i.e., the first position 430) of the target object 315 to the upper edge of the second region 410 is equal to the preset distance.

[0071] Further, the electronic device 210 can determine, based on the adjusted candidate portion 415, a first portion of the picture to be displayed in the second region 410. In this way, embodiments of the present disclosure can further optimize the display of the target object in the remaining picture portion, thereby improving the viewing experience of the user.

[0072] In yet some scenarios, in the case of displaying the target object in the center, the corresponding candidate picture portion can not be able to completely fill the second region. Taking FIG. 5A as an example, in the case of displaying the target object 315 in the vertical center of the second region 510, the candidate portion 515 can not be able to completely fill the second region 510, and for example, cause a blank area 540 to appear.

[0073] In this case, the electronic device 210 may, for example, further adjust the candidate portion 515, such that it can completely fill the second region 510.

[0074] Taking FIG. 5B as an example, the electronic device 210 may, for example, adjust the candidate portion 515 in an opposite direction (e.g., a vertical downward direction) of the preset direction, until the adjusted candidate portion can completely fill the second region 510. Further, the electronic device 210 can determine the adjusted candidate portion 515 as shown in FIG. 5B as the picture portion to be displayed in the second region 510.

[0075] On the contrary, if the candidate portion 515 as shown in FIG. 5A can completely fill the second region 510, the electronic device 210 may, for example, directly determine the candidate portion 515 as the picture portion to be displayed in the second region 510.

[0076] Based on the above discussed manners, embodiments of the present disclosure can perform adaptive adjustment of the picture according to the target object, thereby improving the viewing experience of the user.

[0077] In some embodiments, if the electronic device 210 and / or the server 230 determines that the target object 315 occupies a preset threshold of the frame, the electronic device 210 may, for example, not perform the adaptive adjustment process as discussed above. For example, the electronic device 210 may, for example, control the display of the media content in the second region with reference to the scheme introduced in FIG. IB or FIG. 1C.

[0078] In yet some embodiments, if the electronic device 210 and / or the server 230 determines that the media content does not include a target object of a specific type, the electronic device 210 may, for example, present a second portion of the frame of the media content in the second region in the playback interface such that the first center position of the second region matches the second center position of the frame.

[0079] As shown in FIG. 6A, the interface 600A may, for example, correspond to a playback interface of the media content 610 which may, for example, not include a specific target object. Further, as shown in FIG. 6B, in a case where the target panel 635 is triggered to be displayed in the first region 630, the electronic device 210 may, for example, enable the media content 610 to be displayed centered in the second region 620. For example, the electronic device 210 may, for example, pan the frame of the media content 610 upwards until the center position of the frame aligns with the center position of the second region 620 to determine the portion of the frame 625 to be displayed.

[0080] Thus, in a case where it is determined that the media content does not include a target object, embodiments of the present disclosure can ensure that the center position of the frame is presented in the remaining display region by panning the frame, thereby improving the viewing experience of the user.

[0081] Further, it should be appreciated that although the above examples describe embodiments of the present disclosure in connection with a portrait display, the schemes of the present disclosure can be applicable to other appropriate display modes such as a landscape display.

[0082] In yet some embodiments, for an example where the media content is a live video stream, the server 230 may, for example, determine whether the frame of the media content includes a target object and / or determine at least one display attribute of the target object in response to the target panel being triggered.

[0083] Further, the server 230 may, for example, send the indication of whether the target object is included and / or the determined at least one display attribute to the electronic device 210 for the electronic device 210 to determine the portion of the frame to be displayed in the remaining display region according to the indication of whether the target object is included and / or the determined at least one display attribute.

[0084] In this way, embodiments of the present disclosure can reduce the local computing overhead of the electronic device, further improving the efficiency of frame adjustment.

[0085] In some embodiments, the electronic device 210 can determine the part of the picture to be presented in the second region based on at least one display attribute of the target object determined when the target panel is triggered. In this way, the picture presented in the second region can remain stable during the subsequent playing of the video stream, without changing accordingly due to the change of the display attribute of the target object.

[0086] Example process

[0087] FIG. 7 illustrates a flowchart of an example process 700 for interface interaction, according to some embodiments of the present disclosure. The process 700 can be implemented at the electronic device 210. The process 700 is described below with reference to FIG. 2.

[0088] As shown in FIG. 7, at block 710, the electronic device 210 presents a playing interface of media content. The playing interface displays a picture of the media content.

[0089] At block 720, the electronic device 210 displays a target panel in a first region of the playing interface in response to receiving the indication information.

[0090] At block 730, the electronic device 210 presents a first part of the picture of the media content in a second region of the playing interface if the target object is included in the picture. The first part is determined based on at least one display attribute of the target object in the picture.

[0091] In some embodiments, the at least one display attribute includes position information of the target object in the picture.

[0092] In some embodiments, the position information indicates at least one reference position associated with the target object, and the first part is determined such that the at least one reference position is included in the first part.

[0093] In some embodiments, the at least one display attribute includes a proportion of the target object in the picture, and the process 700 further includes determining the first part of the picture based on a comparison of the proportion with a preset threshold.

[0094] In some embodiments, the at least one display attribute further includes position information of the target object in the picture, and determining the first part of the picture based on a comparison of the display proportion with the preset threshold includes determining the first part of the picture based on the position information if the proportion is less than the preset threshold.

[0095] In some embodiments, the position information indicates a first position of the target object, the first position corresponding to a top portion of the target object in a preset direction of the picture, and determining the first part of the picture based on the position information includes determining the first part based on the first position such that the first position is included in the first part.

[0096] In some embodiments, the preset direction is a direction of arousal of the target panel.

[0097] In some embodiments, the distance from the first position to the upper edge of the second region in the preset direction is greater than or equal to a preset distance.

[0098] In some embodiments, determining the first portion based on the first position comprises: determining a candidate portion of the frame based on the first position and a second position of the target object, such that a difference between a distance from the first position to an upper edge of the second region in the preset direction and a distance from the second position to a lower edge of the second region in the preset direction is less than a threshold, wherein the second position corresponds to a bottom of the target object in the preset direction of the frame; and determining the first portion based on the candidate portion if the distance from the first position to the upper edge of the second region in the preset direction is greater than or equal to the preset distance.

[0099] In some embodiments, determining the first portion based on the candidate portion comprises: determining the candidate portion as the first portion if the candidate portion is able to completely fill the second region; or if the candidate portion is not able to completely fill the second region: adjusting the candidate portion in an opposite direction of the preset direction until an adjusted candidate portion is able to completely fill the second region; and determining the adjusted candidate portion as the first portion.

[0100] In some embodiments, determining the first portion based on the first position further comprises: if the distance from the first position to the upper edge of the second region in the preset direction is less than the preset distance, adjusting the candidate portion in an opposite direction of the preset direction such that the distance from the first position to the upper edge of the second region in the preset direction reaches the preset distance; and determining the first portion based on the adjusted candidate portion.

[0101] In some embodiments, the process 700 further comprises: if the target object is not included in the frame, presenting a second portion of the frame of the media content in the second region in the playback interface such that a first center position of the second portion matches a second center position of the frame.

[0102] In some embodiments, the playback interface is configured to display the frame of the media content in a full screen mode.

[0103] In some embodiments, the media content comprises a live video stream.

[0104] Example apparatus and devices

[0105] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above method or process. FIG. 8 shows a schematic structural block diagram of an apparatus 800 for interface interaction according to certain embodiments of the present disclosure. The apparatus 800 can be implemented as or included in the electronic device 210. Various modules / components in the apparatus 800 can be implemented by hardware, software, firmware, or any combination thereof.

[0106] The apparatus 800 includes an interface presentation module 810 configured to present a play interface of media content, the play interface displaying a frame of the media content. The apparatus 800 also includes a panel display module 820 configured to display a target panel in a first region of the play interface in response to receiving indication information. The apparatus 800 also includes a frame presentation module configured to present a first portion of the frame of the media content in a second region of the play interface if the target object is included in the frame, the first portion being determined based on at least one display attribute of the target object in the frame.

[0107] In some embodiments, the at least one display attribute includes position information of the target object in the frame.

[0108] In some embodiments, the position information indicates at least one reference position associated with the target object, and the first portion is determined such that the at least one reference position is included in the first portion.

[0109] In some embodiments, the at least one display attribute includes a proportion of the target object in the frame, and the apparatus 800 further includes a first frame determination module configured to determine the first portion of the frame based on a comparison of the proportion with a preset threshold.

[0110] In some embodiments, the at least one display attribute further includes position information of the target object in the frame, and the first frame determination module is further configured to determine the first portion of the frame based on the position information if the proportion is less than the preset threshold.

[0111] In some embodiments, the position information indicates a first position of the target object, the first position corresponding to a top portion of the target object in a preset direction of the frame, and the first frame determination module is further configured to determine the first portion based on the first position such that the first position is included in the first portion.

[0112] In some embodiments, the preset direction is a call direction of the target panel.

[0113] In some embodiments, a distance from the first position to an upper edge of the second region in the preset direction is greater than or equal to a preset distance.

[0114] In some embodiments, the first picture determining module is further configured to: determine the candidate portion of the picture based on the first position and the second position of the target object, such that a difference between a distance from the first position to an upper edge of the second region in the preset direction and a distance from the second position to a lower edge of the second region in the preset direction is less than a threshold, wherein the second position corresponds to a bottom of the target object in the preset direction of the picture; and determine the first portion based on the candidate portion if a distance from the first position to the upper edge of the second region in the preset direction is greater than or equal to a preset distance.

[0115] In some embodiments, the first picture determining module is further configured to: determine the candidate portion as the first portion if the candidate portion is able to completely fill the second region; or if the candidate portion is not able to completely fill the second region: adjust the candidate portion in an opposite direction of the preset direction until the adjusted candidate portion is able to completely fill the second region; and determine the adjusted candidate portion as the first portion.

[0116] In some embodiments, the first picture determining module is further configured to: if the distance from the first position to the upper edge of the second region in the preset direction is less than the preset distance, adjust the candidate portion in the opposite direction of the preset direction such that the distance from the first position to the upper edge of the second region in the preset direction reaches the preset distance; and determine the first portion based on the adjusted candidate portion.

[0117] In some embodiments, the apparatus 800 further includes a second picture determining module configured to present a second portion of a picture of the media content in the second region in the playback interface such that a first center position of the second region matches a second center position of the picture if the target object is not included in the picture.

[0118] In some embodiments, the playback interface is configured to display the picture of the media content in a full screen mode.

[0119] In some embodiments, the media content includes a live video stream.

[0120] FIG. 9 illustrates a block diagram of an electronic device 900 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 900 illustrated in FIG. 9 is merely an example and should not be construed to limit the functionality and scope of the embodiments described herein. The electronic device 900 illustrated in FIG. 9 can be used to implement the electronic device 210 of FIG. 2.

[0121] As shown in FIG. 9, electronic device 900 is in the form of a general-purpose electronic device. Components of electronic device 900 can include, but are not limited to, one or more processors or processing units 910, memory 920, storage 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. Processing unit(s) 910 can be actual or virtual processors and capable of executing various processing in accordance with programs stored in memory 920. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 900.

[0122] Electronic device 900 typically includes a plurality of computer storage media. Such media can be removable and / or non-removable, and can include volatile and / or nonvolatile media. Memory 920 can be volatile (such as, for example, registers, cache, random access memory (RAM)), non-volatile (such as, for example, read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage 930 can be removable or non-removable and can include machine-readable media, such as, for example, flash drives, disks, or any other media capable of storing information and / or data (e.g., training data for training) and accessible by electronic device 900.

[0123] Electronic device 900 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 9, a disk drive or other computer-readable media drive can be provided for reading from or writing to a removable, non-removable, volatile, or non-volatile media slot (e.g., a “floppy disk”). In such cases, each drive can be connected to the bus (not shown) by one or more data media interfaces. Memory 920 can include a computer program product 925 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0124] Communication unit(s) 940 enable communication with other electronic devices via communication media. Additionally, functionality of components of electronic device 900 can be implemented in a single computing cluster or a plurality of computer machines capable of communicating over a communication connection. As such, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes in a distributed computing environment.

[0125] The input device 950 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 960 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 900 can also communicate with one or more external devices (not shown), such as a storage device, a display device, etc., one or more devices that enable a user to interact with the electronic device 900, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 900 to communicate with one or more other electronic devices, as desired via the communication unit 940. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0126] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.

[0127] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0128] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0129] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0130] The computer program product of the present disclosure can be a computer program product, which is a machine-readable medium (media) having instances of the software embodied thereon, such as computer software, firmware, wireless application protocol (WAP), middleware or microcode. For example, a computer program product can be a floppy disk, a CD-ROM, a DVD, a Blu-ray Disc™, a flash drive, a memory stick, a magnetic tape, or a hard disk drive. The machine-readable medium can be a single medium, or multiple media, of the same or different type. The computer program product can be one or more computer program components embodied in medium and / or transmission signals. The computer program product can have one or more computer program components embodied in medium and / or transmission signals.

[0131] The implementations of the disclosure have been described above with the intent to be illustrative rather than limiting. Although the implementations of the disclosure have been described with regard to one or more implementations, it will be recognized that a variety of modifications and changes can be made to these implementations without departing from the broader spirit and scope of the implementations as set forth in the preceding disclosure. For example, certain aspects of the implementations can be performed using hardware, software, and / or firmware, or any combination thereof. The above-described implementations should therefore be regarded as merely illustrative, and not as narrowing the scope of the disclosure, which is defined by the appended claims and their equivalents.

Claims

1. A method for interface interaction, comprising: presenting a play interface of media content, the play interface displaying a frame of the media content; in response to receiving an indication information, displaying a target panel in a first region of the play interface; and the frame including a target object, presenting a first portion of the frame of the media content in a second region of the play interface, the first portion being determined based on at least one display attribute of the target object in the frame.

2. The method of claim 1, wherein the at least one display attribute includes position information of the target object in the frame.

3. The method of claim 2, wherein the position information indicates at least one reference position associated with the target object, and the first portion is determined such that the at least one reference position is included in the first portion.

4. The method of claim 1, wherein the at least one display attribute includes a size ratio of the target object in the frame, the method further comprising: determining the first portion of the frame based on a comparison of the size ratio with a preset threshold.

5. The method of claim 4, wherein the at least one display attribute further includes position information of the target object in the frame, and determining the first portion of the frame based on a comparison of the display ratio with a preset threshold comprises: in response to the size ratio being less than the preset threshold, determining the first portion of the frame based on the position information.

6. The method of claim 5, wherein the position information indicates a first position of the target object, the first position corresponding to a top portion of the target object in a preset direction of the frame, and determining the first portion of the frame based on the position information comprises: determining the first portion based on the first position such that the first position is included in the first portion.

7. The method of claim 5, wherein the preset direction is a wake-up direction of the target panel.

8. The method of claim 5, wherein a distance from the first position to an upper edge of the second region in the preset direction is greater than or equal to a preset distance.

9. The method of claim 8, wherein determining the first portion based on the first position comprises: determining a candidate portion of the frame based on the first position and a second position of the target object such that a difference between a distance from the first position to an upper edge of the second region in the preset direction and a distance from the second position to a lower edge of the second region in the preset direction is less than a threshold, wherein the second position corresponds to a bottom portion of the target object in the preset direction of the frame; and in response to the distance from the first position to the upper edge of the second region in the preset direction being greater than or equal to the preset distance, determining the first portion based on the candidate portion.

10. The method of claim 9, wherein determining the first portion based on the candidate portion comprises: ​ ​ in response to the candidate portion being able to completely fill the second region, determining the candidate portion as the first portion; or in response to the candidate portion being unable to completely fill the second region: adjusting the candidate portion in an opposite direction of the preset direction until the adjusted candidate portion is able to completely fill the second region; and determining the adjusted candidate portion as the first portion. 11.The method of claim 9, wherein determining the first portion based on the first position further comprises: in response to a distance from the first position to an upper edge of the second region in the preset direction being less than the preset distance, adjusting the candidate portion in an opposite direction of the preset direction so that the distance from the first position to the upper edge of the second region in the preset direction reaches the preset distance; and determining the first portion based on the adjusted candidate portion. 12.The method of claim 1, further comprising: in response to the target object not being included in the frame, presenting a second portion of the frame of the media content in a second region in the playback interface so that a first center position of the second region matches a second center position of the frame. 13.The method of claim 1, wherein the playback interface is configured to display the frame of the media content in a full screen mode. 14.The method of claim 1, wherein the media content comprises a live video stream. 15.An apparatus for interface interaction, comprising: an interface presentation module configured to present a playback interface of a media content, the playback interface displaying a frame of the media content; a panel display module configured to display a target panel in a first region of the playback interface in response to receiving indication information; and a frame presentation module configured to present a first portion of the frame of the media content in a second region of the playback interface in response to a target object being included in the frame, the first portion being determined based on at least one display attribute of the target object in the frame. 16.An electronic device, comprising: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions when executed by the at least one processing unit causing the electronic device to perform the method according to any one of claims 1-14. 17.A computer-readable storage medium having stored thereon a computer program, the computer program being executable by a processor to implement the method according to any one of claims 1-14. ​ ​ ​ ​

Images