Methods, apparatus, devices, and storage media for interface interaction

Abstract

Embodiments of the present disclosure relate to methods, apparatus, devices, and storage media for interface interaction. The method involves presenting a playback interface for media content, the playback interface displaying a screen of the media content, displaying a target panel in a first area of ​​the playback interface in response to receiving instruction information, and presenting a first portion of the screen of the media content in a second area of ​​the playback interface in response to the screen containing a target object, the first portion being determined based on at least one display attribute of the target object on the screen. According to the method, when a panel is displayed, embodiments of the present disclosure can adaptively adjust the display of the screen according to the display attributes of the target object on the screen, thereby improving the user experience.

Description

Technical Field

[0004]

[0001] (Cross - reference to related applications) This application claims the priority of a Chinese invention patent application with application number 202311056088.4 and title "Method, Apparatus, Device and Storage Medium for Interface Interaction", which was filed on August 21, 2023. The entire content of the said application is incorporated herein by reference.

[0002] (Field of the Invention) Embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, apparatuses, devices, and computer - readable storage media for interface interaction.

Background Art

[0003] With the development of computer technology, the Internet has become an important source for obtaining various contents. Live - streaming technology for content distribution using the Internet and streaming media technology is booming, and by integrating rich elements such as images, texts, and sounds, it is becoming the mainstream way of expression on the Internet.

Summary of the Invention

[0004] In a first aspect of the present disclosure, a method for interface interaction is provided. The method includes presenting a playback interface of media content, where a screen of the media content is displayed on the playback interface; in response to receiving instruction information, displaying a target panel in a first area of the playback interface; and in response to the screen including a target object, presenting a first part of the screen of the media content in a second area in the playback interface, where the first part is determined based on at least one display attribute of the target object on the screen.

[0005] A second aspect of this disclosure provides an interface interaction device, the device comprising an interface presentation module configured to present a playback interface for media content, the interface presentation module on which a screen of media content is displayed on the playback interface, a panel display module configured to display a target panel in a first area of ​​the playback interface in response to receiving instruction information, and a screen presentation module configured to present a first portion of the screen of media content in a second area of ​​the playback interface in response to the screen containing a target object, the first portion being determined based on at least one display attribute on the screen of the target object.

[0006] A third aspect of this disclosure provides an electronic device comprising at least one processing unit and at least one memory coupled to the at least one processing unit and storing instructions that are executed by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device causes the device to perform the method described in the first aspect.

[0007] A fourth aspect of this disclosure provides a computer-readable storage medium which stores a computer program that, when executed on a processor, implements the method described in the first aspect.

[0008] It should be understood that the information described in the summary of the invention is not intended to limit the main or important features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will be readily apparent from the following description. [Brief explanation of the drawing]

[0009] The aforementioned and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent upon reference to the accompanying drawings and the following detailed description. In the accompanying drawings, identical or similar attached marks represent identical or similar elements.

[0010] [Figure 1] Figures 1A to 1C show examples of interfaces using a conventional screen adjustment method. [Figure 2] This is a schematic diagram showing an example of an environment in which the embodiments of this disclosure can be implemented. [Figure 3] Figures 3A and 3B are exemplary interfaces according to several embodiments of the present disclosure. [Figure 4] Figures 4A and 4B are exemplary interfaces according to several embodiments of the present disclosure. [Figure 5] Figures 5A and 5B are exemplary interfaces according to some embodiments of the present disclosure. [Figure 6] Figures 6A and 6B are exemplary interfaces according to several embodiments of the present disclosure. [Figure 7] This flowchart shows examples of interface interaction processes according to some embodiments of the present disclosure. [Figure 8] This is an exemplary structural block diagram of an apparatus for interface interaction according to several embodiments of the present disclosure. [Figure 9] This is a block diagram of an electronic device capable of carrying out multiple embodiments of the present disclosure. [Modes for carrying out the invention]

[0011] Embodiments of this disclosure will be described in more detail below with reference to the accompanying drawings. While specific embodiments of this disclosure are illustrated in the accompanying drawings, this disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein. Rather, these embodiments should be understood as being provided for the purpose of providing a more thorough and complete understanding of this disclosure. The accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0012] Please note that the section / subsection headings provided in this book are not limiting. Various embodiments are described throughout this book, and any type of embodiment may be included in any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with other embodiments described in the same section / subsection and / or different sections / subsections.

[0013] In the description of embodiments of this disclosure, the terms “including” and “embodiments” are understood to have an open-ended inclusion, i.e., “including, but not limited to.” The term “based on” is understood to mean “based at least in part.” The terms “one embodiment” or “the embodiment” should be understood to mean “at least one embodiment.” The terms “several embodiments” should be understood to mean “at least several embodiments.” Other explicit and implicit definitions may be found below. Terms such as “first,” “second,” etc., may refer to different or identical objects. Other explicit and implicit definitions may be found below.

[0014] Embodiments of this disclosure may involve user data, data acquisition, and / or data use. These aspects are governed by applicable laws, regulations, and relevant provisions. In embodiments of this disclosure, all data collection, acquisition, processing, transfer, and use are performed with the user's knowledge and consent. Therefore, in implementing each embodiment of this disclosure, the user shall be notified of the types of data or information that may be involved, the scope of use, and the usage scenarios, in accordance with applicable laws and regulations, and the user's consent shall be obtained by appropriate means. The specific manner of notification and / or authorization may vary depending on the actual circumstances and applicable scenarios, and the scope of this disclosure is not limited in this respect.

[0015] If the solutions in these specifications and embodiments involve the processing of personal information, the processing will be carried out only within the specified or agreed-upon scope, based on lawfulness (such as when the data subject has given consent or when necessary for the performance of a contract). Even if a user refuses the processing of personal information other than that necessary for the basic functions, this will not affect their use of the basic functions.

[0016] As described above, people can use electronic devices to obtain various types of media content. Such media content may include, for example, images, videos, and live streaming content.

[0017] Figure 1A shows an exemplary interface 100A for retrieving media content. Interface 100A may be used, for example, to display a screen of media content 110. Depending on the circumstances, the user may trigger the display of panel 120 through a specific interaction within interface 100A.

[0018] When the panel 120 is triggered and displayed, the area for displaying the media content 110 becomes smaller accordingly. As shown in FIG. 1B, according to some conventional solutions, such a panel 120 may directly cover the screen of the media content 110, which may block the object 115 in the media content 110 that is noticed by the user, thereby affecting the user's viewing experience.

[0019] According to some conventional solutions, as shown in FIG. 1C, the screen of the media content 110 moves parallel accordingly together with the trigger of the panel 120. For example, the screen of the media content 110 moves parallel upward accordingly. However, this may cause the object 115 noticed by the user to move parallel from the screen, thereby affecting the user's viewing experience.

[0020] Therefore, the embodiments of the present disclosure propose a solution for interface interaction. According to this solution, a playback interface for media content can be presented. Such a playback interface displays the screen of the media content. Further, in response to receiving the instruction information, a target panel is displayed in the first area of the playback interface. When the screen includes a target object, the first part of the screen of the media content is presented in the second area of the playback interface, where the first part is determined based on at least one display attribute of the target object on the screen.

[0021] By such a method, when the panel is triggered and displayed, the embodiments of the present disclosure can improve the user experience by adaptively adjusting the display of the screen based on the display attributes of the target object in the screen.

[0022] Hereinafter, various examples of the implementation of this solution will be described in detail in further connection with the accompanying drawings.

[0023] Environmental Example Figure 2 is a schematic diagram showing an example of an environment 200 in which embodiments of the present disclosure can be implemented. As shown in Figure 2, the example environment 200 may include electronic equipment 210.

[0024] In this example environment 200, an application 220 for providing and viewing media content may be running on the electronic device 210. The application 220 may be any suitable type of application for providing and viewing media content, including, but not limited to, online video applications and live streaming applications. Users 240 can interact with the application 220 via the electronic device 210 and / or its accessories. Users 240 may be, for example, a user providing live streaming content (also called a streamer) or a user viewing live streaming (also called a viewer user).

[0025] In the environment 200 of Figure 2, if application 220 is active, the electronic device 210 can present the live streaming interface 250 through application 220.

[0026] In some embodiments, the electronic device 210 communicates with the server 230 to enable the provision of services to the application 220. The electronic device 210 may be any type of mobile, fixed, or portable device, including mobile phones, desktop computers, laptops, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, PDAs, portable game terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, location-based devices, television receivers, radio receivers, e-book readers, and other electronic devices. This includes personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, location-based devices, television receivers, radio receivers, e-book readers, game terminals, or combinations thereof, and accessories and peripherals for these devices or combinations thereof. In some embodiments, the electronic device 210 may also support any type of user-specific interface (such as a “wearable” circuit).

[0027] Server 230 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks, big data, and artificial intelligence platforms. Server 230 may include computing systems / servers such as mainframes, edge computing nodes, and computing devices in a cloud environment. Server 230 can provide backend services for applications 220 that support virtual scenarios of electronic devices 210.

[0028] A communication connection can be established between the server 230 and the electronic device 210. The communication connection can be established by wired or wireless means. The communication connection may include, but is not limited to, Bluetooth® connection, mobile network connection, USB (Universal Serial Bus) connection, WiFi (Wireless Fidelity) connection, etc., and the embodiments of this disclosure are not limited in this respect. In embodiments of this disclosure, the server 230 and the electronic device 210 can realize signaling interaction through the communication connection between them.

[0029] The structure and function of the various elements of Environment 200 are described for illustrative purposes only and should not be considered as limiting the scope of this disclosure.

[0030] Hereinafter, several embodiments of this disclosure will be described with reference to the attached drawings.

[0031] Exemplary Interface The following describes some exemplary embodiments of this disclosure with reference to the attached drawings. Figure 3A shows a media content playback interface 300A according to some embodiments of this disclosure, which may be provided, for example, by an electronic device 210.

[0032] As shown in Figure 3A, the playback interface 300A may be used to play media content 310 and display the screen of media content 310. In some embodiments, such media content 310 may include any suitable media content having corresponding visual content (i.e., a screen), such as image content, video content, etc. Exemplarily, the playback interface 300A may be configured to display the screen of media content 310 in full-screen mode. In another example, the terminal device 210 may display the screen of media content 310 in non-full-screen mode.

[0033] In some embodiments, such media content 310 may be a live streaming video stream. Accordingly, the playback interface 300A may be, for example, a live streaming page of a live streaming room.

[0034] In some embodiments, the electronic device 210 can respond to receiving instruction information by triggering a display on the playback interface of the target panel.

[0035] In some embodiments, such instruction information may be generated based on a preset operation of user 240. For example, user 240 may trigger the display of an input panel by clicking an input control, or user 240 may trigger the display of a gift panel by clicking a gift control.

[0036] In some further embodiments, such instruction information may be generated by an electronic device 210 or a server 230. For example, in a live streaming scene, if user 240 is a viewer user, the electronic device 210 can receive instruction information generated by, for example, server 230 based on a specific operation of the streamer and trigger the display of a corresponding panel accordingly.

[0037] As shown in Figure 3B, the electronic device 210 can display a panel 345 in the first area 340 in response to receiving instruction information. Such a panel 345 may include any suitable type of panel, and this disclosure is not intended to limit it.

[0038] In some embodiments, if the screen of the media content 310 includes a target object of a particular type, the electronic device 210 can determine the screen portion 325 (also called the first portion) in the second area 320 of the interface 300B based on at least one display attribute of the target object on this screen.

[0039] In some embodiments, the electronic device 210 and / or server 230 can determine whether the screen of the media content 310 contains a particular type of target object. Such target objects may include appropriate objects such as streamer objects, product objects, etc. In some examples, such target objects may be preset objects or may be configured by the relevant user (e.g., streamer) of the media content 310.

[0040] Taking Figure 3B as an example, the screen of media content 310 may include, for example, a target object 315. Furthermore, the electronic device 210 and / or server 230 can determine at least one display attribute on the screen of the target object 315 and determine a portion of the screens 325 to be displayed on interface 300B based on this at least one display attribute.

[0041] In some embodiments, at least one display attribute of the target object 315 may include positional information of the target object 315 on the screen. Such positional information may include, for example, the position of a hedge on the screen for describing the target object 315 (which may be represented by a curved axis or a number of hedge position points), the center position of the target object 315 on the screen, or the positions of one or more key points associated with the target object 315.

[0042] Furthermore, the electronic device 210 can determine a portion of the screen 325 based on positional information such that at least one reference position associated with the target object 315 is included in the screen portion 325. Such at least one reference position may include, for example, any suitable position associated with the target object 315, such as one or more key points associated with the target object 315, one or more hedge position points associated with the target object 315, or the screen center point of the target object 315. In this way, embodiments of the present disclosure can improve the user's viewing experience by ensuring that a significant portion of the target object can be exposed on the adjusted screen.

[0043] Taking Figure 3B as an example, the electronic device 210 can determine the screen portion 325 based on a reference position associated with the target object (e.g., the first position 330) such that the first position 330 is included in the screen portion 325. The first position 330 corresponds, for example, to the top of the screen of the target object 315 in a preset direction.

[0044] In some embodiments, at least one display attribute of the target object 315 includes a percentage of the media content 310 screen of the target object 315. Exemplaryly, the electronic device 210 and / or server 230 can determine the percentage of the target object 315 on the screen by determining its display size based on the area of ​​the target object 315 (e.g., by detection against a bounding box) and determining the ratio to the screen size. Furthermore, the electronic device 210 can determine a portion of the screen 325 based on a comparison of this percentage with a preset threshold.

[0045] In some embodiments, if the proportion of the target object 315 on the screen is smaller than this preset threshold, the electronic device 210 can determine a portion of the screen 325 based on the positional information of the target object 315 on the screen. It should be understood that such a preset threshold may be a fixed threshold, a dynamically variable threshold based on the screen size of the media content 310, or a preset threshold configured by the user concerned.

[0046] In some examples, such positional information can indicate a first position 330 on the screen of the target object 315. The first position 330 corresponds, for example, to the top of the target object 315 in the preset direction on the screen.

[0047] In some embodiments, this preset direction can correspond to the audible direction of panel 345. Taking Figure 3B as an example, this preset direction is vertically upward, and the first position 330 may be the top position vertically above the target object 315.

[0048] Furthermore, the electronic device 210 can determine a portion of the screens 325 to be displayed in the second region 320 based on the first position 330, such that the first position 330 is included in a portion of the screens 325.

[0049] This allows the user's viewing experience to be improved by ensuring, as much as possible, that the target object can be displayed relatively completely on some of the screens, as is possible in the embodiments of this disclosure.

[0050] Considering that it is generally necessary to reserve a certain control area at the top of several interfaces, in some scenes, the electronic device 210 can further make the distance from the first position 330 to the top edge 335 in the preset direction of the second area 320 greater than or equal to the preset distance. Taking Figure 3B as an example, the electronic device 210 can ensure, for example, that there is always at least a preset distance (e.g., distance d) from the top position of the target object 315 (i.e., the first position 330) to the top of the second area 320. This can improve the user's viewing experience by further avoiding the target object 315 being obstructed by other controls, as demonstrated in embodiments of this disclosure. In some further embodiments, the electronic device 210 can, for example, display the target object 315 as centrally as possible within the second area.

[0051] As shown in Figure 4A, the electronic device 210 and / or server 230 can determine a first position 430 and a second position 435 of the target object 315. The first position 430 may correspond, for example, to the top of the target object 315 in the preset screen orientation, and the second position 435 may correspond to the bottom of the target object 315 in the preset screen orientation.

[0052] Furthermore, the electronic device 210 determines a candidate portion 415 of the screen based on the first position 430 and the second position 435 of the target object 315, thereby making the difference between the distance from the first position 430 to the upper edge of the second region 410 in the preset direction and the distance from the second position 435 to the lower edge of the second region 410 in the preset direction smaller than a threshold.

[0053] For example, the electronic device 210 can display the target object 315 in the second region 410 approximately vertically in the center. That is, the electronic device 210 makes the distance from its top position (i.e., the first position 430) to the upper edge of the second region 410 equal to the distance from its bottom position (i.e., the second position 435) to the lower edge of the second region 410.

[0054] In some embodiments, the electronic device 210 can directly determine this candidate portion 415 as a part of the screen presented in the second region 410.

[0055] As a result, in the embodiments of this disclosure, the user's viewing experience can be improved by making it easier for the user to view the target object through some of the displayed screens.

[0056] In some embodiments, when the target object 315 is displayed in the center, its top position may be too close to or beyond the upper edge of the second region. As a result, if the distance from the first position 410 to the upper edge of the second region 410 in the preset direction is greater than or equal to the preset distance, the electronic device 210 can determine the first portion of the screen based on the candidate portion 415. For example, the electronic device 210 can determine this candidate portion 415 as the portion of the screen to be displayed in the second region 410.

[0057] Conversely, if the distance from the first position 410 to the upper edge of the second region 410 in the preset direction is less than the preset distance, the electronic device 210 can further adjust the candidate portion 415. Taking Figure 4A as an example, when displayed in the center, the distance from the first position 430 of the target object 315 to the upper edge of the second region 410 is less than the preset distance (e.g., distance d).

[0058] Furthermore, as shown in Figure 4B, the electronic device 210 can adjust the candidate portion 415 along a direction opposite to the preset direction (e.g., vertically downward) so that the distance from the first position 430 to the upper edge of the second region 410 in the preset direction reaches the preset distance (e.g., distance d). Using Figure 4B as an example, the electronic device 210 can adjust the candidate portion 415 downward so that the distance from the top position of the target object 315 (i.e., the first position 430) to the upper edge of the second region 410 is equal to this preset distance.

[0059] Furthermore, the electronic device 210 can determine the first portion of the screen to be displayed in the second region 410 based on the adjusted candidate portion 415. This allows for an improved user viewing experience by further optimizing the display of the target object in the remaining portion of the screen, as demonstrated in embodiments of the present disclosure.

[0060] In several other scenarios, when the target object is displayed in the center, the corresponding candidate screen portion may not be able to completely fill the second area. For example, in Figure 5A, when the target object 315 is displayed vertically in the center of the second area 510, this candidate portion 515 may not be able to completely fill the second area 510, resulting in, for example, a blank area 540.

[0061] In this case, the electronic device 210 can further adjust the candidate portion 515 so that, for example, the second region 510 can be completely filled.

[0062] Taking Figure 5B as an example, the electronic device 210 can adjust the candidate portion 515 along a direction opposite to the preset direction (for example, vertically downward) until the adjusted candidate portion can completely fill the second region 510. Furthermore, the electronic device 210 can determine the adjusted candidate portion 515 shown in Figure 5B as the screen portion to be displayed in the second region 510.

[0063] Conversely, if the candidate portion 515 shown in Figure 5A can completely fill the second region 510, the electronic device 210 can, for example, directly determine the candidate portion 515 as the screen portion to be displayed in the second region 510.

[0064] Based on the method described above, the embodiments of this disclosure can improve the user's viewing experience by performing adaptive adjustments to the screen based on a target object.

[0065] In some embodiments, if the electronic device 210 and / or server 230 determine that the proportion of the target object 315 on the screen has reached a preset threshold, the electronic device 210 may not perform, for example, the adaptive adjustment process described above. For example, the electronic device 210 may control the display of the second area of ​​the media content by referring to the scheme introduced in Figure 1B or Figure 1C.

[0066] In some further embodiments, if the electronic device 210 and / or server 230 determines that the media content does not contain a particular type of target object, the electronic device 210 may present a second portion of the screen of the media content in a second area of ​​the playback interface so that the first center position of the second area coincides with the second center position of the screen.

[0067] As shown in Figure 6, interface 600A can correspond to a playback interface for media content 610, which does not necessarily have to include a specific target object. Furthermore, as shown in Figure 6B, when the target panel 635 is triggered and displayed in the first area 630, the electronic device 210 can center the media content 610 in the second area 620. For example, the electronic device 210 can translate the screen of the media content 610 upwards and determine the portion of the screen 625 to be displayed so that the center position of this screen is flush with the center position of the second area 620.

[0068] This allows for an improved user viewing experience in embodiments of the present disclosure by ensuring that the center of the screen is presented in the remaining display area by translating the screen if it is determined that the media content does not contain a target object.

[0069] It should be understood that while the above examples describe embodiments of this disclosure in conjunction with portrait mode display, the solutions of this disclosure can be applied to other appropriate display modes, such as landscape mode display.

[0070] In some further embodiments, for example, where the media content is a live streaming video stream, the server 230 can be invoked in response to a target panel and determine whether the screen of the media content contains a target object and / or determine at least one display attribute of the target object.

[0071] Furthermore, the server 230 transmits relevant instructions regarding whether or not the target object is included and / or at least one determined display attribute to the electronic device 210, which can then determine the screen portion to be displayed in the remaining display area based on the instructions regarding whether or not the target object is included and / or at least one determined display attribute.

[0072] Thus, the embodiments of this disclosure can reduce the local computation overhead of electronic devices and further improve the efficiency of screen adjustment.

[0073] In some embodiments, the electronic device 210 can determine the portion of the screen to be presented in the second area based on at least one display attribute of the target object determined when the target panel is triggered. This ensures that the screen presented in the second area remains stable throughout the subsequent playback of the video stream, without being altered by changes in the display attributes of the target object.

[0074] Process example Figure 7 is a flowchart illustrating exemplary process 700 for interface interaction according to some embodiments of the present disclosure. Process 700 can be carried out in electronic device 210. Process 700 will be described with reference to Figure 2.

[0075] As shown in Figure 7, in block 710, the electronic device 210 presents a media content playback interface. The media content screen is displayed on the playback interface.

[0076] In block 720, the electronic device 210 responds to receiving instruction information by displaying the target panel in the first area of ​​the playback interface.

[0077] In block 730, if the screen contains a target object, the electronic device 210 presents a first portion of the screen containing the media content in a second area of ​​the playback interface. The first portion is determined based on at least one display attribute of the target object on the screen.

[0078] In some embodiments, at least one display attribute includes the screen position information of the target object.

[0079] In some embodiments, the position information indicates at least one reference location associated with the target object, and the first portion is determined such that at least one reference location is included in the first portion.

[0080] In some embodiments, at least one display attribute includes a percentage of a target object on the screen, and the program 700 further includes determining a first portion of the screen based on a comparison of the percentage with a preset threshold.

[0081] In some embodiments, at least one display attribute further includes location information of a target object on the screen, and determining a first portion of the screen based on a comparison of the display ratio with a preset threshold includes determining a first portion of the screen based on the location information in response to the ratio being smaller than the preset threshold.

[0082] In some embodiments, the position information indicates a first position of a target object, the first position corresponds to the top of the target object in a preset orientation of the screen, and determining a first portion of the screen based on the position information includes determining a first portion based on the first position such that the first position is included in the first portion.

[0083] In some embodiments, the preset direction is the arousal direction relative to the target panel.

[0084] In some embodiments, the distance from the first position to the upper edge in the preset direction of the second region is greater than or equal to the preset distance. In some embodiments, determining a first portion based on a first position includes determining a candidate portion of the screen based on a first position and a second position of the target object, such that the difference between the distance from the first position to the top edge of the second region in a preset direction and the distance from the second position to the bottom edge of the second region in a preset direction is less than a threshold, wherein the second position corresponds to the bottom of the target object in a preset direction of the screen, and determining the first portion based on the candidate portion in response to the distance from the first position to the top edge of the second region in a preset direction being greater than or equal to a preset distance.

[0085] In some embodiments, determining a first part based on a candidate part includes determining the candidate part as the first part in response that the candidate part can completely fill a second area, or, in response that the candidate part cannot completely fill a second area, adjusting the candidate part along the direction opposite to the preset direction until the adjusted candidate part can completely fill a second area, and determining the adjusted candidate part as the first part.

[0086] In some embodiments, determining a first portion based on a first position further includes, in response to the distance from the first position to the top edge of the second region in the preset direction being less than a preset distance, adjusting the candidate portion along the direction opposite to the preset direction so that the distance from the first position to the top edge of the second region in the preset direction reaches the preset distance, and determining the first portion based on the adjusted candidate portion.

[0087] In some embodiments, the process 700, in response to the screen not containing a target object, further includes presenting a second portion of the screen of media content in a second area of ​​the playback interface, such that the first center position of the second area coincides with the second center position of the screen.

[0088] In some embodiments, the playback interface is configured to display the media content screen in full-screen mode.

[0089] In some embodiments, the media content includes a live streaming video stream.

[0090] Exemplary devices and equipment Embodiments of this disclosure also provide corresponding apparatus for implementing the above methods or processes. Figure 8 is an exemplary structural block diagram of an interface interaction apparatus 800 according to some embodiments of this disclosure. The apparatus 800 may be implemented as a power device 210 or included as part thereof. Each module / component of the apparatus 800 may be implemented by hardware, software, firmware, or any combination thereof.

[0091] The device 800 includes an interface presentation module 810 configured to present a playback interface for media content, and the playback interface displays a screen of the media content. The device 800 further includes a panel display module 820 configured to display a target panel in a first area of ​​the playback interface in response to receiving instruction information. The device 800 further includes a screen presentation module configured to present a first portion of the screen of the media content in a second area of ​​the playback interface in response to the screen containing a target object, the first portion being determined based on at least one display attribute of the target object on the screen.

[0092] In some embodiments, at least one display attribute includes the screen position information of the target object.

[0093] In some embodiments, the position information indicates at least one reference location associated with the target object, and the first portion is determined such that at least one reference location is included in the first portion.

[0094] In some embodiments, at least one display attribute includes a percentage of a target object on the screen, and the device 800 further includes a first screen determination module configured to determine a first portion of the screen based on a comparison of the percentage with a preset threshold.

[0095] In some embodiments, at least one display attribute further includes location information of a target object on the screen, and the first screen determination module is further configured to determine a first portion of the screen based on the location information in response to a percentage being less than a preset threshold.

[0096] In some embodiments, the position information indicates a first position of a target object, the first position corresponding to the top of the target object in a preset screen orientation, and the first screen determination module is further configured to determine a first portion based on the first position such that the first position is included in the first portion.

[0097] In some embodiments, the preset direction is the arousal direction relative to the target panel.

[0098] In some embodiments, the distance from the first position to the upper edge in the preset direction of the second region is greater than or equal to the preset distance.

[0099] In some embodiments, the first screen determination module determines a candidate portion of the screen based on a first and second position of a target object, by making the difference between the distance from the first position to the top edge of the second region in a preset direction and the distance from the second position to the bottom edge of the second region in a preset direction less than a threshold, wherein the second position corresponds to the bottom of the target object in a preset direction of the screen, and in response to the distance from the first position to the top edge of the second region in a preset direction being greater than or equal to a preset distance, it determines the first portion based on the candidate portion.

[0100] In some embodiments, the first screen determination module is further configured to determine a candidate portion as the first portion in response to the candidate portion being able to completely fill the second region, or, in response to the candidate portion not being able to completely fill the second region, to adjust the candidate portion along the direction opposite to the preset direction until the adjusted candidate portion is able to completely fill the second region, and then determine the adjusted candidate portion as the first portion.

[0101] In some embodiments, the first screen determination module is further configured to respond to the distance from the first position to the top edge of the second region in the preset direction being less than the preset distance by adjusting the candidate portion along the direction opposite to the preset direction so that the distance from the first position to the top edge of the second region in the preset direction reaches the preset distance, and to determine the first portion based on the adjusted candidate portion.

[0102] In some embodiments, the device 800 includes a second screen determination module configured such that, in response to the screen not containing a target object, it presents a second portion of the screen of media content in a second region of the playback interface, so that the first center position of the second region coincides with the second center position of the screen.

[0103] In some embodiments, the playback interface is configured to display the media content screen in full-screen mode.

[0104] In some embodiments, the media content includes a live streaming video stream.

[0105] Figure 9 shows a block diagram of an electronic device 900 that can carry out one or more embodiments of the present disclosure. It should be understood that the electronic device 900 shown in Figure 9 is merely an example and does not limit the functionality and scope of the embodiments described herein. The electronic device 900 shown in Figure 9 can be used to realize the electronic device 210 shown in Figure 2.

[0106] As shown in Figure 9, the electronic device 900 is in the form of a general-purpose electronic device. The components of the electronic device 900 may include, but are not limited to, one or more processors or processing units 910, memory 920, storage devices 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. The processing unit 910 may be an actual or virtual processor and can perform various processes based on a program stored in memory 920. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 900.

[0107] The electronic device 900 generally includes multiple computer storage media. Such media may be any obtainable media accessible to the electronic device 900, and may include, but are not limited to, volatile and non-volatile media, and removable and non-removable media. Memory 920 may be volatile memory (e.g., registers, fast cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 930 may be removable or non-removable media, and may include instrument-readable media, such as flash memory drives, magnetic disks, or any other media, which can be used to store information and / or data (e.g., training data for training) and can be accessed within the electronic device 900.

[0108] The electronic device 900 may further include other removable / non-removable, volatile / non-volatile storage media. Not shown in Figure 9, a magnetic disk drive for reading from or writing to removable, non-volatile magnetic disks (e.g., “floppy disks”) and a disk drive for reading from or writing to removable, non-volatile disks may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data medium interfaces. The memory 920 may also include a computer program product 925 having one or more program modules, which are configured to perform various methods or operations of various embodiments of the present disclosure.

[0109] The communication unit 940 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 900 can be implemented by a single computing cluster or multiple computing devices, which can communicate via a communication connection. Therefore, the electronic device 500 can operate in a network environment using logical connections with one or more other servers, network personal computers (PCs), or other network nodes.

[0110] The input device 950 may be one or more input devices, such as a mouse, keyboard, or trackball. The output device 960 may be one or more output devices, such as a display, speaker, or printer. The electronic device 900 may further communicate with one or more external devices (not shown), such as storage devices or display devices, via the communication unit 940 as needed, communicate with one or more devices for user-to-electronic device 900 interaction, or communicate with any device (e.g., a network card or modem) for communication between the electronic device 900 and one or more other electronic devices. Such communication may be performed via an input / output (I / O) interface (not shown).

[0111] An exemplary embodiment of the present disclosure provides a computer-readable storage medium in which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to realize the method described above. An exemplary embodiment of the present disclosure further provides a computer program product, which is tangibly stored in a non-transient computer-readable medium and includes computer-executable instructions, wherein the computer-executable instructions are executed by a processor to realize the method described above.

[0112] Aspects of this disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatus, devices, and computer program products implemented in accordance with this disclosure. It should be understood that every block in a flowchart and / or block diagram, and every combination of blocks in a flowchart and / or block diagram, can be implemented by computer-readable program instructions.

[0113] These computer-readable program instructions are provided to a processing unit of a general-purpose computer, a computer for specific purposes, or other programmable data processing device to create a device that, when executed by the processing unit of the computer or other programmable data processing device, produces a device that performs one or more functions / operations defined in a flowchart and / or block diagram. These computer-readable program instructions may be stored in a computer-readable storage medium, and by operating the computer, programmable data processing device, and / or other device in a specific manner, the computer-readable medium on which the instructions are stored includes a product containing instructions in each mode that perform one or more functions / operations defined in a flowchart and / or block diagram.

[0114] By loading computer-readable program instructions into a computer, other programmable data processing device, or other device, and by executing a series of operational steps on the computer, other programmable data processing device, or other device, the instructions executed on the computer, other programmable data processing device, or other device can realize the functions / operations defined in one or more blocks in a flowchart and / or block diagram.

[0115] The flowcharts and block diagrams in the drawings illustrate the implementable system architectures, functions, and operations of the systems, methods, and computer program products of the multiple implementations of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of an instruction, and a module, program segment, or part of an instruction may contain one or more executable instructions for implementing a defined logical function. In some alternative implementations, the functions represented in the blocks may occur in an order different from the order shown in the drawings. For example, two consecutive blocks may actually be executed almost in parallel, or in reverse order depending on the related functions. Note that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented in a dedicated, hardware-based system that performs the function or operation defined, or in a combination of dedicated hardware and computer instructions.

[0116] The above descriptions illustrate various implementations of this disclosure; however, these descriptions are illustrative, not exhaustive, and are not limited to any of the disclosed implementations. Many modifications and changes will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein has been selected to best describe the various embodiments disclosed herein, the principles of the embodiments, the practical application or improvement of the technology in the market, or to be understood by those skilled in the art.

Claims

1. An interface interaction method, To present a playback interface for media content, wherein the screen displaying the media content is shown on the playback interface. In response to receiving instruction information, the target panel is displayed in the first area of ​​the playback interface, An interface interaction method comprising: the screen includes a target object; a first portion of the media content on the screen is presented in a second area of ​​the playback interface; the first portion is determined based on at least one display attribute of the target object on the screen.

2. The at least one display attribute includes the position information of the target object on the screen, The method according to claim 1.

3. The position information indicates at least one reference position associated with the target object, and the first portion is determined such that the at least one reference position is included in the first portion. The method according to claim 2.

4. The at least one display attribute includes the proportion of the target object on the screen, and the method is The first portion of the screen is determined based on a comparison of the aforementioned ratio with a preset threshold. The method according to claim 1.

5. The at least one display attribute further includes positional information of the target object on the screen, and determines the first portion of the screen based on a comparison of the display ratio and a preset threshold, The process includes determining the first portion of the screen based on the position information in response to the ratio being smaller than the preset threshold, The method according to claim 4.

6. The position information indicates a first position of the target object, the first position corresponds to the top of the target object in the preset direction of the screen, and the first portion of the screen is determined based on the position information. The process includes determining the first portion based on the first position such that the first position is included in the first portion, The method according to claim 5.

7. The preset direction is the arousal direction relative to the target panel. The method according to claim 5.

8. The distance from the first position to the upper edge in the preset direction of the second region is greater than or equal to the preset distance. The method according to claim 5.

9. Determining the first part based on the first position is Based on the first and second positions of the target object, a candidate portion of the screen is determined, thereby reducing the difference between the distance from the first position to the upper edge of the second region in the preset direction and the distance from the second position to the lower edge of the second region in the preset direction to a threshold, wherein the second position corresponds to the bottom of the screen of the target object in the preset direction. The process includes determining the first portion based on the candidate portion in response to the distance from the first position to the upper edge of the second region in the preset direction being greater than or equal to the preset distance, The method according to claim 8.

10. Determining the first portion based on the candidate portion means that In response to the fact that the candidate portion can completely fill the second region, the candidate portion is determined to be the first portion, or In response to the fact that the candidate portion cannot completely fill the second region, Adjusting the candidate portion along the direction opposite to the preset direction until the adjusted candidate portion can completely fill the second region, This includes determining the adjusted candidate portion as the first portion, The method according to claim 9.

11. Determining the first part based on the first position is In response to the distance from the first position to the upper edge of the second region in the preset direction being less than the preset distance, the candidate portion is adjusted along the direction opposite to the preset direction so that the distance from the first position to the upper edge of the second region in the preset direction reaches the preset distance, The further step is to determine the first portion based on the adjusted candidate portion, The method according to claim 9.

12. In response to the absence of the target object in the screen, the playback interface further includes presenting a second portion of the media content in a second region of the screen, such that the first center position of the second region coincides with the second center position of the screen. The method according to claim 1.

13. The playback interface is configured to display the screen of the media content in full-screen mode. The method according to claim 1.

14. The aforementioned media content includes live streaming video streams, The method according to claim 1.

15. A device for interface interaction, An interface presentation module configured to present a media content playback interface, the interface presentation module having a screen of the media content displayed on the playback interface, A panel display module configured to display a target panel in a first area of ​​the playback interface in response to receiving instruction information, A device comprising a screen presentation module configured to present a first portion of the media content on the screen in a second area of ​​the playback interface in response to the screen containing a target object, wherein the first portion is determined based on at least one display attribute of the target object on the screen.

16. At least one processing unit, An electronic device comprising at least one processing unit and at least one memory in which instructions executed by the at least one processing unit are stored, When the instruction is executed by the at least one processing unit, it causes the electronic device to perform the method according to any one of claims 1 to 14. electronic equipment.

17. A computer-readable storage medium storing a computer program that, when executed on a processor, implements the method described in any one of claims 1 to 14.

Images