Control method and apparatus for multimedia playback application, and electronic device
By displaying interactive controls in the lock screen state in multimedia playback applications, users can adjust and operate multimedia playback applications in the lock screen state, solving the problem of low operation efficiency and poor user experience in existing technologies. Realize more efficient and convenient user interaction.
Patent Information
- Application Number
- PCT/CN2024/107477
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-25
- Filing Date
- 2024-07-25
- Publication Date
- 2025-01-30
Smart Images

Figure CN2024107477_30012025_PF_FP_ABST
Abstract
Description
Method, device and electronic device for controlling multimedia playback application
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application is based on the Chinese application with application number 202310920024.8 and application date July 25, 2023, and claims its priority. The disclosed content of the Chinese application is hereby introduced as a whole into this application. Technical Field
[0003] The present disclosure relates to the field of computer technology, and in particular to a method and device for controlling a multimedia playback application, an electronic device, and a computer-readable storage medium. Background Art
[0004] With the continuous development of terminal technology, the number of applications (Applications, Apps) installed in terminal devices is increasing. The lock screen function of terminal devices can protect data security, prevent accidental touches, save power, etc. Users often need to listen to audio in the locked screen state.
[0005] Summary of the Invention
[0006] The embodiments of the present disclosure provide a method and device for controlling a multimedia playback application, an electronic device, and a computer-readable storage medium to solve problems existing in related technologies.
[0007] According to a first aspect of an embodiment of the present disclosure, a method for controlling a multimedia playback application is provided, the method comprising: in a process in which the multimedia playback application plays multimedia content, in response to a terminal device entering a lock screen state, displaying a first playback control area and a second playback control area of the multimedia playback application in a lock screen interface, wherein the second playback control area includes at least one interactive control for triggering at least one interactive operation for the multimedia playback application; in response to a user selecting a target interactive control from among the at least one interactive control, controlling the multimedia playback application to execute a target interactive operation corresponding to the target interactive control from among the at least one interactive operation, and displaying a target interaction result corresponding to the target interactive operation in the first playback control area.
[0008] According to a second aspect of an embodiment of the present disclosure, a control device for a multimedia playback application is provided, the device comprising: a display module configured to, in response to a terminal device entering a lock screen state while the multimedia playback application is playing multimedia content, display a first playback control area and a second playback control area of the multimedia playback application in a lock screen interface, wherein the second playback control area comprises at least one interactive control for triggering at least one interactive operation for the multimedia playback application; and a control module configured to, in response to a user's selection of a target interactive control in at least one interactive control, control the multimedia playback application to execute a target interactive operation corresponding to the target interactive control in at least one interactive operation, and display a target interaction result corresponding to the target interactive operation in the first playback control area.
[0009] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, comprising at least one processor; and a memory for storing instructions executable by at least one processor; wherein the at least one processor is configured to execute instructions to implement the steps of the above method.
[0010] According to a fourth aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided. When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the steps of the above method.
[0011] According to a fifth aspect of the embodiments of the present disclosure, a computer program product is provided, comprising program instructions, which, when executed on a processor, cause the processor to execute the steps of the above method.
[0012] According to a sixth aspect of the embodiments of the present disclosure, a computer program is provided, comprising program instructions, which, when executed on a processor, cause the processor to execute the steps of the above method. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0014] FIG1 is a flow chart of a method for controlling a multimedia playback application provided by an exemplary embodiment of the present disclosure.
[0015] FIG2 is a schematic diagram of a lock interface provided by an exemplary embodiment of the present disclosure.
[0016] FIG3 a and FIG3 b are schematic diagrams of an unlocking interface provided by an exemplary embodiment of the present disclosure.
[0017] FIG4 is a flow chart of another method for controlling a multimedia playback application provided by an exemplary embodiment of the present disclosure.
[0018] FIG5 is a schematic structural diagram of a control device for a multimedia playback application provided by an exemplary embodiment of the present disclosure.
[0019] FIG6 is a schematic structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure.
[0020] FIG7 is a schematic diagram of the structure of a computer system provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION
[0021] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.
[0022] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0023] The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the description below. It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0024] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".
[0025] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0026] In the related art, terminal devices support playing audio while the screen is locked. For example, the multimedia content currently being played by the multimedia player is displayed on the lock screen interface. However, existing terminal devices only support song pause / play, song fast forward / rewind, and track switching. To operate application functions such as adjusting recommendation mode and adding songs to favorites, the user must first unlock the terminal device, then find the multimedia player, and finally operate the application function. Therefore, existing multimedia player control methods cannot meet diverse needs, reduce operating efficiency, increase operating costs, and thus affect the user experience.
[0027] A method and device for controlling a multimedia playback application according to an embodiment of the present disclosure will be described in detail below with reference to the accompanying drawings.
[0028] Figure 1 is a flow chart of a method for controlling a multimedia playback application provided by an exemplary embodiment of the present disclosure. Figure 2 is a schematic diagram of a lock interface provided by an exemplary embodiment of the present disclosure. Figures 3a and 3b are schematic diagrams of an unlock interface provided by an exemplary embodiment of the present disclosure.
[0029] The control method of the multimedia playback application in FIG1 can be executed by an electronic device with a certain computing capability, such as a terminal device, a server or other processing device. As shown in FIG1 , the control method of the multimedia playback application includes:
[0030] S101, in response to a terminal device entering a lock screen state while a multimedia playback application is playing multimedia content, displaying a first playback control area and a second playback control area of the multimedia playback application on a lock screen interface, wherein the second playback control area includes at least one interactive control for triggering at least one interactive operation for the multimedia playback application;
[0031] S102, in response to the user's selection of a target interactive control among at least one interactive control, controlling the multimedia playback application to execute a target interactive operation corresponding to the target interactive control among at least one interactive operation, and displaying a target interaction result corresponding to the target interactive operation in the first playback control area.
[0032] Specifically, taking the terminal device as an example, during the process of multimedia playback application playing multimedia content, that is, when the multimedia playback application is in running state, if the user wants to lock the terminal device, the user can perform a lock screen operation on the terminal device by controlling the lock screen button to switch the terminal device to the lock screen state and exit the playback interface; or, when it is detected that the multimedia content in the playback interface is in a paused state for a preset time length, the terminal device automatically switches to the lock screen state; or, when it is detected that the preset automatic lock screen time has been reached, the terminal device automatically switches to the lock screen state.
[0033] When the terminal device is in the lock screen state, the first playback control area and the second playback control area of the multimedia playback application are displayed on the lock screen interface of the terminal device, as shown in Figure 2. The first playback control area includes at least a playback control block and a playback progress bar, and the second playback control area includes at least one interactive control for triggering at least one interactive operation for the multimedia playback application.
[0034] Furthermore, when the user wants to perform operations such as collection and mode adjustment on the currently playing multimedia content, the user can select the interactive control corresponding to the operation as the target interactive control in at least one interactive control in the second playback control area to control the multimedia playback application to perform the target interactive operation corresponding to the target interactive control, and display the target interaction result corresponding to the target interactive operation in the first playback control area.
[0035] Here, the terminal device can be a user equipment (UE), a mobile device, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, an in-vehicle device, a wearable device, etc. Among them, a personal digital assistant is a handheld electronic device that has some functions of an electronic computer and can be used to manage personal information, browse the Internet, send and receive emails, etc. It is generally not equipped with a keyboard and can also be called a handheld computer. In some possible implementations, the control method of the multimedia playback application can be implemented by a processor calling computer-readable instructions stored in a memory. Preferably, in the embodiment of the present disclosure, the terminal device is a mobile device, such as a mobile phone.
[0036] Multimedia refers to media that carry and transmit information or material, and can include one or more media forms such as text, images, photos, sound, images, and animation. Multimedia content is data generated by multimedia, including but not limited to audio and video data. Audio data can include music, opera, etc., while video data can include TV series, movies, live broadcasts, short videos, etc.
[0037] It should be noted that the multimedia content may be a single video, or may be a plurality of arranged short videos or a series of arranged pictures, for example, a video obtained by combining a plurality of short videos, or a combination of a plurality of pictures.
[0038] A multimedia playback application is an application or player that can play audio or video. The multimedia playback application can be an audio playback application, such as music playback software; it can also be a video playback application, such as video playback software; or it can also be a live broadcast application or a short video application, and the embodiments of the present disclosure do not limit this. Furthermore, the multimedia playback application can be installed in different operating systems, and the operating system may include but is not limited to the Android operating system developed by Google, the iOS operating system developed by Apple, the Windows operating system developed by Microsoft, etc. In the embodiments of the present disclosure, the multimedia playback application is an application installed in the iOS operating system that can play audio and video. The multimedia playback application being in a running state includes the multimedia playback application being in any running state from startup to shutdown.
[0039] The first playback control area and the second playback control area are both areas for controlling the multimedia content being played by the multimedia playback application in the terminal device in the locked screen state. The first playback control area and the second playback control area can be any area in the user interface (UI), and the sizes of the first playback control area and the second playback control area are both smaller than the display screen. The user interface is a media interface for interaction and information exchange between an application or operating system and a user, so as to realize the conversion between the internal form of information and the form acceptable to the user. In the embodiment of the present disclosure, the first playback control area is displayed by the system control that comes with the iOS operating system, and the second playback control area is displayed by the specified function control developed by a third-party developer for a specified application.
[0040] Controls, also known as widgets or gadgets, are basic elements of user interfaces. They include, but are not limited to, buttons, toggles, images, text, input fields, and scroll views. The first playback control area may include one or more controls, such as a playback control block and a playback progress bar.
[0041] Interactive controls refer to controls displayed on the second playback control area for performing interactive operations. Different interactive controls have different interactive functions. For example, the interactive controls can be mode adjustment controls for adjusting the recommendation mode, collection controls for collecting currently playing multimedia content, lyrics display controls for displaying lyrics, etc. The number of interactive controls can be set according to actual needs, and the embodiments of the present disclosure do not limit this. For example, the number of interactive controls can be any value in the range of 1 to 10. Preferably, in the embodiments of the present disclosure, considering the screen size of the mobile phone, the number of interactive controls is 3.
[0042] A target interactive control refers to an interactive control selected by the user. Upon detecting that a user has selected a target interactive control, an interaction instruction for the target interactive control may be generated. In response to the interaction instruction, a target interactive operation associated with the target interactive control is performed, and a target interaction result corresponding to the target interactive operation is displayed. For example, if a user's phone is locked and the user is listening to a song, and if it is detected that the user has selected a lyrics display control in the second playback control area, the lyrics of the song may be displayed in the second playback control area.
[0043] It should be noted that the target interaction result can be displayed in the first playback control area or in the second playback control area, and the embodiment of the present disclosure does not limit this.
[0044] According to the technical solution provided by the embodiment of the present disclosure, during the process of multimedia content playback by the multimedia playback application, in response to the terminal device entering the lock screen state, the first playback control area and the second playback control area of the multimedia playback application are displayed in the lock screen interface, wherein the second playback control area includes at least one interactive control for triggering at least one interactive operation for the multimedia playback application; in response to the user's selection of a target interactive control in the at least one interactive control, the multimedia playback application is controlled to execute the target interactive operation corresponding to the target interactive control in the at least one interactive operation, and the target interaction result corresponding to the target interactive operation is displayed in the first playback control area. This enables the user to flexibly control the multimedia playback application when the terminal device is in the lock screen state, thereby meeting diverse needs, improving operational efficiency, reducing operational costs, and further enhancing user experience.
[0045] In some embodiments, the method also includes: creating at least one interactive control in the second playback control area, and associating the at least one interactive control with at least one corresponding application intent; recording attribute information of the at least one interactive control so that the at least one interactive control interacts with the multimedia playback application, wherein the attribute information includes interactive interface information and interactive window information.
[0046] Specifically, in order to meet the diverse needs of users, at least one interactive control can be created in the second playback control area in advance, and the at least one interactive control can be associated with at least one corresponding application intent (App Intent). That is, in response to the triggering operation of at least one interactive control, the multimedia playback application is controlled to execute at least one application function corresponding to the at least one interactive control.
[0047] For example, you can create an application intent for the "Collection Button", such as the Collection Song Intent. When the user clicks the "Collection Button", the "Collection Song Intent" will trigger the function of adding the song to the collection list. For another example, you can create an application intent for the "Recommendation Mode Switch Button", such as the Switch Recommendation Mode Intent. When the user clicks the "Recommendation Mode Switch Button", the "Switch Recommendation Mode Intent" will trigger the function of switching between different recommendation modes.
[0048] According to the technical solution provided by the embodiment of the present disclosure, interactive controls can be created based on application intent, thereby meeting the diverse needs of users and improving user experience.
[0049] In some embodiments, at least one interactive control includes a favorite control, and in response to a user's selection of a target interactive control in at least one interactive control, the multimedia playback application is controlled to perform a target interactive operation corresponding to the target interactive control in at least one interactive operation, and a target interaction result corresponding to the target interactive operation is displayed in the first playback control area, including: in response to selecting the favorite control as the target interactive control in the second playback control area, when it is determined that the user has not favorited the currently playing first multimedia content, the first multimedia content is added to the favorites list of the multimedia playback application.
[0050] Specifically, when a user triggers a favorites control in the second playback control area, a check can be performed to determine whether the currently playing first multimedia content exists in the favorites list of the multimedia playback application. If the currently playing first multimedia content does not exist in the favorites list, it indicates that the user has not yet favorited the currently playing first multimedia content. In this case, the first multimedia content can be added to the favorites list of the multimedia playback application. If the currently playing first multimedia content exists in the favorites list, it indicates that the user has already favorited the currently playing first multimedia content. In this case, a reminder message can be sent to the user, for example, via a pop-up window. Here, the favorites control is a space for favoriteing the currently playing first multimedia content.
[0051] According to the technical solution provided by the embodiment of the present disclosure, multimedia content can be collected when the terminal device is in a locked state, thereby improving operation efficiency, saving operation time, reducing operation costs, and further enhancing user experience.
[0052] In some embodiments, at least one interactive control includes a mode adjustment control, which controls the multimedia playback application to perform a target interactive operation corresponding to the target interactive control in at least one interactive operation in response to a user's selection of a target interactive control in at least one interactive control, and displays a target interaction result corresponding to the target interactive operation in the first playback control area, including: in response to selecting the mode adjustment control as the target interactive control in the second playback control area, playing the second multimedia content in a preset media recommendation mode in the first playback control area, wherein the preset media recommendation mode includes any one of a default mode, a familiar mode, a scene mode, and a fresh mode.
[0053] Specifically, when it is detected that the user triggers the mode adjustment control in the second playback control area, the media recommendation mode associated with the mode adjustment control can be displayed in the second playback control area; when it is detected that the user selects any recommended mode in the media recommendation mode, the first multimedia content currently being played can be switched to the second multimedia content in the first playback control area, and the second multimedia content can be played in this recommendation mode.
[0054] Here, the mode adjustment control is a control for adjusting the media recommendation mode, and may include multiple mode adjustment sub-controls to correspond to different media recommendation modes. The media recommendation mode may include but is not limited to the default mode, the familiar mode, the scene mode, and the fresh mode. For example, if the user selects the "default mode", the currently used media recommendation mode will not be changed; if the user selects the "familiar mode", it means that the user expects to receive recommendations for multimedia content that he or she frequently listens to; if the user selects the "scene mode", it means that the user expects to receive recommendations for multimedia content that is suitable for listening in scenarios such as learning and fitness; if the user selects the "fresh mode", it means that the user expects to receive recommendations for multimedia content that he or she has not listened to and / or has listened to less frequently.
[0055] The technical solutions provided by the embodiments of the present disclosure enable cross-genre content recommendations even when the terminal device is locked, thereby reducing barriers between genres and meeting user diversity needs. Furthermore, users can consume content from multiple genres without unlocking their terminal devices, thereby improving operational efficiency, reducing operating costs, and enhancing the user experience.
[0056] In some embodiments, the interactive window information includes an interactive window in the form of a Smart Island, and the method further includes: in response to a user's triggering operation on the terminal device, displaying an interactive window in the form of a Smart Island above the unlocking interface; in response to a user's triggering operation on the interactive window in the form of a Smart Island, displaying a third playback control area in the unlocking interface, wherein the third playback control area includes at least one interactive control.
[0057] Specifically, after the user unlocks the terminal device, the multimedia playback application currently playing multimedia content will not switch to the background operation, but will be directly and dynamically displayed in the Smart Island above the unlocking interface, as shown in Figure 3a; when the user interacts with the Smart Island, the Smart Island expands to form a third playback control area, as shown in Figure 3b; the third playback control area includes at least one interactive control, and the user can trigger at least one interactive operation for the multimedia playback application by triggering the target interactive control in at least one interactive control, for example, switching songs, collecting songs, etc.
[0058] Here, Dynamic Island is a new interactive interface designed by Apple, which can automatically change size and shape based on different application operations and prompts, notifications and activity content requirements. In addition, without affecting the display of screen content, Dynamic Island can remain active, allowing users to use control options with just a long press. Applications such as maps, music, or activities running in the background such as timers are always visible and can be directly interacted with, and important reminders, notifications and activity information can also be displayed in real time. In addition, Dynamic Island is also suitable for third-party applications that provide "real-time activities" such as game scores, flight information, etc.
[0059] The third play control area is an area for controlling the multimedia content being played by the multimedia play application in the unlocked terminal device. The third play control area is located at the top of the display screen, and the size of the third play control area is smaller than the display screen.
[0060] According to the technical solution provided by the embodiment of the present disclosure, after the terminal device is unlocked, the multimedia playback application will not be transferred to the background, but will be directly and dynamically displayed in the Smart Island, so that the user can operate the multimedia playback application in the Smart Island. This not only brings a unique visual experience and convenient information display to the user, but also provides the user with an easy and convenient operation method.
[0061] In some embodiments, the method further includes: monitoring data changes of the multimedia playback application, and updating at least one interactive control in the second playback control area based on the data changes.
[0062] Specifically, data changes of the multimedia playback application are monitored in real time, such as changes in the favorites list and the recommendation mode, and at least one interactive control in the second playback control area is updated based on the changed data to ensure that the user interface is always kept up to date, that is, it can reflect the actual status of the multimedia playback application.
[0063] In some embodiments, the method further includes: adding animation effects to at least one interactive control, wherein the animation effects include at least one of fade-in animation effects, fade-out animation effects, slide-in animation effects, and slide-out animation effects; and in response to a user's selection of a target interactive control among at least one interactive control, displaying the animation effect associated with the target interactive control.
[0064] Specifically, the user interface is the medium for interaction and information exchange between the system and the user. The user interface includes user interface controls such as text, images, buttons, switches, sliders, charts, or input boxes, through which the terminal device can interact with the user. To meet the need for customized display and hiding animation effects for user interface controls, a corresponding animation effect can be added to at least one interactive control in the second playback control area. When the user selects a target interactive control from the at least one interactive control, the animation effect associated with the target interactive control is displayed.
[0065] Here, the animation effect may include at least one of a fade-in animation effect, a fade-out animation effect, a slide-in animation effect, and a slide-out animation effect. The fade-in animation effect is an animation effect in which the transparency gradually changes from a first transparency to a second transparency, and the fade-out animation effect is an animation effect in which the transparency gradually changes from a second transparency to a first transparency. The first transparency may be any transparency, and the second transparency may be the transparency after the target interface is fully displayed. Exemplarily, the second transparency may be 1, and the first transparency may be any real number greater than or equal to 0 and less than 1, for example, 0.8, 0.7, 0.5, 0.2, 0, etc. The slide-in animation effect is an animation effect that slides in from either side of the display screen, and the slide-out animation effect is an animation effect that slides out from either side of the display screen. Exemplarily, the user interface control may be controlled to slide in or out from the left, right, top, or bottom of the display screen.
[0066] In some embodiments, the animation effect may also be a luminous animation effect. The luminous animation effect may be a collection control that flashes at preset time intervals to guide the user to collect the currently playing first media content. For example, the collection control may flash once every 1 second, or once every 2 seconds, for a total of three or four flashes, and the present disclosure does not limit this.
[0067] According to the technical solution provided by the embodiment of the present disclosure, by adding animation effects to interactive controls, user interface controls can be flexibly displayed and hidden, meeting the demand for customizing different display and hiding animation effects for user interface controls.
[0068] All of the above optional technical solutions can be combined in any way to form optional embodiments of the present disclosure, and will not be described in detail here. In addition, the order of the sequence numbers of the steps in the above embodiments does not imply a specific order of execution. The order of execution of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present disclosure.
[0069] FIG4 is a flow chart of another method for controlling a multimedia playback application provided by an exemplary embodiment of the present disclosure. The method for controlling a multimedia playback application in FIG4 can be executed by an electronic device. As shown in FIG4 , the method for controlling a multimedia playback application includes:
[0070] S401, creating at least one interactive control in a second playback control area, and associating the at least one interactive control with at least one corresponding application intent;
[0071] S402, recording attribute information of at least one interactive control, so that the at least one interactive control interacts with the multimedia playback application, wherein the attribute information includes interactive interface information and interactive window information;
[0072] S403, in the process of the multimedia playback application playing multimedia content, in response to the terminal device entering the lock screen state, displaying the first playback control area and the second playback control area of the multimedia playback application on the lock screen interface;
[0073] S404, in response to the user selecting a target interactive control among the at least one interactive control, controlling the multimedia playback application to perform a target interactive operation corresponding to the target interactive control;
[0074] S405: Display the target interaction result corresponding to the target interaction operation in the first playback control area.
[0075] According to the technical solution provided by the embodiment of the present disclosure, by creating at least one interactive control for interacting with a multimedia playback application in the second playback control area, it is possible to control the multimedia playback application to perform a target interactive operation corresponding to the target interactive control by selecting a target interactive control from at least one interactive control when the multimedia playback application is playing multimedia content and the terminal device is in a locked state. Therefore, flexible control of the multimedia playback application by the user is achieved, diverse needs are met, operational efficiency is improved, operational costs are reduced, and user experience is further enhanced.
[0076] By dividing functional modules into modules corresponding to their respective functions, an embodiment of the present disclosure provides a control device for a multimedia playback application. This control device for a multimedia playback application can be a server or a chip used in a server. Figure 5 is a schematic diagram of the structure of a control device for a multimedia playback application provided by an exemplary embodiment of the present disclosure. As shown in Figure 5, the control device 500 for the multimedia playback application includes:
[0077] The display module 501 is configured to, in response to the terminal device entering a lock screen state while the multimedia playback application is playing multimedia content, display a first playback control area and a second playback control area of the multimedia playback application on the lock screen interface, wherein the second playback control area includes at least one interactive control for triggering at least one interactive operation on the multimedia playback application;
[0078] The control module 502 is configured to control the multimedia playback application to perform a target interaction operation corresponding to the target interaction control in at least one interaction operation in response to the user's selection of a target interaction control in at least one interaction control, and display the target interaction result corresponding to the target interaction operation in the first playback control area.
[0079] According to the technical solution provided by the embodiment of the present disclosure, during the process of multimedia content playback by the multimedia playback application, in response to the terminal device entering the lock screen state, the first playback control area and the second playback control area of the multimedia playback application are displayed in the lock screen interface, wherein the second playback control area includes at least one interactive control for triggering at least one interactive operation for the multimedia playback application; in response to the user's selection of a target interactive control in the at least one interactive control, the multimedia playback application is controlled to execute the target interactive operation corresponding to the target interactive control in the at least one interactive operation, and the target interaction result corresponding to the target interactive operation is displayed in the first playback control area. This enables the user to flexibly control the multimedia playback application when the terminal device is in the lock screen state, thereby meeting diverse needs, improving operational efficiency, reducing operational costs, and further enhancing user experience.
[0080] In some embodiments, the control device 500 of the multimedia playback application in Figure 5 also includes: a creation module 503, configured to create at least one interactive control in the second playback control area, and associate the at least one interactive control with at least one corresponding application intention; a recording module 504, configured to record attribute information of the at least one interactive control so that the at least one interactive control interacts with the multimedia playback application, wherein the attribute information includes interaction interface information and interaction window information.
[0081] In some embodiments, at least one interactive control includes a favorites control. In response to selecting the favorites control as the target interactive control in the second playback control area, if it is determined that the user has not favorited the currently playing first multimedia content, the control module 502 of Figure 5 adds the first multimedia content to the favorites list of the multimedia playback application.
[0082] In some embodiments, at least one interactive control includes a mode adjustment control. In response to selecting the mode adjustment control as the target interactive control in the second playback control area, the control module 502 of Figure 5 plays the second multimedia content in the first playback control area in a preset media recommendation mode, wherein the preset media recommendation mode includes any one of a default mode, a familiar mode, a scene mode, and a fresh mode.
[0083] In some embodiments, the interactive window information includes an interactive window in the form of a Smart Island. The display module 501 of Figure 5 displays the interactive window in the form of a Smart Island above the unlocking interface in response to the user's triggering operation on the terminal device; in response to the user's triggering operation on the interactive window in the form of a Smart Island, a third playback control area is displayed in the unlocking interface, wherein the third playback control area includes at least one interactive control.
[0084] In some embodiments, the control device 500 of the multimedia playback application in Figure 5 further includes: a monitoring module 505 configured to monitor data changes of the multimedia playback application and update at least one interactive control in the second playback control area based on the data changes.
[0085] In some embodiments, the control device 500 of the multimedia playback application in Figure 5 also includes: an adding module 506, configured to add animation effects to at least one interactive control, wherein the animation effects include at least one of a fade-in animation effect, a fade-out animation effect, a slide-in animation effect, and a slide-out animation effect; a display module 507, configured to display the animation effect associated with the target interactive control in response to the user's selection of the target interactive control in the at least one interactive control.
[0086] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.
[0087] An embodiment of the present disclosure further provides an electronic device, comprising: at least one processor; a memory for storing instructions executable by at least one processor; wherein the at least one processor is configured to execute instructions to implement the steps of the above method disclosed in the embodiment of the present disclosure.
[0088] Figure 6 is a schematic diagram of the structure of an electronic device provided by an exemplary embodiment of the present disclosure. As shown in Figure 6, the electronic device 600 includes at least one processor 601 and a memory 602 coupled to the processor 601. The processor 601 can execute the corresponding steps in the above method disclosed in the embodiment of the present disclosure.
[0089] The processor 601 can also be referred to as a central processing unit (CPU), which can be an integrated circuit chip with signal processing capabilities. Each step in the above method disclosed in the embodiment of the present disclosure can be completed by the hardware integrated logic circuit in the processor 601 or by instructions in the form of software. The processor 601 can be a general-purpose processor, a digital signal processor (DSP), an ASIC, a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiment of the present disclosure can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in the memory 602, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, or other mature storage media in the art. The processor 601 reads the information in the memory 602 and completes the steps of the above method in combination with its hardware.
[0090] In addition, when various operations / processes according to the present disclosure are implemented via software and / or firmware, the programs constituting the software can be installed from a storage medium or a network to a computer system having a dedicated hardware structure, such as the computer system 700 shown in FIG7 . When the various programs are installed, the computer system can perform various functions, including those described above. FIG7 is a schematic diagram of the structure of a computer system provided by an exemplary embodiment of the present disclosure.
[0091] Computer system 700 is intended to represent various forms of digital electronic computer equipment, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic equipment can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.
[0092] As shown in FIG7 , a computer system 700 includes a computing unit 701 that can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 702 or a computer program loaded from a storage unit 708 into a random access memory (RAM) 703. Various programs and data required for the operation of the computer system 700 may also be stored in the RAM 703. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.
[0093] Multiple components within computer system 700 are connected to I / O interface 705, including an input unit 706, an output unit 707, a storage unit 708, and a communication unit 709. Input unit 706 can be any type of device capable of inputting information into computer system 700. Input unit 706 can receive input numeric or character information and generate key input signals related to user settings and / or function control of an electronic device. Output unit 707 can be any type of device capable of presenting information and may include, but is not limited to, a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. Storage unit 708 may include, but is not limited to, a magnetic disk or an optical disk. Communication unit 709 allows computer system 700 to exchange information / data with other devices over a network, such as the Internet, and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver and / or chipset, such as a Bluetooth™ device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.
[0094] The computing unit 701 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 701 performs the various methods and processes described above. For example, in some embodiments, the above-mentioned method disclosed in the embodiments of the present disclosure may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 708. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 700 via the ROM 702 and / or the communication unit 709. In some embodiments, the computing unit 701 may be configured to perform the above-mentioned method disclosed in the embodiments of the present disclosure by any other appropriate means (e.g., by means of firmware).
[0095] An embodiment of the present disclosure further provides a computer-readable storage medium, wherein when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the above method disclosed in the embodiment of the present disclosure.
[0096] The computer-readable storage medium in the embodiments of the present disclosure can be a tangible medium that can contain or store a program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. The above-mentioned computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the above. More specifically, the above-mentioned computer-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0097] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0098] The embodiments of the present disclosure further provide a computer program product, including a computer program, wherein when the computer program is executed by a processor, the method disclosed in the embodiments of the present disclosure is implemented.
[0099] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof, including but not limited to object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer.
[0100] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0101] The modules, components, or units described in the embodiments of the present disclosure may be implemented in software or hardware. The names of the modules, components, or units do not necessarily limit the modules, components, or units themselves.
[0102] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, and without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0103] The above descriptions are merely some embodiments of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but also encompasses other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in the present disclosure.
[0104] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art will appreciate that the above examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Those skilled in the art will appreciate that modifications may be made to the above embodiments without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.
Claims
1. A method for controlling a multimedia playback application, comprising: In the process of multimedia content playback by the multimedia playback application, in response to the terminal device entering a lock screen state, displaying a first playback control area and a second playback control area of the multimedia playback application in the lock screen interface, wherein the second playback control area includes at least one interactive control for triggering at least one interactive operation for the multimedia playback application; In response to a user's selection of a target interactive control among the at least one interactive control, the multimedia playback application is controlled to execute a target interactive operation corresponding to the target interactive control among the at least one interactive operation, and a target interactive result corresponding to the target interactive operation is displayed in the first playback control area.
2. The method according to claim 1, wherein: The method further comprises: Creating the at least one interactive control in the second playback control area, and associating the at least one interactive control with the corresponding at least one application intent; The property information of the at least one interactive control is recorded so that the at least one interactive control interacts with the multimedia playback application, wherein the property information includes interactive interface information and interactive window information.
3. The method according to claim 2, wherein: The at least one interactive control includes a collection control, and in response to a user selecting a target interactive control in the at least one interactive control, controlling the multimedia playback application to perform a target interactive operation corresponding to the target interactive control in the at least one interactive operation, and displaying a target interactive result corresponding to the target interactive operation in the first playback control area, comprises: In response to selecting the favorite control as the target interactive control in the second playback control area, if it is determined that the user has not favorited the currently playing first multimedia content, the first multimedia content is added to a favorites list of the multimedia playback application.
4. The method according to claim 2, wherein: The at least one interactive control includes a mode adjustment control, and in response to a user selecting a target interactive control in the at least one interactive control, controlling the multimedia playback application to perform a target interactive operation corresponding to the target interactive control in the at least one interactive operation, and displaying a target interactive result corresponding to the target interactive operation in the first playback control area, comprises: In response to selecting the mode adjustment control as the target interactive control in the second playback control area, the second multimedia content is played in the first playback control area in a preset media recommendation mode, wherein the preset media recommendation mode includes any one of a default mode, a familiar mode, a scene mode and a fresh mode.
5. The method according to any one of claims 2 to 4, wherein: The interactive window information includes an interactive window in the form of a smart island, and the method further includes: In response to the user's triggering operation on the terminal device, displaying the interactive window in the form of the smart island above the unlocking interface; In response to the user's triggering operation on the interactive window in the form of Smart Island, a third playback control area is displayed in the unlocking interface, wherein the third playback control area includes the at least one interactive control.
6. The method according to any one of claims 1 to 5, wherein: The method further comprises: Monitor data changes of the multimedia playback application, and update the at least one interactive control in the second playback control area based on the data changes.
7. The method according to any one of claims 1 to 6, wherein: The method further comprises: adding an animation effect to the at least one interactive control, wherein the animation effect comprises at least one of a fade-in animation effect, a fade-out animation effect, a slide-in animation effect, and a slide-out animation effect; In response to the user selecting the target interactive control among the at least one interactive control, an animation effect associated with the target interactive control is displayed.
8. A control device for a multimedia playback application, comprising: The display module is configured to display a first playback control area and a second playback control area of the multimedia playback application in a lock screen interface in response to the terminal device entering a lock screen state during the multimedia playback application playing multimedia content, wherein the second playback control area includes at least one interactive control for triggering at least one interactive operation for the multimedia playback application; The control module is configured to control the multimedia playback application to execute a target interaction operation corresponding to the target interaction control in the at least one interaction operation in response to a user's selection of a target interaction control in the at least one interaction control, and to display a target interaction result corresponding to the target interaction operation in the first playback control area.
9. An electronic device, comprising: at least one processor; a memory for storing the at least one processor-executable instruction; The at least one processor is configured to execute the instructions to implement the method as claimed in any one of claims 1 to 7.
10. A computer-readable storage medium, wherein: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the method as claimed in any one of claims 1 to 7.
11. A computer program product, comprising program instructions, which, when executed on a processor, cause the processor to execute the method according to any one of claims 1 to 7. 12 . A computer program comprising program instructions, which, when executed on a processor, causes the processor to execute the method according to claim 1 .
Citation Information
Patent Citations
Control method and terminal equipment
CN110221750A
Lock screen interface display method of electronic equipment and electronic equipment
CN113973150A
Screen locking control method and device, electronic equipment and storage medium
CN116320155A
Control method and device of multimedia playing application program and electronic equipment
CN116931790A
Touchscreen lock feature for playback of media content
US20230120950A1