Data processing method and device, client and storage medium

Abstract

Embodiments of the present application disclose a data processing method and device, a client and a storage medium, wherein the method comprises: displaying a user interface of a target user, the user interface displaying a user identifier of the target user, the user interface being associated with at least one multimedia data; when the user identifier is executed with a first trigger operation, playing the multimedia data associated with the user interface in the user interface; in the process of playing the multimedia data, if the user identifier is executed with a second trigger operation, playing the multimedia data is controlled according to the second trigger operation, and the flexibility of feature display in the user interface can be improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data processing method, a device client, and a storage medium. Background Technology

[0002] With the rapid development of internet technology, various applications have emerged to facilitate users' production and daily lives. To make users' personal expression clearer, these applications provide user interfaces (or personal homepages) for personal display. Currently, these user interfaces typically display images or avatars uploaded by the target user. As such, the current user interface has limitations in displaying the target user's personality traits. Therefore, how to make the user interface display the corresponding user's personality traits more flexible has become a current research hotspot. Summary of the Invention

[0003] This invention provides a data processing method, apparatus, client, and storage medium that can improve the flexibility of feature display in the user interface.

[0004] On one hand, embodiments of the present invention provide a data processing method, including:

[0005] The user interface of the target user is displayed, the user interface displays the user identifier of the target user, and the user interface is associated with at least one multimedia data;

[0006] When the user identifier is triggered by the first operation, multimedia data associated with the user interface is played on the user interface.

[0007] During the playback of the multimedia data, if the user identifier is triggered by a second operation, the playback control of the multimedia data is performed according to the second trigger operation.

[0008] In another aspect, embodiments of the present invention provide a data processing apparatus, including:

[0009] A display unit is used to display the user interface of a target user, wherein the user interface displays the user identifier of the target user and the user interface is associated with at least one multimedia data.

[0010] A playback unit is configured to play multimedia data associated with the user interface on the user interface when the user identifier is triggered by a first triggering operation.

[0011] The control unit is configured to control the playback of the multimedia data according to the second triggering operation if the user identifier is triggered during the playback of the multimedia data.

[0012] In another aspect, embodiments of the present invention provide a client, including a processor, an input device, an output device, and a memory, wherein the processor, input device, output device, and memory are interconnected, wherein the memory is used to store a computer program supporting the terminal to execute the above-described method, the computer program including program instructions, and the processor is configured to invoke the program instructions to execute the following steps:

[0013] The user interface of the target user is displayed, the user interface displays the user identifier of the target user, and the user interface is associated with at least one multimedia data;

[0014] When the user identifier is triggered by the first operation, multimedia data associated with the user interface is played on the user interface.

[0015] During the playback of the multimedia data, if the user identifier is triggered by a second operation, the playback control of the multimedia data is performed according to the second trigger operation.

[0016] In another aspect, embodiments of the present invention provide a computer-readable storage medium storing program instructions, which, when executed by a processor, are used to perform the data processing method as described in the first aspect.

[0017] In this embodiment of the invention, after displaying the target user's user interface, the client binds at least one multimedia data associated with the user interface to the user identifier displayed in the user interface. Therefore, if the user identifier displayed in the user interface is triggered by a first trigger operation, the client can play the multimedia data associated with the user interface, thereby enhancing the interactivity between the browsing user and the user interface during access. Furthermore, playing multimedia data based on the browsing user's triggering of the user identifier in the user interface enhances the browsing experience and improves the user's browsing experience. In addition, during the playback of the multimedia data, the client can also control the playback of the multimedia data based on a second trigger operation performed on the user identifier, allowing the client to control the playback of multimedia data according to user needs, thus improving the flexibility of controlling the multimedia data when playing it in the user interface. Attached Figure Description

[0018] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1a This is a schematic diagram of a data processing system provided in an embodiment of the present invention;

[0020] Figure 1b This is an interactive diagram of a data processing method provided in an embodiment of the present invention;

[0021] Figure 2 This is a schematic flowchart of a data processing method provided in an embodiment of the present invention;

[0022] Figure 3a This is a schematic diagram of a user interface provided in an embodiment of the present invention;

[0023] Figure 3b This is a schematic diagram illustrating the playback of audio data on a user interface according to an embodiment of the present invention;

[0024] Figure 3c This is a schematic diagram illustrating the playback of video data on a user interface according to an embodiment of the present invention;

[0025] Figure 3d This is a schematic diagram illustrating a method for switching video data playback according to an embodiment of the present invention;

[0026] Figure 3e This is a schematic diagram illustrating a method for switching video data playback according to an embodiment of the present invention;

[0027] Figure 3f This is a schematic diagram illustrating the re-display of the user identifier and background image when the second triggering operation and the first triggering operation are the same, according to an embodiment of the present invention.

[0028] Figure 3g This is a schematic diagram illustrating a method for switching and playing another multimedia data according to an embodiment of the present invention;

[0029] Figure 4 This is a schematic flowchart of a data processing method provided in an embodiment of the present invention;

[0030] Figure 5a This is a schematic diagram of a display playback indicator provided in an embodiment of the present invention;

[0031] Figure 5b This is a schematic diagram illustrating how to display matching associated data while playing multimedia data, according to an embodiment of the present invention.

[0032] Figure 5c This is a schematic diagram illustrating how to display multiple related data while playing multimedia data, according to an embodiment of the present invention.

[0033] Figure 5d This is a schematic diagram of a display stop playback indicator provided in an embodiment of the present invention;

[0034] Figure 5e This is a schematic diagram of a display data switching indicator provided in an embodiment of the present invention, which switches to play another multimedia data.

[0035] Figure 6 This is a schematic diagram of a data processing method provided in an embodiment of the present invention;

[0036] Figure 7 This is a schematic block diagram of a data processing device provided in an embodiment of the present invention;

[0037] Figure 8 This is a schematic block diagram of a client provided in an embodiment of the present invention. Detailed Implementation

[0038] This invention proposes a data processing method that binds multimedia data set by a target user for a user interface to a user identifier. This allows the user browsing the user interface to execute different trigger operations on the user identifier based on their needs. The client then controls the playback of multimedia data within the user interface based on these trigger operations, improving the interactivity between the user and the user interface, thereby enhancing the user's enjoyment of browsing the interface. This data processing method can be applied to applications such as... Figure 1aThe data processing system shown includes a browsing user 10, a client 11 used by the browsing user, and a server 12. The browsing user 10 can access the target user's user interface through the client 11. Specifically, the client 11 can listen to one or more user operations performed by the browsing user 10 in the user interface and respond to these operations in real time. Furthermore, the server 12 supports the operation of the user interface; that is, when the client 11 responds to the user operations performed by the browsing user 10 in the user interface, it can request corresponding feedback data from the server 12 to display to the browsing user. In one embodiment, the server 12 also stores rendering data corresponding to the user interfaces of different users. When the browsing user 10 accesses the target user's user interface through the client 11, the client 11 can also send a data acquisition request to the server 12 to request the rendering data required for rendering the target user's user interface. After obtaining the rendering data from the server 12, the client 11 can render the user interface based on the rendering data and display the rendered user interface to the browsing user 10.

[0039] The specific process by which browsing user 10 requests access to the target user's user interface through client 11, and how client 11 responds to the user operations performed by browsing user 10 in the user interface, can be described as follows: Figure 1b As shown, a browsing user can launch a target application, thereby displaying the user interface corresponding to that target application. In one embodiment, after the browsing user launches the target application, if the client detects the browsing user's launch (or opening) operation of the target user's user interface, it can first query the local cache to see if there is rendering data required for rendering the target user's user interface. If not, the client can send a data retrieval request to the server to obtain the rendering data required for rendering the user interface. The target user and the browsing user can be the same user or different users. It is understood that when the target user and the browsing user are the same user, the client can obtain the rendering data for that user interface from the local cache after detecting the browsing user's opening operation of the user interface. However, when the target user and the browsing user are not the same user, the client will not be able to obtain the rendering data for that user interface from the local cache and will request the rendering data from the server. In this embodiment, the detailed description mainly focuses on the case where the target user and the browsing user are not the same user, i.e., the browsing user requests access to the target user's user interface in guest mode. The same embodiment applies to the case where the target user and the browsing user are the same user.

[0040] After receiving a data retrieval request from a client, the server can query a database to obtain the rendering data required for rendering the user interface and then send the rendering data to the client. In one embodiment, the server can directly send the rendering data to the client, allowing the client to directly render the user interface based on the data. In another feasible embodiment, to ensure the security and integrity of the rendering data during transmission, the server can first encrypt and / or package the obtained rendering data to obtain a rendering data packet, and then send the rendering data packet to the client. After obtaining the rendering data packet, the client can first parse the rendering data packet to obtain the rendering data, and then render the user interface based on the rendering data. In one embodiment, when rendering the user interface based on the rendering data, the client can first render the basic interface elements of the user interface, such as functional labels like album and game labels, and then render the personalized elements set by the target user, such as the background image and user identifier, as well as multimedia indicators displayed after binding multimedia data of the user interface device to the user identifier. Alternatively, the client can simultaneously render the basic interface elements and personalized elements of the user interface.

[0041] After the client-side renders the user interface, it can be displayed to the browsing user. The client then listens for the user's actions on the user interface (i.e., the interaction between the user and the user interface). If the client detects that the user has performed a first triggering action at the user identifier on the user interface, the client needs to first determine the multimedia data bound to the user interface and check if the multimedia data resource exists in the local cache. If not, the client can request the multimedia data resource from the server. Since the client checks the local cache before playing the multimedia data, it avoids requesting the server every time the client responds to a user action. This reduces the server's data processing pressure, speeds up the client's response to user actions, improves response efficiency, and ultimately provides a better user experience. In one embodiment, the data resource includes a first data resource for playing the multimedia data. When the multimedia data is audio data, the first data resource for playing the audio data can be an audio playback resource (such as the playback address of the audio data). When the multimedia data is video data, the first data resource for playing the video data can be a video playback resource (such as the playback address of the video data). In addition, the data resource also includes a second data resource for displaying associated data that matches the data content of the multimedia data. The associated data that matches the data content of the multimedia data can be a cover image, etc., and the second data resource is a rendering resource for rendering the cover image, etc.

[0042] After obtaining data resources from the server, the client can load these resources and play multimedia data based on the first data resource included within them. Simultaneously, based on the second data resource, the client renders associated data matching the content of the multimedia data in the user interface. In one embodiment, when playing multimedia data based on the first data resource, the client can use a simultaneous playback and loading approach. This approach improves playback efficiency and maximizes the utilization of each request from the server. It is understood that after the client plays the multimedia data in the user interface and displays the associated multimedia data matching the content to the browsing user, the client's response to the first trigger operation performed by the browsing user at the user identifier ends. The client can then continue to listen for trigger operations performed by the browsing user at the user identifier. If the browsing user performs a second trigger operation at the user identifier, the client can first determine the number of multimedia data bound to the user interface. If multiple multimedia data are determined to be bound to the user interface, the client can switch the currently playing multimedia data based on the second trigger operation. In a specific implementation, if the multimedia data bound to the user interface includes at least first multimedia data and second multimedia data, and the multimedia data being played by the client is the first multimedia data, then after the browsing user performs a second trigger operation at the user identifier, in one embodiment, if the first trigger operation and the second trigger operation are different, the client can switch from playing the first multimedia data to playing the second multimedia data, and will switch to displaying associated data matching the data content of the second multimedia data. When the client switches from playing the first multimedia data to playing the second multimedia data, it can also first check whether the data resource of the second multimedia data is cached locally, and if it is determined that it is not, it requests the data resource of the second multimedia data from the server. Similarly, after the client obtains the data resource of the second multimedia data from the server, it will also play the second multimedia data in a simultaneous playback and loading manner, and display associated data matching the data content of the multimedia data during the playback process.

[0043] In another embodiment, after the browsing user performs the second triggering operation at the user identifier, if the first triggering operation and the second triggering operation are the same—that is, if the client detects the browsing user performing the first triggering operation at the user identifier again after the browsing user performs the first triggering operation at the user identifier—then the client can stop the multimedia data being played on the user interface. After stopping the multimedia data being played on the user interface, the client can continue downloading the multimedia data resource and store the downloaded data resource in a local cache. This allows the client to play the multimedia data based on the locally cached data resource when it is needed again, without requesting the server to retrieve the data resource, thus improving the client's efficiency in playing multimedia data. In one embodiment, before continuing to download the multimedia data resource after the client stops playing the multimedia data, the client can first determine the client's network status. If the client's network status is wireless network, the download of the multimedia data resource can begin. If the client's network status is mobile data, a download task for downloading the data resource can be created, and the download of the data resource can begin when the client is detected to be in wireless network status. Alternatively, the client can download the data resource regardless of whether it is in wireless network status or mobile data status. In this embodiment of the invention, the triggering condition for the client to download the multimedia data resource is not limited.

[0044] Please see Figure 2 This is a schematic flowchart of a data processing method proposed in an embodiment of the present invention. This data processing method can be executed by the aforementioned client, such as... Figure 2 As shown, the method may include:

[0045] S201, Display the user interface of the target user, which displays the user identifier of the target user and is associated with at least one multimedia data.

[0046] In one embodiment, the client may display the target user's user interface when it detects that a browsing user has launched the target application and accessed the target user's user interface (or personal homepage) within the target application. The user interface displayed by the client may be as follows: Figure 3a As shown, the user interface of the target user displays the user's identifier, i.e., as shown below. Figure 3a As shown in the left image, in addition to displaying the target user's user ID, the user interface also displays multimedia indicator icons associated with the user interface at the location where the target user's user ID is displayed, such as... Figure 3aAs shown in the right figure, the multimedia indicator is displayed when a user accesses the user interface after the target user has pre-set associated multimedia data for the user interface. It can be displayed as follows: Figure 3a As indicated by the symbol marked 30 in the right-hand image, adding associated multimedia data features to the user interface can better highlight the target user's mood and personality, and effectively increase the access rate of other users to the user interface. After the client detects that the target user has added associated multimedia data to the user interface, it can bind the multimedia data to the target user's user ID displayed in the user interface. Then, when a browsing user enters the user interface, the playback of the multimedia data can be triggered through the user ID.

[0047] In one embodiment, the browsing user, while browsing the user interface, can trigger the client to play associated multimedia data by performing a first trigger operation at the user identifier. This first trigger operation can be one or more of the following: a double-click operation, a drag operation along a first direction, and a press operation. When the client detects the first trigger operation performed by the browsing user on the user identifier, it can play the multimedia data in the user interface, i.e., proceed to step S202. It should be noted that the browsing user and the target user can be the same user or different users. In this embodiment, the detailed description mainly focuses on the case where the browsing user and the target user are different users. When the browsing user and the target user are the same user, please refer to the embodiments of this invention.

[0048] In this implementation, the target user can add one or more multimedia data to the user interface. After determining that the browsing user has performed a first trigger operation on the user identifier, if the target user has added only one multimedia data to the user interface, the client can play that one multimedia data and stop playing it after playback is complete. Alternatively, the client can restart and loop the playback of that one multimedia data after playback is complete. In another implementation, if the target user has added at least two multimedia data to the user interface, the client can play the at least two multimedia data in the order in which they were added, or the client can play them randomly, or according to their playback duration, or according to their data quality. Furthermore, after the client finishes playing one or more multimedia data added to the user interface, it can stop playing the multimedia data, or it can loop the multimedia data, or it can obtain other multimedia data related to the data content of the multimedia data being played from the Internet and play the other related multimedia data. In other words, the embodiments of the present invention do not limit the source of the multimedia data played in the user interface, nor do they limit the playback order of multiple multimedia data added to the user interface by the target user.

[0049] S202, when the user identifier is triggered by the first operation, the multimedia data associated with the user interface is played on the user interface.

[0050] If the user interface displayed in the user interface is like Figure 3a As shown in the right figure, the first triggering operation is a drag operation targeting the user identifier. If the multimedia data associated with the user interface is audio data, then when the client determines that the browsing user has performed a drag operation on the user identifier in the user interface, the audio data associated with the user interface can be played in the user interface. When the client plays the audio data in the user interface, it can keep the user interface unchanged and play the audio data only through the speaker; or, it can be as follows... Figure 3b As shown, the client can play the audio data through a speaker while simultaneously displaying the audio data's information in the user interface. This displayed information can be the audio data's title or theme information, for example, such as... Figure 3bThe information marked by 31 is shown in the figure. In one embodiment, the audio data may be music, and the data information displayed for the music may include the title of the music and the singer, etc. Alternatively, the audio data may be a self-introduction recording of the target user, and the data information displayed for the self-introduction recording may include the theme information of the self-introduction recording, etc. In this embodiment of the invention, the data format of the audio data and the content of the data information of the audio data displayed on the user interface are not limited.

[0051] In one embodiment, if the multimedia data associated with the user interface is video data, then after the browsing user performs a drag operation on the user identifier of the user interface, the video data can be played on the user interface. When the client plays the video data, if... Figure 3c As shown, the client can play the video data at the location where the background image is displayed on the user interface. This video data can be data comprising multiple consecutive frames of images, or it can be slideshow data, etc. While the client is playing the video data on the user interface, the browsing user can also adjust the playback position of the video data according to their needs. Specifically, the client can adjust the playback position of the video data when it detects a trigger operation (such as a press or drag) by the browsing user on the playing video data. Figure 3d As shown, when the client detects a press operation on the playing video data, it can display the video data in a floating full-screen window, or it can also do so as... Figure 3e As shown, when the client detects a press operation on the playing video data, it displays the video data in a small window in the user interface, allowing the browsing user to access the user interface and perform corresponding operations while watching the playing video data. This greatly enriches the browsing user's various needs when accessing the user interface. It is understandable that the video data displayed in this small window can also be dragged to any interface of the user for playback as needed.

[0052] S203, during the playback of the multimedia data, if the user identifier is subjected to a second trigger operation, the playback control of the multimedia data is performed according to the second trigger operation.

[0053] During the playback of the multimedia data, the client can also control the playback of the multimedia data based on a second trigger operation performed by the browsing user at the user identifier. This second trigger operation can be the same as or different from the first trigger operation. When the second trigger operation is the same as the first trigger operation, the client can stop the currently playing multimedia data. Regardless of whether the playing multimedia data is audio or video data, the client will redisplay the original user interface after stopping the playback, such as... Figure 3f As shown, if the user interface is as follows Figure 3f The interface marked with a 301 error is showing audio data being played, or, as... Figure 3f The interface marked with a 302 error is showing video data being played. If the client detects a second triggering operation identical to the first, it will stop playing the audio or video data and redisplay the interface as shown in the image. Figure 3f The original user interface marked with a 303 error.

[0054] In one embodiment, the second triggering operation may also differ from the first triggering operation. If the first triggering operation is a rightward dragging operation, it can be understood that the second triggering operation can be a dragging operation in a different direction from the first triggering operation, such as a leftward dragging operation, a downward dragging operation, or a dragging operation along the upper right, etc. If the second triggering operation is a downward dragging operation, when the client determines that the user identifier has been subjected to the second triggering operation, if the target user has only added one associated multimedia data to the user interface, the client can replay the currently playing multimedia data, or the client can obtain multimedia data from the Internet that matches the data content of the one multimedia data, and after stopping the playback of the currently playing multimedia data, start playing the multimedia data obtained from the Internet; or, if the target user has added at least two associated multimedia data to the user interface, after obtaining a second triggering operation different from the first triggering operation, the client can stop playing the currently playing multimedia data and start playing other multimedia data added by the target user to the user interface. Taking audio data as an example, for instance... Figure 3g As shown, after detecting a downward drag operation, the client will stop playing audio data numbered 1 in the user interface and start playing audio data numbered 2 in the user interface.

[0055] In this embodiment of the invention, after displaying the target user's user interface, the client binds at least one multimedia data associated with the user interface to the user identifier displayed in the user interface. Therefore, if the user identifier displayed in the user interface is triggered by a first trigger operation, the client can play the multimedia data associated with the user interface, thereby enhancing the interactivity between the browsing user and the user interface during access. Furthermore, playing multimedia data based on the browsing user's triggering of the user identifier in the user interface enhances the browsing experience and improves the user's browsing experience. In addition, during the playback of the multimedia data, the client can also control the playback of the multimedia data based on a second trigger operation performed on the user identifier, allowing the client to control the playback of multimedia data according to user needs, thus improving the flexibility of controlling the multimedia data when playing it in the user interface.

[0056] Please see Figure 4 This is a schematic flowchart illustrating a data processing method proposed in an embodiment of the present invention. This method can also be applied to the aforementioned client, such as... Figure 4 As shown, the method may include:

[0057] S401, Display the user interface of the target user, the user interface displays the user identifier of the target user, and the user interface is associated with at least one multimedia data.

[0058] In one embodiment, the specific implementation of step S401 can be found in the specific implementation of step S201 in the above embodiments, and will not be limited here.

[0059] S402, when the user identifier is triggered by the first operation, multimedia data is played on the user interface.

[0060] When the user identifier is triggered in the first operation, the client can first determine whether the target user has bound associated multimedia data to the user interface. Specifically, the client can determine this by checking if a multimedia indicator is displayed at the location of the user identifier in the user interface. If, when the user identifier is triggered in the first operation, a multimedia indicator is also displayed at the location of the user identifier in the user interface, such as... Figure 3a As shown in the right figure, the multimedia data associated with the user interface can be played on the user interface. This multimedia indicator is displayed after the target user adds associated multimedia data to the user interface. In another embodiment, if the multimedia indicator is not displayed at the location where the user identifier is displayed in the user interface when the client performs the first triggering operation on the user identifier, such as... Figure 3aAs shown in the left figure, it can be understood that if the multimedia indicator is not displayed at the location where the user identifier is displayed, it means that the target user has not bound the associated multimedia data to the user interface, or that the client has not bound the multimedia data associated with the target user to the user interface with the user identifier. In this case, the client can choose not to play the multimedia data when the multimedia indicator is not displayed at the location where the user identifier is displayed.

[0061] The first triggering operation for this user identifier can be a double-click, a dragging operation along a first direction, or a pressing operation, etc. The first direction can be to the right. When the browsing user drags the user identifier along the right and the dragged distance reaches a preset distance threshold, a playback indicator for multimedia data will be triggered at the initial display position of the user identifier on the user interface. The browsing user can stop dragging the user identifier when the playback indicator is displayed on the user interface, and the client can then play the multimedia data associated with that user interface after the playback indicator is displayed. Figure 5a As shown, the playback indicator is displayed as follows: Figure 5a The indicator marked with 50 is shown in the image. It can be understood that if the browsing user drags the user icon a distance less than a preset distance threshold, the playback indicator will not appear at the initial display position of the user icon in the user interface, and the client will not be triggered to play the multimedia data. This initial display position is the position of the user icon in the user interface before it is dragged. By ensuring that multimedia data playback is triggered only after the browsing user drags the user icon a certain distance, the client can effectively avoid playing multimedia data based on accidental triggering of the user icon by the browsing user, thus avoiding waste of client data playback resources.

[0062] In order to further enhance the browsing experience of users during the playback of multimedia data, the client can also display related data that matches the content of the multimedia data, i.e., execute step S403.

[0063] S403, during playback, displays associated data on the user interface that matches the data content of the multimedia data.

[0064] Multimedia data played in the user interface includes audio or video data. The associated data matching the audio data content includes one or more of the following: cover images, text, and video; while the associated data matching the video data content includes one or both of the following: cover images and text. Displaying associated data matching the multimedia data content during playback effectively enhances the user's immersion when accessing the user interface, thereby improving the interface's stylistic presentation. For example, when the multimedia data associated with the user interface is music, the user can play the music associated with the user interface by performing a first trigger operation at the user identifier displayed in the user interface. Simultaneously, during music playback, static or dynamic images, text, or music videos (MVs) related to the music content can be displayed on the user interface, thus enhancing the user experience when accessing the user interface.

[0065] In one embodiment, if the multimedia data is audio data, the client displays associated data matching the audio data content in the user interface in one or more of the following ways: displaying a cover image matching the audio data content at the location where a user identifier is displayed or a background image is displayed; displaying video data matching the audio data content at the location where a background image is displayed in the user interface; and displaying text matching the audio data content at the location where a background image is displayed in the user interface. Specifically, such as Figure 5b As shown, the client can display the album art of the audio data only at the location where the user identifier is displayed during playback, such as... Figure 5b The interface marked with a 501 error is shown in the image; alternatively, the client can display the cover image only where the background image is displayed during the playback of the audio data, such as... Figure 5b The interface marked with a 502 error is shown in the image; alternatively, the client can display the video data only where the background image is displayed during the playback of the audio data, such as... Figure 5b The interface marked with a 503 error is shown in the image; alternatively, the client can display text data only where the background image is displayed during the playback of the audio data, such as... Figure 5b The interface marked with a 504 error is shown in the image. Furthermore, the associated data displayed by this user interface, matching the audio data, can also be as follows: Figure 5b The 501 to 504 marks any combination of two or more interfaces, such as... Figure 5c As shown, the client can display a cover image at the location where the user identifier is displayed, and play video data (or display an image that matches the content of the audio data) at the location where the background image is displayed, while playing the audio data.

[0066] In one embodiment, if the multimedia data is video data, when the client plays the video data, it can display the video data in the location where the background image is displayed in the user interface. The client can display associated data matching the video data content in one or two of the following ways: displaying a cover image matching the video data content in the location where the user identifier is displayed; and displaying text matching the video data content in the location where the background image is displayed. By displaying associated data matching the multimedia data content in the user interface while playing the multimedia data, the user interface can better reflect the target user's mood and personality, and also enhance the browsing experience.

[0067] When a client plays multimedia data and associated data matching the multimedia data content in the user interface, it can first check whether the first data resource of the multimedia data and the second data resource of the associated data matching the multimedia data content are stored in the local cache. If the client determines that the first data resource and the second data resource are stored in the local cache, it can play the multimedia data based on the first data resource and display the associated data based on the second data resource. Alternatively, if the client determines that the first data resource or the second data resource is not stored in the local cache, it can request the first data resource and / or the second data resource from the server. In other words, the client pre-caches the first data resource of the multimedia data and the second data resource of the associated data matching the data content. Then, except when the client first loads the multimedia data and the associated data, it can directly play the multimedia data based on the locally cached data resources. This reduces the data processing pressure on the server, reduces the client's traffic consumption, and speeds up the client's response efficiency to the user's triggering operations, providing the user with a better browsing experience.

[0068] During the process of playing the multimedia data on the user interface and displaying associated data that matches the data content of the multimedia data, the browsing user can also control the playback of the multimedia data, i.e., execute step S404.

[0069] S404: During the playback of multimedia data, if the user identifier is subjected to a second trigger operation, the playback control of the multimedia data is performed according to the second trigger operation.

[0070] If the target user is associated with multimedia data that includes at least first multimedia data and second multimedia data, then when the user identifier is triggered by the first operation, the client can first compare the data quality of the first multimedia data and the second multimedia data. If the data quality of the first multimedia data is higher than that of the second multimedia data, then when the user identifier is triggered by the first operation, the client can play the first multimedia data on the user interface. In another implementation, the client can select the multimedia data to be played when the user identifier is triggered for the first time, based on the current network quality. That is, when the network quality is good, the client can select multimedia data with higher data quality for playback, while when the network quality is poor, the client can first load the data resources of relatively more concise (i.e., lower data quality) multimedia data. For example, if the client's current network is a 5th generation mobile network (5G), the client can select to load the data resources of the first multimedia data with higher data quality and play the first multimedia data in a simultaneous loading (or simultaneous playback) manner. If the client's current network is a 2nd generation mobile network (2G), the client can select to load the data resources of the second multimedia data with lower data quality and play the second multimedia data.

[0071] In one embodiment, if a second triggering operation is performed on the user identifier during the playback of the multimedia data, and this second triggering operation is the same as the first triggering operation, then the playback of the multimedia data can be stopped. After stopping the playback of the multimedia data, the background image and the user identifier are redisplayed on the user interface. In this embodiment of the invention, taking the first multimedia data played by the client after the user identifier is triggered as an example, if the user identifier is triggered again during the playback of the first multimedia data, a stop playback indicator for the multimedia data will be displayed at the starting position of the user identifier on the user interface. The client can then stop playing the first multimedia data after the stop playback indicator is displayed and redisplay the user identifier and the background image. Figure 5d As shown in the figure, if the first multimedia data is played and the associated data of the first multimedia data is displayed on the user interface, the interface diagram is as follows. Figure 5d As shown in the interface marked with 505, after the user identifier is triggered again by the first action, the displayed stop playback indicator could be as follows: Figure 5d The indicator marked 51 indicates that after the first multimedia data stops playing, the background image and user icon are re-displayed on the user interface. The user interface, with its background image and user icon, is then displayed again. Figure 5d The interface marked with 506 is shown in the image.

[0072] In one embodiment, during the playback of the multimedia data, if a second triggering operation is performed on the user identifier, and this second triggering operation differs from the first triggering operation, the client can stop playing the first multimedia data and start playing the second multimedia data. Similarly, during the playback of the second multimedia data, the client can display associated data matching the content of the second multimedia data on the user interface. Wherein, if the first triggering operation is a dragging operation along a first direction, the second triggering operation includes a dragging operation along a second direction. For example, if the first triggering operation is a dragging operation along the right, the second triggering operation could be a dragging operation along the downward direction. Similarly, when the client drags the user identifier along the second direction, a data switching indicator will appear on the user interface. After the data switching indicator is displayed on the user interface, the client will stop playing the first multimedia data and start playing the second multimedia data. Figure 5e As shown, if the client plays the first multimedia data and displays the associated data on the user interface, the interface will be as follows: Figure 5e As shown in the interface marked 507, after the user ID is dragged downwards (i.e., the second trigger operation), the displayed data switching indicator may be as follows: Figure 5e The indicator marked 52 shows that after the first multimedia data stops playing, the second multimedia data is played, and the user interface displays associated data matching the content of the second multimedia data. The user interface could be as follows: Figure 5e The interface marked with 508 is shown in the image. It should be noted that during the playback of the first multimedia data, if the client detects a second trigger operation different from the first trigger operation, the client can switch to playing second multimedia data of the same or different type as the first multimedia data. That is, if the first multimedia data is audio data, after the user identifier is executed with the second trigger operation, the second multimedia data played by the client can be audio data or video data; this embodiment of the invention does not impose any limitations.

[0073] In one embodiment, if the first triggering operation is a rightward dragging operation and the second triggering operation is a downward dragging operation, the client can determine whether to play, stop, or switch multimedia data based on the direction of the triggering operation performed by the browsing user at the user identifier, the dragging distance, and the status. Specifically, it can be as follows: Figure 6As shown, after multimedia data is played in the user interface, the client can listen for triggering operations performed at the user icon displayed in the user interface. If the client determines that the triggering operation at the user icon is horizontally downward, it further determines whether the dragging distance of the user icon meets a preset distance threshold, that is, whether the dragging distance of the browsing user at the user icon is sufficient to trigger the display of a stop playback indicator. If it determines that the dragging distance is sufficient, the stop playback indicator is rendered and displayed in the user interface, and the playback of the first multimedia data is stopped. Furthermore, after stopping the playback of the first multimedia data, the client will continue to listen for triggering operations performed in the user interface. When a triggering operation is detected again at the user icon, if the client determines that the target user has added second multimedia data to the user interface, the second multimedia data can be played.

[0074] In one embodiment, if the client detects a horizontal rightward movement triggered at the user identifier, and the distance the user identifier is dragged horizontally to the right is sufficient to trigger a display indicator, and if multimedia data is currently playing, a stop playback indicator can be rendered and displayed in the user interface. Playback of the multimedia data will stop when the triggering operation is sufficient to trigger interactive behavior. If no multimedia data is currently playing, a playback indicator can be rendered and displayed in the user interface, and playback of multimedia data (such as the first multimedia data) can begin. Similarly, after playing the first multimedia data, if the client detects another triggering operation at the user identifier, it can play the second multimedia data if the target user has added second multimedia data to the user interface. When playing the second multimedia data, the client can first check if the data resource for the second multimedia data (specifically including the first data resource of the second multimedia data and the second data resource of associated data matching the data content of the second multimedia data) is stored in its local cache. If it determines that the data resource is not present, it can request the data resource from the server and download it. If the client determines that the data resource is present in its local cache, it can play the multimedia data based on the data resource and display the associated data matching the multimedia data in the user interface.

[0075] In one embodiment, the client checks whether the local cache of multimedia data resources has been completely downloaded, both when stopping playback and during playback. If not, it resumes playback from where it left off until the multimedia data resources are downloaded. In this embodiment, resuming playback from where it left off maximizes server utilization. The client can play multimedia data while simultaneously resuming playback from where it left off, thus accelerating the client's response to user actions and improving user experience. Furthermore, because the client locally caches the multimedia data resources using a custom encoding method, it is unaffected by name conflicts or version discrepancies. When the same multimedia data is needed again, playback can be based on the locally cached data resources, further improving the efficiency of responding to user actions. This reduces server data processing pressure while allowing the client to respond quickly and promptly to triggers, providing a better user experience.

[0076] In this embodiment of the invention, when the user identifier of the target user is displayed in the user interface, if the user identifier is triggered by a first operation, the client can play multimedia data in the user interface and display associated data matching the content of the multimedia data during the playback. In addition, the client can also control the playback of the multimedia data when the user identifier is triggered by a second operation during the playback. Since the client binds the multimedia data associated with the user interface to the user identifier, it can save the display resources of the user interface. Furthermore, when the client plays multimedia data, it will prioritize the display of locally cached data resources. Combined with the simultaneous playback and power outage resume methods, it can effectively save the data processing pressure of the server and improve the client's response efficiency to the user's trigger operations.

[0077] Based on the description of the above data processing method embodiments, this invention also proposes a data processing apparatus, which can be a computer program (including program code) running on the aforementioned client. This data processing apparatus can be used to perform tasks such as... Figure 2 and Figure 4 For the data processing method described above, please refer to [link / reference]. Figure 7 The data processing device includes a display unit 701, a playback unit 702, and a control unit 703.

[0078] Display unit 701 is used to display the user interface of the target user, the user interface displaying the user identifier of the target user, and the user interface being associated with at least one multimedia data;

[0079] The playback unit 702 is configured to play multimedia data associated with the user interface on the user interface when the user identifier is triggered by a first triggering operation.

[0080] The control unit 703 is configured to control the playback of the multimedia data according to the second trigger operation if the user identifier is triggered during the playback of the multimedia data.

[0081] In one embodiment, the playback unit 702 is specifically used for:

[0082] Play the multimedia data on the user interface; or,

[0083] The multimedia data is played on the user interface, and during the playback, associated data matching the data content of the multimedia data is displayed on the user interface.

[0084] In one embodiment, the multimedia data includes audio data or video data;

[0085] The associated data that matches the data content of the audio data includes one or more of the following: cover images, text, and videos;

[0086] The associated data that matches the data content of the video data includes one or both of the following: cover image and text.

[0087] In one embodiment, the user interface also displays a background image. If the multimedia data is audio data, the display unit 701 is specifically used for:

[0088] Display a cover image that matches the data content of the audio data at the location where the user identifier is displayed or the location where the background image is displayed;

[0089] Display video data matching the data content of the audio data at the location where the background image is displayed; and...

[0090] Text matching the data content of the audio data is displayed at the location where the background image is displayed.

[0091] In one embodiment, the user interface further displays a background image; if the multimedia data is video data, the video data is displayed at the position where the background image is displayed in the user interface; the display unit 701 is specifically used for:

[0092] Display a cover image matching the data content of the video data at the location where the user identifier is displayed; and,

[0093] Text matching the data content of the video data is displayed at the location where the background image is displayed.

[0094] In one embodiment, the playback unit 703 is specifically used for:

[0095] When the user identifier is triggered by the first operation, if a multimedia indicator is also displayed in the position where the user identifier is displayed in the user interface, then the associated multimedia data of the user interface is played in the user interface.

[0096] The multimedia indicator is displayed after the target user adds associated multimedia data to the user interface.

[0097] In one embodiment, the control unit 703 is specifically used for:

[0098] If the second triggering operation performed on the user identifier is the same as the first triggering operation, then the playback of the multimedia data is stopped;

[0099] The first triggering operation includes one or more of the following: double-click operation, drag operation along a first direction, and press operation.

[0100] In one embodiment, the display unit 701 is further configured to re-display the background image on the user interface and re-display the user identifier on the user interface.

[0101] In one embodiment, at least one multimedia data associated with the user interface includes: first multimedia data and second multimedia data; the playback unit 702 is specifically used for:

[0102] If the data quality of the first multimedia data is higher than that of the second multimedia data, then when the user identifier is triggered by the first operation, the first multimedia data is played on the user interface.

[0103] In one embodiment, the control unit 703 is specifically used for:

[0104] If the second triggering operation performed on the user identifier is different from the first triggering operation, then the first multimedia data playback stops, and the second multimedia data is played.

[0105] The second triggering operation includes a dragging operation along a second direction.

[0106] In one embodiment, the display unit 701 is further configured to display associated data matching the data content of the second multimedia data on the user interface during the playback of the second multimedia data.

[0107] In one embodiment, the playback unit 702 is specifically used for:

[0108] The system queries whether the multimedia data has been stored in the local cache as a first data resource, and whether the associated data that matches the data content of the multimedia data is a second data resource.

[0109] If so, the multimedia data is played according to the first data resource, and the associated data is displayed according to the second data resource;

[0110] If not, then request the first data resource, the second data resource, or the first data resource and the second data resource from the server.

[0111] In this embodiment of the invention, after the display unit 701 displays the user interface of the target user, since at least one multimedia data associated with the user interface is bound to the user identifier displayed in the user interface, if the user identifier displayed in the user interface is triggered by a first trigger operation, the playback unit 702 can play the multimedia data associated with the user interface in the user interface. This enhances the interactivity between the browsing user and the user interface during the access process. Furthermore, playing multimedia data based on the browsing user's trigger on the user identifier in the user interface enhances the browsing experience and improves the user's browsing experience. In addition, during the playback of the multimedia data, the control unit 703 can also control the playback of the multimedia data based on a second trigger operation performed on the user identifier, enabling control of the multimedia data playback based on user needs and improving the flexibility of controlling the multimedia data when playing it in the user interface.

[0112] Please see Figure 8 This is a schematic block diagram of a client structure provided in an embodiment of the present invention. Figure 8 The client in this embodiment may include: one or more processors 801; one or more input devices 802; one or more output devices 803; and a memory 804. The processors 801, input devices 802, output devices 803, and memory 804 are connected via a bus 805. The memory 804 stores a computer program, which includes program instructions, and the processor 801 executes the program instructions stored in the memory 804.

[0113] The memory 804 may include volatile memory, such as random-access memory (RAM); the memory 804 may also include non-volatile memory, such as flash memory, solid-state drive (SSD), etc.; the memory 804 may also include a combination of the above types of memory.

[0114] The processor 801 may be a central processing unit (CPU). The processor 801 may further include hardware chips. These hardware chips may be application-specific integrated circuits (ASICs), programmable logic devices (PLDs), etc. The PLD may be a field-programmable gate array (FPGA), generic array logic (GAL), etc. The processor 801 may also be a combination of the above structures.

[0115] In this embodiment of the invention, the memory 804 is used to store a computer program, the computer program including program instructions, and the processor 801 is used to execute the program instructions stored in the memory 804 to implement the above-mentioned... Figure 2 and Figure 4 The steps of the corresponding method.

[0116] In one embodiment, the processor 801 is configured to invoke the program instructions to execute:

[0117] The user interface of the target user is displayed, the user interface displays the user identifier of the target user, and the user interface is associated with at least one multimedia data;

[0118] When the user identifier is triggered by the first operation, multimedia data associated with the user interface is played on the user interface.

[0119] During the playback of the multimedia data, if the user identifier is triggered by a second operation, the playback control of the multimedia data is performed according to the second trigger operation.

[0120] In one embodiment, the processor 801 is configured to invoke the program instructions to execute:

[0121] Play the multimedia data on the user interface; or,

[0122] The multimedia data is played on the user interface, and during the playback, associated data matching the data content of the multimedia data is displayed on the user interface.

[0123] In one embodiment, the multimedia data includes audio data or video data;

[0124] The associated data that matches the data content of the audio data includes one or more of the following: cover images, text, and videos;

[0125] The associated data that matches the data content of the video data includes one or both of the following: cover image and text.

[0126] In one embodiment, the user interface also displays a background image. If the multimedia data is audio data, the processor 801 is configured to invoke the program instructions to execute:

[0127] Display a cover image that matches the data content of the audio data at the location where the user identifier is displayed or the location where the background image is displayed;

[0128] Display video data matching the data content of the audio data at the location where the background image is displayed; and...

[0129] Text matching the data content of the audio data is displayed at the location where the background image is displayed.

[0130] In one embodiment, the user interface further displays a background image; if the multimedia data is video data, the video data is displayed at the position where the background image is displayed in the user interface; the processor 801 is configured to call the program instructions to execute:

[0131] Display a cover image matching the data content of the video data at the location where the user identifier is displayed; and,

[0132] Text matching the data content of the video data is displayed at the location where the background image is displayed.

[0133] In one embodiment, the processor 801 is configured to invoke the program instructions to execute:

[0134] When the user identifier is triggered by the first operation, if a multimedia indicator is also displayed in the position where the user identifier is displayed in the user interface, then the associated multimedia data of the user interface is played in the user interface.

[0135] The multimedia indicator is displayed after the target user adds associated multimedia data to the user interface.

[0136] In one embodiment, the processor 801 is configured to invoke the program instructions to execute:

[0137] If the second triggering operation performed on the user identifier is the same as the first triggering operation, then the playback of the multimedia data is stopped;

[0138] The first triggering operation includes one or more of the following: double-click operation, drag operation along a first direction, and press operation.

[0139] In one embodiment, the processor 801 is configured to invoke the program instructions to execute:

[0140] Redisplay the background image in the user interface, and redisplay the user ID in the user interface.

[0141] In one embodiment, at least one multimedia data associated with the user interface includes: first multimedia data and second multimedia data; the processor 801 is configured to invoke the program instructions to execute:

[0142] If the data quality of the first multimedia data is higher than that of the second multimedia data, then when the user identifier is triggered by the first operation, the first multimedia data is played on the user interface.

[0143] In one embodiment, the processor 801 is configured to invoke the program instructions to execute:

[0144] If the second triggering operation performed on the user identifier is different from the first triggering operation, then the first multimedia data playback stops, and the second multimedia data is played.

[0145] The second triggering operation includes a dragging operation along a second direction.

[0146] In one embodiment, the processor 801 is configured to invoke the program instructions to execute:

[0147] During the playback of the second multimedia data, associated data matching the data content of the second multimedia data is displayed on the user interface.

[0148] In one embodiment, the processor 801 is configured to invoke the program instructions to execute:

[0149] The system queries whether the multimedia data has been stored in the local cache as a first data resource, and whether the associated data that matches the data content of the multimedia data is a second data resource.

[0150] If so, the multimedia data is played according to the first data resource, and the associated data is displayed according to the second data resource;

[0151] If not, then request the first data resource, the second data resource, or the first data resource and the second data resource from the server.

[0152] This invention provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the aforementioned actions. Figure 2 or Figure 4 The method embodiment shown. The computer-readable storage medium may be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0153] The above-disclosed embodiments are merely partial examples of the present invention and should not be construed as limiting the scope of the invention. Those skilled in the art will understand that all or part of the processes for implementing the above embodiments, and equivalent variations made in accordance with the claims of the present invention, still fall within the scope of the invention.

Claims

1. A data processing method, characterized in that, include: The user interface of the target user is displayed. The user interface displays the user's user identifier, which is associated with a multimedia indicator. The user interface is associated with at least one multimedia data. The multimedia indicator is displayed after the target user has associated at least one multimedia data with the user interface. The user interface is associated with at least one type of multimedia data, including: first multimedia data and second multimedia data; When the user ID associated with the multimedia indicator is triggered by the first operation, the first multimedia data associated with the user interface is played on the user interface. During the playback of the first multimedia data, if the user identifier is subjected to a second trigger operation, the playback of the first multimedia data is controlled according to the second trigger operation; wherein, if the second trigger operation is the same as the first trigger operation, the playback of the first multimedia data is stopped; if the second trigger operation is different from the first trigger operation, the playback of the first multimedia data is stopped and the playback of the second multimedia data begins.

2. The method according to claim 1, characterized in that, Playing multimedia data associated with the user interface on the user interface includes: Play the multimedia data on the user interface; or, The multimedia data is played on the user interface, and during the playback, associated data matching the data content of the multimedia data is displayed on the user interface.

3. The method according to claim 2, characterized in that, The multimedia data includes audio data or video data; The associated data that matches the data content of the audio data includes one or more of the following: cover images, text, and videos; The associated data that matches the data content of the video data includes one or both of the following: cover image and text.

4. The method according to claim 3, characterized in that, The user interface also displays a background image. If the multimedia data is audio data, the way the user interface displays associated data matching the data content of the audio data includes one or more of the following: Display a cover image that matches the data content of the audio data at the location where the user identifier is displayed or the location where the background image is displayed; Display video data matching the data content of the audio data at the location where the background image is displayed; and... Text matching the data content of the audio data is displayed at the location where the background image is displayed.

5. The method according to claim 3, characterized in that, The user interface also displays a background image. If the multimedia data is video data, the video data is displayed at the position where the background image is displayed in the user interface. The user interface displays associated data matching the content of the video data in one or both of the following ways: Display a cover image matching the data content of the video data at the location where the user identifier is displayed; and, Text matching the data content of the video data is displayed at the location where the background image is displayed.

6. The method according to claim 1, characterized in that, When the user identifier is triggered by the first operation, playing multimedia data associated with the user interface on the user interface includes: When the user identifier is triggered by the first operation, if a multimedia indicator is also displayed in the position where the user identifier is displayed in the user interface, then the associated multimedia data of the user interface is played in the user interface. The multimedia indicator is displayed after the target user adds associated multimedia data to the user interface.

7. The method according to claim 1, characterized in that, The first triggering operation includes one or more of the following: double-click operation, drag operation along a first direction, and press operation.

8. The method according to claim 7, characterized in that, After stopping the playback of the multimedia data, the method further includes: Redisplay the background image in the user interface, and redisplay the user ID in the user interface.

9. The method according to claim 1, characterized in that, When the user identifier is triggered by the first operation, playing multimedia data associated with the user interface on the user interface includes: If the data quality of the first multimedia data is higher than that of the second multimedia data, then when the user identifier is triggered by the first operation, the first multimedia data is played on the user interface.

10. The method according to claim 9, characterized in that, in, The second triggering operation includes a dragging operation along a second direction.

11. The method according to claim 10, characterized in that, The method further includes: During the playback of the second multimedia data, associated data matching the data content of the second multimedia data is displayed on the user interface.

12. The method according to claim 1, characterized in that, Playing multimedia data associated with the user interface on the user interface includes: The system queries whether the multimedia data has been stored in the local cache as a first data resource, and whether the associated data that matches the data content of the multimedia data is a second data resource. If so, the multimedia data is played according to the first data resource, and the associated data is displayed according to the second data resource; If not, then request the first data resource, the second data resource, or the first data resource and the second data resource from the server.

13. A data processing apparatus, characterized in that, include: A display unit is used to display the user interface of a target user. The user interface displays the user identifier of the target user, which is displayed in association with a multimedia indicator. The user interface is associated with at least one multimedia data. The multimedia indicator is displayed after the target user has associated at least one multimedia data with the user interface. The user interface is associated with at least one type of multimedia data, including: first multimedia data and second multimedia data; A playback unit is configured to play first multimedia data associated with the user interface on the user interface when the user identifier associated with the multimedia indicator is triggered by a first operation. The control unit is configured to, during the playback of the first multimedia data, if the user identifier is subjected to a second trigger operation, control the playback of the first multimedia data according to the second trigger operation; wherein, if the second trigger operation is the same as the first trigger operation, the playback of the first multimedia data is stopped; if the second trigger operation is different from the first trigger operation, the playback of the first multimedia data is stopped and the playback of the second multimedia data begins.

14. A client, characterized in that, The device includes a processor, an input device, an output device, and a memory, wherein the processor, the input device, the output device, and the memory are interconnected, wherein the memory is used to store a computer program, the computer program including program instructions, and the processor is configured to invoke the program instructions to execute the method as described in any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1 to 12.

Images