Information processing method, apparatus, device, medium, and program product

Abstract

Disclosed in embodiments of the present application are an information processing method and a related apparatus. During information synchronization adjustment, whether information to be played is related to a target content progress that significantly affects the information synchronization perception of a content viewer is determined; during content playing, whether information asynchronization occurs in content at the target content progress would be easily perceived by the content viewer; if said information played at a target playing moment is related to the target content progress, and there are large differences among content progresses respectively corresponding to said information of different information types, information synchronization adjustment is performed on the target playing moment, so as to ensure that the content related to the target content progress does not have a significant information synchronization problem during playing; and if said information is not related to the target content progress, the intensity of information synchronization adjustment can be reduced to reduce the amount of information that needs to be processed. The present application ensures the played information to be completer and more authentic while ensuring the content viewing experience, and is also more suitable for content playing scenarios with strong real-time requirements.

Description

Information processing method, device, equipment, medium and program product

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on January 26, 2024, with application number 2024101127624 and application name “A Method for Information Processing and Related Devices”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present application relates to the field of information technology, and in particular to information processing. Background Art

[0003] Audio and video synchronization is a key factor affecting the information playback effect in various scenarios. For example, in video communication scenarios, if audio and video synchronization cannot be achieved, the video information seen by the communicating parties and the audio information heard will not correspond, resulting in the inability to conduct effective video communication.

[0004] To ensure audio and video synchronization, related technologies perform timestamp checks on the video and audio information being played to determine whether they are time-synchronized. If a mismatch is detected, the information is processed to ensure that the audio and video information being played is more closely synchronized.

[0005] However, the information processing method in the related technology will process any audio and video information that is out of synchronization. Although it can ensure the audio and video synchronization effect of the played information, it will occupy a large amount of information processing resources and consume a lot of information processing time, which may easily lead to problems such as information jamming and loss during information playback. Summary of the Invention

[0006] In order to solve the above technical problems, the present application provides an information processing method that can perform information synchronization adjustment on the content of object information that is likely to affect the synchronous browsing experience of browsing information, while reducing the processing volume of information synchronization adjustment while ensuring the information browsing experience.

[0007] The embodiments of this application disclose the following technical solutions:

[0008] In a first aspect, an embodiment of the present application discloses an information processing method, the method comprising:

[0009] Obtaining first to-be-played information and second to-be-played information for playback at a target playback time, wherein the first to-be-played information is information of a first information type corresponding to target content at a first content progress, and the second to-be-played information is information of a second information type corresponding to the target content at a second content progress, wherein the first information type and the second information type are different information types;

[0010] Based on the presence of a target content progress in the first content progress and the second content progress, and the progress difference between the first content progress and the second content progress being greater than a first difference threshold, first information corresponding to the first information type is determined based on the first information to be played, and second information corresponding to the second information type is determined based on the second information to be played; when the target content reaches the target content progress, information corresponding to both the first information type and the second information type changes, and the change in the information in the first information type causes the change in the information in the second information type;

[0011] The first information and the second information are played at the target playback time, and a difference between content progresses respectively corresponding to the first information and the second information in the target content is not greater than the first difference threshold.

[0012] In a possible implementation, the third content progress is located between the first content progress and the second content progress.

[0013] In a second aspect, an embodiment of the present application discloses an information processing device, the device comprising an acquisition unit, a first determination unit, and a first playback unit:

[0014] The acquiring unit is configured to acquire first to-be-played information and second to-be-played information for playback at a target playback time, wherein the first to-be-played information is information of a first information type corresponding to target content at a first content progress, and the second to-be-played information is information of a second information type corresponding to the target content at a second content progress, wherein the first information type and the second information type are different information types;

[0015] The first determining unit is configured to determine, based on the presence of a target content progress in the first content progress and the second content progress, first information corresponding to the first information type according to the first to-be-played information, and second information corresponding to the second information type according to the second to-be-played information, wherein, when the target content reaches the target content progress, information corresponding to both the first information type and the second information type changes, and the change in information in the first information type is a cause of the change in information in the second information type;

[0016] The first playback unit is configured to play the first information and the second information at the target playback time, wherein a difference between content progress corresponding to the first information and the second information in the target content is not greater than the first difference threshold.

[0017] In a third aspect, an embodiment of the present application discloses a computer device, comprising a processor and a memory:

[0018] The memory is used to store a computer program and transmit the computer program to the processor;

[0019] The processor is configured to execute the information processing method according to any one of the first aspects according to the instructions in the computer program;

[0020] In a fourth aspect, an embodiment of the present application discloses a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and the computer program is used to execute the information processing method according to any one of the first aspects;

[0021] In a fifth aspect, an embodiment of the present application discloses a computer program product comprising a computer program, which, when executed on a computer device, enables the computer device to execute the information processing method described in any one of the first aspects.

[0022] As can be seen from the above technical solution, the first device can play the target content by playing the target content at each content progress, corresponding to the first information type and the second information type. After obtaining the first to-be-played information and the second to-be-played information for playing at the target playback time, the present application does not directly play at the target playback time, but first analyzes the content progress difference between the two to-be-played information and analyzes whether the content progress corresponding to the two to-be-played information includes the target content progress. When the target content is at the target content progress, the information corresponding to the first information type and the second information type respectively changes, and the information change on the first information type is the cause of the information change on the second information type. Therefore, if the target content is played at the target content progress corresponding to one information type, the information played corresponding to the other information type is significantly different from the target content progress, which can easily cause the content browser to perceive that the browsed content is out of sync between the two information types, affecting the content browsing experience of the content browser. On the contrary, if the target content progress is not included, the content browser has less perception of whether there is an information progress difference in the content played at that moment, so the progress difference has less impact on the content browsing experience of the content browser. Therefore, based on the existence of the target content progress in the first content progress and the second content progress, and the progress difference between the first content progress and the second content progress being greater than a first difference threshold, information synchronization processing is performed on the information to be played at the target playback time. That is, first information corresponding to the first information type and second information corresponding to the second information type are determined based on the first information to be played and the second information to be played, respectively, so that the difference between the content progress corresponding to the first information and the second information is no greater than the first difference threshold. The first information and the second information can be played at the target playback time in place of the original first information to be played and the second information to be played, so that the content viewer can browse content that is relatively consistent in multiple information types at the target playback time. Since this application only adjusts the information that has progress differences and has a greater impact on the content browsing experience when performing information synchronization adjustment, there is no need to adjust the information to be played at each moment when there is a progress difference. Therefore, while ensuring the content browsing experience, the adjustment amount of information synchronization adjustment is reduced, thereby reducing the amount of information that needs to be abandoned during the information synchronization adjustment, and the amount of information that needs to be extended / slowed down, etc., which helps to improve the content browsing party's ability to browse more complete and restored content when browsing the content, and also reduces the information processing time, which is more suitable for scenarios with high real-time content playback. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] FIG1 is a schematic diagram of an information processing method in a practical application scenario provided by an embodiment of the present application;

[0024] FIG2 is a flow chart of an information processing method provided in an embodiment of the present application;

[0025] FIG3 is a schematic diagram of an information processing method provided in an embodiment of the present application;

[0026] FIG4 is a schematic diagram of an information processing method provided in an embodiment of the present application;

[0027] FIG5 is a signaling diagram of an information processing method in a practical application scenario provided by an embodiment of the present application;

[0028] FIG6 is a structural block diagram of an information processing device provided in an embodiment of the present application;

[0029] FIG7 is a structural diagram of a terminal provided in an embodiment of the present application;

[0030] FIG8 is a structural diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The embodiments of the present application are described below with reference to the accompanying drawings.

[0032] Information synchronization adjustment is one of the common technical means when playing content that includes multiple information types. For example, when the content is video content, it will include two types of information: image information and audio information. Through information synchronization adjustment, the object watching the video can browse the image information and audio information of similar content progress of the corresponding video content, thereby ensuring the object's video viewing experience.

[0033] In the related art, whether to perform information synchronization adjustment depends entirely on the difference between the content progress corresponding to the information of each information type of the content to be played. For example, taking video content as an example, a difference threshold is set in the related art. After obtaining the image information and audio information to be played at the next playback moment, the content progress corresponding to the image information and audio information in the video content (for example, the frame number, the second number, etc.) will be determined respectively. If the difference in the content progress of the two is greater than the difference threshold, it is determined that playing the image information and audio information at the same time will result in a problem of audio and video being out of sync. Therefore, the information synchronization adjustment will be performed at the playback moment to make the difference between the content progress corresponding to the image information and audio information actually played at the playback moment smaller, so that the user watching the video content will hardly notice it.

[0034] However, since methods such as deleting part of the information and deforming the information are usually used when performing information synchronization adjustment, and the information synchronization adjustment method in the related technology may contain a large amount of information that needs to be synchronized, in the related technology, a lot of information in the played content may be deleted or deformed (such as lengthening, shortening, etc.), resulting in poor quality of content browsed by the content browser, making it difficult to bring a good content browsing experience, and requiring a large amount of information processing, which puts a lot of pressure on information processing and is not suitable for scenarios such as real-time transmission that require high immediacy of content playback.

[0035] In order to solve the above technical problems, the present application provides an information processing method. When performing information synchronization adjustment, it will be judged whether the information to be played involves the target content progress. The target content changes in the information of the first information type and the second information type corresponding to the target content progress, and the change in the first information type is the reason for the change in the information of the second information type. Therefore, when playing the content, whether the content of the target content progress has information asynchrony can be easily perceived by the content browsing party. If the information to be played at the target playback time involves the target content progress, and the content progress corresponding to the to-be-played information of different information types is relatively different, information synchronization adjustment will be performed for the target playback time to ensure that there is no significant information synchronization problem when the content involved in the target content progress is played. If the target content progress is not involved, the information synchronization adjustment intensity can be reduced to reduce the amount of information required to be processed. While ensuring the content browsing experience, the played information is more complete and restored, and it is also more suitable for content playback scenarios with strong real-time performance.

[0036] It is understandable that the method can be applied to a computer device, which is a computer device capable of processing and playing information, such as a terminal device or a server. The method can be executed independently by a terminal device, or it can be applied to a network scenario in which a terminal device and a server communicate, and is executed in cooperation with the terminal device and the server. Among them, the terminal device can be a mobile phone, a tablet computer, a laptop computer, a desktop computer and other devices. The terminal device can also include a variety of virtual reality devices, for example, it can include augmented reality (AR) devices, such as AR glasses, AR screens and other devices, and can include virtual reality technology (VR) devices, such as head-mounted VR glasses and other devices. The server can be understood as an application server or a web server. In actual deployment, the server can be a standalone server, a cluster server, or a cloud server.

[0037] In order to facilitate understanding of the technical solution provided by this application, the information processing method provided by this application will be introduced in conjunction with an actual application scenario.

[0038] See Figure 1, which is a schematic diagram of an information processing method in an actual application scenario provided by this application. In this actual application scenario, the computer device can be a terminal device 101 with information processing function, for example, it can be a mobile phone for playing video content, etc., and the content is the target video content.

[0039] The terminal device 101 can obtain the video frames and audio frames corresponding to the target video content at multiple content progresses, wherein the video frame is information corresponding to the image information type in the target video content, and the audio frame is information corresponding to the audio information type in the target video content. The terminal device 101 can play the target video content by playing the video frames and the audio frames simultaneously. In order to play the target video content normally, at the target playback time of playing the target video content, the terminal device 101 first obtains the video frame 1 and audio frame 1 for playing at the target playback time, where the video frame 1 is the video frame corresponding to the content progress 1, and the audio frame 1 is the audio frame corresponding to the content progress 2.

[0040] Since the video frame and the audio frame may be transmitted to the terminal device 101 separately, a variety of factors may occur during the transmission process, causing the terminal device 101 to receive the information of these two information types at a time that is not synchronized, which may cause the played video frame and audio frame to be out of sync, that is, the content progress 1 and the content progress 2 may not be the same content progress. The terminal device 101 can make judgments in two dimensions (the two dimensions are not in order), for example, it can first determine whether the two content progresses include the target content progress. As shown in Figure 1, when the target video content is in the target content progress, both the image information and the audio information change, and the change in the image information is the cause of the change in the audio information, that is, the target video content has undergone a highly correlated synchronous change in the two information types in the target content progress. For example, when a character starts to speak in the video frame, the sound of the character speaking appears synchronously in the audio frame.

[0041] Therefore, if the video viewing party wants to have a better viewing experience for the video content at the target content progress, it is necessary to ensure that the time interval between the video frames and audio frames corresponding to the target content progress is small. Based on this, if it is determined that the target content progress is not included, it means that even if there is a difference in content progress between the video frame and the audio frame, the viewing experience of the video viewer is relatively small, and the terminal device 101 can choose not to perform information synchronization adjustment; if the target content progress is included, the terminal device 101 can also determine whether the progress difference between the above two content progresses reaches a first difference threshold. If not, it means that the two content progresses are relatively close, and directly playing video frame 1 and audio frame 1 has little impact on the content playback effect of the target content progress (for example, audio and video synchronization). Therefore, information synchronization adjustment can be omitted; if the first difference threshold is reached, it means that the difference between the two content progresses is large. Directly playing video frame 1 and audio frame 1 will cause the video viewer to experience obvious audio and video synchronization problems. Therefore, the terminal device 101 can perform information synchronization adjustment, that is, determine video frame 2 based on video frame 1, and determine audio frame 2 based on audio frame 1. The progress difference between the content progress corresponding to video frame 2 and audio frame 2 is not greater than the first preset threshold, so that video frame 2 and audio frame 2 can be played at the target playback time to ensure that the video viewer has a better video viewing experience at the target playback time.

[0042] It can be seen from the above content that when playing video content, the terminal device 101 may not adjust every audio and video asynchrony problem, but only adjust the audio and video asynchrony problems that have a greater impact on the viewing experience of the video viewer. For problems with less impact, you can choose not to adjust them. This ensures the video viewing experience while reducing the amount of information adjustment. On the one hand, it reduces the amount of information lost or deformed due to information synchronization adjustment, improves the integrity and restoration of video viewing, and on the other hand reduces the time required for information synchronization adjustment, which helps to bring a more real-time video viewing experience in real-time video transmission scenarios.

[0043] Next, the information processing method provided by this application will be introduced in conjunction with the accompanying drawings.

[0044] Referring to FIG. 2 , FIG. 2 is a flowchart of an information processing method provided in an embodiment of the present application. In this embodiment, the computer device may be any of the aforementioned computer devices with information processing capabilities, such as a terminal device for processing and playing information. The method includes:

[0045] S201: Acquire first to-be-played information and second to-be-played information for playing at a target playback time.

[0046] The first and second pending information are the information that would be played at the target playback time if no synchronization adjustment was required. For multiple types of information that are originally required to be played at the same playback time (e.g., the target playback time), synchronization adjustment is used to reduce the progress differences between the content corresponding to each of these types of information.

[0047] The information of the multiple information types includes at least the aforementioned first information to be played and second information to be played. The first information to be played is of the first information type and corresponds to the first content progress of the target content. The second information to be played is of the second information type and corresponds to the second content progress of the target content. The first information type and the second information type are different information types, that is, the target content includes information of the multiple information types, and the information of the multiple information types together constitute the target content. Therefore, the same content progress of the target content contains information of the multiple information types.

[0048] Content progress refers to the progress of information within the target content, identifying its temporal distribution within the target content. Content progress can be expressed in time. For example, if the target content plays for 1 minute, its content progress can be expressed as a moment, such as the 5th second or the 18th second, or as a percentage, such as 10% (corresponding to the 6th second) or 50% (corresponding to the 30th second).

[0049] The playback time is used to identify the moment at which the target content is played, and can be understood as a time-based expression of the content progress. The target content can be of various types. Taking video content as an example, the multiple information types corresponding to the video content can include image information type and audio information type, i.e., the "picture" and "sound" in audio-visual synchronization. The information corresponding to the image information type of the video content can be image information (such as video frames), and the information corresponding to the audio information type of the video content can be audio information (such as audio frames). The content progress can be the time corresponding to the information in the video content, such as the second or frame in the video content.

[0050] S202: Based on the existence of a target content progress in the first content progress and the second content progress, and when a progress difference between the first content progress and the second content progress is greater than a first difference threshold, determining first information corresponding to a first information type according to the first information to be played, and determining second information corresponding to a second information type according to the second information to be played.

[0051] It is understandable that the target content usually has correlations between the information corresponding to multiple information types. For example, the events occurring in the image information of the video content will have corresponding sounds in the audio information. Therefore, if you want the content browser who receives and plays the target content to have a good content browsing experience, when playing information of multiple information types, it is usually necessary to ensure that the content progress corresponding to the information of multiple information types is relatively close.

[0052] The difference is that the present application has found that not all content progress differences between information can be clearly perceived by the content browser. For example, in video content, if the image information remains black for a period of time, even if the sound information changes, the content browser cannot clearly perceive whether the time of the sound change is accurate, and thus cannot clearly perceive the problem of audio and video being out of sync. However, if the image information is a picture of a person starting to speak, but the sound of the person does not appear in the audio information, the content browser can clearly perceive that there is a problem of audio and video being out of sync.

[0053] Based on this, in order to reduce the amount of information synchronization adjustment while ensuring the content browsing experience, the computer device can only adjust the information asynchrony problem that the content browser can clearly perceive. The computer device can perform two-dimensional analysis. The first dimension is to analyze whether there is a target content progress in the first content progress and the second content progress. When the target content is at the target content progress, the information corresponding to the first information type and the second information type respectively changes, and the information change on the first information type is the cause of the information change on the second information type. That is, when the target content is at the target content progress, information changes occur on multiple information types, and the correlation between the information changes of multiple information types is relatively close, so that the content browser can clearly perceive whether the information on multiple information types is correctly played synchronously when the target content is played to the target content progress. For example, the character in the image information starts to speak, which causes the character's voice to appear in the audio information, and the closing of the door in the image information causes the door closing sound to appear in the audio information.

[0054] Therefore, in the first dimension, if the computer device determines that the first content progress and the second content progress include the target content progress, the difference between the two content progresses (i.e., the correlation between the first information to be played and the second information to be played) has a greater impact on the content browsing experience; if the target content progress is not included, it means that the difference between the two content progresses has little impact on the content browsing experience.

[0055] In the second dimension, the computer device can determine whether the progress difference between the first content progress and the second content progress is greater than a first difference threshold, which is used to determine whether there is a large difference between the two content progresses. If it is greater than the first difference threshold and includes the target content progress, it means that if the first to-be-played information and the second to-be-played information are played directly at this time, the difference between the content progresses will have a greater impact on the content browsing experience. At this time, the computer device can perform information synchronization adjustment. If the target content progress is not included, or although the content progress is included, the content progress difference does not exceed the first difference threshold, it means that the difference between the two content progresses has a small impact on the content browsing experience. The computer device can choose not to perform information synchronization adjustment to reduce the amount of information adjustment.

[0056] When adjusting information synchronization, the computer device may determine the first information based on the first information to be played, and determine the second information based on the second information to be played. The determination may be performed in a variety of ways, which will be described in detail below. The difference between the content progress corresponding to the first information and the second information in the target content is no greater than a first difference threshold. This ensures that when the first information and the second information are played at the target playback time, they can have better information synchronization and have a minimal impact on the content browsing experience.

[0057] S203: Play the first information and the second information at the target playback time.

[0058] It can be seen from the above technical solution that after obtaining the first information to be played and the second information to be played for playing at the target playback time, the present application does not directly play at the target playback time, but first analyzes the content progress difference between the two information to be played, and analyzes whether the content progress corresponding to the two information to be played includes the target content progress that has a greater impact on the content browsing experience, and performs targeted information synchronization adjustment on multiple information that includes the target content progress and has a large progress difference. Because the present application only adjusts the information that has a progress difference and has a greater impact on the content browsing experience when performing information synchronization adjustment, there is no need to adjust the information to be played at each moment when there is a progress difference. Therefore, while ensuring the content browsing experience, the adjustment amount of information synchronization adjustment is reduced, thereby reducing the amount of information that needs to be abandoned when performing information synchronization adjustment, and the amount of information that needs to be extended / slowed down, etc., thereby helping to improve the content browsing party's ability to browse more complete and restored content when browsing content, while also reducing the information processing time, and is more suitable for scenarios with high real-time content playback.

[0059] As mentioned above, if the target content progress does not exist between the first content progress and the second content progress, it means that the content progress difference is not likely to affect the content browsing experience, but it does not mean that there is no impact at all. If the difference between the two content progress is too large, it may still cause the content browser to perceive information asynchrony. For example, in video content, if the time difference between the audio information and the image information is too large, although the video content may not have any content that can cause significant information changes, the video viewer may still perceive that the audio and video are out of sync.

[0060] Based on this, in order to further improve the content browsing experience in one possible implementation, the computer device can further determine whether the progress difference between the first content progress and the second content progress is greater than a second difference threshold. The second difference threshold is greater than the first difference threshold, that is, for information that does not include the target content progress, the threshold for the computer device to trigger information synchronization adjustment will be increased, that is, a larger progress difference will trigger information synchronization adjustment, thereby giving information that has less impact on the content browsing experience a larger progress difference space, and to a certain extent reducing the amount of information adjustment.

[0061] Because the target content progress does not exist between the first content progress and the second content progress, and the progress difference between the first content progress and the second content progress is greater than the second difference threshold, it indicates that due to the large difference in content progress corresponding to the first information to be played and the second information to be played, playing the first information to be played and the second information to be played simultaneously is still likely to affect the content browsing experience. In this case, the computer device can determine third information corresponding to the first information type based on the first information to be played, and determine fourth information corresponding to the second information type based on the second information to be played, and then play the third information and the fourth information at the target playback time, and the difference between the content progress corresponding to the third information and the fourth information in the target content is no greater than the second difference threshold, thereby achieving information synchronization adjustment for the playback time.

[0062] Similarly, if the progress difference between the first content progress and the second content progress is not greater than the first difference threshold, it indicates that the content progress difference between the two pieces of information is small. Regardless of whether the information itself is easily perceived as synchronized, under this progress difference, the content browser is unlikely to perceive the information as out of sync. Therefore, the computer device can directly play the first to-be-played information and the second to-be-played information at the target playback time.

[0063] Alternatively, if the progress difference between the first content progress and the second content progress is no greater than a second difference threshold, and the target content progress does not exist between the first content progress and the second content progress, this indicates that although there is a certain difference in content progress between the two pieces of information, the information itself is not easily perceived as indicating whether there is an information synchronization issue. Therefore, after playback, the content viewer is also unlikely to perceive the information out of synchronization issue. Therefore, the computer device may directly play the first and second pieces of information to be played at the target playback time. This approach can reduce the need for information synchronization adjustments to a certain extent, thereby reducing the amount of information adjustments required.

[0064] Next, the information synchronization adjustment process will be introduced in detail.

[0065] First, when performing information synchronization adjustment, the information to be adjusted may vary depending on the adjustment requirements. The following will mainly introduce two methods: adjusting information of a single information type and adjusting information of a combination of two information types.

[0066] The first type: adjusting information of a single information type

[0067] It is understandable that information is usually played in sequence based on the progress of the content. Therefore, on the one hand, in order to ensure the continuity of information playback, and on the other hand, in order to reduce the adjustment calculation amount of information synchronization adjustment, the computer device can only adjust the information of a single information type out of the two information types, and keep the information of the other information type unchanged.

[0068] In one possible implementation, when executing step S202, the computer device may execute step S2021 (not shown in the figure). Step S2021 is a possible implementation of step S202, including:

[0069] S2021: Determine the first information to be played as first information corresponding to a first information type, and determine second information corresponding to a second information type based on the second information to be played.

[0070] The computer device can keep the first information to be played of the first information type unchanged, and perform information synchronization adjustment on the second information to be played of the second information type to obtain the second information. The second information is used to simulate the target content corresponding to the information of the second information type on the third content progress. The progress difference between the third content progress and the first content progress is not greater than the first difference threshold. Therefore, when the first information (i.e., the first information to be played) and the second information are played at the target playback time, a smaller content progress difference can be brought about, thereby ensuring the content viewing experience of the content browser.

[0071] It should be emphasized that the simulation in this application can be the information of the target content corresponding to the second information type at the third content progress, or it can be information similar to the information. For example, when adjusting information synchronization for image information type, the image information corresponding to the target content at the third content progress can be directly selected as the second information; when adjusting information synchronization for audio information type, the second information can be selected as the second information. The playback information is adjusted by slowing down the audio, compressing the audio, etc., to obtain second information similar to the audio information corresponding to the target content at the third content progress.

[0072] Among them, in order to further reduce the information adjustment amount of information synchronization adjustment, in a possible implementation method, the third content progress can be located between the first content progress and the second content progress, so as to narrow the difference between the third content progress and the second content progress. When the second information is determined based on the second information to be played, the information adjustment amount can be reduced. For example, by deleting the information corresponding to the content progress between the second content progress and the third content progress so that the second information can be played at the target playback time, the amount of information deletion can be reduced, so that the content browsed by the content browser can be more complete; when the second information is obtained by performing information deformation processing on the second information to be played, such as audio frame lengthening, shortening, etc., the information deformation amplitude of the second information to be played can be reduced, so that the second information can be more real and restored.

[0073] As shown in Figure 3, the information used to play at the target playback time is video frame 1 and audio frame 1, and the first difference threshold can be one frame. The progress difference between the first content progress and the second content progress is three frames, which exceeds the first progress difference. If the target content progress is included, information synchronization adjustment is required. Among them, the computer device can keep video frame 1 unchanged and adjust the audio frame. The difference between the content progress corresponding to audio frame 3 and audio frame 2 and the first content progress is one frame, which meets the adjustment requirements. However, the progress difference between the second content progress and the fourth content progress is much greater than the progress difference between the second content progress and the third content progress. Therefore, the amount of information processing required to adjust to audio frame 3 is greater, so audio frame 2 can be selected as the audio frame actually played.

[0074] In addition, in order to further reduce the impact of information synchronization adjustment on the content browsing experience, the computer device can also analyze the impact of information synchronization adjustment on the content browsing experience caused by each information type, and select information of a lower impact type for information synchronization adjustment.

[0075] For example, in one possible implementation, the second information type is an audio information type. The way the audio information changes in the time domain is a key factor in determining whether the audio information perceived by the content viewer is distorted. Therefore, when adjusting the audio information, if the time difference between the audio information before adjustment and the audio information after adjustment is large, for example, compressing audio information over a longer period of time to obtain new audio information, it is easy to cause the audio information perceived by the content viewer to be distorted.

[0076] Based on this, in one possible implementation, the computer device may determine whether to use the audio information type as the information type that needs to be adjusted based on the content progress interval that needs to be adjusted. When executing step S2021, the computer device may execute step S20211 (not shown in the figure). Step S20211 is a possible implementation of step S2021, including:

[0077] S20211: Based on the progress difference between the second content progress and the first content progress being less than a third difference threshold, the first information to be played is determined as first information corresponding to a first information type, and second information corresponding to a second information type is determined based on the second information to be played.

[0078] Among them, the third difference threshold is used to measure whether the difference between the progress of two contents is small. If the progress difference between the two contents is less than the third difference threshold, it means that the probability of audio information distortion caused by adjusting the audio information based on the progress difference is low. Therefore, the audio information type can be used as the information type for information synchronization adjustment. Otherwise, it means that the probability of audio information distortion is high, and the computer device can select other information types for adjustment.

[0079] The specific adjustment methods for audio information may include the following:

[0080] When the audio information is ahead of another information type in content progress (e.g., the audio information reaches the 10th second of the content, but the other information type only reaches the 8th second), the computer device can use a time compression / stretching (TS) algorithm to slow down the playback speed of the audio information to wait for the arrival of the other information type; if the other information type is ahead of the audio information in content progress, the computer device can use the TS algorithm to speed up the playback speed of the audio information to catch up with the content progress of the other information type.

[0081] In another possible implementation, the computer device may further determine whether to select the image information type as the type for information synchronization adjustment based on the adjustment impact of the image information. It is understandable that in some content, the image information corresponding to multiple content progresses may be relatively similar. For example, video content may include some static content. When this image information is fast-forwarded or slowed down, the content viewer may have difficulty perceiving the image information adjustment, and thus may have a low perception of the information synchronization adjustment.

[0082] Based on this, in one possible implementation, to reduce the impact of information synchronization adjustments on the content browsing experience, the computer device may only perform information synchronization adjustments on image information with a smaller range of changes. In this implementation, the second information type may be an image information type. When executing step 2021, the computer device may execute step S20212 (not shown in the figure). Step S20212 is a possible implementation of step S2021, including:

[0083] S20212: Based on the fact that the information change amplitude of the corresponding information on the image information type between the second content progress and the third content progress of the target content is less than the amplitude threshold, the first information to be played is determined as the first information corresponding to the first information type, and the second information corresponding to the second information type is determined based on the second information to be played.

[0084] The amplitude threshold is used to measure the amplitude of image information changes between multiple content progresses. If the amplitude threshold is less than the amplitude threshold, it indicates that the amplitude of image information changes between the second and third content progresses is small. Therefore, when the image information corresponding to the second content progress is adjusted to the image information corresponding to the third content progress, the content viewer will be less aware of the adjustment, resulting in a better content viewing experience. Therefore, the computer device can use the image information type as the information type for information synchronization adjustment. If the amplitude threshold is not less than the amplitude threshold, it indicates that the amplitude of image information changes between the second and third content progresses is large. Therefore, if the image information to be played at the target playback time is directly replaced from the second to-be-played information to the second information, the content viewer will likely perceive an abnormal image information change, thereby affecting the content viewer's content viewing experience.

[0085] When adjusting the image information, the computer device may adopt the following adjustment methods:

[0086] When the image information is ahead of the information of another information type in terms of content progress (e.g., the image information reaches the 10th second of the content, but the information of the other information type reaches only the 8th second), the computer device may slow down the playback of the image information, or keep the image information unchanged (e.g., add a still frame, etc.) to wait for the information of the other information type to catch up; when the image information lags behind the information of the other information type in terms of content progress, the computer device may delete part of the image information corresponding to the content progress, so that the playback of the image information catches up with the information of the other information type. For example, when the image information reaches the 8th second of the content and the information of the other information type reaches the 10th second of the content, the computer device may delete the image information before the 10th second and directly play the image information of the 10th second.

[0087] The second type: combining information from two types of information for adjustment

[0088] It is understandable that the purpose of information synchronization adjustment is to reduce the content progress difference between the two information types actually played. Therefore, under normal circumstances, the adjustment range of the content progress difference is borne by the information of both information types. Compared with adjusting only one information type, the adjustment range of each information type can be controlled at a lower range, thereby ensuring the content browsing experience. For example, the content progress difference between two information types may be 10 seconds. If the information of a single information type is adjusted to fast forward / slow down by 10 seconds, the excessive adjustment range may result in a poor content browsing experience. However, if the information of both information types is adjusted by 5 seconds respectively, the overall adjustment range can be reduced, thereby reducing the impact of information synchronization adjustment on the content browsing experience.

[0089] Based on this, in one possible implementation method, the first information obtained through information synchronization adjustment can be used to simulate the information of the first information type corresponding to the target content in the fourth content progress, and the second information can be used to simulate the information of the second information type corresponding to the target content in the fifth content progress. The fourth content progress and the fifth content progress are located between the first content progress and the second content progress, so that the adjustment range can be distributed to the two information types, further reducing the impact of information synchronization adjustment on the content browsing experience.

[0090] As shown in Figure 4, before adjustment, the video frame 1 and audio frame 1 used to be played at the target playback time have a content progress difference of 3 frames. During information synchronization adjustment, only 1 frame needs to be adjusted on the image information type and 1 frame on the audio information type to obtain video frame 2 and audio frame 2. The content progress difference between video frame 2 and audio frame 2 is only 1 frame, which meets the playback requirements and can actually be played at the target playback time.

[0091] It should be emphasized that the solution in this application is only introduced for two types of information involved in the content, and can also be applied to content with more than two types of information, which is not limited here.

[0092] Next, we will introduce in detail how to determine the target content progress corresponding to the target content.

[0093] As mentioned above, the target content will undergo information changes during the target content progress. This is why the information corresponding to the target content progress has a significant impact on the content browsing experience. Based on this, in one possible implementation, the computer device can analyze whether the above-mentioned target content progress is achieved based on the information changes at each content progress.

[0094] In this implementation, the target content progress is determined through a progress determination process, which includes:

[0095] The computer device can obtain first information to be analyzed and second information to be analyzed of the first information type corresponding to the target content at a sixth content progress and a seventh content progress, respectively. The progress difference between the seventh content progress and the sixth content progress is less than a fourth difference threshold, i.e., the seventh content progress is a content progress that is relatively close to the sixth content progress. The sixth content progress can be any content progress within the target content. Because the target content progress satisfies the requirement of corresponding information changes in both information types, the computer device can perform information change detection on a single information type to determine the target content progress within the target content. The computer device can preset a first information difference threshold, which is used to measure whether significant information changes have occurred. If the difference between the first information to be analyzed and the second information to be analyzed is greater than the first information difference threshold, it can be determined that at the sixth content progress, a significant information change has occurred in at least the first information type of the target content. Therefore, the computer device can determine the sixth content progress as the target content progress.

[0096] It should be emphasized that the multiple target content progresses determined by this method may not all meet the requirement of information changes in both information types. For example, content progress that has only undergone significant changes in the first information type will also be identified by this method. However, the target content progress that meets the above requirements can be determined by this method. Therefore, when information synchronization adjustment is performed on the target content progress determined by this method, the technical effects involved in this application can still be achieved.

[0097] Among them, the seventh content progress can be before the sixth content progress or after the sixth content progress. When the seventh content progress is before the sixth content progress, it means that the sixth content progress is probably the starting progress of a certain key content. When the seventh content progress is after the sixth content progress, it means that the sixth content progress is probably the ending progress of a certain key content. The computer device can perform information synchronization adjustment for both progresses to improve the information synchronization of the key content playback.

[0098] The information change analysis for different information types may be different, and various information types will be introduced in detail below.

[0099] In one possible implementation, the first information type may be audio information type, and the first information difference threshold includes a first energy threshold, which is used to measure whether there is a significant difference in information energy between two audio information pieces. The first information to be analyzed is the first audio information, and the second information to be analyzed is the second audio information. When the sixth content progress is determined as the target content progress based on the difference between the first information to be analyzed and the second information to be analyzed being greater than the first information difference threshold, the computer device may analyze whether the difference in information energy between the two audio information pieces reaches the first energy threshold.

[0100] Since the information energy of the first audio information exceeds that of the second audio information and reaches the first energy threshold, it indicates that a significant change has occurred in the audio information on the sixth content progress, and therefore the sixth content progress can be determined as the target content progress. For example, when special events such as door slamming and explosions occur in the video content, special sounds such as door slamming and explosions will appear in the audio information, which will lead to more significant changes in the audio information. Generally, content viewers are more sensitive to changes in audio information, so this method can be used to determine content that is easily perceived by content viewers, and then determine the target content progress.

[0101] In addition, for audio information, the computer device can further analyze whether the audio information can be perceived by the content browser. For example, the computer device can set a preset perception threshold based on the information energy that the content browser can perceive. Only when the information energy is greater than the preset perception threshold can the audio information be perceived by the content browser. Therefore, based on the judgment of the information energy difference of the audio information, the computer device can also make a judgment in combination with the preset perception threshold. Only when the information energy difference reaches the first energy threshold and the first audio information exceeds the preset perception threshold, the computer device can determine that the audio information change of the content progress can be perceived by the content browser, and therefore can be determined as the target content progress. On the contrary, if it does not exceed the preset perception threshold, even if the information energy change occurs, it cannot be perceived by the content browser, so the impact on the content browsing experience is small.

[0102] It is understandable that the content browser has different perception acuity for different audio information, and the degree to which the synchronization of information changes of different audio information affects the content browsing experience is also different. For example, the content browser is usually more sensitive to the synchronization of audio information and image information when a person speaks, and can clearly perceive small differences in content progress, while the sensitivity to the synchronization perception of some things such as object collisions and object sound effects is lower. Based on this, in one possible implementation, the computer device can perform more accurate information change recognition for human voice information.

[0103] The process of a character speaking includes a voice start event (i.e., the character begins speaking) and a voice end event (i.e., the character ends speaking). First, in one possible implementation, a computer device can accurately identify the voice start event to determine the content progress at which the character begins speaking. In this implementation, the sixth content progress is after the seventh content progress, the first information difference threshold also includes the second energy threshold, and the progress determination process further includes:

[0104] The computer device can further analyze whether the first audio information and the second audio information include human voice information. Based on the fact that the information energy of the first audio information exceeds the information energy of the second audio information to reach the second energy threshold, and the first audio information includes human voice information, but the second audio information does not include human voice information, it means that before the sixth content progress, no human voice has appeared. At the sixth content progress, the human voice starts to speak, a human voice start event occurs, and the human voice start event can be more clearly perceived by the content browser. Based on this, the computer device can determine the sixth content progress as the target content progress. Among them, the second energy threshold is less than the first energy threshold, so the difference in audio information including human voice information can be more accurately identified to meet the content browser's demand for high information synchronization of human voice information.

[0105] In another possible implementation, the computer device can accurately identify the human voice ending event. The sixth content progress is after the seventh content progress, the first information difference threshold also includes the second energy threshold, and the progress determination process further includes:

[0106] Based on the fact that the information energy of the first audio information is lower than that of the second audio information and reaches the second energy threshold, and the second audio information includes human voice information, but the first audio information does not include human voice information, it means that the character is still speaking at the seventh content progress, and has finished speaking at the sixth content progress. Therefore, it can be said that there is a high probability that a human voice end event has occurred at the sixth content progress, so that the computer device can determine the sixth content progress as the target content progress, and the second energy threshold is less than the first energy threshold.

[0107] Through the above process, the computer device can more accurately identify the content progress of the start and end of the human voice, thereby ensuring that the content viewer can perceive the human voice content with strong information synchronization, meeting the content viewer's demand for high synchronization perception of human voice content. The second energy threshold for identifying the human voice start event and the human voice end event can be different or the same threshold, which is not limited here.

[0108] In another possible implementation, the first information type is an image information type, the first information difference threshold may include an image information difference threshold, the first information to be analyzed is the first image information, and the second information to be analyzed is the second image information. When the sixth content progress is determined as the target content progress based on the difference between the first information to be analyzed and the second information to be analyzed being greater than the first information difference threshold, the computer device may analyze whether the difference between the first image information and the second image information reaches the image information difference threshold. The image information difference threshold is used to measure whether there is a significant difference between the two image information that can be clearly perceived by the content browser. If the difference between the first image information and the second image information reaches the image information difference threshold, it indicates that a significant change has occurred in the image information type at the sixth content progress, and the sixth content progress is likely to be the target content progress. Therefore, the computer device may determine the sixth content progress as the target content progress to ensure that the content browser synchronously perceives the information about the change in the image information.

[0109] Among them, similar to human voice information, content viewers are usually more sensitive to human images, so the computer device can set a lower image information difference threshold to more effectively identify the content progress of the appearance and disappearance of human images. For example, if the sixth content progress is after the seventh content progress, and the seventh content progress does not include human images, the sixth content progress includes human images, and the image information difference is greater than the lower image information difference threshold, then it means that an easily perceived human appearance event has occurred in the sixth content progress, and the computer device can determine the sixth content progress as the target content progress. If the sixth content progress is after the seventh content progress, and the seventh content progress includes human images, the sixth content progress does not include human images, and the image information difference is greater than the lower image information difference threshold, then it means that an easily perceived human disappearance event has occurred in the sixth content progress, and the computer device can also determine the sixth content progress as the target content progress.

[0110] Furthermore, as mentioned above, the target content progress has information changes in both information types, and the synchronous changes of information of multiple information types are also easy for the content browser to perceive whether the information is synchronized. Therefore, in one possible implementation method, in order to further improve the recognition accuracy of the target content progress and thereby reduce the amount of information synchronization adjustment during information playback, the computer device can simultaneously perform information change analysis on information of the two information types.

[0111] In this implementation, the progress determination process may further include:

[0112] The target content is obtained at the sixth content progress and the seventh content progress, respectively, corresponding to the third to-be-analyzed information and the fourth to-be-analyzed information of the second information type. When the sixth content progress is determined as the target content progress based on a difference between the first to-be-analyzed information and the second to-be-analyzed information being greater than a first information difference threshold, the computer device may preset a second information difference threshold and further analyze the information difference between the third to-be-analyzed information and the fourth to-be-analyzed information. The second information difference threshold is used to measure whether information of the second information type has undergone an information change that is easily perceived by a content viewer.

[0113] Because the difference between the first information to be analyzed and the second information to be analyzed is greater than the first information difference threshold, and the difference between the third information to be analyzed and the fourth information to be analyzed is greater than the second information difference threshold, it indicates that at the sixth content progress, the target content has undergone significant changes in both the first information type and the second information type that are perceptible to the content viewer. Therefore, the sixth content progress is likely the target content progress. Therefore, the computer device can determine the sixth content progress as the target content progress, so that information synchronization adjustments can be made based on the sixth content progress during information playback.

[0114] Compared with the above-mentioned method of identifying the target content progress based on information changes of a single information type, the target content progress identified by combining information changes of multiple information types is more accurate, and can filter out some content progress that only undergoes information changes in a single information type, thereby reducing the number of content progress that needs to be adjusted during information playback. While ensuring the content browsing experience, the amount of information adjustment is further reduced, which helps to improve the integrity and restoration of the playback content.

[0115] In addition to directly identifying the target content progress from the dimension of information change, in another possible implementation, the computer device can also directly determine the target content progress involved in the target content through content recognition.

[0116] It is understandable that there are some specific contents that are prone to cause information changes in multiple information types, and the correlation between the information changes in multiple information types is relatively strong. For example, in content involving people speaking, changes in the character's lip shape or movements will appear in the image information, and human voice information will appear in the audio information; in content involving objects exploding, the image effect of the object exploding will appear in the image information, and the sound of the explosion will appear in the audio information. These contents are all content that allows content viewers to accurately perceive whether there are information synchronization problems in content playback. Based on this, the computer device can directly identify this part of the content, thereby determining the content progress involved in this part of the content, and determining these content progresses as the target content progress, so that more accurate information synchronization adjustments can be made for this part of the content during information playback to ensure the content browsing experience.

[0117] In this implementation, the progress determination process may include:

[0118] Obtain the information to be analyzed of the target information type corresponding to the eighth content progress of the target content. The eighth content progress can be any content progress involved in the target content, and the target information type is the first information type or the second information type. The computer device can pre-determine the information corresponding to the target sub-content on the target information type. This part of information is called content identification information. That is, if the information corresponding to the target information type on a certain content progress of the target content includes the content identification information, it means that the target sub-content has a high probability of appearing on the target content on the content progress. Among them, the target sub-content is the content that causes the information change on the first information type and the second information type, and the information change on the first information type is the reason for the information change on the second information type. That is, the target sub-content is the above-mentioned content that is easy for the content browser to perceive whether there is an information synchronization difference.

[0119] Therefore, based on the information to be analyzed including content identification information corresponding to the target information type, the computer device can determine whether the content associated with the eighth content progress is easily perceived by the content viewer and whether an information synchronization discrepancy exists. The computer device can then determine the eighth content progress as the target content progress, with the content identification information being information corresponding to the target information type for the target sub-content. Consequently, during information playback, by adjusting information synchronization based on the target content progress, the computer device can ensure that the target sub-content is played with high information synchronization.

[0120] For example, the target sub-content may be content about an object exploding, the content identification information corresponding to the image information type may be a picture of an object exploding, and the content identification information corresponding to the audio information type may be the sound of an object exploding. As long as it is recognized that the image information corresponding to the eighth content progress includes a picture of an object exploding, or that the audio information corresponding to the eighth content progress includes the sound of an object exploding, it can be determined that content about an object exploding has occurred in the eighth content progress, and the computer device can therefore determine the eighth content progress as the target content progress.

[0121] In order to enable the determined target content progress to be adjusted in a targeted manner in each device on the information playback side, the computer device may add a corresponding identifier for the target content progress. In a possible implementation, the progress determination process further includes:

[0122] Based on determining that the sixth content progress is the target content progress, the computer device can add a target identifier to the first information to be analyzed and the third information to be analyzed. The third information to be analyzed is information of the second information type corresponding to the sixth content progress of the target content, that is, the computer device can add a target identifier to the information of each information type corresponding to the target content progress. The target identifier is used to identify that the information corresponds to the target content progress.

[0123] Therefore, when executing step S202, the computer device may execute step S2022 (not shown in the figure). Step S2022 is a possible implementation of step S202, including:

[0124] S2022: Based on the presence of information including a target identifier in the first information to be played and the second information to be played, and the progress difference between the first content progress and the second content progress is greater than a first difference threshold, first information corresponding to the first information type is determined according to the first information to be played, and second information corresponding to the second information type is determined according to the second information to be played.

[0125] The computer device can determine whether the target content progress is included in the content progress corresponding to the to-be-played information based on whether the target identifier is included in the to-be-played information. Thus, with only a single progress determination process, the target content can be accurately identified across multiple computer devices used for information processing. This eliminates the need for multiple analyses of the target content information and simplifies identification based on the target identifier, further improving information processing efficiency.

[0126] The computer devices used to perform the progress identification process and the computer devices used to perform information processing and playback can be different computer devices. For example, in one possible implementation, the above-mentioned information processing method can be applied to a first device on the information playback side, which is used to perform information synchronization processing and information playback. The progress determination process is performed by a second device on the information transmission side, which is used to send information corresponding to the first information type and the second information type of the target content to the first device. For example, after obtaining the target content, the second device first determines the target content progress included in the target content and adds a target identifier to the information related to the target content progress. Then, the information of the first information type and the second information type corresponding to the target content are sent to the first device, and the first device can play the received information of each information type in sequence. Due to various interference factors that may occur during the information transmission process, the progress of the information received by the first device and the progress of the information sent may be different, which may cause the first device to experience content progress differences when playing the information. The first device can use the target identifier added by the second device to determine the information related to the target progress content and perform information synchronization adjustments based on this information to ensure the content browsing experience.

[0127] In order to facilitate understanding of the technical solution provided by this application, the information processing method provided by this application will be introduced in conjunction with an actual application scenario.

[0128] Referring to Figure 5, Figure 5 is a signaling diagram of an information processing method in an actual application scenario provided by the present application. In this actual application scenario, the computer device may include a terminal device on the information playback side and a server on the information sending side. The content may be video content. The information type corresponding to the video content includes an image information type and an audio information type. The information corresponding to the image information type of the video content is a video frame, and the information corresponding to the audio information type of the video content is an audio frame. The content progress is the frame number position (such as the frame number, etc.) corresponding to the video frame or audio frame in the video content. The method includes:

[0129] S501: The server obtains video content.

[0130] The video content may be any video content, for example, video content in real-time video communication.

[0131] S502: The server performs a progress determination process for the video content to determine the target content progress corresponding to the video content.

[0132] The server can pass the video content through a video encoder and an audio encoder, respectively, to generate a video encoding stream and an audio encoding stream. The video encoding stream includes multiple video frames, and the audio encoding stream includes multiple audio frames. The server can analyze the information changes in the video frames and audio frames to determine the progress of the target content.

[0133] For example, the server can determine whether the audio frame has a sudden change in audio energy, that is, an event with transient frame energy changes, such as a door slamming, a knocking sound, etc. If the current audio frame energy is greater than a preset perception threshold (the frame energy value that reaches a noticeable level based on human ear perception), or the current audio frame energy is greater than the previous frame energy by more than M1 times (M1 is an empirical value, for example, M1=10).

[0134] Alternatively, the server can determine whether there is a sound start event or a sound end event based on the audio frame. The event needs to pass three levels of detection. The first level is human voice detection (which can be achieved through the existing voice activity detection (VAD) algorithm or the human voice detection algorithm based on deep neural network), which is used to detect whether the current audio frame has human voice information. If the detection result is that there is human voice information, the second level of detection is performed, that is, whether the information energy of the current frame exceeds the preset perception threshold. If the detection result is true, the third level of detection is performed, that is, human voice start and end detection. If the audio signal of the previous frame or the previous frame does not include human voice information, the audio signal of the current frame includes human voice information, and the energy of the current frame exceeds the energy of the non-human voice frame of the previous frame or the previous frame by more than M2 times (M2 takes an empirical value, for example, M2=8, which is less than M1), it is determined that a human voice start event has occurred in the current frame. If the audio signal of the previous frame includes human voice information, the audio signal of the current frame does not include human voice information, and the energy of the previous frame exceeds M3 times the energy of the current frame (M3 takes an empirical value, for example, M3=5, which is also less than M1), then it means that a human voice end event has occurred in the current frame, and the corresponding content progress can also be determined as the target content progress.

[0135] S503: The server adds a target identifier to the video frame and audio frame corresponding to the target content progress.

[0136] The server may add a "1" identifier (ie, a target identifier) ​​to the video frames and audio frames corresponding to the target content progress, and add a "0" identifier to the video frames and audio frames corresponding to the non-target content progress.

[0137] S506: The server sends the video frames and audio frames corresponding to the video content to the terminal device respectively.

[0138] S505: The terminal device obtains video frames and audio frames corresponding to the video content.

[0139] S506: The terminal device determines a first video frame and a first audio frame to be played at the target playback time.

[0140] The first video frame corresponds to the first content progress, and the second video frame corresponds to the second content progress.

[0141] S507: The terminal device determines whether the first video frame and the first audio frame include a target identifier.

[0142] The terminal device can determine whether the identifier included in the first video frame and the first audio frame is a "1" identifier or a "0" identifier, thereby determining whether it corresponds to the target content progress.

[0143] S508: The terminal device determines whether the content progress difference corresponding to the first video frame and the first audio frame reaches a first difference threshold.

[0144] If the "1" flag is included, it indicates that the first video frame and the first audio frame contain information corresponding to the target content progress. The computer device can then determine whether the difference in the content progress between the two reaches a first, smaller difference threshold. If so, information synchronization is performed. If not, step S510 can be executed.

[0145] S509: The terminal device determines whether the content progress difference corresponding to the first video frame and the first audio frame reaches a second difference threshold.

[0146] If the "1" flag is not present, it indicates that the first video frame and the first audio frame do not contain information corresponding to the target content progress. The computer device can then determine whether the difference in content progress between the two reaches a larger second difference threshold. If so, information synchronization is performed. If not, step S510 can be executed.

[0147] S510: The terminal device plays the first video frame and the first audio frame at the target playback time.

[0148] S511: The terminal device determines whether a video frame change amplitude between the first content progress and the third content progress is less than an amplitude threshold.

[0149] When performing information synchronization adjustment, the computer device can determine whether to adjust the video frame or the audio frame. If the amplitude of the video frame change between the first content progress and the third content progress is less than the amplitude threshold, it indicates that the image information type has changed little during this time period. Therefore, step S513 can be executed to perform information synchronization adjustment on the first video frame to obtain a video frame for simulating the image information type corresponding to the video content at the third content progress. If the amplitude threshold is reached, it indicates that the image information has changed significantly, and adjusting the video frame will result in distortion. Therefore, the terminal device can execute step S514 to adjust the first audio frame.

[0150] S512: The terminal device determines whether the progress difference between the second content progress and the third content progress is greater than a third difference threshold.

[0151] When determining whether to adjust the first audio frame, the computer device may determine whether there is a large time difference between the second content progress and the third content progress. If it is greater than a third difference threshold, it means that the time difference is large, and compression, slow playback, and other adjustments to the audio information may easily cause distortion of the audio information, so step S513 may be selected for execution; if it is not greater than, it means that the probability of distortion of adjusting the audio information is low, and step S514 may be selected for execution.

[0152] S513: The terminal device performs information synchronization adjustment on the first video frame.

[0153] The method of synchronously adjusting the video frames has been mentioned above and will not be described in detail here.

[0154] S514: The terminal device performs information synchronization adjustment on the first audio frame

[0155] The method of synchronously adjusting the audio frames has been mentioned above and will not be described in detail here.

[0156] S515: The terminal device plays the first video frame and the first audio frame after information synchronization adjustment at the target playback time.

[0157] The content progress difference between the adjusted first video frame and the first audio frame is smaller than the first difference threshold, thereby ensuring information synchronization of the information played at the target playback time.

[0158] From the above, it can be seen that this application can bring the following technical effects:

[0159] On the first hand, the present application can perform information synchronization adjustment on key content that has a greater impact on the information synchronization of the content browsing experience, and reduce the intensity of information synchronization adjustment for content with less impact, thereby reducing the amount of information adjustment, so as to reduce the amount of information loss and information deformation caused by information synchronization adjustment, improve the restoration and completeness of the playback content, and also improve the efficiency of information processing.

[0160] Secondly, the present application can identify key content from multiple dimensions, thereby improving the recognition accuracy of target content progress and thus improving the accuracy of information processing.

[0161] Thirdly, the present application can selectively select the type of information to be processed during information processing, thereby avoiding a reduction in the accuracy of the playback information due to information processing, and further ensuring the content browsing experience.

[0162] Based on the information processing method provided in the above embodiment, the present application further provides an information processing device. Referring to FIG6 , FIG6 is a structural block diagram of an information processing device provided in an embodiment of the present application. The device 600 includes an acquisition unit 601, a first determination unit 602, and a first playback unit 603:

[0163] The acquiring unit 601 is configured to acquire first to-be-played information and second to-be-played information for playback at a target playback time, wherein the first to-be-played information is information of a first information type corresponding to target content at a first content progress, and the second to-be-played information is information of a second information type corresponding to the target content at a second content progress, wherein the first information type and the second information type are different information types;

[0164] The first determining unit 602 is configured to determine, based on the first to-be-played information, first information corresponding to the first information type, and second information corresponding to the second information type, based on the second to-be-played information, when a target content progress exists between the first content progress and the second content progress, and when a progress difference between the first content progress and the second content progress is greater than a first difference threshold, and when the target content reaches the target content progress, information corresponding to both the first information type and the second information type changes, and the change in information in the first information type causes the change in information in the second information type;

[0165] The first playback unit 603 is configured to play the first information and the second information at the target playback time, wherein the difference between the content progress corresponding to the first information and the second information in the target content is not greater than the first difference threshold.

[0166] In a possible implementation, the apparatus further includes a second determining unit and a second playing unit:

[0167] the second determining unit is configured to determine, based on the first to-be-played information, third information corresponding to the first information type, and fourth information corresponding to the second information type, based on the second to-be-played information, based on the absence of a target content progress between the first content progress and the second content progress, and the progress difference between the first content progress and the second content progress being greater than a second difference threshold, wherein the second difference threshold is greater than the first difference threshold;

[0168] The second playback unit is configured to play the third information and the fourth information at the target playback time, wherein a difference between content progress corresponding to the third information and the fourth information in the target content is not greater than the second difference threshold.

[0169] In a possible implementation, the apparatus further includes a third playback unit:

[0170] the third playing unit being configured to play the first to-be-played information and the second to-be-played information at the target playing time based on a progress difference between the first content progress and the second content progress being no greater than the first difference threshold;

[0171] Alternatively, based on the fact that the progress difference between the first content progress and the second content progress is not greater than the second difference threshold, and the target content progress does not exist in the first content progress and the second content progress, the first to-be-played information and the second to-be-played information are played at the target playback time.

[0172] In a possible implementation, the first determining unit 602 is specifically configured to:

[0173] The first information to be played is determined as first information corresponding to the first information type, and second information corresponding to the second information type is determined based on the second information to be played, wherein the second information is used to simulate information corresponding to the second information type of the target content on a third content progress, and a progress difference between the third content progress and the first content progress is not greater than the first difference threshold.

[0174] In a possible implementation, the third content progress is located between the first content progress and the second content progress.

[0175] In a possible implementation, the second information type is an audio information type, and the first determining unit 602 is specifically configured to:

[0176] Based on the progress difference between the second content progress and the first content progress being less than a third difference threshold, the first to-be-played information is determined as first information corresponding to the first information type, and second information corresponding to the second information type is determined based on the second to-be-played information.

[0177] In a possible implementation, the second information type is an image information type, and the first determining unit 602 is specifically configured to:

[0178] Based on the fact that the information change amplitude of the information corresponding to the image information type of the target content between the second content progress and the third content progress is less than the amplitude threshold, the first information to be played is determined as the first information corresponding to the first information type, and the second information corresponding to the second information type is determined based on the second information to be played.

[0179] In one possible implementation, the first information is used to simulate information of a first information type corresponding to the target content at a fourth content progress, and the second information is used to simulate information of a second information type corresponding to the target content at a fifth content progress. The fourth content progress and the fifth content progress are located between the first content progress and the second content progress.

[0180] In a possible implementation, the target content progress is determined through a progress determination process, which includes:

[0181] acquiring first information to be analyzed and second information to be analyzed corresponding to the first information type at a sixth content progress and a seventh content progress of the target content, respectively, wherein a progress difference between the seventh content progress and the sixth content progress is less than a fourth difference threshold;

[0182] Based on the difference between the first information to be analyzed and the second information to be analyzed being greater than a first information difference threshold, the sixth content progress is determined as the target content progress.

[0183] In one possible implementation, the first information type is an audio information type, the first information difference threshold includes a first energy threshold, the first information to be analyzed is first audio information, and the second information to be analyzed is second audio information, and determining the sixth content progress as the target content progress based on the difference between the first information to be analyzed and the second information to be analyzed being greater than the first information difference threshold includes:

[0184] Based on the information energy of the first audio information exceeding that of the second audio information reaching the first energy threshold, the sixth content progress is determined as the target content progress.

[0185] In a possible implementation, the sixth content progress is after the seventh content progress, the first information difference threshold further includes a second energy threshold, and the progress determination process further includes:

[0186] Based on the fact that the information energy of the first audio information exceeds that of the second audio information and reaches the second energy threshold, and the first audio information includes human voice information and the second audio information does not include human voice information, the sixth content progress is determined as the target content progress, and the second energy threshold is less than the first energy threshold.

[0187] In a possible implementation, the sixth content progress is after the seventh content progress, the first information difference threshold further includes a second energy threshold, and the progress determination process further includes:

[0188] Based on the fact that the information energy of the first audio information is lower than that of the second audio information and reaches the second energy threshold, and the second audio information includes human voice information, while the first audio information does not include human voice information, the sixth content progress is determined as the target content progress, and the second energy threshold is less than the first energy threshold.

[0189] In one possible implementation, the first information type is an image information type, the first information difference threshold includes an image information difference threshold, the first information to be analyzed is first image information, and the second information to be analyzed is second image information, and determining the sixth content progress as the target content progress based on the difference between the first information to be analyzed and the second information to be analyzed being greater than the first information difference threshold includes:

[0190] Based on the difference between the first image information and the second image information reaching the image information difference threshold, the sixth content progress is determined as the target content progress.

[0191] In a possible implementation, the progress determination process further includes:

[0192] Acquire the third information to be analyzed and the fourth information to be analyzed of the second information type corresponding to the target content at the sixth content progress and the seventh content progress respectively;

[0193] The determining, based on the difference between the first information to be analyzed and the second information to be analyzed being greater than a first information difference threshold, the sixth content progress as the target content progress includes:

[0194] Based on the difference between the first information to be analyzed and the second information to be analyzed being greater than a first information difference threshold, and the difference between the third information to be analyzed and the fourth information to be analyzed being greater than a second information difference threshold, the sixth content progress is determined as the target content progress.

[0195] In a possible implementation, the target content progress is determined through a progress determination process, which includes:

[0196] Obtaining information to be analyzed of a target information type corresponding to an eighth content progress of the target content, where the target information type is the first information type or the second information type;

[0197] Based on the fact that the information to be analyzed includes content identification information corresponding to the target information type, the eighth content progress is determined as the target content progress, the content identification information is information corresponding to the target sub-content of the target information type, the target sub-content is content that causes information changes between the first information type and the second information type, and the information change on the first information type is the reason for the information change on the second information type.

[0198] In a possible implementation, the progress determination process further includes:

[0199] Based on determining that the sixth content progress is the target content progress, adding a target identifier to the first information to be analyzed and the third information to be analyzed, the third information to be analyzed being information of the second information type corresponding to the target content at the sixth content progress;

[0200] The first determining unit 602 is specifically configured to:

[0201] Based on the presence of information including the target identifier in the first information to be played and the second information to be played, and the progress difference between the first content progress and the second content progress is greater than a first difference threshold, first information corresponding to the first information type is determined according to the first information to be played, and second information corresponding to the second information type is determined according to the second information to be played.

[0202] In one possible implementation, the method is applied to a first device on the information playback side, and the progress determination process is performed by a second device on the information sending side, and the second device is used to send information to the first device in which the target content corresponds to the first information type and the second information type respectively.

[0203] The embodiment of the present application further provides a computer device, as shown in FIG7 , which may be a terminal device. For example, the terminal device is a mobile phone.

[0204] FIG7 is a block diagram showing a partial structure of a mobile phone related to a terminal device provided in an embodiment of the present application. Referring to FIG7 , the mobile phone includes components such as a radio frequency (RF) circuit 710, a memory 720, an input unit 730, a display unit 740, a sensor 750, an audio circuit 760, a wireless fidelity (WiFi) module 770, a processor 780, and a power supply 790. Those skilled in the art will appreciate that the mobile phone structure shown in FIG7 does not limit the mobile phone and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0205] The following is a detailed introduction to the various components of the mobile phone in conjunction with Figure 7:

[0206] The RF circuit 710 may be used for receiving and sending signals during information transmission or calls. In particular, after receiving downlink information from the base station, it is sent to the processor 780 for processing. In addition, the designed uplink data is sent to the base station.

[0207] The memory 720 may be used to store software programs and modules. The processor 780 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 720 .

[0208] The input unit 730 may be configured to receive input digital or character information and generate key signal input related to user settings and function control of the mobile phone. Specifically, the input unit 730 may include a touch panel 731 and other input devices 732 .

[0209] The display unit 740 may be configured to display information input by a user or information provided to a user, as well as various menus of the mobile phone. The display unit 740 may include a display panel 741 .

[0210] The mobile phone may also include at least one sensor 750, such as a light sensor, a motion sensor, and other sensors.

[0211] Audio circuit 760, speaker 761, and microphone 762 provide an audio interface between the user and the phone. Audio circuit 760 converts received audio data into electrical signals and transmits them to speaker 761, which then converts them into sound signals for output. Microphone 762, on the other hand, converts collected sound signals into electrical signals, which are then received by audio circuit 760 and converted into audio data. The audio data is then processed by processor 780 and transmitted to, for example, another phone via RF circuit 710, or stored in memory 720 for further processing.

[0212] Processor 780 is the control center of the phone, connecting all parts of the phone using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 720 and accessing data stored in memory 720, it performs various phone functions and processes data, thereby performing overall phone testing. Optionally, processor 780 may include one or more processing units; preferably, processor 780 may integrate an application processor and a modem processor, where the application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 780.

[0213] The mobile phone also includes a power supply 790 (such as a battery) for supplying power to various components.

[0214] Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0215] In this embodiment, the processor 780 included in the terminal device further has the following functions:

[0216] Obtaining first to-be-played information and second to-be-played information for playback at a target playback time, wherein the first to-be-played information is information of a first information type corresponding to target content at a first content progress, and the second to-be-played information is information of a second information type corresponding to the target content at a second content progress, wherein the first information type and the second information type are different information types;

[0217] Based on the presence of a target content progress in the first content progress and the second content progress, and the progress difference between the first content progress and the second content progress being greater than a first difference threshold, first information corresponding to the first information type is determined based on the first information to be played, and second information corresponding to the second information type is determined based on the second information to be played; when the target content reaches the target content progress, information corresponding to both the first information type and the second information type changes, and the change in the information in the first information type causes the change in the information in the second information type;

[0218] The first information and the second information are played at the target playback time, and a difference between content progresses respectively corresponding to the first information and the second information in the target content is not greater than the first difference threshold.

[0219] The embodiment of the present application also provides a server, as shown in Figure 8, which is a structural diagram of the server 800 provided in the embodiment of the present application. The server 800 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPUs) 822 (for example, one or more processors) and a memory 832, and one or more storage media 830 (for example, one or more mass storage devices) for storing application programs 842 or data 844. Among them, the memory 832 and the storage medium 830 can be temporary storage or permanent storage. The program stored in the storage medium 830 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processing unit 822 can be configured to communicate with the storage medium 830 to execute a series of instruction operations in the storage medium 830 on the server 800.

[0220] The server 800 may also include one or more power supplies 826, one or more wired or wireless network interfaces 850, one or more input and output interfaces 858, and / or one or more operating systems 841, such as Windows Server 2000. TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM etc.

[0221] The steps executed by the server in the above embodiment may be based on the server structure shown in FIG8 .

[0222] An embodiment of the present application further provides a computer-readable storage medium for storing a computer program, which is used to execute any one of the information processing methods described in the aforementioned embodiments.

[0223] An embodiment of the present application further provides a computer program product including a computer program, which, when executed on a computer device, enables the computer device to execute the information processing method described in any one of the above embodiments.

[0224] It is understandable that in the specific implementation of this application, related data such as user information (such as voice information, character images), when the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0225] Those skilled in the art will understand that all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the above-mentioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the above-mentioned storage medium can be at least one of the following media: read-only memory (English: read-only memory, abbreviated: ROM), RAM, magnetic disk or optical disk, etc., various media that can store program codes.

[0226] It should be noted that the various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments. The device and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. A person of ordinary skill in the art can understand and implement it without expending creative work.

[0227] The above is merely one specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. An information processing method, which is executed by a computer device, and the method includes: Obtaining first information to be played and second information to be played for playing at a target playing moment, where the first information to be played is information corresponding to a first information type of the target content at a first content progress, the second information to be played is information corresponding to a second information type of the target content at a second content progress, and the first information type and the second information type are different information types; Based on the existence of a target content progress in the first content progress and the second content progress, and when the progress difference between the first content progress and the second content progress is greater than a first difference threshold, determining first information corresponding to the first information type according to the first information to be played, and determining second information corresponding to the second information type according to the second information to be played. When the target content is at the target content progress, the information corresponding to the first information type and the second information type both change, and the information change in the first information type is the reason for the information change in the second information type; Playing the first information and the second information at the target playing moment, and the difference between the content progresses corresponding to the first information and the second information in the target content is not greater than the first difference threshold.

2. The method according to claim 1, and the method further includes: Based on the non-existence of a target content progress in the first content progress and the second content progress, and when the progress difference between the first content progress and the second content progress is greater than a second difference threshold, determining third information corresponding to the first information type according to the first information to be played, and determining fourth information corresponding to the second information type according to the second information to be played, where the second difference threshold is greater than the first difference threshold; Playing the third information and the fourth information at the target playing moment, and the difference between the content progresses corresponding to the third information and the fourth information in the target content is not greater than the second difference threshold.

3. The method according to claim 2, and the method further includes: Based on the progress difference between the first content progress and the second content progress not being greater than the first difference threshold, playing the first information to be played and the second information to be played at the target playing moment; Or, based on the progress difference between the first content progress and the second content progress not being greater than the second difference threshold, and the non-existence of the target content progress in the first content progress and the second content progress, playing the first information to be played and the second information to be played at the target playing moment.

4. The method according to claim 1, and the determining first information corresponding to the first information type according to the first information to be played, and determining second information corresponding to the second information type according to the second information to be played, includes: Determine the first to-be-played information as the first information corresponding to the first information type, and determine the second information corresponding to the second information type according to the second to-be-played information, where the second information is used to simulate the information corresponding to the second information type of the target content at the third content progress, and the progress difference between the third content progress and the first content progress is not greater than the first difference threshold.

5. The method according to claim 4, wherein the second information type is an audio information type, and the determining the first to-be-played information as the first information corresponding to the first information type and determining the second information corresponding to the second information type according to the second to-be-played information includes: Based on the progress difference between the second content progress and the first content progress being less than the third difference threshold, determine the first to-be-played information as the first information corresponding to the first information type, and determine the second information corresponding to the second information type according to the second to-be-played information.

6. The method according to claim 4, wherein the second information type is an image information type, and the determining the first to-be-played information as the first information corresponding to the first information type and determining the second information corresponding to the second information type according to the second to-be-played information includes: Based on the information change amplitude of the information corresponding to the target content in the image information type between the second content progress and the third content progress being less than the amplitude threshold, determine the first to-be-played information as the first information corresponding to the first information type, and determine the second information corresponding to the second information type according to the second to-be-played information.

7. The method according to claim 1, wherein the first information is used to simulate the information corresponding to the first information type of the target content at the fourth content progress, the second information is used to simulate the information corresponding to the second information type of the target content at the fifth content progress, and the fourth content progress and the fifth content progress are located between the first content progress and the second content progress.

8. The method according to claim 1, wherein the target content progress is determined through a progress determination process, and the progress determination process includes: Obtain the first to-be-analyzed information and the second to-be-analyzed information corresponding to the first information type of the target content at the sixth content progress and the seventh content progress respectively, where the progress difference between the seventh content progress and the sixth content progress is less than the fourth difference threshold; Based on the difference between the first to-be-analyzed information and the second to-be-analyzed information being greater than the first information difference threshold, determine the sixth content progress as the target content progress.

9. The method according to claim 8, wherein the first information type is an audio information type, the first information difference threshold includes a first energy threshold, the first to-be-analyzed information is the first audio information, the second to-be-analyzed information is the second audio information, and the determining the sixth content progress as the target content progress based on the difference between the first to-be-analyzed information and the second to-be-analyzed information being greater than the first information difference threshold includes: Based on the information energy of the first audio information exceeding that of the second audio information reaching the first energy threshold, determine the sixth content progress as the target content progress.

10. The method according to claim 9, wherein the sixth content progress is after the seventh content progress, the first information difference threshold further includes a second energy threshold, and the progress determination process further includes: Based on the information energy of the first audio information exceeding that of the second audio information reaching the second energy threshold, and the first audio information includes voice information while the second audio information does not include voice information, determine the sixth content progress as the target content progress, and the second energy threshold is less than the first energy threshold.

11. The method according to claim 9, wherein the sixth content progress is after the seventh content progress, the first information difference threshold further includes a second energy threshold, and the progress determination process further includes: Based on the information energy of the first audio information being lower than that of the second audio information reaching the second energy threshold, and the second audio information includes voice information while the first audio information does not include voice information, determine the sixth content progress as the target content progress, and the second energy threshold is less than the first energy threshold.

12. The method according to claim 8, wherein the first information type is an image information type, the first information difference threshold includes an image information difference threshold, the first information to be analyzed is first image information, the second information to be analyzed is second image information, and the step of determining the sixth content progress as the target content progress based on the difference between the first information to be analyzed and the second information to be analyzed being greater than the first information difference threshold includes: Based on the difference between the first image information and the second image information reaching the image information difference threshold, determine the sixth content progress as the target content progress.

13. The method according to claim 8, wherein the progress determination process further includes: Obtain third information to be analyzed and fourth information to be analyzed corresponding to the second information type of the target content at the sixth content progress and the seventh content progress respectively; The step of determining the sixth content progress as the target content progress based on the difference between the first information to be analyzed and the second information to be analyzed being greater than the first information difference threshold includes: Based on the difference between the first information to be analyzed and the second information to be analyzed being greater than the first information difference threshold, and the difference between the third information to be analyzed and the fourth information to be analyzed being greater than the second information difference threshold, determine the sixth content progress as the target content progress.

14. The method according to claim 1, wherein the target content progress is determined through a progress determination process, and the progress determination process includes: Obtain the information to be analyzed corresponding to the target information type of the target content at the eighth content progress, and the target information type is the first information type or the second information type; Based on that the information to be analyzed includes the content recognition information corresponding to the target information type, determine the eighth content progress as the target content progress, where the content recognition information is the information corresponding to the target information type of the target sub-content, the target sub-content is the content that causes information changes in the first information type and the second information type, and the information change in the first information type is the reason for the information change in the second information type.

15. The method according to any one of claims 8-14, wherein the progress determination process further includes: Based on determining that the sixth content progress is the target content progress, add a target identifier to the first information to be analyzed and the third information to be analyzed, where the third information to be analyzed is the information of the target content corresponding to the second information type at the sixth content progress; The step of, based on the existence of the target content progress in the first content progress and the second content progress, and the progress difference between the first content progress and the second content progress being greater than the first difference threshold, determining the first information corresponding to the first information type according to the first information to be played, and determining the second information corresponding to the second information type according to the second information to be played, includes: Based on the existence of information including the target identifier in the first information to be played and the second information to be played, and the progress difference between the first content progress and the second content progress being greater than the first difference threshold, determining the first information corresponding to the first information type according to the first information to be played, and determining the second information corresponding to the second information type according to the second information to be played.

16. The method according to claim 8, wherein the method is applied to a first device on the information playback side, and the progress determination process is executed by a second device on the information sending side, and the second device is configured to send the information of the target content corresponding to the first information type and the second information type to the first device.

17. An information processing device, the device includes an acquisition unit, a first determination unit, and a first playback unit: The acquisition unit is configured to acquire the first information to be played and the second information to be played for playback at a target playback time, where the first information to be played is the information of the target content corresponding to the first information type at the first content progress, and the second information to be played is the information of the target content corresponding to the second information type at the second content progress, and the first information type and the second information type are different information types; The first determination unit is configured to, when there is a target content progress in the first content progress and the second content progress, and the progress difference between the first content progress and the second content progress is greater than a first difference threshold, determine a first piece of information corresponding to the first information type according to the first information to be played, and determine a second piece of information corresponding to the second information type according to the second information to be played. When the target content is at the target content progress, the information corresponding to the first information type and the second information type both change, and the information change in the first information type is the reason for the information change in the second information type; The first playback unit is configured to play the first information and the second information at the target playback moment, and the difference between the content progress corresponding to the first information and the second information in the target content is not greater than the first difference threshold.

18. A computer device, the computer device includes a processor and a memory: The memory is configured to store a computer program and transmit the computer program to the processor; The processor is configured to execute the information processing method according to any one of claims 1-16 according to the instructions in the computer program.

19. A computer-readable storage medium, the computer-readable storage medium is configured to store a computer program, and the computer program is configured to execute the information processing method according to any one of claims 1-16.

Images