Data processing method, device, storage medium and computer equipment

Abstract

The embodiments of the present application disclose a data processing method, apparatus, storage medium and computer equipment, which monitors an audio-video data package table in a data stream in a data stream, analyzes the audio-video data package table to obtain and cache timestamp information, obtains a target data stream waiting to be played back in a terminal from the data stream, extracts target audio-video data from the target data stream, searches for target timestamp information corresponding to the target audio-video data from the cached timestamp information, and plays back the target audio-video data based on the target timestamp information, thereby improving the speed of starting playback of audio-video data and the efficiency of program playback.

Description

[Technical Field]

[0001] The present application relates to the field of communications technology, and in particular to a data processing method, apparatus, storage medium and computer equipment. [Background technology]

[0002] Integrated Services Digital Broadcasting Standard 3 (ISDB S3) is a more common and widespread modulation format for satellite digital television.

[0003] However, in the playback flow of the ISDB S3 standard digital television broadcasting system, when a user switches programs, the playback start speed of audio and video data in the TLV (Type Length Value, abbreviated as TLV) program stream is relatively slow, which reduces the program playback efficiency. Summary of the Invention [Problem to be solved by the invention]

[0004] The embodiments of the present application provide a data processing method, device, storage medium and computer device, which can increase the speed of starting playback of audio / video data, and thus improve the playback efficiency of programs. [Means for solving the problem]

[0005] An embodiment of the present application provides a data processing method, the data processing method comprising: monitoring an audio / video data package table in a data stream transmitted from the server in a data stream channel for data transmission between the server and the terminal; analyzing the audio-video data package table to obtain and cache timestamp information of the audio-video data in the data stream; obtaining a target data stream waiting to be played back by the terminal from the data stream, and extracting target audio / video data from the target data stream; retrieving target timestamp information corresponding to the target audio-video data from the cached timestamp information; and performing playback of the target audio-video data based on the target timestamp information.

[0006] Accordingly, an embodiment of the present application provides a data processing apparatus, the data processing apparatus comprising: a monitoring unit for monitoring an audio-video data package table in a data stream transmitted from the server in a data stream channel for data transmission between the server and a terminal; an analyzing unit for analyzing the audio-video data package table to obtain and cache timestamp information of the audio-video data in the data stream; an extraction unit for obtaining a target data stream waiting to be played by the terminal from the data stream and extracting target audio-video data from the target data stream; a search unit for searching target timestamp information corresponding to the target audio-video data from the cached timestamp information; and a playback unit for playing back the target audio-video data based on the target timestamp information.

[0007] In one embodiment, the monitoring unit comprises: a first monitoring subunit that monitors data in the target data stream based on a message type and a table identifier; and a determining subunit for determining, when target data whose message type is a target message type and whose table identifier is a target identifier is obtained by monitoring, that the target data is an audio / video data package table.

[0008] In one embodiment, the analysis unit: an analysis subunit for analyzing the audio-video data package table to obtain timestamp information of the audio-video data in the data stream; and a classification and caching subunit that acquires a serial number of a media processing unit for the audio-video data, and classifies and caches timestamp information corresponding to the audio-video data based on the serial number of the media processing unit.

[0009] In one embodiment, the search unit: an acquiring subunit for acquiring a serial number of a target media processing unit for the target audio-video data; a search subunit for searching the cached timestamp information for target timestamp information corresponding to the serial number of the target media processing unit based on the serial number of the target media processing unit.

[0010] In one embodiment, the playback unit comprises: a calculation subunit for calculating a playback timestamp of the target audio-video data based on the target timestamp information; a transmitting subunit for transmitting the target audio-video data and corresponding playback timestamps to a decoder; and a playback subunit for causing the decoder to play back the target audio-video data based on the playback timestamp.

[0011] In one embodiment, the playback timestamps include a decoding timestamp and a display timestamp, and the playback subunit: decoding the target audio-video data by the decoder based on the decoding timestamp; If the decoded target audio-video data satisfies the audio-video synchronization condition, the decoded target audio-video data is played back based on the display timestamp.

[0012] In one embodiment, the extraction unit comprises: a target information acquisition subunit for acquiring a target Internet Protocol address and a corresponding target audio-video packet identifier; a filtering subunit for filtering the target data stream based on the target Internet Protocol address and the corresponding target audio-video packet identifier to obtain target audio-video data.

[0013] In one embodiment, the data processing device comprises: a reacquisition unit for acquiring a first audio-video data package table corresponding to the target data stream; a re-analysis unit for analyzing the first audio-video data package table to obtain a first Internet Protocol address and a corresponding first audio-video packet identifier; a re-filtering unit for filtering the target data stream based on the first Internet Protocol address and the corresponding first audio-video packet identifier to obtain first audio-video data when at least one of the first Internet Protocol address and the target Internet Protocol address and the first audio-video packet identifier and the target audio-video packet identifier are different; a re-search unit for searching first time stamp information corresponding to the first audio / video data from the cached time stamp information; The apparatus further includes a replay unit for replaying the first audio-video data based on the first timestamp information.

[0014] In one embodiment, the recapture unit comprises: a first re-receiving subunit for receiving an address mapping table in the target data stream, the address mapping table including Internet Protocol addresses of the audio-video data; a second re-receiving subunit for receiving an audio-video packet identifier list in the target data stream, the audio-video packet identifier list including audio-video packet identifiers of the audio-video data; a re-filtering subunit for filtering a first audio-video data package table from the target data stream based on the address mapping table and the audio-video packet identifier list.

[0015] In one embodiment, the data processing device comprises: The apparatus further includes a third re-receiving unit for re-acquiring the first audio-video data package table from the target data stream when detecting failure in acquiring the first audio-video data package table.

[0016] In one embodiment, the filtering unit comprises: a setting subunit for setting an audio filter and a video filter according to the target Internet Protocol address and the corresponding target audio-video packet identifier; an audio filtering subunit for filtering the target data stream with the audio filter to obtain at least one frame of target audio data; a video filtering subunit for filtering the target data stream with the video filter to obtain at least one frame of target video data; an integrated subunit for integrating the target audio data and the target video data into target audio-video data;

[0017] Furthermore, an embodiment of the present application provides a storage medium having a plurality of instructions stored therein, the instructions being loadable by a processor to cause the processor to perform steps in any one of the data processing methods provided by the embodiment of the present application.

[0018] Furthermore, an embodiment of the present application provides a computer device, which includes a processor and a memory, wherein a computer program is stored in the memory, and the processor is used to execute the computer program stored in the memory to implement the data processing method provided by the embodiment of the present application.

[0019] Furthermore, embodiments of the present application provide a computer program product or a computer program, the computer program product or the computer program including computer instructions, the computer instructions being stored in a storage medium, a processor of a computing device reading the computer instructions from the storage medium and executing the computer instructions to cause the computing device to perform steps of a data processing method provided by embodiments of the present application. [Effects of the Invention]

[0020] In an embodiment of the present application, a data stream channel for transmitting data between a server and a terminal monitors an audio / video data package table in a data stream transmitted from the server, analyzes the audio / video data package table to obtain and cache timestamp information of the audio / video data in the data stream, obtains a target data stream waiting for playback by the terminal from the data stream, extracts the target audio / video data from the target data stream, searches for target timestamp information corresponding to the target audio / video data from the cached timestamp information, and plays the target audio / video data based on the target timestamp information.In this way, by proactively monitoring and analyzing the audio / video data package table in the data stream to obtain timestamp information of the audio / video data, timely caching, and extracting and obtaining the target audio / video data, searching for target timestamp information corresponding to the target audio / video data from the pre-cached timestamp information, and timely playing the target audio / video data based on the target timestamp information, the speed of starting playback of audio / video data is increased, and program playback efficiency is improved. [Brief explanation of the drawings]

[0021] Hereinafter, specific embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that the technical solutions and advantages of the present invention will become more apparent. [Figure 1] FIG. 1 is a schematic diagram illustrating an implementation scenario of a data processing method provided by an embodiment of the present application; [Figure 2] FIG. 2 is a schematic diagram illustrating the flow of a data processing method provided by an embodiment of the present application. [Figure 3] FIG. 2 is a schematic diagram illustrating a specific flow of a data processing method provided by an embodiment of the present application. [Figure 4] 1 is a schematic diagram illustrating the configuration of a data processing device provided by an embodiment of the present application. [Figure 5] FIG. 1 is a schematic diagram illustrating the configuration of a computer device provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE INVENTION

[0022] Hereinafter, the technical solutions in the embodiments of the present application will be described clearly and explicitly with reference to the drawings in the embodiments of the present application, but it is clear that the described embodiments are only some of the embodiments of the present application and do not represent all of the embodiments. All other embodiments that a person skilled in the art can obtain without inventive efforts based on the embodiments of the present application fall within the scope of protection of the present application.

[0023] Embodiments of the present application provide a data processing method, an apparatus, a storage medium, and a computer device, wherein the data processing apparatus can be integrated into a computer device, and the computer device can be a server, a terminal, or other device.

[0024] To better describe the embodiments of the present application, reference will be made to the following terms.

[0025] The triple encoding format (abbreviated as TLV, Type Length Value) is a flexible encoding format that can contain fields such as Type, Length, and Value. Here, the Type field may contain information about the label and encoding format, the Length field may define the length of the value, and the Value field may indicate the actual value of the data contained in the TLV.

[0026] A Group of Pictures (GOP) is a group of images in an audio-video data sequence, and one GOP is a group of consecutive images. When encoding audio-video data, images (i.e., frames) are divided into three types: I, P, and B, where I is an intra-encoded frame, P is a forward-predicted frame, and B is a bidirectionally interpolated frame. The first image in a GOP is an I-frame, which ensures that a GOP can be decoded independently without reference to other images.

[0027] A time stamp is data generated using digital signature technology, and the signature target includes information such as initial file information, signature parameters, and signing time. A time stamp system is used to generate and manage time stamps, and a digital signature is applied to the signature target to generate a time stamp, proving that the initial file already existed before the signing time.

[0028] A frequency point is the absolute value of a frequency. Different frequencies are also called frequency points, and are usually the center frequency of a modulated signal. A frequency point is a number associated with a specific frequency. Currently, the number of television programs available on a typical television is increasing, as are the channels received by the general television. However, since televisions only have one line, a method called frequency division multiplexing can be used to transmit multiple channels of data on a single signal channel.

[0029] Program search is to obtain information on program channels that can be played in the current Digital Video Broadcast (abbreviated as DVB) system.

[0030] In the playback flow of a digital television broadcasting system based on the ISDB S3 standard, the presentation time stamp (PTS) of the audio and video data for each frame of a television program is typically acquired, and the audio and video data for each frame is played and displayed based on the display timestamp. If it is detected that the audio and video data for a certain frame does not have a corresponding display timestamp, the audio and video data for that frame is discarded. If the discarded audio and video data is a key frame, i.e., an I-frame, the audio and video data cannot be decoded. It is then necessary to wait for the arrival of a key frame that acquires the next group of pictures (GOP), and playback can begin only if the audio and video synchronization conditions are met. This results in a relatively slow program playback startup speed, reducing program playback efficiency.

[0031] To solve the above problems, an embodiment of the present application provides a data processing method that caches timestamp information of audio / video data in a timely manner, thereby avoiding the situation in the prior art where target timestamp information corresponding to the target audio / video data is not retrieved and the target audio / video data is lost, thereby increasing the speed at which audio / video data playback of a program is started and ultimately improving the playback efficiency of the program. The specific implementation process of this method is described in detail below.

[0032] 1 is a schematic diagram illustrating an implementation scenario of a data processing method provided by an embodiment of the present application, which includes a server A and a terminal B.

[0033] Here, Server A may be an independent physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides infrastructure cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0034] Terminal B may be, but is not limited to, various computer devices capable of displaying images, such as a smart TV, a smartphone, a tablet PC, a notebook PC, a desktop PC, etc. Terminal B and server A may be directly or indirectly connected by wired or wireless communication, and terminal B may receive data provided by server A and perform corresponding data processing operations, but the present application is not limited thereto.

[0035] Here, terminal B monitors the audio-video data package table in the data stream sent from the server in the data stream channel that transmits data between the server and the terminal, analyzes the audio-video data package table to obtain and cache timestamp information of the audio-video data in the data stream, obtains a target data stream waiting to be played back by the terminal from the data stream, extracts the target audio-video data from the target data stream, searches for target timestamp information corresponding to the target audio-video data from the cached timestamp information, and plays back the target audio-video data based on the target timestamp information.

[0036] It should be noted that the schematic diagram of the implementation environment scenario of the data processing method shown in Figure 1 is only an example, and the implementation environment scenario of the data processing method described in the embodiments of the present application is intended to more clearly explain the technical solutions of the embodiments of the present application and is not intended to limit the technical solutions provided by the embodiments of the present application. Those skilled in the art should understand that with the evolution of data processing and the emergence of new service scenarios, the technical solutions provided by the present application can be similarly applied to similar technical problems.

[0037] Each of these will be described in detail below. Note that the order in which the embodiments are described is not intended to limit the preferred order of the embodiments.

[0038] This embodiment will be described from the perspective of a data processing device, which may be specifically integrated into a computer device, and the computer device may be a terminal, and the present application is not limited thereto.

[0039] 2, which is a schematic diagram illustrating the flow of a data processing method provided by an embodiment of the present application. The data processing method may include:

[0040] In step 101, an audio / video data package table in a data stream transmitted from a server is monitored in a data stream channel for transmitting data between the server and a terminal.

[0041] Here, the data stream channel may be a channel for transmitting a data stream between a server and a terminal. This data stream may be a data stream configured in a specific order with data for playing a program on the terminal. This data stream may be a TLV-formatted data stream (abbreviated as a TLV stream). This data for playing a program may include audio / video data corresponding to the program and data for enabling the audio / video data to be played on the terminal. The audio / video data may be audio / video data for multiple programs at the current frequency point encoded in an elementary stream (abbreviated as an ES) format and exist in the data stream transmitted from the server in a packetized format called a data packet. The audio / video data may include audio and video data, or may include only audio or video data, but is not limited thereto. The data for enabling the audio / video data to be played on the terminal may include an audio / video data package table corresponding to each program at the current frequency point, an address mapping table corresponding to the current frequency point, and an audio / video packet identifier list.

[0042] Here, this audio-video data package table (MMT Package Table, abbreviated as MPT) is a data table used to describe detailed information about audio-video data corresponding to a program at the current frequency point. For example, it may include information such as the format, byte, bit, sampling rate, or resolution of the audio-video data. It may also include timestamp information used to calculate related time information such as the decoding time and display time of the audio-video data. The terminal can calculate related time information such as the decoding time and display time and realize playback of the audio-video data based on the time information. Note that this data stream may include audio-video data for all programs at the current frequency point and the audio-video data package tables corresponding to each program, or may include audio-video data for some programs at the current frequency point and the audio-video data package tables corresponding to each program. The specific details can be determined according to actual circumstances, and will not be described here.

[0043] The address mapping table (AMT) may include Internet Protocol addresses (IP addresses) corresponding to all programs at the current frequency point, with each program corresponding to one Internet Protocol address. The audio-video packet identifier list (PLT) may include packet identifiers (Packetids) corresponding to data packets corresponding to the audio-video data of each program at the current frequency point. Since one data packet corresponding to the audio-video data of each channel corresponds to one packet identifier, the audio-video data of one channel in one program can be uniquely determined based on the Internet Protocol address and packet identifier. Therefore, filtering is performed on the data stream based on the Internet Protocol address and packet identifier to filter out the audio-video data that needs to be played.

[0044] For example, the terminal may be a television terminal. Referring to FIG. 3, FIG. 3 is a schematic diagram illustrating a specific flow of a data processing method provided by an embodiment of the present application. When a user performs a program search or program switching operation on the television terminal, the television terminal is located at a frequency point in response to the program search or program switching operation, which triggers the television terminal to send a request to the server to acquire a data stream corresponding to the frequency point, and the television terminal can turn on the data stream channel. The data stream channel can acquire the data stream corresponding to the frequency point transmitted from the server and monitor the audio-video data package table in the data stream transmitted from the server. Multiple programs can exist at one frequency point. Because the bandwidth of the data stream channel is relatively large, the data stream channel can load multiple programs. The television terminal can acquire a data stream containing audio-video data of multiple programs at the current frequency point.

[0045] Optionally, if this terminal is a television terminal, specifically, when a user performs an operation that requires program playback, such as program search or program switching, through the television terminal, and the parallel trigger television terminal sends a request to the server to obtain a data stream corresponding to this frequency point, the television terminal specifies the current frequency point through a tuner, receives the audio / video signal corresponding to this frequency point, and performs analog-to-digital conversion on the received audio / video signal through a demodulator, thereby obtaining the data stream corresponding to the current frequency point, and performs subsequent audio / video data playback operations.

[0046] In practical applications, the terminal may send request information to the server to acquire the data stream based on other trigger instructions, and have the server send the data stream to the terminal.

[0047] Optionally, in one embodiment, the step of monitoring an audio-video data package table in the data stream transmitted from the server comprises: (1) monitoring for data in a target data stream based on a message type and a table identifier; (2) When target data whose message type is the target message type and whose table identifier is the target identifier is obtained by monitoring, determining that the target data is an audio / video data package table.

[0048] Here, the message type may be a type corresponding to each data in the data stream, the table identifier (Table ID) may be an identifier corresponding to each data table, the target message type may be a message type corresponding to an audio-video data package table, and the target identifier may be a table identifier corresponding to an audio-video data package table.

[0049] Because the message type and table identifier in the data stream for the audio-video data package table can be specific, the terminal can search the data stream based on the message type and table identifier and monitor the data obtained by the search. Specifically, the terminal searches for the message type and table identifier corresponding to the data in the target data stream, and obtains target data whose message type is the target message type and whose table identifier is the target identifier. It can then determine that the target data whose message type is the target message type and whose table identifier is the target identifier is the target data audio-video data package table. For example, if the terminal is a television terminal, the television terminal can be triggered to monitor the audio-video data package table in the data stream transmitted from the server. The television terminal can then search and determine that the target data whose message type is the target message type and whose table identifier is the target identifier is the audio-video data package table for multiple programs at the current frequency point. Optionally, the target message type can be MESSAGE_TYPE_PA and the target identifier can be 0x20, thereby realizing the search and acquisition of the audio-video data package table from the data stream.

[0050] In step 102, the audio / video data package table is analyzed to obtain timestamp information of the audio / video data in the data stream and cache it.

[0051] Here, this timestamp information may be a timestamp for calculating related time information such as the decoding time and display time of the audio-video data in the audio-video data package table, and this timestamp information may be the presentation time (mpu_presentation_time) of one media processing unit (abbreviated as mpu) consisting of multiple audio-video data frames in the audio-video data of multiple programs at the current frequency point, where the media processing unit is a processing unit in a terminal playback device for processing audio-video data, and each media processing unit corresponds to the serial number (mpu_sequence_number) of one media processing unit so as to uniquely identify one media processing unit. For example, suppose the current frequency point contains audio-video data D of Program A, where the 10 video data frames contained in audio-video data D constitute two media processing units, media processing unit V1 and media processing unit V2, respectively. In the audio-video data package table, the serial number of the media processing unit corresponding to V1 is entered as 155443, and the corresponding timestamp information is 2018 / 03 / 08 11:10:00.364656860940. In the audio-video data package table, the serial number of the media processing unit corresponding to V2 is entered as 155444, and the corresponding timestamp information is 2018 / 03 / 08 11:10:00.449990194291.

[0052] To avoid discarding corresponding audio-video data due to the lack of associated timestamp information after filtering the audio-video data by caching the timestamp information of the audio-video data in advance, an audio-video data package table for multiple programs at the current frequency point obtained by the search is extracted and analyzed to obtain timestamp information of the audio-video data of the multiple programs at the current frequency point, and this timestamp information is cached. Specifically, the audio-video data package table is analyzed to obtain timestamp information of the audio-video data in this data stream, the serial number of the media processing unit for this audio-video data is obtained, and the timestamp information corresponding to this audio-video data is classified and cached based on the serial number of the media processing unit.

[0053] There are various methods for analyzing the audio / video data package table to obtain timestamp information for the audio / video data in the data stream. For example, the media processing unit timestamp descriptor (MPU_Timestamp_Descriptor) and media processing unit extended timestamp descriptor (MPU_Extended_Timestamp_Descriptor) in the audio / video data package table are analyzed to obtain timestamp information, which is then cached according to a specified format. Here, the media processing unit timestamp descriptor includes the Universal Time Coordinated (UTC) (i.e., the presentation time of the media processing unit) corresponding to each audio / video data, i.e., each frame audio data frame and each frame video data frame, and the serial number of the media processing unit corresponding to each audio / video data, i.e., each frame audio data frame and each frame video data frame. The smallest media unit processed by the playback device is a group of pictures (GOP). Since there are multiple audio / video data frames in a GOP, each frame audio data in an audio GOP has the same media processing unit serial number, and each frame video data in a video GOP has the same media processing unit serial number. Therefore, the audio / video data package table is analyzed and the analyzed timestamp information of the audio / video data is cached, so that the terminal can timely play the audio / video data of the current frequency point based on the cached timestamp information during subsequent playback.

[0054] After analyzing the audio / video data package table to obtain the timestamp information of the audio / video data in the data stream, the timestamp information of the audio / video data in the data stream can be classified and cached. There are various methods for classifying and caching the timestamp information of the audio / video data in the data stream. For example, to improve the efficiency of timestamp information retrieval, the serial number of the media processing unit for each GOP of audio / video data can be optionally obtained, and the timestamp information corresponding to each GOP of audio / video data can be classified and cached based on this media processing unit serial number. Specifically, the timestamp information is classified and cached according to the media processing unit serial number, and all the timestamp information corresponding to each media processing unit serial number is collected in one place. Furthermore, when it is necessary to search for the timestamp information of the audio / video data of a certain program, the serial number of the media processing unit corresponding to the audio / video data of the program can be obtained, and the timestamp information corresponding to this media processing unit serial number can be searched for from the cached timestamp information based on this media processing unit serial number.

[0055] Optionally, in the process of receiving a target data stream, an audio / video data package table for audio / video data from the target data stream is retrieved in a timely manner, the audio / video data package table obtained by the retrieval is analyzed in a timely manner, and timely caches the timestamp information of the analyzed audio / video data.

[0056] In step 103, a target data stream waiting to be played back by the terminal is obtained from the data stream, and target audio / video data is extracted from the target data stream.

[0057] Here, the target data stream may be a data stream received after the terminal turns on the data stream channel, and the target audio-video data may be audio-video data in the target data stream, i.e., audio-video data of a program corresponding to the current frequency point of the terminal, where the target audio-video data may be audio-video data of all programs at the current frequency point, audio-video data of some programs at the current frequency point, audio-video data of a program that needs to be currently played at the current frequency point, etc., and the description here is omitted.

[0058] Here, there are various ways to extract target audio-video data from a target data stream, for example, still referring to Figure 3, obtain a target Internet Protocol address and a corresponding target audio-video packet identifier, and then filter the target data stream based on the target Internet Protocol address and the corresponding target audio-video packet identifier to obtain the target audio-video data. Specifically, the following methods are included:

[0059] (1) Obtain a target Internet Protocol address and a corresponding target audio / video packet identifier.

[0060] Here, the target Internet Protocol address may be an Internet Protocol address (IP address) corresponding to the program that needs to be played at the current frequency point, where each program corresponds to one IP address, and the target audio-video packet identifier is at least one audio-video packet identifier (Packet ID) corresponding to the target audio-video data of the program that needs to be currently played, where this audio-video packet identifier corresponds to the audio-video data of one channel. If a program has multiple channels of audio-video data, there will be the same number of audio-video packet identifiers. The audio-video data of each channel corresponds to one audio-video packet identifier.

[0061] Optionally, when performing an operation such as a program search or program switching, the terminal can obtain the Internet Protocol address and audio / video packet identifiers of the frequency point where the frequency point is located and store them in the database. When a user specifies a frequency point and starts playing a program, the terminal can uniquely determine the audio / video data of one channel in one program based on one Internet Protocol address and one audio / video packet identifier, so it can obtain the target Internet Protocol address and target audio / video packet identifier corresponding to the program to be played from the database and obtain the audio / video data corresponding to the program to be currently played based on the target Internet Protocol address and the corresponding target audio / video packet identifier.

[0062] (2) filtering the target data stream based on the target Internet Protocol address and the corresponding target audio / video packet identifier to obtain the target audio / video data;

[0063] To obtain the audio-video data corresponding to the program that needs to be currently played, the target data stream is filtered based on the target Internet Protocol address and the corresponding target audio-video packet identifier to filter out the audio-video data corresponding to the program that needs to be currently played, thereby obtaining the target audio-video data corresponding to the program that needs to be currently played, where the target audio-video data at this time is the target audio-video data corresponding to the program that needs to be currently played at the current frequency point.

[0064] In one embodiment, an audio / video filter is established based on the target Internet Protocol address and the target audio / video packet identifier, and the target data stream is filtered by the audio / video filter to store audio / video data corresponding to the target Internet Protocol address and the target audio / video packet identifier, thereby obtaining the target audio / video data. Here, the audio / video filter may include an audio filter and a video filter. Specifically, the target data stream is filtered by the audio filter to obtain target audio data corresponding to the program that needs to be currently played, and the target audio data may include at least one frame of audio data. The target data stream is filtered by the video filter to obtain target video data corresponding to the program that needs to be currently played, and the target video data may include at least one frame of video data. Based on the target audio data and the target video data, the target audio / video data corresponding to the program that needs to be currently played can finally be obtained.

[0065] In one embodiment, to avoid a playback bug caused by a change in the program currently being played back due to a user's operation such as re-specifying a frequency point or switching to a program, the audio / video data package table corresponding to the program currently being played back is re-received, and based on the Internet Protocol address and audio / video packet identifier in the re-received audio / video data package table, it is determined whether the program currently being played back has changed. Specifically, a first audio / video data package table corresponding to the target data stream is obtained, and the first audio / video data package table is analyzed to obtain a first Internet Protocol address and a corresponding first audio / video packet identifier. If at least one of the first Internet Protocol address and the target Internet Protocol address, and the first audio / video packet identifier and the target audio / video packet identifier are different, the target data stream is filtered based on the first Internet Protocol address and the corresponding first audio / video packet identifier to obtain the first audio / video data. The first timestamp information corresponding to the first audio / video data is searched for from the cached timestamp information. Based on this first timestamp information, the first audio / video data is played back.

[0066] Here, the first audio-video data package table may be an audio-video data package table corresponding to a program that is currently being played and that is received from the target data stream, the first Internet Protocol address may be an IP address that is included in the first audio-video data package table and corresponds to the program that is currently being played, the first audio-video packet identifier may be an audio-video packet identifier that is included in the first audio-video data package table and corresponds to the audio-video data of the program that is currently being played, the first audio-video data may be audio-video data that corresponds to the program that is currently being played, and the first timestamp information may be timestamp information that corresponds to the audio-video data of each GOP in the audio-video data that corresponds to the program that is currently being played.

[0067] There are various ways to obtain the first audio-video data package table corresponding to the target data stream, such as receiving an address mapping table in the target data stream, where the address mapping table includes the Internet Protocol addresses of the audio-video data, receiving an audio-video packet identifier list in the target data stream, where the audio-video packet identifier list includes the audio-video packet identifiers of the audio-video data, and selecting the first audio-video data package table from the target data stream based on the address mapping table and the audio-video packet identifier list.

[0068] Here, the address mapping table may include the Internet Protocol addresses of all programs at the current frequency point, and the audio-video packet identifier list may include audio-video packet identifiers corresponding to the audio-video data of all programs at the current frequency point, thereby receiving the address mapping table in the target data stream and the audio-video packet identifier list, and filtering the list target data stream based on the address mapping table and the audio-video packet identifiers in the received target data stream to obtain a first audio-video data package table corresponding to the program that needs to be currently played.

[0069] In one embodiment, it may be determined whether this first audio-video data package table has been received, and if it is determined that reception of the first audio-video data package table has failed, re-reception may be performed until reception is successful.

[0070] After obtaining the first audio-video data package table corresponding to the target data stream, the first audio-video data package table can be analyzed to obtain a first Internet Protocol address and a corresponding first audio-video packet identifier. Then, the first Internet Protocol address and the corresponding first audio-video packet identifier are compared with the target Internet Protocol address and the corresponding target audio-video packet identifier, respectively. If at least one of the first Internet Protocol address and the target Internet Protocol address, and the first audio-video packet identifier and the target audio-video packet identifier is different, it indicates that the program to be currently played has changed, and then the audio-video data needs to be re-filtered. Specifically, based on the first Internet Protocol address and the corresponding first audio / video packet identifier, filtering is performed on the target data stream to obtain the first audio / video data, thereby re-obtaining the target audio / video data of the program that currently needs to be played back, and then searching for the first timestamp information corresponding to the first audio / video data from the cached timestamp information, and playing back the first audio / video data based on the first timestamp information.

[0071] In step 104, target timestamp information corresponding to the target audio / video data is searched from the cached timestamp information.

[0072] Here, this target timestamp information is timestamp information corresponding to the target audio / video data in the cached timestamp information.

[0073] Here, there are various methods for searching for target timestamp information corresponding to the target audio / video data from the cached timestamp information. For example, the serial number of the target media processing unit of the target audio / video data is obtained, and based on the serial number of the target media processing unit, the target timestamp information corresponding to the serial number of the target media processing unit is searched for from the cached timestamp information.

[0074] Here, the serial number of the target media processing unit may be the serial number of the media processing unit corresponding to each GOP of audio-video data in the target audio-video data.

[0075] Optionally, the sorted and cached timestamp information is sorted and cached according to the serial number of the media processing unit from smallest to largest. When target audio / video data is acquired, the sorted and cached timestamp information is searched for based on the serial number of the target media processing unit corresponding to the target audio / video data. If a media processing unit serial number that is the same as the serial number of the target media processing unit is found, the timestamp information corresponding to the current serial number of this media processing unit is determined to be the target timestamp information.

[0076] For example, suppose the current frequency point includes target audio-video data D of program A, where target audio-video data D includes 20 audio-video data frames, and every 5 frames of the audio-video data frames constitute one media processing unit as one GOP. Therefore, the four media processing units included in target audio-video data D of program A are M1, M2, M3, and M4, respectively, and the media processing unit serial numbers corresponding to the four media processing units are 155431, 155432, 155433, and 155434, respectively, and the cached timestamp information includes [...(155431,2018 / 03 / 08 11:10:00.449990194271), (155432,2018 / 03 / 08 11:10:00.449990194279), (155433,2018 / 03 / 08 11:10:00.449990194281), (155434,2018 / 03 / 08 11:10:00.449990194289), (155435,2018 / 03 / 08 11:10:00.449990194297), ..., (155439,2018 / 03 / 08 11:10:00.449990194299...], and thus the media processing unit serial numbers corresponding to the four media processing units are 155431, 155432, 155433, and 155434, respectively, and the corresponding target timestamp information retrieved from the cached timestamp information is 2018 / 03 / 08 11:10:00.449990194271, 2018 / 03 / 08 11:10:00.449990194279, 2018 / 03 / 08 11:10:00.449990194281, and 2018 / 03 / 08 11:10:00.449990194289, respectively.

[0077] In step 105, the target audio / video data is played back based on the target timestamp information.

[0078] Here, there are various methods for playing back the target audio-video data based on the target timestamp information. For example, a playback timestamp for the target audio-video data is calculated based on the target timestamp information, the target audio-video data and the corresponding playback timestamp are sent to a decoder, and the decoder plays back the target audio-video data based on the playback timestamp.

[0079] Here, the playback timestamp is a timestamp at which the target audio / video data is played back, and the decoder is a module that decodes the target audio / video data in the terminal, thereby playing back the target audio / video data in the terminal based on the decoded target audio / video data.

[0080] Optionally, the playback timestamps include a decode timestamp and a display timestamp, and then the step of playing back the target audio-video data by the decoder based on the playback timestamps includes decoding the target audio-video data by the decoder based on the decode timestamp, and, if the decoded target audio-video data satisfies an audio-video synchronization condition, playing back the decoded target audio-video data based on the display timestamp.

[0081] Here, the decode timestamp is used to inform the playback device associated with the terminal when to decode a frame of audio-video data in the target audio-video data, and the display timestamp is used to inform the playback device associated with the terminal when to display a frame of audio-video data in the target audio-video data. Furthermore, the audio-video synchronization condition can be understood as meaning that during the playback process of audio-video data, the audio and video are mixed and played together, resulting in a broad image. When audio and video are played together, a challenge typically arises: how to synchronize the audio and video so that the image matches the sound. To synchronize the audio and video, a reference clock is usually selected. Time in the reference clock increases linearly. When encoding an audio-video stream, a timestamp is assigned to each frame of data according to the time in the reference clock. When playing audio-video data, the timestamp in the audio-video data frame is read and playback is prepared based on the current time in the reference clock. This timestamp is the target timestamp information, and this playback condition is the audio-video synchronization condition.

[0082] Specifically, based on this target timestamp information, a playback timestamp is calculated for each target audio / video data, i.e., a decode timestamp and a display timestamp are calculated for each target audio / video data. According to this decode timestamp, each target audio / video data is sent to a decoder for decoding. The decoder receives and decodes the target audio / video data frame by frame, thereby accumulating the target audio / video data for one GOP. Once the decoded target audio / video data meets the audio / video synchronization conditions, it can be played back based on the display timestamp.

[0083] Here, since the smallest media processing unit that a terminal playback device can process is one GOP, this target timestamp information is the display timestamp information of each audio-video GOP in the target audio-video data, while since there are multiple audio-video data frames in one audio-video GOP, the display timestamps shared by multiple audio-video data frames in one audio-video GOP, i.e., each frame audio data frame in one audio GOP, all have the same media processing unit serial number, and each frame video data frame in one video GOP all have the same media processing unit serial number.

[0084] In this way, to be able to play back the audio / video data of each frame in the target audio / video data, it is necessary to obtain the decode time, display time, etc. corresponding to each frame of audio / video data in the target audio / video data, i.e., the decode timestamp, display timestamp, etc. corresponding to each frame of audio / video data. Optionally, to calculate and obtain the decode timestamp and display timestamp corresponding to each frame of audio / video data, the decode timestamp and display timestamp of each frame of audio / video data are calculated based on information such as the offset (dts_pts_offset) between the decode timestamp and display timestamp entered in the media processing unit extended timestamp descriptor in the audio / video data package table, the number of frames of audio / video data included in one GOP, and the timescale (Timescale).

[0085] Optionally, the calculation formula for the decoding timestamp is:

[0086]

number

number

[0087] The calculation formula for the display timestamp corresponding to each frame of audio-video data in the target audio-video data is as follows:

[0088] PTS(m)=DTS(m)+dts_pts_offset(m)÷timescale Here, PTS(m) represents the display timestamp corresponding to the mth frame of audio-video data in one audio-video GOP of the target audio-video data, and dts_pts_offset(m) represents the difference between the display timestamp corresponding to the mth frame of audio-video data in the audio-video GOP and the corresponding decoding timestamp.

[0089] In one embodiment, when a user triggers an action such as re-specifying a frequency point and the current frequency point changes, the timestamp information of the audio / video data corresponding to the previously played program can be cleared to avoid incorrectly using the timestamp information of the audio / video data corresponding to the previously played program.

[0090] As described above, the data processing method provided by the present embodiment monitors and analyzes the audio-video data package table in the data stream to obtain and cache the serial number and timestamp information of the media processing unit for the audio-video data corresponding to the program to be played. After extracting and obtaining the target audio-video data, the method searches for the target timestamp information corresponding to the target audio-video data from the pre-cached timestamp information, thereby enabling timely playback of the target audio-video data based on the target timestamp information. This avoids the situation in the prior art where the target audio-video data is lost because the serial number or target timestamp information of the media processing unit corresponding to the target audio-video data cannot be obtained. When the audio-video data corresponding to the program to be currently played changes due to a user switching programs or different audio-video data in the program, i.e., when the packet ID corresponding to the audio-video data to be currently played changes, the timestamp information of all packet IDs at the current frequency point has been cached in advance, and the corresponding timestamp information can be obtained in a timely manner and quickly sent to the decoder to play the audio-video data. Therefore, when switching between audio and video data, the related timestamp information is not retrieved, so some audio and video data is discarded, which avoids delaying the start time of audio and video data playback, thereby increasing the start speed of audio and video data playback and ultimately improving program playback efficiency.

[0091] As described above, an embodiment of the present application monitors an audio / video data package table in a data stream channel that transmits data between a server and a terminal, analyzes the audio / video data package table to obtain and cache timestamp information of the audio / video data in the data stream, obtains a target data stream waiting to be played by the terminal from the data stream, extracts the target audio / video data from the target data stream, searches for target timestamp information corresponding to the target audio / video data from the cached timestamp information, and plays the target audio / video data based on the target timestamp information. In this way, the audio-video data package table in the data stream is monitored and analyzed in advance to obtain timestamp information of the audio-video data, which is then cached in a timely manner. After the target audio-video data is extracted and obtained, the target timestamp information corresponding to the target audio-video data is searched for from the pre-cached timestamp information, and the target audio-video data is played back in a timely manner based on the target timestamp information. This avoids the situation in which the target audio-video data is lost due to the inability of the prior art to search for and obtain target timestamp information corresponding to the target audio-video data, thereby increasing the speed at which audio-video data playback can be started and improving the efficiency of program playback.

[0092] To better implement the above method, an embodiment of the present invention further provides a data processing device, which can be integrated into a computer device, and the computer device is a terminal.

[0093] For example, as shown in Fig. 4, Fig. 4 is a schematic diagram showing the configuration of a data processing device provided by an embodiment of the present application, which includes a monitoring unit 201, an analyzing unit 202, an extracting unit 203, a searching unit 204, and a playing unit 205, as follows:

[0094] The monitoring unit 201 is used in a data stream channel for data transmission between the server and the terminal to monitor the audio-video data package table in the data stream sent from the server.

[0095] The analysis unit 202 is used to analyze the audio-video data package table to obtain and cache timestamp information of the audio-video data in the data stream.

[0096] The extraction unit 203 is used to obtain a target data stream waiting to be played by the terminal from the data stream, and extract target audio-video data from the target data stream.

[0097] The search unit 204 is used to search the cached timestamp information for target timestamp information corresponding to the target audio-video data.

[0098] The playback unit 205 is used to perform playback on the target audio-video data based on the target timestamp information.

[0099] In one embodiment, the monitoring unit 201 includes: a first monitoring subunit used to monitor data in the target data stream based on a message type and a table identifier; and a determination subunit, which is used to determine, when target data whose message type is the target message type and whose table identifier is the target identifier is obtained by monitoring, that the target data is an audio / video data package table.

[0100] In one embodiment, the analysis unit 202: a parsing subunit used to parse the audio-video data package table to obtain timestamp information of the audio-video data in the data stream; and a classification and caching subunit used to acquire the serial number of the media processing unit of the audio-video data, and to classify and cache timestamp information corresponding to the audio-video data based on the serial number of the media processing unit.

[0101] In one embodiment, the search unit 204 includes: an acquisition subunit used to acquire the serial number of the target media processing unit of the target audio-video data; and a search subunit used to search the cached timestamp information for target timestamp information corresponding to the serial number of the target media processing unit based on the serial number of the target media processing unit.

[0102] In one embodiment, the playback unit 205 includes: a calculation subunit used to calculate a playback timestamp of the target audio-video data based on the target timestamp information; a transmitting subunit used to transmit the target audio-video data and corresponding playback timestamps to a decoder; and a playback subunit used by the decoder to perform playback of the target audio-video data based on the playback timestamp.

[0103] In one embodiment, the playback timestamps include a decode timestamp and a display timestamp, and the playback subunit: performing decoding by the decoder on the target audio-video data based on the decoding timestamp; If the decoded target audio-video data satisfies the audio-video synchronization conditions, the decoded target audio-video data is played back based on this display timestamp.

[0104] In one embodiment, the extraction unit 203 comprises: a target information acquisition subunit used for acquiring a target Internet Protocol address and a corresponding target audio-video packet identifier; and a filtering subunit used to perform filtering on the target data stream based on the target Internet Protocol address and the corresponding target audio-video packet identifier to obtain target audio-video data.

[0105] In one embodiment, the data processing device comprises: a re-acquisition unit used to acquire a first audio-video data package table corresponding to the target data stream; a re-analysis unit adapted to parse the first audio-video data package table to obtain a first Internet Protocol address and a corresponding first audio-video packet identifier; a re-filtering unit adapted to filter the target data stream based on the first Internet Protocol address and the corresponding first audio-video packet identifier to obtain first audio-video data when at least one of the first Internet Protocol address and the target Internet Protocol address and the first audio-video packet identifier and the target audio-video packet identifier are different; a re-retrieval unit used to retrieve first time stamp information corresponding to the first audio-video data from the cached time stamp information; The apparatus further includes a replay unit used to perform playback on the first audio-video data based on the first timestamp information.

[0106] In one embodiment, the recapture unit comprises: a first re-receiving subunit for receiving an address mapping table in the target data stream, the address mapping table being used to contain the Internet Protocol addresses of the audio-video data; a second re-receiving subunit containing an audio-video packet identifier list in the target data stream, the audio-video packet identifier list being used to contain audio-video packet identifiers of the audio-video data; and a re-filtering subunit used to select a first audio-video data package table from the target data stream based on the address mapping table and the audio-video packet identifier list.

[0107] In one embodiment, the data processing device comprises: The apparatus further includes a third re-receiving unit, which is used to re-acquire the first audio-video data package table from the target data stream when a failure in acquiring the first audio-video data package table is detected.

[0108] In one embodiment, the filtering unit comprises: a placement subunit used to place audio and video filters based on the target Internet Protocol address and the corresponding target audio and video packet identifier; an audio filtering subunit used to filter the target data stream with the audio filter to obtain at least one frame of target audio data; a video filtering subunit used to perform filtering on the target data stream with the video filter to obtain at least one frame of target video data; and an integrated subunit used to convert the target audio data and the target video data into target audio-video data.

[0109] In a specific embodiment, each of the above units may be realized as an entity, or may be arbitrarily combined and realized as the same or several entities. For specific implementations of each of the above units, reference can be made to the embodiments relating to the above-mentioned methods, and therefore, description thereof will be omitted here.

[0110] As described above, in this embodiment of the present application, the monitoring unit 201 monitors the audio-video data package table in the data stream transmitted from the server over a data stream channel for transmitting data between the server and the terminal. The analyzing unit 202 analyzes the audio-video data package table to obtain and cache timestamp information of the audio-video data in the data stream. The extracting unit 203 obtains a target data stream waiting for playback by the terminal from the data stream and extracts the target audio-video data from the target data stream. The searching unit 204 searches for target timestamp information corresponding to the target audio-video data from the cached timestamp information. The playing unit 205 plays the target audio-video data based on the target timestamp information. In this way, the audio-video data package table in the data stream is monitored and analyzed in advance to obtain timestamp information of the audio-video data, which is then cached in a timely manner. After the target audio-video data is extracted and obtained, the target timestamp information corresponding to the target audio-video data is searched for from the pre-cached timestamp information, and the target audio-video data is played back in a timely manner based on the target timestamp information. This avoids the situation in the prior art where the target audio-video data is lost due to the lack of search for target timestamp information corresponding to the target audio-video data, thereby increasing the speed at which audio-video data playback can be started and improving the efficiency of program playback.

[0111] The embodiment of the present application further provides a computer device, as shown in FIG. 5, which shows a structural schematic diagram of a computer device according to the embodiment of the present application, where the computer device is a terminal, and is specifically as follows:

[0112] This computer device may include components such as a processor 301 for processing one or more cores, a memory 302 of one or more computer-readable storage media, a power supply 303, and an input unit 304. Those skilled in the art should understand that the configuration of the computer device shown in Fig. 5 does not limit the computer device, and that the computer device may include more or fewer components than those shown, or may combine specific components, or may be configured with different components. Specifically, the computer device is as follows.

[0113] The processor 301 is the control center of the computer device, connecting various components of the entire computer device using various interfaces and wiring, executing or implementing software programs and / or modules stored in the memory 302, and accessing data stored in the memory 302 to perform various functions of the computer device and process data. Optionally, the processor 301 may include one or more processing cores. Preferably, the processor 301 may be integrated with a modulation / demodulation processor. Here, the processor is used to primarily process the operation system, user interface, computer programs, etc., and the modulation / demodulation processor is used to primarily process wireless communications. As can be appreciated, the modulation / demodulation processor described above does not necessarily have to be integrated into the processor 301.

[0114] The memory 302 can be used to store software programs and modules. The processor 301 executes the software programs and modules stored in the memory 302 to perform various functional applications and data processing. The memory 302 mainly includes a program storage area and a data storage area. The program storage area can store an operating system, at least one computer program required for a function (e.g., an audio playback function, an image playback function, etc.), etc. The data storage area can store data generated based on the use of the computer device, etc. Furthermore, the memory 302 can include a high-speed random access memory or a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state memory device. Accordingly, the memory 302 can include a memory controller to provide access to the memory 302 by the processor 301.

[0115] The computer device further includes a power supply 303 for supplying power to each component. Preferably, the power supply 303 may be logically connected to the processor 301 through a power management system, thereby realizing functions such as charging, discharging, and power consumption management through the power management system. The power supply 303 may further include any component such as one or more DC or AC power sources, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, etc.

[0116] The computing device may further include an input unit 304, which can be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs for user settings and function control.

[0117] Although not shown, the computer device may also include a display unit, etc., the description of which is omitted here. In this embodiment, the processor 301 in the computer device loads executable files corresponding to one or more computer program processes into the memory 302 in accordance with the following instructions, and executes the computer programs stored in the memory 302 by the processor 301 to realize various functions. Specifically, as follows:

[0118] In a data stream channel for transmitting data between a server and a terminal, an audio / video data package table in the data stream sent from the server is monitored, the audio / video data package table is analyzed to obtain and cache timestamp information of the audio / video data in the data stream, a target data stream waiting to be played back by the terminal is obtained from the data stream, and the target audio / video data is extracted from the target data stream, target timestamp information corresponding to the target audio / video data is searched for from the cached timestamp information, and the target audio / video data is played back based on the target timestamp information.

[0119] The specific implementation of each of the above operations can be referred to in the above embodiments, and therefore the description thereof will be omitted here. In addition, the computer device provided by the embodiments of the present application belongs to the same technical idea as the method for adapting to data processing in the above embodiments, and the specific implementation process thereof can be referred to in the above embodiments, and therefore the description thereof will be omitted here.

[0120] Those skilled in the art should understand that all or some of the steps in each method of the above-described embodiments may be implemented by instructions or by controlling related hardware with instructions, which are stored in a computer-readable storage medium and are loaded and executed by a processor.

[0121] Therefore, an embodiment of the present application provides a storage medium having a plurality of instructions stored thereon, which can be loaded by a processor to cause the processor to perform steps in any one of the data processing methods provided by the embodiment of the present application. For example, the instructions can cause the processor to perform the following steps:

[0122] In a data stream channel for transmitting data between a server and a terminal, an audio / video data package table in the data stream sent from the server is monitored, the audio / video data package table is analyzed to obtain and cache timestamp information of the audio / video data in the data stream, a target data stream waiting to be played back by the terminal is obtained from the data stream, and the target audio / video data is extracted from the target data stream, target timestamp information corresponding to the target audio / video data is searched for from the cached timestamp information, and the target audio / video data is played back based on the target timestamp information.

[0123] Here, the storage medium may include a read only memory (ROM), a random access memory (RAM), a disk, an optical disk, or the like.

[0124] The instructions stored in this storage medium can perform the steps of any one of the data processing methods provided by the embodiments of the present application, thereby achieving the effects of the invention that can realize any one of the data processing methods provided by the embodiments of the present application. For details, please refer to the above-mentioned embodiments and the description will be omitted here.

[0125] In one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program including computer instructions stored in a computer-readable storage medium, a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided by the various selectable implementation manners provided by the above-mentioned embodiments.

[0126] The data processing method, device, storage medium, and computer device provided by the embodiments of the present application have been described in detail above, and the principles and embodiments of the present application have been described using specific examples in this specification. However, the description of the above examples is intended only to aid in understanding the method and core idea of ​​the present application. Furthermore, it should be understood that those skilled in the art can modify specific embodiments and application scope based on the technical concept of the present application. In summary, the description in this specification should not be construed as limiting the present application.

Claims

1. monitoring an audio / video data package table in a data stream transmitted from the server in a data stream channel for data transmission between the server and the terminal; analyzing the audio / video data package table to obtain and cache timestamp information of the audio / video data in the data stream; obtaining a target data stream waiting to be played back from the terminal from the data stream, and extracting target audio / video data from the target data stream; retrieving target timestamp information corresponding to the target audio / video data from the cached timestamp information; and reproducing the target audio / video data based on the target timestamp information. Data processing methods.

2. monitoring an audio-video data package table in a data stream transmitted from the server, monitoring data in the data stream based on a message type and a table identifier; and determining, when monitoring and obtaining target data in which the message type is the target message type and the table identifier is the target identifier, that the target data is an audio / video data package table. The data processing method according to claim 1 .

3. Analyzing the audio / video data package table to obtain and cache timestamp information of the audio / video data in the data stream includes: analyzing the audio-video data package table to obtain timestamp information of the audio-video data in the data stream; obtaining a serial number of a media processing unit for the audio / video data, and classifying and caching timestamp information corresponding to the audio / video data based on the serial number of the media processing unit; The data processing method according to claim 1 .

4. retrieving target timestamp information corresponding to the target audio / video data from the cached timestamp information, obtaining a serial number of a target media processing unit for the target audio-video data; and searching the cached timestamp information for target timestamp information corresponding to the serial number of the target media processing unit based on the serial number of the target media processing unit. The data processing method according to claim 3 .

5. performing playback of the target audio / video data based on the target timestamp information, calculating a playback timestamp of the target audio-video data based on the target timestamp information; transmitting the target audio-video data and corresponding playback timestamps to a decoder; and performing playback of the target audio-video data by the decoder based on the playback timestamp. The data processing method according to claim 1 .

6. The playback timestamps include a decoding timestamp and a display timestamp, and performing playback of the target audio-video data by the decoder based on the playback timestamps includes: performing decoding on the target audio-video data by the decoder based on the decoding timestamp; When the decoded target audio-video data satisfies an audio-video synchronization condition, performing playback on the decoded target audio-video data based on the display timestamp.

6. The data processing method according to claim 5.

7. Extracting target audio-video data from the target data stream includes: obtaining a target Internet Protocol address and a corresponding target audio-video packet identifier; filtering the target data stream based on the target Internet Protocol address and corresponding target audio-video packet identifier to obtain target audio-video data; The data processing method according to claim 1 .

8. after extracting the target audio-video data from the target data stream; obtaining a first audio-video data package table corresponding to the target data stream; parsing the first audio-video data package table to obtain a first Internet Protocol address and a corresponding first audio-video packet identifier; if at least one of the first Internet Protocol address and the target Internet Protocol address, and the first audio-video packet identifier and the target audio-video packet identifier are different, filtering the target data stream based on the first Internet Protocol address and the corresponding first audio-video packet identifier to obtain first audio-video data; retrieving first timestamp information corresponding to the first audio / video data from the cached timestamp information; and performing playback on the first audio / video data based on the first timestamp information. The data processing method according to claim 7.

9. Obtaining a first audio-video data package table corresponding to the target data stream includes: receiving an address mapping table in the target data stream, the address mapping table including Internet Protocol addresses of the audio and video data; receiving a list of audio-video packet identifiers in the target data stream, the list of audio-video packet identifiers including audio-video packet identifiers of the audio-video data; selecting a first audio-video data package table from the target data stream based on the address mapping table and the audio-video packet identifier list; 9. The data processing method according to claim 8.

10. After obtaining a first audio-video data package table corresponding to the target data stream, and when detecting a failure in acquiring the first audio-video data package table, reacquiring the first audio-video data package table from the target data stream.

9. The data processing method according to claim 8.

11. filtering the target data stream based on the target Internet Protocol address and the corresponding target audio-video packet identifier to obtain target audio-video data; establishing audio and video filters based on the target Internet Protocol address and the corresponding target audio and video packet identifier; filtering the target data stream with the audio filter to obtain at least one frame of target audio data; filtering the target data stream with the video filter to obtain at least one frame of target video data; and setting the target audio data and the target video data as target audio-video data. The data processing method according to claim 7.

12. a monitoring unit for monitoring an audio / video data package table in a data stream transmitted from the server in a data stream channel for data transmission between the server and a terminal; an analyzing unit for analyzing the audio-video data package table to obtain and cache timestamp information of the audio-video data in the data stream; an extraction unit for obtaining a target data stream waiting to be played by the terminal from the data stream and extracting target audio / video data from the target data stream; a search unit for searching the cached timestamp information for target timestamp information corresponding to the target audio / video data; a playback unit for performing playback of the target audio / video data based on the target timestamp information. Data processing device.

13. The monitoring unit a first monitoring subunit that monitors data in the data stream based on a message type and a table identifier; a determining subunit for determining, when monitoring and obtaining target data whose message type is a target message type and whose table identifier is a target identifier, that the target data is an audio / video data package table; 13. A data processing apparatus according to claim 12.

14. The analysis unit an analysis subunit for performing analysis on the audio / video data package table to obtain timestamp information of the audio / video data in the data stream; a classifying and caching subunit that acquires a serial number of a media processing unit for the audio / video data, and classifies and caches timestamp information corresponding to the audio / video data based on the serial number of the media processing unit.

13. A data processing apparatus according to claim 12.

15. The search unit an acquiring subunit for acquiring a serial number of a target media processing unit for the target audio / video data; a search subunit for searching the cached timestamp information for target timestamp information corresponding to the serial number of the target media processing unit based on the serial number of the target media processing unit; 13. A data processing apparatus according to claim 12.

16. The regeneration unit comprises: a calculation subunit for calculating a playback timestamp of the target audio / video data based on the target timestamp information; a transmitting subunit for transmitting the target audio-video data and corresponding playback timestamps to a decoder; a playback subunit for performing playback of the target audio / video data by the decoder based on the playback timestamp.

13. A data processing apparatus according to claim 12.

17. The playback timestamps include a decoding timestamp and a display timestamp, and the playback subunit: performing decoding on the target audio-video data by the decoder based on the decoding timestamp; If the decoded target audio-video data satisfies an audio-video synchronization condition, then playback is performed on the decoded target audio-video data based on the display timestamp.

17. A data processing apparatus according to claim 16.

18. The extraction unit comprises: obtaining a target Internet Protocol address and a corresponding target audio-video packet identifier; filtering the target data stream based on the target Internet Protocol address and the corresponding target audio-video packet identifier to obtain target audio-video data; 13. A data processing apparatus according to claim 12.

19. A plurality of instructions for causing a processor to perform the steps of the data processing method according to any one of claims 1 to 11 are stored on the processor. storage medium.

20. a memory and a processor, wherein a computer program is stored in the memory, and the processor executes the computer program stored in the memory to perform the steps of the data processing method according to any one of claims 1 to 11; Computer equipment.

Images