32 results about "Live coding" patented technology

A game console capable of communicating with other game consoles over a link or network is provided with a headphone and microphone for each player who will engage in voice communication. Verbal communications directed to one or more other players are converted to pulse code modulated (PCM) digital data and are encoded and compressed in real-time, producing data packets that are transmitted to another game console. The compressed data packets are decompressed and decoded, producing PCM data that are converted to an analog signal that drives a headphone of the intended recipient. Players can selectively mute voice communications to and from a specific other player. The PCM data can be encoded in a round-robin fashion that reduces the number of encoders required. A predefined level of computing resources is used for voice communication to avoid aversely affecting the quality of game play.

The invention provides a method and a device for selecting an optimal intra-frame coding mode for a video sequence. The method comprises the steps of dividing an image into a plurality of code blocks; determining a plurality of intra-frame coding modes according to the sizes of the code blocks; calculating horizontal and perpendicular gradients and the like of pixels in the code blocks; calculating the slope of the coding direction that each intra-frame coding mode corresponds to, and dividing the intra-frame coding modes into N groups; comparing the slopes in all of the gradient directions with the first to the Nth scheduled intervals so as to obtain the first to the Nth gradient energy values; selecting a group of intra-frame coding modes that the maximum gradient energy value corresponds to as a candidate prediction mode set; calculating the rate distortion cost of each coding mode in the candidate prediction mode set, and selecting the intra-frame coding mode with the minimum rate distortion cost as the optimal intra-frame coding mode for the code blocks. The method has the advantages of reducing the amount of calculation of the rate distortion cost and increasing calculation speed, and is suitable for real-time coding.

The invention discloses a method for on-line and real-time recording and forwarding of audio / video streams by a mobile internet terminal. After audio / video streams collected by a mobile internet terminal camera and a microphone are coded in real time by client side software, the audio / video streams are connected by a media stream and is sent to a server side in real time; and stream media is recorded by the server side to store as an audio / video file, or the server side directly forwards the media stream. The method relates to the field of the audio and the video of the mobile internet. The method comprises the following basic steps: (1) the client side software of the mobile internet terminal builds a media stream connection with the server side; (2) the client side software invokes a camera and microphone equipment to collect the audio / video streams and codes in real time; (3) the client side software sends the coded audio / video data to the server side in real time by the media stream connection; and (4) the server side records the received media stream data to store as an audio / video file, or the server side directly forwards the media stream.

The invention relates to a video live broadcast control method based on IPV9, and the method comprises the following steps: realizing audio and video information acquisition and real-time coding of aPC (Personal Computer) end of an anchor, and then pushing audio and video streams to a server through a streaming media protocol; receiving audio and video information pushed by the anchor, and transcoding and slicing the audio and video information into a TS format for HLS protocol pull flow; enabling a user to access webpage resources on the server through a browser and to select a live broadcast room of a live broadcast anchor which the user wants to watch on a webpage, and entering the live broadcast room to automatically play a real-time video of the anchor. Video data is acquired mainlythrough a camera, audio data is acquired through a microphone, and the video data and the audio data are subjected to a series of preprocessing, encoding and packaging and then pushed to a CDN to be distributed. Therefore, the hardware acceleration capability of the HTML5 native playing environment on multimedia playing is fully exerted, and the playing performance is greatly improved.

A digital signal processor (DSP) optimization method based on a G729 speech compression coding algorithm is characterized by comprising the following steps: using a DSP software development environment of a CCS version 3.3, transplanting an open-source source code of the G729 speech coding algorithm to TMS320C55X, and successfully performing speed coding; performing improvement of a polynomial rooting algorithm on a linear predictive coding (LPC) stage of the algorithm, optimizing a search algorithm of a codebook at a search stage of the fixed codebook, and simplifying the distance searching process in the calculation process of a vector distance; arranging a compiler; and rewriting some module functions sequentially on the C language level and the assembling level. The DSP optimization method has the remarkable advantages that the coding time is short, and difficulty of multichannel voice in real-time coding on a DSP can be overcome.

The invention relates to a coded data processing method and device, computer equipment and a storage medium. The method comprises the steps: obtaining a to-be-coded data frame; determining the complexity of the to-be-coded data frame; acquiring a real-time coding rate, wherein the real-time coding rate is a coding rate of a preorder coded data frame of the to-be-coded data frame; and adjusting thecoding parameters according to the real-time coding rate and the complexity of the to-be-coded data frame. Because the coding parameters are adjusted according to the real-time coding rate and the complexity degree, different real-time coding rates and complexity degrees can correspond to different coding parameters, so the coding parameters can be suitable for different scenes, and the adaptability is high.

A system and method for performing source buffering to transmit a real-time encoded scalable video to multiple transmission groups are provided. A streaming system for providing a scalable video bitstream for each multicast group may include an encoder source buffer to receive a scalable video bitstream and to store the received scalable video bitstream, and a plurality of subgroup transmitters, each to receive data of different layers in the stored scalable video bitstream from the encoder source buffer, to packetize the received data, and to transmit the packetized data to a terminal.

The invention belongs to the technical field of high-definition digital video compression coding and decoding and particularly relates to an address mapping algorithm for a transposed matrix based on a single-port SRAM in a 2D-DCT / IDCT under HEVC video coding standards. The address mapping algorithm is based on the algorithm of transposition of matrix blocks, that is, the matrix is divided into blocks first, the whole matrix and small-sized matrix blocks are transposed with the small-sized matrix blocks and basic elements as units, and transposition of the small-sized matrix blocks can be achieved directly by means of ranking. The algorithm is implemented on the basis of transform units (TUs) and supports four sizes of the TUs allowed by the HEVC, the fixed throughput rate 32 pixes / cycle can be realized, and the method is applicable to the 2D-DCT / IDCT with a high throughput rate and a high-performance video coder and decoder. According to the algorithm, by means of a hardware structure, the area can be reduced by 40% or so; compared with an existing address mapping algorithm for the transposed matrix based on the single-port SRAM, the algorithm has the advantages that on the condition of not increasing hardware expenses, a higher throughput rate can be obtained, and real-time coding of high-definition videos can be achieved.

The invention discloses a video transmission method and device, equipment and a medium, and the method comprises the steps: obtaining an image sequence, carrying out the real-time coding of the imagesequence based on a preset coding rate, and obtaining a corresponding key frame or coded frames so as to obtain a target frame group, wherein the target frame group comprises a key frame and a plurality of coded frames after the key frame; segmenting the acquired key frame or coded frames in real time based on a data packet segmentation length to obtain a plurality of data packets; filling the data packet with the data packet header information based on a preset data packet format to obtain a packaged data packet; and sending the packaged data packet to a receiving end based on a first presettime interval, so that the receiving end recombines the key frame and the coded frames based on the data packet header information of the packaged data packet to obtain a video picture. According to the method, H264 and H265 video stream transmission congestion, frame loss and the like can be improved in a poor network environment with large signal interference, weak signals and the like or a network environment with limited throughput.

The invention discloses a motion estimation realizing method of a configurable speed in video compression. The motion estimation realizing method specifically comprises the following steps of: reasonably configuring and processing quantity of PE units according to user demands; in the PE units, calculating costs of basic blocks; based on the cost correlation of different sizes of blocks to obtain costs of different blocks under different partition modes; and reading complete all reference data line by line, comparing final costs obtained by all PEs and taking minimum cost to determine optimal motion information MV. According to the invention, times of storage access are effectively reduced, and coding speed completely can meet requirements of real-time coding of high-definition video.

Embodiments of the invention provide for live encoding systems that can replicate a current encoded frame instead of re-encoding said current frame, and then adjust the replicated frame to different bitrates, resolutions, and / or contexts as necessary for the several different adaptive bitrate streams. In addition, various embodiments of the invention can extend a duration of a current frame being repackaged and / or re-encoded. Utilizing these and other techniques, live encoding systems in accordance with embodiments of the invention can more efficiently handle gaps in received data, slower feeding of data, and / or heavy loads on server hardware.

The invention provides a video coding rate adjustment method, system and device, and a storage medium. The method comprises the following steps: acquiring a target coding rate of a video encoder; detecting a current coding rate of the video encoder; calculating a rate deviation value between a current coding rate and a target coding rate of the video encoder; obtaining an updated coding rate of the video encoder according to the rate deviation value, and controlling the coding rate of the video encoder based on the updated coding rate. By adopting the method and the device, the video coding rate is updated based on the difference value between the current coding rate and the target coding rate, so the problem that the real-time coding rate of the video coder cannot actually reach the target coding rate is solved, the adaptability between the coding rate of the video coder and the rate of subsequently sending video data is improved, the situation that the sending cache queue caches too much data is avoided, the situation of data packet loss is also avoided, and the accuracy and effectiveness of video data sending are improved.

Before receiving an instruction from a media player to encode a media program, a placeshifting device or other video encoder pre-encodes at least a portion of the media program to a low-bandwidth format that can be readily transmitted to the media player upon request. When the media player does instruct the placeshifting device to encode the media program, the placeshifting device initially provides the pre-encoded portion of the media program to thereby allow the media player to begin immediate playback of the pre-encoded portion. After providing the preencoded portion of the media program, the placeshifting device live encodes the remaining portions of the media program according to then-current network conditions to thereby provide the placeshifted video stream to the media player.

The invention provides a parallel implementing method of SAD in motion estimation. The method is double-edge-triggered by a clock to parallel process addition and subtraction and ensures the SAD is carried out in single period. The method can reduce the expense of hardware resource in motion estimation by 50 percent or shorten the processing cycle in single-channel processing by 50 percent and can guarantee the real-time coding of high definition video.

The present invention relates to a code stream length calculation method and equipment, comprising: in the process of encoding video, at least two residual coefficients that need to be calculated in a decision mode to calculate the code stream length in the first video frame are obtained; the first A video frame is any video frame in the video; the length of the code stream obtained after encoding each residual coefficient in the at least two residual coefficients is calculated in parallel. In the code stream length calculation method provided by the embodiment of the present invention, when calculating the code stream length obtained after encoding the residual-coefficient, a parallel calculation method can be used instead of a serial method, which can greatly improve the calculation speed and shorten the obtained Cost time, improve the efficiency of video encoding. Especially in the process of real-time encoding, the method provided by the embodiment of the present invention will have relatively great advantages.

The invention relates to video compression technology, in particular to a fast motion estimation method in the video compression technology. The invention proposes a motion estimation method that reduces the possibility of falling into a local optimum and basically does not affect the signal-to-noise ratio of an image. The gist of its technical scheme is: a kind of method for quick motion estimation, comprises the following steps: a. counts the probability size that the motion vector of the block in the image is equal to the predicted motion vector; b. when detecting the motion vector, according to the above steps a Detect the predicted motion vector in sequence from the probability obtained in the statistics from large to small; c. Use a threshold to judge the termination of the motion search. The invention reduces unnecessary searches, improves search efficiency, and is suitable for high-definition video coding and real-time coding.

According to the video generation method and device, the storage medium and the computer equipment provided by the invention, the Flutter function module is accessed into the client, and the Flutter function module is a function module which is developed based on the Flutter technology and realizes real-time animation video generation, so that after the client obtains the target animation file, the target animation file only needs to be loaded through the Flutter function module, a target video can be generated by rendering and encoding the target animation file in real time, and a video production function universal for different operating system platforms can be compiled only by developing a Flutter function module for one time through a Flutter technology in the process, so that a large amount of development cost input can be reduced, the research and development efficiency can be improved, and code maintenance is facilitated; moreover, after the target animation file is rendered into the video frame in real time, the video frame can be directly subjected to video coding output, so that the whole process has no extra performance loss, the output efficiency is higher, and the applicability is wider.

This application relates to a method and an apparatus for processing encoded data, a computer device, and a storage medium. The method includes: obtaining a to-be-encoded data frame; determining a complexity of the to-be-encoded data frame, the complexity representing at least a spatial texture complexity and a temporal motion intensity; obtaining a real-time encoding bit rate, the real-time encoding bit rate being an encoding bit rate of a previous encoded data frame of the to-be-encoded data frame; and adjusting an encoding parameter according to the real-time encoding bit rate and the complexity of the to-be-encoded data frame. The encoding parameter is adjusted according to the real-time encoding bit rate and the complexity, and different real-time encoding bit rates and complexities may correspond to different encoding parameters. In this way, the encoding parameter is applicable to different scenes, thereby achieving high adaptability.

The invention belongs to the technical field of three-dimensional video image processing, and particularly relates to an advanced residual error prediction method based on a reconfigurable array processor. The method comprises the following steps: acquiring texture image data and corresponding depth image data of a current coding unit of a texture image to be coded; when the depth data of the current coding unit belongs to a depth range in a pre-obtained advanced residual error prediction rule, obtaining an advanced residual error prediction algorithm of the current coding unit through matching of the advanced residual error prediction rule; performing predictive encoding on the texture image data of the current encoding unit by adopting the obtained advanced residual prediction algorithm,wherein the advanced residual prediction rule is obtained by counting an advanced residual prediction algorithm adopted by a video test image coding unit, and the video test image and the texture image to be coded belong to the same scene. The method is low in calculation complexity and short in coding time, and meets the real-time coding requirements of video images in a multimedia system.

The invention discloses an adaptive variable length real-time encoder and encoding method. The encoder comprises a pre-processing module, an encoding module and a packaging module; the pre-processingmodule with two groups of coefficient storage space and the encoding module with serial-parallel combined entropy encoding are used for optimizing the structure of the encoder, the efficient encodingis realized, and the real-time encoding requirement is satisfied.

The invention discloses a multi-node low-delay parallel encoding method for 8K ultra-high definition. It adopts master-slave multi-node encoding, video encoding is based on slice encoding, divides a complete frame to be encoded into several slices, assigns different encoding nodes for encoding, and limits each slice to contain a certain number of integer CTU lines, the number of lines Variable, dynamically adjusted according to the encoding time of each node. After each node is encoded, the encoded code stream is sent back to the master node, and the master node is splicing the code stream data into a complete frame. The beneficial effects of the present invention are: Realize 8K real-time encoding in formats such as HEVC and AVS2, increase the encoding performance and reduce the encoding delay by adding an encoding server, and can balance the encoding time of the master-slave encoding nodes to achieve the optimization of the overall system, And with the lowest latency.

The invention provides a VBR code rate control method for video real-time coding, which is applied to an IPPP structure for video real-time coding and comprises the following steps of: sequentially distributing target code rates for different coding units by adopting a grading strategy; the grading strategy is divided into a GOPs level, a GOP level and an image level; setting the upper and lower limits of allowable fluctuation for the current GOP target code rate according to the tolerance of the user to the code rate fluctuation, and comparing the instantaneous estimated code rate with the upper and lower limits of the allowable fluctuation of the target code rate to decide how to adjust the QP so as to reduce unnecessary fluctuation of the QP; according to the influence degree of the scene change on the code rate and the scene change position, a new code rate fluctuation upper limit and a new code rate fluctuation lower limit are calculated, and QP adjustment is guided; when scene change occurs in a video image, weighted summation is carried out through the estimated instantaneous code rate and the distributed target code rate fluctuation upper and lower limits to obtain a new code rate control upper and lower limits, the weight proportion is related to the position of the current frame in the GOP, the control intensity is higher when the current frame is closer to the I frame, and the control intensity is weaker when the current frame is farther from the I frame.