39 results about "Live coding" patented technology

A game console capable of communicating with other game consoles over a link or network is provided with a headphone and microphone for each player who will engage in voice communication. Verbal communications directed to one or more other players are converted to pulse code modulated (PCM) digital data and are encoded and compressed in real-time, producing data packets that are transmitted to another game console. The compressed data packets are decompressed and decoded, producing PCM data that are converted to an analog signal that drives a headphone of the intended recipient. Players can selectively mute voice communications to and from a specific other player. The PCM data can be encoded in a round-robin fashion that reduces the number of encoders required. A predefined level of computing resources is used for voice communication to avoid aversely affecting the quality of game play.

A game console capable of communicating with other game consoles over a link or network is provided with a headphone and microphone for each player who will engage in voice communication. Verbal communications directed to one or more other players are converted to pulse code modulated (PCM) digital data and are encoded and compressed in real-time, producing data packets that are transmitted to another game console. The compressed data packets are decompressed and decoded, producing PCM data that are converted to an analog signal that drives a headphone of the intended recipient. Players can selectively mute voice communications to and from a specific other player. The PCM data can be encoded in a round-robin fashion that reduces the number of encoders required. A predefined level of computing resources is used for voice communication to avoid aversely affecting the quality of game play.

The invention provides a method and a device for selecting an optimal intra-frame coding mode for a video sequence. The method comprises the steps of dividing an image into a plurality of code blocks; determining a plurality of intra-frame coding modes according to the sizes of the code blocks; calculating horizontal and perpendicular gradients and the like of pixels in the code blocks; calculating the slope of the coding direction that each intra-frame coding mode corresponds to, and dividing the intra-frame coding modes into N groups; comparing the slopes in all of the gradient directions with the first to the Nth scheduled intervals so as to obtain the first to the Nth gradient energy values; selecting a group of intra-frame coding modes that the maximum gradient energy value corresponds to as a candidate prediction mode set; calculating the rate distortion cost of each coding mode in the candidate prediction mode set, and selecting the intra-frame coding mode with the minimum rate distortion cost as the optimal intra-frame coding mode for the code blocks. The method has the advantages of reducing the amount of calculation of the rate distortion cost and increasing calculation speed, and is suitable for real-time coding.

The invention discloses a method for on-line and real-time recording and forwarding of audio / video streams by a mobile internet terminal. After audio / video streams collected by a mobile internet terminal camera and a microphone are coded in real time by client side software, the audio / video streams are connected by a media stream and is sent to a server side in real time; and stream media is recorded by the server side to store as an audio / video file, or the server side directly forwards the media stream. The method relates to the field of the audio and the video of the mobile internet. The method comprises the following basic steps: (1) the client side software of the mobile internet terminal builds a media stream connection with the server side; (2) the client side software invokes a camera and microphone equipment to collect the audio / video streams and codes in real time; (3) the client side software sends the coded audio / video data to the server side in real time by the media stream connection; and (4) the server side records the received media stream data to store as an audio / video file, or the server side directly forwards the media stream.

The invention relates to a video live broadcast control method based on IPV9, and the method comprises the following steps: realizing audio and video information acquisition and real-time coding of aPC (Personal Computer) end of an anchor, and then pushing audio and video streams to a server through a streaming media protocol; receiving audio and video information pushed by the anchor, and transcoding and slicing the audio and video information into a TS format for HLS protocol pull flow; enabling a user to access webpage resources on the server through a browser and to select a live broadcast room of a live broadcast anchor which the user wants to watch on a webpage, and entering the live broadcast room to automatically play a real-time video of the anchor. Video data is acquired mainlythrough a camera, audio data is acquired through a microphone, and the video data and the audio data are subjected to a series of preprocessing, encoding and packaging and then pushed to a CDN to be distributed. Therefore, the hardware acceleration capability of the HTML5 native playing environment on multimedia playing is fully exerted, and the playing performance is greatly improved.

A digital signal processor (DSP) optimization method based on a G729 speech compression coding algorithm is characterized by comprising the following steps: using a DSP software development environment of a CCS version 3.3, transplanting an open-source source code of the G729 speech coding algorithm to TMS320C55X, and successfully performing speed coding; performing improvement of a polynomial rooting algorithm on a linear predictive coding (LPC) stage of the algorithm, optimizing a search algorithm of a codebook at a search stage of the fixed codebook, and simplifying the distance searching process in the calculation process of a vector distance; arranging a compiler; and rewriting some module functions sequentially on the C language level and the assembling level. The DSP optimization method has the remarkable advantages that the coding time is short, and difficulty of multichannel voice in real-time coding on a DSP can be overcome.

The invention relates to a coded data processing method and device, computer equipment and a storage medium. The method comprises the steps: obtaining a to-be-coded data frame; determining the complexity of the to-be-coded data frame; acquiring a real-time coding rate, wherein the real-time coding rate is a coding rate of a preorder coded data frame of the to-be-coded data frame; and adjusting thecoding parameters according to the real-time coding rate and the complexity of the to-be-coded data frame. Because the coding parameters are adjusted according to the real-time coding rate and the complexity degree, different real-time coding rates and complexity degrees can correspond to different coding parameters, so the coding parameters can be suitable for different scenes, and the adaptability is high.

A system and method for performing source buffering to transmit a real-time encoded scalable video to multiple transmission groups are provided. A streaming system for providing a scalable video bitstream for each multicast group may include an encoder source buffer to receive a scalable video bitstream and to store the received scalable video bitstream, and a plurality of subgroup transmitters, each to receive data of different layers in the stored scalable video bitstream from the encoder source buffer, to packetize the received data, and to transmit the packetized data to a terminal.

The invention belongs to the technical field of high-definition digital video compression coding and decoding and particularly relates to an address mapping algorithm for a transposed matrix based on a single-port SRAM in a 2D-DCT / IDCT under HEVC video coding standards. The address mapping algorithm is based on the algorithm of transposition of matrix blocks, that is, the matrix is divided into blocks first, the whole matrix and small-sized matrix blocks are transposed with the small-sized matrix blocks and basic elements as units, and transposition of the small-sized matrix blocks can be achieved directly by means of ranking. The algorithm is implemented on the basis of transform units (TUs) and supports four sizes of the TUs allowed by the HEVC, the fixed throughput rate 32 pixes / cycle can be realized, and the method is applicable to the 2D-DCT / IDCT with a high throughput rate and a high-performance video coder and decoder. According to the algorithm, by means of a hardware structure, the area can be reduced by 40% or so; compared with an existing address mapping algorithm for the transposed matrix based on the single-port SRAM, the algorithm has the advantages that on the condition of not increasing hardware expenses, a higher throughput rate can be obtained, and real-time coding of high-definition videos can be achieved.

The invention discloses a video transmission method and device, equipment and a medium, and the method comprises the steps: obtaining an image sequence, carrying out the real-time coding of the imagesequence based on a preset coding rate, and obtaining a corresponding key frame or coded frames so as to obtain a target frame group, wherein the target frame group comprises a key frame and a plurality of coded frames after the key frame; segmenting the acquired key frame or coded frames in real time based on a data packet segmentation length to obtain a plurality of data packets; filling the data packet with the data packet header information based on a preset data packet format to obtain a packaged data packet; and sending the packaged data packet to a receiving end based on a first presettime interval, so that the receiving end recombines the key frame and the coded frames based on the data packet header information of the packaged data packet to obtain a video picture. According to the method, H264 and H265 video stream transmission congestion, frame loss and the like can be improved in a poor network environment with large signal interference, weak signals and the like or a network environment with limited throughput.

The invention discloses a motion estimation realizing method of a configurable speed in video compression. The motion estimation realizing method specifically comprises the following steps of: reasonably configuring and processing quantity of PE units according to user demands; in the PE units, calculating costs of basic blocks; based on the cost correlation of different sizes of blocks to obtain costs of different blocks under different partition modes; and reading complete all reference data line by line, comparing final costs obtained by all PEs and taking minimum cost to determine optimal motion information MV. According to the invention, times of storage access are effectively reduced, and coding speed completely can meet requirements of real-time coding of high-definition video.

Embodiments of the invention provide for live encoding systems that can replicate a current encoded frame instead of re-encoding said current frame, and then adjust the replicated frame to different bitrates, resolutions, and / or contexts as necessary for the several different adaptive bitrate streams. In addition, various embodiments of the invention can extend a duration of a current frame being repackaged and / or re-encoded. Utilizing these and other techniques, live encoding systems in accordance with embodiments of the invention can more efficiently handle gaps in received data, slower feeding of data, and / or heavy loads on server hardware.

The invention provides a video coding rate adjustment method, system and device, and a storage medium. The method comprises the following steps: acquiring a target coding rate of a video encoder; detecting a current coding rate of the video encoder; calculating a rate deviation value between a current coding rate and a target coding rate of the video encoder; obtaining an updated coding rate of the video encoder according to the rate deviation value, and controlling the coding rate of the video encoder based on the updated coding rate. By adopting the method and the device, the video coding rate is updated based on the difference value between the current coding rate and the target coding rate, so the problem that the real-time coding rate of the video coder cannot actually reach the target coding rate is solved, the adaptability between the coding rate of the video coder and the rate of subsequently sending video data is improved, the situation that the sending cache queue caches too much data is avoided, the situation of data packet loss is also avoided, and the accuracy and effectiveness of video data sending are improved.

Before receiving an instruction from a media player to encode a media program, a placeshifting device or other video encoder pre-encodes at least a portion of the media program to a low-bandwidth format that can be readily transmitted to the media player upon request. When the media player does instruct the placeshifting device to encode the media program, the placeshifting device initially provides the pre-encoded portion of the media program to thereby allow the media player to begin immediate playback of the pre-encoded portion. After providing the preencoded portion of the media program, the placeshifting device live encodes the remaining portions of the media program according to then-current network conditions to thereby provide the placeshifted video stream to the media player.

The invention provides a parallel implementing method of SAD in motion estimation. The method is double-edge-triggered by a clock to parallel process addition and subtraction and ensures the SAD is carried out in single period. The method can reduce the expense of hardware resource in motion estimation by 50 percent or shorten the processing cycle in single-channel processing by 50 percent and can guarantee the real-time coding of high definition video.

The present invention relates to a code stream length calculation method and equipment, comprising: in the process of encoding video, at least two residual coefficients that need to be calculated in a decision mode to calculate the code stream length in the first video frame are obtained; the first A video frame is any video frame in the video; the length of the code stream obtained after encoding each residual coefficient in the at least two residual coefficients is calculated in parallel. In the code stream length calculation method provided by the embodiment of the present invention, when calculating the code stream length obtained after encoding the residual-coefficient, a parallel calculation method can be used instead of a serial method, which can greatly improve the calculation speed and shorten the obtained Cost time, improve the efficiency of video encoding. Especially in the process of real-time encoding, the method provided by the embodiment of the present invention will have relatively great advantages.

The present invention provides a novel three-dimensional video encoding quality evaluation method, comprising: S1, performing an encoding test on a section of video, and obtaining three values ​​of code rate / channel, quality, and complexity through different transmission conditions; S2, judging the code rate / Whether the value of the channel and complexity meets the conditions, and enter step S3 if the conditions are met; otherwise, discard the set of encoding parameters; S3, judge the video quality, and the quality values ​​are sorted in order from high to low, and the quality value is judged or compared with The judgment of the complexity value and the coding / channel value selects the optimal coding parameter combination; S4, obtaining the optimal parameter as the coding parameter. The new three-dimensional video coding quality evaluation method of the present invention selects a better combination of coding parameters to obtain a good effect of real-time coding and transmission.

The invention discloses a slow action server processing method, device and equipment and a storage medium, and the method comprises the steps: firstly, accessing a plurality of paths of video signals through video collection equipment, and carrying out the parallel double-code-stream real-time coding, and generating high and low code stream frame data; binding each frame of data with the PTP hardware timestamp to generate a bare frame data packet; constructing a channel-code stream-time sequence three-level collaborative index table, and performing efficient management on frame data; the bare frame data packets are written into an annular buffer area according to a timestamp sequence, the bare frame data packets are written into linear data files in batches through asynchronous threads, random writing is converted into sequential writing, and low-code-stream frame data are retrieved through an index table to be used for previewing and high-code-stream frame data are retrieved through an index table to be used for slow action processing; and finally, performing slow action processing on the high code stream frame data and outputting a slow action video sequence, and through combination of frame-level direct storage and three-level indexing, realizing millisecond-level accurate retrieval and efficient storage, and remarkably improving the response speed and the processing performance of a slow action server.

The invention relates to video compression technology, in particular to a fast motion estimation method in the video compression technology. The invention proposes a motion estimation method that reduces the possibility of falling into a local optimum and basically does not affect the signal-to-noise ratio of an image. The gist of its technical scheme is: a kind of method for quick motion estimation, comprises the following steps: a. counts the probability size that the motion vector of the block in the image is equal to the predicted motion vector; b. when detecting the motion vector, according to the above steps a Detect the predicted motion vector in sequence from the probability obtained in the statistics from large to small; c. Use a threshold to judge the termination of the motion search. The invention reduces unnecessary searches, improves search efficiency, and is suitable for high-definition video coding and real-time coding.

The present application relates to the technical field of audio codec, and particularly relates to a fast coding and decoding method and system for real-time audio.The method comprises the following steps: obtaining real-time sampling data of an input audio stream, performing multi-time point sliding window division and coding preprocessing, and generating coding preprocessing enhanced audio; performing adaptive quantization strategy analysis on the coding preprocessing enhanced audio, and performing multi-level residual quantization modeling to construct a real-time incremental coding mapping table; performing multi-module decomposition and execution based on the real-time incremental coding mapping table, and performing multi-thread parallel coding optimization to construct a real-time audio parallel coding strategy; performing real-time coding processing according to the real-time audio parallel coding strategy, and performing task-by-task rate-distortion optimization to obtain optimal coding parameters of each coding task.The present application realizes high-fidelity rate and low-delay audio coding and decoding, and improves user auditory experience.

The invention provides a binary arithmetic encoder with high throughput. A Range updating unit adopts 3 Range updating sub-units and forms a LU-LU-MU cascade structure, a LU-MU cascade structure and an LU-FU cascade structure, so that the circuit is optimized, the path delay of the circuit can be shortened, the working efficiency of the circuit is improved, accordingly, the throughput of the binary arithmetic encoder is improved, and real-time encoding of high-definition and ultra high-definition videos is supported.

The invention discloses a method and device for achieving screen projection control based on a WIFI-Display protocol, and relates to the technical field of wireless communication and multimedia transmission, and the method comprises the steps: firstly, building a WIFI-Display connection session between a source device and a receiving end; secondly, a dynamic updating area of the screen is intelligently captured by monitoring a graphic buffer area and using a difference block detection algorithm, and an original screen data stream is only generated for a changing area so as to improve the efficiency; then, dynamically generating coding control parameters by analyzing image motion complexity and real-time network state parameters; and finally, carrying out real-time coding and adaptive network packaging on the data stream based on the parameter to form a screen projection data stream, and sending the screen projection data stream to a receiving end. Through the above mode, the method effectively reduces the bandwidth consumption and the coding calculation amount, and remarkably improves the transmission fluency and the image quality stability of the dynamic screen content in a complex network environment through the adaptive code rate and the packaging strategy.

The invention provides an intelligent caching and breakpoint resuming method and system based on streaming AI, and the method comprises the steps: carrying out the real-time encoding of an operation sequence of a user and corresponding to-be-uploaded data through an encoder, and generating a potential state sequence; the potential state sequence is input into a preset prediction model, a prediction result is output, and the prediction result comprises the next operation intention of a user and an affected data range; periodically generating and persisting a first breakpoint state snapshot according to the potential state sequence; and when breakpoint resume is needed, loading a second breakpoint state snapshot selected by the user from the first breakpoint state snapshot, and replaying a playback operation sequence and playback data corresponding to the second breakpoint state snapshot based on a decoder corresponding to the encoder.

According to the video generation method and device, the storage medium and the computer equipment provided by the invention, the Flutter function module is accessed into the client, and the Flutter function module is a function module which is developed based on the Flutter technology and realizes real-time animation video generation, so that after the client obtains the target animation file, the target animation file only needs to be loaded through the Flutter function module, a target video can be generated by rendering and encoding the target animation file in real time, and a video production function universal for different operating system platforms can be compiled only by developing a Flutter function module for one time through a Flutter technology in the process, so that a large amount of development cost input can be reduced, the research and development efficiency can be improved, and code maintenance is facilitated; moreover, after the target animation file is rendered into the video frame in real time, the video frame can be directly subjected to video coding output, so that the whole process has no extra performance loss, the output efficiency is higher, and the applicability is wider.

This application relates to a method and an apparatus for processing encoded data, a computer device, and a storage medium. The method includes: obtaining a to-be-encoded data frame; determining a complexity of the to-be-encoded data frame, the complexity representing at least a spatial texture complexity and a temporal motion intensity; obtaining a real-time encoding bit rate, the real-time encoding bit rate being an encoding bit rate of a previous encoded data frame of the to-be-encoded data frame; and adjusting an encoding parameter according to the real-time encoding bit rate and the complexity of the to-be-encoded data frame. The encoding parameter is adjusted according to the real-time encoding bit rate and the complexity, and different real-time encoding bit rates and complexities may correspond to different encoding parameters. In this way, the encoding parameter is applicable to different scenes, thereby achieving high adaptability.

The invention provides a video encoding method and apparatus, and relates to the field of video encoding technology. The method comprises the following steps: acquiring prediction data of a target encoding unit, wherein the target encoding unit is an encoding unit obtained after a to-be-encoded frame is divided, and the target encoding unit is a to-be-processed encoding unit at present; based on the prediction data, executing a first process and a second process in parallel, wherein the first process is a process of obtaining reference data based on the prediction data, the second process is aprocess of obtaining an encoding result of the target encoding unit based on the prediction data, and the reference data are reference data of the next to-be-processed encoding unit to perform intra-frame prediction. By adoption of the video encoding method and apparatus, the technical problem that the existing AVS2 encoding technology cannot achieve real-time encoding is solved.

The invention provides a video compression method and system based on a LivePortrait-GAN video technology, and the method comprises the steps: extracting a coordinate set of key points of a human body of a teacher, carrying out the matching of the coordinate set with a preset teaching action semantic template library, carrying out the coding of a template number and a space offset if the matching succeeds, and otherwise, reserving a residual key point sequence; adjusting the residual key point sequence in combination with the synchronous voice rhythm characteristics, the structure mask and the space offset; fusing the semantic anchoring vector, the residual vector and a gating parameter generated based on the ratio of the residual amplitude to the template offset amplitude, and generating a driving vector with a smooth time sequence; and driving the clipped and fixed-point LivePortrait-GAN generator to reconstruct a portrait picture by using the identity characteristics of the static reference image of the teacher and the driving vector, and outputting a final video frame through frame-level fusion. The key model can be efficiently deployed on a domestic artificial intelligence acceleration chip (such as AX650N), end-to-end real-time coding and rendering are achieved, and the domestic controllable deployment requirement is met.