The embodiment of the invention provides a live broadcast dataprocessing method and device and a storage medium, and the live broadcast dataprocessing method comprises the steps: determining multi-modal live broadcast data of a target game, carrying out the data analysis of the multi-modal live broadcast data, and obtaining the initial features of a plurality of modals, the multi-modal live broadcast data comprises target game data, a game live broadcast video and live broadcast interaction data associated with the game live broadcast video; performing feature analysis on the initial features of the multiple modes to obtain target features of the multiple modes; performing fragment detection on the target features of the multiple modes by using a fragment detection model to obtain target video fragment parameters; generating a target live video clip corresponding to the target game based on the target video clip parameter and the game live video; the problems that the efficiency of a manual screening mode is low, and the requirements of actual popularization and publicity cannot be met are solved.
Systems and methods for a media contentuser interface. A media content provider includes storage for storing and serving video content to subscribers. The media content provider records and or otherwise stores video content from around the world. Subscribers are provided a user interface to the system that includes a channel bar. The channel bar is dynamically scoped responsive to interactions of a viewer with the system. Selectable elements within the channel bar provide direct access to related content regarding video content, such as television series information and cast information. In addition, the channel bar is operable in multiple modes. An EPG mode displays live video for multiple channels simultaneously. Themed modes permit channel bars that display content according to various themes which may be defined by a viewer, the provider, or both.
The invention relates to the technical field of video decoding, in particular to a fast decoding transmission method and system for a video live broadcast image. The method comprises the following steps: acquiring a video live broadcast picture stream; performing image group division on the video live broadcast image flow to generate image group images; analyzing an inter-frame relationship of the picture grouping images, defining priorities of the picture grouping images according to the inter-frame relationship, and generating decoding priority mark data; entropy data fragmentation is carried out on the picture grouping images, and a picture basic entropy slice and a picture increment entropy slice are generated; stage picture transmission is carried out on the picture grouping images based on the picture basic entropy slice and the picture increment entropy slice, and an image streaming preloading strategy is generated; and performing terminal transmission feedback on the picture grouping images by using an image stream type preloading strategy to obtain terminal transmission feedback data. According to the invention, through optimization of video picture grouping, priority scheduling, bandwidth management, decoding acceleration and fault-tolerant reconstruction, the rapid decoding transmission performance of the video live broadcast image is improved.
The invention relates to the technical field of live broadcast behavior monitoring, in particular to a live broadcast behavior tracking system based on deep learning, which obtains high-quality multi-source information and improves the accuracy of feature analysis by synchronously extracting image and audio data from a live broadcast video stream and combining frame extraction, image enhancement and voice recognition. According to the method, image features are extracted through a pre-trained convolutional neural network, audio features are extracted through a deep learning model, voice transliteration texts are fused, the weight of each modal feature is dynamically adjusted based on an attention mechanism, precise recognition of complex scenes and hidden violation behaviors is achieved, and image camouflage and latent language expression risks are effectively coped with. And the illegal type and confidence are output in real time, once suspected illegal behaviors are detected, alarm, interruption or shielding operation is triggered immediately, and related evidences are uploaded to an auditing database. And efficient, accurate and full-process management and control of the live broadcast violation behaviors are realized.
Mixed reality instructional technology is enhanced. Comparison of a guide mixed realitydata stream to a candidate mixed realitydata stream detects a deviation, e.g., different hand movement, different tool placement, or different sensor telemetry. Experiencing a feedback stream of output that is based on the deviation facilitates device control and helps candidates improve their skills. Some feedback output emphasizes deviation size, e.g., by varying colors, sounds, or haptic output proportionally to the deviation size. Some feedback output renders a translucent or skeletal guide overlaid on a live video of current candidate activity. Some embodiments support searches whose results show, e.g., how a certain expert performed a task differently than the candidate, or examples of a certain task such as widget replacement in the field. Stream optimization, summarization, synchronization, and other stream derivation functionality is provided.
The invention discloses an AR glasses blogger live video anti-shake processing method and processingsystem, and the method specifically comprises the steps: carrying out the calculation based on an original video stream and equipment motion data, and generating a preliminary stable frame sequence; based on the preliminary stable frame sequence, marking a key semantic region as a strong stability demand region, and segmenting a foreground main body and a background region; performing fine stabilization on the strong stability demand area and the foreground main body by applying non-rigid transformation, performing stabilization on the background area by applying rigid transformation and retaining the depth of the scene, and obtaining a frame sequence after partition correction; predicting a future multi-frame equipment motion track based on the frame sequence after partition correction, the equipment motion data and the segmentation information of the foreground main body / background region; and calculating and executing prospective canvas motion compensation in advance based on the future multi-frame equipment motion trail and the segmentation information of the foreground main body / background region. According to the invention, efficient anti-shake processing of the live video of the AR glasses is realized, and the stability of the live picture and the user experience are effectively improved.
The invention discloses an emotion attention method for AI online education, which is applied among student ends, a teacher end and a server, and the server sends a live videostream of the teacher end to each student end for playing. According to the emotion attention method for AI online education, the average understanding degree value is calculated according to the learning expressions of the students, the understanding and attention degree of the students to the current course listening are evaluated, the playing speed of each student terminal is dynamically and intelligently adjusted, personalized learning experience is provided for each student, and therefore the learning efficiency is improved; the reminding information of the overall understanding condition of the students is sent to the teacher end, so that the teacher can better interact with the students and adjust the teaching method and content in time; according to the embodiment of the invention, the student end starting the camera sends the speed regulation state information to all other student ends and the server, the server does not need to carry out message interaction with each student end, the processing pressure of the server can be reduced, and the server adjusts the code stream of the live videostream by calculating each playing proportion.
The invention provides a video coding method and device, electronic equipment and a storage medium, relates to the technical field of image processing, in particular to the field of video coding and the like, and can be applied to application scenes such as video live broadcast and the like. The specific implementation scheme is as follows: acquiring a reference frame which is adjacent to a current frame and has established initial ROI hierarchical division; multiplexing a motion vector generated by the reference frame in a motion compensation time domain filtering process, and determining an ROI position predicted value of the current frame; extracting feature points of the five sense organs of the current frame, and correcting an ROI position predicted value based on a feature point spatial topological relation in the initial ROI; respectively configuring differential quantization parameters for the corrected main face region, the corrected secondary face region and the corrected background region; dynamically allocating a three-layer area code rate according to a real-time network bandwidth; and outputting the coded frame of the current frame and the associated ROI level metadata. According to the scheme, the coding efficiency and quality can be improved.
The invention discloses an e-commerce live broadcast violation detection method, device and equipment, a medium and a product. The method comprises the steps that real-time live broadcast data is acquired, the real-time live broadcast data is obtained by performing voice recognition on an acquired real-time live broadcast video, and the data type of the real-time live broadcast data is text data; marking the real-time live broadcast data by using a preset model to obtain a corresponding text vector; inputting the text vector corresponding to the real-time live broadcast data into a pre-trained first-stage classification model to obtain a first violation detection result indicating whether the real-time live broadcast data is compliant or not; and under the condition that the first violation detection result is non-compliant, inputting a text vector corresponding to the real-time live broadcast data into a pre-trained two-stage classification model to obtain a second violation detection result, the second violation detection result comprising suspected violation or serious violation. According to the embodiment of the invention, the model detection efficiency can be improved, and the detection accuracy can be improved.
The invention relates to the technical field of network communication and video processing, in particular to an intelligent global cloud live broadcast system based on AI and multi-operator and multi-cloud optimization, and the system comprises a data collection module which is used for collecting live broadcast video streams; the video compression module adopts H.265 coding; the content review module is used for performing multi-modal review; the RPMTS packaging module is used for accessing three operator cloud private line POP nodes through a public network after packaging; the decoding module is used for decoding POP nodes in the middle area; the translation module is used for generating multi-language subtitles or dubbing; the multi-operator and multi-cloud adaptability matrix module calculates an optimal path in combination with an AI algorithm and a multi-cloud cost adaptability matrix; the multi-branch access module is used for realizing branch node cooperative forwarding; and the multi-language distribution module is used for generating multi-language subtitles and dubbles and pushing the multi-language subtitles and dubbles to each global live broadcast platform, so that synchronous distribution is realized, and the system can reduce global live broadcast delay, improve multi-language coverage capability and realize high reliability and cost optimization.
User authentication, spoofing and replay attack prevention, liveness detection, and user-and-document verification using a live videostream with spatial challenges. A camera of an electronic device captures and transmit a live selfie user-facing video, as part of a user registration process. The user is instructed to spatially move his body or face, such that his face would appear within a first particular on-screen shape; and to also, concurrently or simultaneously, spatially hold in his hand or move a particular an identification document such that it would appear within a second on-screen shape. Optionally, the on-screen shape moves on the screen, and the user is required to spatially move the relevant item to keep it within the boundaries of the moving on-screen shape. The system then analyzes the video via computerized vision, to determine whether the user complied with the spatial manipulation challenges.
A computer system is provided. The computer system may be configured or programmed to: (1) communicate with a user device to cause the user device to present a virtual environment, the virtual environment including at least one agent avatar associated with an agent; (2) receive, from the user device, user input data including one or more of live audio data, live video data, or live motion data; (3) generate a proposed response based upon the user input data; (4) determine whether an agent is present at an agent interface; (5) when the agent is present at the agent interface, cause the agent interface to display a recommendation including the proposed response; and / or (6) when the agent is not present at the agent interface, cause that at least one agent avatar to perform the proposed response within the virtual environment.
A computer implemented method, system, and non-transitory computer-readable device that may be used in a remote deposit environment. Upon receiving a user request, based on interactions with the UI, the method implements an electronic deposit of a financial instrument by activating a camera on the client device to generate a live videostream of image data of a field of view of at least one camera, wherein the live videostream includes imagery of at least a portion of each side of the financial instrument. The method continues by extracting data fields based on the formation of image objects on one or more sides of the financial instrument from the live videostream of image data. An EFT conversion of extracted data fields may be processed during or subsequent to the extraction process. A message is sent from a payee to a payor requesting the EFT. Upon acceptance, an EFT to the payee occurs. Upon denial, the remote deposit process is completed.
One of the promises of ATSC 3.0 has been the potential for data offload. Separately, advances have been made in hybrid and IP channel rollouts on ATSC 3.0 over the last year. The two have been combined to architect and implement a data offload system. This application explores a practical hybrid delivery model for streaming video services, allowing the distribution of video over CDNs and simultaneously over 3.0, drastically decreasing the bandwidth needs of these CDNs in 3.0 markets, all while integrating into third-party streaming apps to enable seamless streaming with no change to the viewer experience. Topics covered include the methodology for synchronization, encoding needs for the CDN and airchain, signaling design, integration into a streaming application, and the results of the real-world testing of this system.
A management and security alert system with a first store management and anti-theft subsystem include: a merchandise status monitoring module for monitoring in real time whether any merchandise leaves a shelf in the retail store, locating the merchandise leaving the shelf, based on a live videostream captured by cameras in the retail store, and recording the merchandise leaving the shelf as the off-shelf merchandise; a Re-id human detecting and tracking module for detecting in real time whether there is a new customer entering the retail store, assigning every new customer with a unique ID number and assigning the off-shelf merchandise to the ID number of the customer who has the closest distance from the off-shelf merchandise; and an alarm generating module that sends an alert when the Re-id human detecting and tracking module detects that a customer in the retail store approaches a store exit awith unpaid merchandise.
Disclosed is a computer-implemented method and system for training a subject-specific machine learning model to infer inherent subject features from recorded or live video data. The system preprocesses the visual and audio channels, converting audio to text, and employs multiple pre-trained extraction models to generate feature embeddings. Ground truth data is obtained to guide training, where weights are assigned to produce and combine predicted feature values. Model performance is optimized by minimizing error. The trained feature extraction models are deployed on an edge device, while the subject-specific model resides in the cloud. A lightweight edge model, derived via knowledge distillation and model compression, supports local inferencing with reduced reliance on cloud resources. Synchronization ensures iterative updates for sustained accuracy.
The embodiment of the invention provides a live video editing method, and the method comprises the steps: obtaining the target modal data of a to-be-edited live video, and the target modal data at least comprises audio data and image data; performing multi-dimensional analysis on the live video based on the target modal data, and determining a wonderful fragment in the live video based on an analysis result; and editing the wonderful clip, and obtaining an edited video based on an editing result. According to the technical scheme provided by the embodiment of the invention, the highlights in the live video can be automatically edited, and the efficiency and accuracy of editing the live video are improved.
The invention discloses a high-definition mapping method based on a low-altitude unmanned aerial vehicle live video, and belongs to the technical field of high-definition mapping of low-altitude unmanned aerial vehicles, and the method comprises the steps: dividing an image region, and carrying out the adaptive grid processing; building a parallel computing framework, and splicing the images by adopting a splicing algorithm; adjusting the size of an image grid in real time, and optimizing an image processingalgorithm according to real-time feedback data; analyzing flight path data, establishing a prediction model, and modeling data requirements of a future area; dynamically optimizing a data transmission path and bandwidth allocation based on image data requirements and flight path information; a virtual environment model is constructed based on a digital twinning technology, and image loss caused by environment change is compensated; performing real-time quality evaluation on the image, and adjusting a processing strategy in real time; through an image processing technology combining deep learning and dynamic grid size adjustment, the problems of low image splicing precision, inaccurate quality evaluation and the like in the prior art are solved.
Systems and methods for configuring video conferencing adaptations for a user interface (UI) of a driver's conferencing device based on a driving mode of an autonomous vehicle are described. A mode of operation of the autonomous vehicle when a video conferencing call is or will be in progress is determined. A route taken by the autonomous vehicle may include some segments that allow an autonomous mode of driving while other segments may not. Different adaptations may be configured for the driver and / or non-driver's UI for their conference devices based on the determined mode of operation such that advanced call feature capability may be provided while ensuring driver safety while driving. These adaptations include displaying still images instead of live video of participants, presenting video conferencing scheduling or alert options based on mode of operation, and an option to bookmark a point in the video conference.
A server receives and rebroadcasts live streaming video content from a video capture device, such as a mobile phone or unmanned surveillance vehicle. The server includes a media server configured to stream selected video content to a client device, a video analysis system configured to analyze the live video content and generate object detection data, a storage system configured to store the generated object detection data and an identifier of the associated live video content, and a search engine configured to receive a text-based search request, search the object detection data stored in the storage system for relevant search results, and generate a list of live and stored video content associated with the relevant search results.
The invention provides a live broadcast playback video downloading method and device and electronic equipment, and relates to the technical field of communication, and the method comprises the steps: carrying out the fragmentation task division of a live broadcast playback video based on a downloading task and a dynamic fragmentation strategy, and obtaining a plurality of target fragmentation tasks; each target fragment task corresponds to one to-be-downloaded video fragment and a serial number of the to-be-downloaded video fragment; executing a plurality of target fragmentation tasks based on a concurrency control mechanism and carrying out downloading detection; if it is detected that the video fragment corresponding to the target fragment task fails to download, retry processing is performed on the failed target fragment task based on a retry mechanism; merging and format conversion are carried out on the downloaded multiple video fragments to generate the target playback video file, the technical problems of low network bandwidth utilization rate and low downloading efficiency are solved through the method, and efficient and stable live video downloading is realized.