79 results about "Video stitching" patented technology

The invention relates to the technical field of digital image processing and computer vision, and discloses a remote multi-view video stitching and monitoring method and system based on digital twinning, and the method comprises the steps: constructing a digital twinning model containing geometric, material and semantic information, and calibrating and initially registering a multi-view camera; based on the model and camera parameters, collecting a preprocessed video stream, and refining the camera pose in combination with the model; predicting expected visual content by using the model and the refined pose, and performing non-rigid alignment on the preprocessed video frame; based on the aligned video frames, a model semantic optimization splicing suture line is utilized to generate a reconstructed video, and information loss is repaired in combination with a model context; and finally, performing integrated monitoring interaction on the repaired reconstructed video and the digital twin model, comparing and detecting abnormality, and updating the model by using the reconstructed video. According to the invention, the problems of traditional remote monitoring in the aspects of scene comprehensive perception, intelligent anomaly detection and synchronism of environment digital representation and physical reality are solved.

The embodiment of the invention relates to the field of video processing, and discloses a video stitching method and device in a dynamic scene, electronic equipment and a storage medium, and the method comprises the steps: determining a first frame of registration image in each frame of to-be-stitched image extracted from a video stream from a multi-view camera, taking a transformation matrix used in the registration process of the first frame of registration image as an initial transformation matrix, taking a suture line of the transformation matrix as an initial suture line, establishing an initial background model based on the first frame of registration image, and for subsequent frames of to-be-spliced images, when the background model detects that a current video frame image contains a moving object, carrying out registration on the subsequent frames of to-be-spliced images; and updating the transformation matrix based on the current frame of the to-be-spliced image so as to carry out registration again to determine a new suture line and update the background model, otherwise, maintaining the transformation matrix, the background model and the suture line of the previous frame unchanged, and carrying out real-time fusion based on the suture line of each frame of the to-be-spliced image to obtain a spliced video. And the requirements of stability and real-time performance of panoramic video stitching of the mobile unmanned carrier are met.

The invention provides a video stitching method, a video stitching device and electronic equipment. Under the condition that K current to-be-spliced images at different visual angles are obtained, for each current to-be-spliced image, the historical color compensation coefficient is determined as the target color compensation coefficient, or the historical color compensation coefficient is determined as the target color compensation coefficient. And determining the target color compensation coefficient based on the current color compensation coefficient of the current to-be-spliced image and the historical color compensation coefficient, so that the influence of the color information of the historical to-be-spliced image on the color compensation coefficient of the current to-be-spliced image is fully considered. And further performing color correction on the current to-be-spliced image according to the target color compensation coefficient of the current to-be-spliced image to obtain a target color image corresponding to the current to-be-spliced image, and splicing the target color images corresponding to the K current to-be-spliced images to obtain a target spliced image for forming a target video. And color balance in the video stitching process is realized.

The invention relates to a short video stitching and distributing method, a program and a storage medium, the method comprises the following steps: constructing an intelligent layered material library, the intelligent layered material library comprises a six-dimensional material management system, which is respectively a frame picture material, a background video material, a dynamic patch material, a background music material, a transition special effect material and a dynamic text material; the dynamic combination duplicate removal engine realizes intelligent combination and duplicate removal of each material in the intelligent layered material library to generate a short video, and the dynamic combination duplicate removal engine adopts a double-factor duplicate removal mechanism of a frequency control module and a content detection module to ensure that the generated short video is unique in intelligent combination and content presentation of each material; and the intelligent distribution control system completes high-efficiency compliance distribution of short video contents through a multi-stage state circulation and real-time decision-making mechanism. Through large-scale commercial verification, the generation amount of a single template per hour is increased from 80 to 380, and the material reuse rate is reduced from 47% to 8.5%; the image content similarity is reduced from 61.2% to 4.3%, and the audio repetition rate is reduced from 58.7% to 2.1%.

The invention discloses a video processing method and device, equipment and a medium. The method comprises the following steps: acquiring a plurality of initial videos collected by a plurality of cameras; performing picture feature extraction based on the plurality of initial videos to obtain a plurality of static features and a plurality of dynamic features; performing feature fusion on the plurality of static features and the plurality of dynamic features to obtain an interested image, the interested image being used for representing that the initial videos collected by the at least two cameras comprise images of the same area; and based on the interested image, performing video stitching on the plurality of initial videos to obtain a panoramic video. According to the embodiment of the invention, a panoramic image of a blind area can be provided for a vehicle owner in real time, the possibility of an accident is reduced, and a clear video image can be conveniently provided after the accident occurs.

The invention belongs to the technical field of civil transportation aviation airport aircraft monitoring, and discloses a panoramic aircraft monitoring system and method based on video stitching and an electronic map. The method comprises the following steps: acquiring a vehicle position, a personnel position, aircraft information and flight dynamic information, and acquiring high-definition camera video stream data by a video gateway; performing video stitching processing on the acquired high-definition camera video stream data; the electronic map GIS server provides an electronic map service; carrying out panoramic video fusion processing on the electronic map and the spliced video, calculating the position information of the aircraft, and completing personnel management, vehicle management, flight dynamic information management and monitoring mode management; and reporting normal monitoring and exception handling conditions to the server through the client. According to the invention, a video fusion and electronic map function complementarity technology is adopted, all-weather panoramic video safety monitoring of the aircraft in different modes is realized, and invading personnel and vehicles can be actively found and alarmed.

The invention relates to the technical field of intelligent monitoring, in particular to an embedded multi-lens panoramic video intelligent monitoring system and a construction method thereof, a computing energy SE5 micro server and an NVIDIA Jetson board card construction system are integrated, a deep learning neural network is adapted to the computing energy SE5 micro server, and the NVIDIA Jetson board card construction system is adapted to the NVIDIA Jetson board card construction system. The functions of network model weight conversion, sample generation, deployment training, test analysis and the like are completed; embedded spherical panoramic splicing software for lookup table calculation and GPU parallel acceleration is adapted on a Jetson board card platform to complete lookup table import, pixel mapping, suture line fusion and CUDA deployment and optimization functions, and meanwhile, a YOLO-based vehicle illegal parking detection, retrograde driving detection and human-vehicle statistics module is designed according to the parking lot monitoring requirements of the highway service area, so that the parking lot monitoring requirements of the highway service area are met. According to the method, the real-time splicing and intelligent analysis processing functions of the high-resolution panoramic video are realized on a heterogeneous embedded platform through collaborative optimization, and the application bottleneck of OMS panoramic video splicing and intelligent analysis processing on the embedded platform at present is solved.

The invention provides a video stitching method and system based on object tracking, and relates to the technical field of video stitching, and the method comprises the steps: obtaining a to-be-processed video file, converting the to-be-processed video file into a frame sequence with a timestamp through a decoder, calculating a feature difference and a motion vector based on a key frame recognition algorithm, determining a feature frame in the frame sequence; performing gray level conversion on the feature frame to generate a gray level frame and a spectrogram corresponding to the gray level frame, removing image noise in the spectrogram, performing color correction to obtain a standard image, tracking an object in the standard image through an optical flow tracking algorithm according to the standard image, and generating an image analysis result; determining a Hessian matrix corresponding to each pixel point in the standard image according to an image analysis result, constructing a scale space according to the Hessian matrix, determining a key point and generating a feature descriptor, performing image matching according to the feature descriptor, selecting an optimal matching pair, and performing image splicing according to an image stitching algorithm to obtain a spliced image.

The invention relates to an asset management method and device based on model and video fusion and a storage medium, and is applied to the technical field of logistics storage asset management, and the method comprises the steps: obtaining park warehouse logistics asset data, and dividing the park warehouse logistics asset data into two categories: physical asset data and digital asset data; constructing a twin model of each asset of the park warehouse logistics, wherein the twin model is divided into an entity asset twin model and a virtual asset twin model; wherein when the solid asset twinborn model is constructed, virtual-real mapping of an equipment physical entity and a 3D model is realized through combination of a digital twinborn technology and a video stitching fusion technology, and time-space consistency fusion of a real video stream and a virtual three-dimensional scene is realized; according to the scheme of the invention, all-around protection of physical assets and digital assets of the park is realized, the authenticity and integrity of data are ensured, the credibility among links in supply chain management is increased, resource configuration is optimized, and finally the purpose of improving enterprise performance and enterprise value is achieved.

The invention discloses a garbage rapid identification method based on an unmanned environmental sanitation vehicle-mounted looking-around camera, and belongs to the technical field of image identification, and the method comprises the steps: obtaining an original image with a synchronous timestamp according to a multi-path unmanned vehicle-mounted fisheye camera, and carrying out the rapid rendering through OpenGL by employing a calibrated internal and external parameter pixel-level fusion technology, and obtaining an original image with a synchronous timestamp; a bird's-eye view angle image is obtained; and a Lang-Segment-Anything depth model is utilized to carry out garbage instance segmentation, and garbage coordinates are obtained through identification. According to the method, the aerial view angle image is generated through the surround-view video stitching technology, the trained Lang-Segment-Anything depth model is used for carrying out garbage detection on the aerial view angle image, lower video memory occupation and hardware computing resource requirements are achieved, the dependence of garbage rapid identification on training data is reduced, and the efficiency of garbage rapid identification is improved. The problems that the view of a single camera is limited, and a target object crosses and shields the camera are solved.

1. Name of the product in this design: Visible light splicing monitoring equipment. 2. Purpose of this design: To use multi-channel video stitching for wide-angle observation of a scene. 3. The key design features of this product are its overall shape. 4. The image or photograph that best illustrates the design's key points: a 3D model.

A video coding mechanism for view-dependent video coding is disclosed. The mechanism includes receiving a spherical video signal spliced from a multi-directional video stream. The spherical video signal is mapped into a plurality of sub-picture video signals, each of which includes a sequence of sub-pictures. The plurality of sub-picture video signals are coded into a plurality of sub-picture bitstreams such that, when decoded in a decoder, each pixel in each sub-picture has a value equal to a corresponding pixel in a whole picture composed of the sub-pictures after decoding. The plurality of sub-picture bitstreams form a plurality of sub-picture tracks, and it is indicated that the sub-picture tracks conform to a specific video profile. The sub-picture bitstreams are sent to a decoder to support decoding and displaying a virtual reality video view.

The invention discloses a video stitching method and device based on an embedded platform, and the method comprises the steps: collecting a video stream with an overlapping region through two cameras, carrying out the processing of the first frame data on the embedded platform, obtaining a homography matrix, and calculating the overlapping region; determining a suture line by using an optimal suture line algorithm, and performing color correction and fusion on the first frame by using an optimized histogram matching method and a fade-in and fade-out method; detecting a moving object by using a frame difference method, setting a current frame as an updated frame, an updated suture line and a color correction function when the moving object passes through the vicinity of the suture line, avoiding ghosting and blurring, and periodically updating a homography matrix in order to eliminate errors; and generating pixel mapping from the data of the first frame and the updated frame, storing a color correction function, directly performing coordinate mapping and color correction on other frames, accelerating a fusion process by using hardware, and finally displaying a spliced video on a display device in real time. The splicing quality is improved while the real-time performance is ensured, and the spliced image is quickly obtained and displayed on the display device in real time.

This application discloses a panoramic stitching method, apparatus, device, and storage medium based on multi-camera systems, relating to the field of image processing technology. The method includes: acquiring calibration images collected by multiple cameras, wherein the calibration images include common calibration areas of adjacent cameras; identifying calibration board corner features in the calibration images and obtaining calibration parameters for each camera based on these features; generating a configuration file according to the calibration parameters; and processing the video streams collected by the multiple cameras based on the configuration file to obtain a panoramic video stream. This method solves the problems of low calibration accuracy and reliance on manual experience and complex online calculations in existing technologies under long-distance, large field-of-view conditions. It achieves standardization and automation of the calibration process and enables efficient, high-precision real-time panoramic video stitching on embedded devices, reducing the system's dependence on high-performance processing platforms and overall cost.

The embodiment of the invention provides a bucket wheel machine unattended system and method based on video stitching, and the system obtains the global high-precision visual information of a bucket wheel machine operation area and an accurate material pile semantic segmentation mask image through the panoramic image stitching and image recognition of the original video streams of a plurality of cameras. Meanwhile, the external parameters of the dynamic camera are solved in real time by combining with the PLC pose data of the bucket wheel machine, the two-dimensional semantic segmentation mask graph and the synchronized laser radar point cloud are efficiently fused, the material pile edge features are accurately mapped to the three-dimensional space, the high-precision three-dimensional material pile edge point cloud is obtained, and therefore the defects of the laser radar in semantic recognition are overcome. And finally, based on the three-dimensional material pile edge point cloud updated in real time and the current pose data of the bucket wheel machine, the system can intelligently carry out operation path planning, the operation path planning is decomposed into PLC control instructions, and autonomous, safe and accurate operation of the bucket wheel machine in the complex and changeable material pile environment is achieved.

The invention relates to a marine unstructured camera video stitching method, which comprises the following steps: S1, acquiring video stream data of a shipborne camera, the video stream data being initial data required for calculating stitching parameters; s2, the initial data obtained in the step 1 are processed, splicing mapping parameters are obtained, and the splicing mapping parameters comprise cylindrical projection mapping parameters, homography matrixes between adjacent cameras, self exposure compensation parameters and optimal suture lines; splicing mapping parameters are stored in a file form, and the parameters are loaded to a memory in a GPU mapping table form during subsequent splicing; and S3, on the basis of the splicing mapping parameters obtained in the step S2, carrying out online splicing on the video images. According to the method, the problem that the ship camera array is difficult to calibrate is solved, a more stable splicing effect is achieved in different illumination scenes, and compared with a traditional video splicing method, the method is higher in dynamic scene adaptability.

A kind of distributed video splicing device, it is related to video splicing technical field, including with several local input modules of external image device connection, with the management module of several local input modules connection, with the output module of management module connection, with the network streaming media input module of management module connection, output module is connected with external display device, local input module includes with the input interface of external image device connection, with the input conversion chip of input interface electrical connection, with the input FPGA of input conversion chip electrical connection, input FPGA is electrically connected with management module, input conversion chip is used to output RGB signal to input FPGA.The technical scheme provided by the utility model aims to realize integrated design, and can solve the technical problem of network streaming media data processing.

Disclosed herein are an apparatus and method for 360-degree video stitching. The apparatus for 360-degree video stitching includes memory for storing at least one program, and a processor for executing the program, wherein the program is configured to stitch features of multiple input images based on at least one parameter included in a 360-degree stitching function description template, and then creating a single 360-degree video, the 360-degree stitching function description template includes a configuration parameter that is an array of function parameters, the configuration parameter includes a stitching parameter, a camera parameter, a feature parameter, and a projection parameter, the feature parameter includes a method for extracting respective features from multiple input images, and the projection parameter includes a projection type that is a kind of a projection plane onto which the multiple input images are projected.

The present invention provides a video splicing method and system based on object tracking, which relate to the technical field of video splicing. The method and system include the following steps: obtaining a video file to be processed, converting the video file to be processed into a frame sequence with a timestamp through a decoder, calculating feature differences and motion vectors based on a key frame recognition algorithm, and determining feature frames in the frame sequence; performing grayscale conversion on the feature frames to generate grayscale frames and spectrograms corresponding to the grayscale frames, removing image noise in the spectrogram and performing color correction to obtain a standard image; tracking an object in the standard image through an optical flow tracking algorithm based on the standard image to generate an image analysis result; determining a Hessian matrix corresponding to each pixel point in the standard image based on the image analysis result, constructing a scale space based on the Hessian matrix, determining key points and generating feature descriptors, performing image matching based on the feature descriptors, selecting an optimal matching pair, and performing image splicing based on an image stitching algorithm to obtain a spliced image.

The invention discloses a water surface detection and identification method for water supervision and law enforcement security guards, and relates to a water surface detection and identification method. The invention aims to solve the problems that an existing detection and recognition method is single in function, various illegal regulations of a shipping ship cannot be well supervised, and illegal regulations of the ship cannot be processed in time due to the fact that the acquisition speed of a ship image is delayed. The method comprises the following steps: step 1, constructing a data set; step 2, establishing an image video stitching algorithm; step 3, training the data set in the step 1 in batches, and training the identification network by adopting different grouping methods to improve the accuracy and reliability of the identification network; and step 4, carrying out image identification on the spliced video stream. The invention belongs to the technical field of overwater safety supervision and identification.

A method for displaying large-format virtual reality video on a nonvirtual reality device includes identifying a location chosen by an operator comprising determining a point of interest at the location and picking a frame of action at the location to be provided in relation to the point of interest, the location is such that the point of interest and the frame of action are captured with a camera at the location, the point of interest to be accessible by a viewer in an interactive environment on a non-virtual reality device; recording a large-format video of the frame of action at the location; clarifying the large-format video into a finished large-format video file, the clarifying comprising video sorting wherein the large-format video is sorted to subsequently undergo video stitching to derive an equirectangular video, the equirectangular video then undergoing video adjusting which results in the finished large-format video file, and reframing the finished large-format video file wherein the reframing comprises manipulating the finished large-format video file into a standard aspect ratio video for displaying in the interactive environment viewable on the non-virtual reality device such that the limited viewable area is exported as a standard aspect ratio video.

The invention relates to the technical field of image processing, and discloses a video stitching method, system, device, medium and product, and the method comprises the steps: carrying out the key point matching of a left visual angle image and a right visual angle image, screening an initial key point pair set through a random sampling consistency algorithm, and obtaining a key point pair set; based on this set, a homography matrix is determined. And splicing the left view angle image and the right view angle image of the current frame through the homography matrix by using the key point pair set of the current frame. And by means of an optical flow method, tracking a key point pair set from the current frame to the next frame, updating the key point pair set as the key point pair set of the current frame, and continuing splicing of the left-view-angle image and the right-view-angle image. The process lasts until all video frame images are spliced, and finally key points in each frame image are tracked through an optical flow method, and a homography matrix is accurately determined, so that the splicing speed and quality are improved.

The invention provides a video stitching method, system and related equipment, which are applied to the technical field of data processing, and the video stitching method comprises the following steps: obtaining multiple paths of video streams input by monitoring equipment, and decoding the multiple paths of video streams to obtain multiple paths of decoded video data of the multiple paths of video streams; performing feature extraction on the multi-channel decoded video data through a neural network processor to obtain multi-channel video feature information of the multi-channel video streams; performing feature matching on the multi-channel video feature information through a neural network processor to obtain a multi-channel feature matching result of the multi-channel video streams; when the multi-channel video feature information is subjected to feature matching to obtain a multi-channel feature matching result of the multi-channel video stream, removing mismatching points in the multi-channel feature matching result in parallel; and through a neural network processor, aligning the multiple paths of video frames according to the effective feature matching points in the multiple paths of feature matching results, and generating target video stitching data. The video stitching efficiency and the resource utilization rate can be improved.

The invention discloses a time-space consistency video stitching method and device, and relates to the technical field of video stitching. The method comprises the step of realizing high-precision video stitching through dual-channel feature extraction and spatio-temporal joint optimization. The method comprises the following steps: firstly, respectively extracting shallow layer and deep layer features of two paths of video sequences by adopting a StarNet-s050 model; constructing a space distortion module comprising a context correlation layer, RegressNet1 and RegressNet2 to generate a space distortion matrix before optimization, and obtaining a final space distortion matrix through an auxiliary training head; a time sequence distortion module is used for extracting space-time dynamic features, and space-time smooth increment is calculated in combination with smooth constraints; and finally, inputting the corrected space-time distortion matrix and an original video into a splicing module to generate a fusion sequence. According to the method, the problems of deformation difference of a multi-view video in a space dimension and fuzziness on a time axis are effectively solved, and the video stitching quality is remarkably improved through hierarchical feature fusion and space-time consistency modeling.

The present disclosure relates to a video processing method and apparatus, a storage medium, and an electronic device. The method includes: obtaining a plurality of original videos, where the plurality of original videos are videos obtained by a plurality of dynamic image recorders arranged at preset positions; determining an overlapping area of each adjacent pair of the original videos according to a preset rule corresponding to the preset position, where the adjacent original videos are the original videos obtained by the dynamically image recorders arranged adjacent to each other; performing multi-level optical flow calculation on the original videos within each of the overlapping areas to obtain a plurality of target optical flow information; and splicing the overlapping areas of each adjacent pair of the original videos based on the target optical flow information to obtain a target video.

According to embodiments of the present disclosure, methods and apparatuses for remote assistance are provided. The method includes presenting an assistance interface associated with an autonomous vehicle; and presenting, in the assistance interface, a multi-path video stream corresponding to a plurality of viewing perspectives of the autonomous vehicle based on video data received from the autonomous vehicle, wherein the multi-path video stream includes a first video stream corresponding to a forward viewing perspective and a second video stream corresponding to a rearward viewing perspective, the first video stream and the second video stream are generated based on a video stitching model associated with the autonomous vehicle, the video stitching model is constructed based on a plurality of images captured by a plurality of cameras deployed on the autonomous vehicle. In this way, embodiments of the present disclosure can improve the reliability of remote assistance, thereby improving the driving safety of the autonomous vehicle.

The invention relates to the technical field of computer vision, and discloses a multi-camera video stitching method based on regionalized symmetric weighting. The method comprises the following steps: realizing multi-camera frame-level synchronous acquisition (time sequence jitter is less than or equal to 10ms) through an event-driven multi-thread mechanism; obtaining distortion parameters (k1, k2 and k3) by adopting a Zhang Zhengyou calibration method, and correcting the image in real time according to a nonlinear model; dynamically constructing a fusion region: firstly expanding pixels of an overlapping region We belonging to [100, 200] to compensate a registration error, then generating an optimal suture line through a graph cutting method, forming a suture line region through morphological expansion, and finally dividing the optimal suture line region into a suture line region and a transition region; during partition fusion, an image source with the minimum pixel difference is directly selected in a suture line area to eliminate ghosts, and a dynamic boundary weight strategy is adopted in a transition area to achieve seamless transition. Finally, two fusion problems of ghosting elimination and splicing seam elimination are realized based on the two, image transition becomes smoother and more natural, and the method is suitable for panoramic security and protection monitoring and the like in industrial complex scenes such as wind power and the like.

The application discloses a kind of multi-view video splicing methods based on deep learning, steps are as follows: first, using Airsim simulator is collected at the image and depth data of set virtual public viewpoint, generates the dataset for video splicing task, and the image is cylindrical projection and so on Preprocessing.Then, using convolutional neural network designs artifact elimination module and smooth transition module respectively, the former considers the feature correlation of overlapping area, and the overlapping area is aligned by viewpoint regression to eliminate the artifact after fusion;The latter according to the feature information of image, the deformation rule obtained in the overlapping area is propagated to the non-overlapping area, to guide the smooth transition between regions to improve visual perception.Finally, according to the predicted displacement field, the original viewpoint image is distorted and transformed, and the splicing result is obtained by weighted linear fusion.The application can achieve real-time splicing performance while removing splicing artifacts, and can meet the online splicing needs in practical applications.

The present invention discloses an FPGA-based vehicle-mounted video image stitching method and system. The system utilizes a cross-temporal processing module, an input frame storage module, a storage controller, an output frame storage module, an output buffer unit, a video stitching module, an output timing generation module, and a windowing processing module. The output buffer unit is used to buffer image data retrieved by the output frame storage module to obtain a first image and a second image to be stitched together; the output timing generation module is used to generate a corresponding timing signal based on the resolution parameters of a third image; the windowing processing module is used to generate effective window signals for the corresponding images based on the resolution parameters of the first image, the resolution parameters of the second image, and the timing signal; and the video stitching module is used to stitch the first image and the second image together based on the effective window signal to form a third image, and output the third image to a display screen. The present invention provides efficient, convenient, and real-time video processing and intuitive preview functions.

The present application provides a video stitching method, system and computing device based on digital twin scenes. Among them, a set of video clips to be stitched is obtained; according to the real scene coordinates of the multiple video clips, the multiple video clips are mapped into a virtual scene to construct a spatial layout; according to the timestamps of the multiple video clips, the initial video sequence is obtained, and the initial video sequence is mapped into the virtual scene to construct a temporal layout; based on the spatial layout and the temporal layout, a spatiotemporal layout is constructed, and in the spatiotemporal layout, the visual features and scene semantic tone between the multiple video clips are identified, and based on the visual features and scene semantic tone between the multiple video clips, the perspectives and positions of the multiple video clips are adjusted to generate video clip adjustment results; based on the video clip adjustment results, the multiple video clips are stitched to generate a digital twin display video. The technical solution provided by the present application improves the video stitching effect.