98 results about "Video stitching" patented technology

The invention provides a vehicle-mounted navigation panoramic video stitching method and system, and belongs to the technical field of auxiliary driving, and the method comprises the following steps: obtaining vehicle periphery original images of a vehicle body in multiple directions in real time; performing image distortion correction on the plurality of original images around the vehicle to obtain a plurality of overlook view angle images for splicing; and dividing the plurality of overlook view angle images into overlapped areas and non-overlapped areas by adopting a partition gradual-in and gradual-out weighted fusion method, retaining image information of the non-overlapped areas, performing weighted distribution on gray weight information of the overlapped areas, and fusing the overlapped areas according to a distributed gray value to obtain a spliced panoramic image around the vehicle body. According to the method, the visual blind area existing during turning, overtaking and side parking can be solved, potential safety hazards are greatly eliminated, meanwhile, ghosting or distortion occurring in the overlapping area can be eliminated, the splicing effect of the panoramic spliced image is improved, and a driver can make correct judgment conveniently.

The invention discloses an image registration method based on improved ORB feature extraction and grid feature matching. The method comprises the following steps: inputting an image to be extracted; using an improved FAST algorithm to extract feature points of the to-be-spliced image; establishing a BRIEF descriptor, and obtaining a BRIEF descriptor with a direction; according to the feature point set of the to-be-spliced image, establishing a Delaunay triangular grid taking the feature points as vertexes; judging the similarity of triangles, and obtaining similar triangles formed by the feature points; matching the similar triangle vertexes by using a Hamming distance to obtain an optimal matching feature point pair; obtaining affine matrix parameters by using an SVD method; according to the image registration method provided by the invention, the image quality is ensured, the feature extraction efficiency and the extraction precision can be improved, wrong matching is reduced, the stability is improved, the real-time performance of video stitching is improved, the waste of memory resources is reduced, the equipment cost is reduced, the working efficiency is greatly improved, and the method is suitable for popularization and application. And a better method is provided for image splicing.

The invention relates to the technical field of digital image processing and computer vision, and discloses a remote multi-view video stitching and monitoring method and system based on digital twinning, and the method comprises the steps: constructing a digital twinning model containing geometric, material and semantic information, and calibrating and initially registering a multi-view camera; based on the model and camera parameters, collecting a preprocessed video stream, and refining the camera pose in combination with the model; predicting expected visual content by using the model and the refined pose, and performing non-rigid alignment on the preprocessed video frame; based on the aligned video frames, a model semantic optimization splicing suture line is utilized to generate a reconstructed video, and information loss is repaired in combination with a model context; and finally, performing integrated monitoring interaction on the repaired reconstructed video and the digital twin model, comparing and detecting abnormality, and updating the model by using the reconstructed video. According to the invention, the problems of traditional remote monitoring in the aspects of scene comprehensive perception, intelligent anomaly detection and synchronism of environment digital representation and physical reality are solved.

The embodiment of the invention relates to the field of video processing, and discloses a video stitching method and device in a dynamic scene, electronic equipment and a storage medium, and the method comprises the steps: determining a first frame of registration image in each frame of to-be-stitched image extracted from a video stream from a multi-view camera, taking a transformation matrix used in the registration process of the first frame of registration image as an initial transformation matrix, taking a suture line of the transformation matrix as an initial suture line, establishing an initial background model based on the first frame of registration image, and for subsequent frames of to-be-spliced images, when the background model detects that a current video frame image contains a moving object, carrying out registration on the subsequent frames of to-be-spliced images; and updating the transformation matrix based on the current frame of the to-be-spliced image so as to carry out registration again to determine a new suture line and update the background model, otherwise, maintaining the transformation matrix, the background model and the suture line of the previous frame unchanged, and carrying out real-time fusion based on the suture line of each frame of the to-be-spliced image to obtain a spliced video. And the requirements of stability and real-time performance of panoramic video stitching of the mobile unmanned carrier are met.

The invention provides a video stitching method, a video stitching device and electronic equipment. Under the condition that K current to-be-spliced images at different visual angles are obtained, for each current to-be-spliced image, the historical color compensation coefficient is determined as the target color compensation coefficient, or the historical color compensation coefficient is determined as the target color compensation coefficient. And determining the target color compensation coefficient based on the current color compensation coefficient of the current to-be-spliced image and the historical color compensation coefficient, so that the influence of the color information of the historical to-be-spliced image on the color compensation coefficient of the current to-be-spliced image is fully considered. And further performing color correction on the current to-be-spliced image according to the target color compensation coefficient of the current to-be-spliced image to obtain a target color image corresponding to the current to-be-spliced image, and splicing the target color images corresponding to the K current to-be-spliced images to obtain a target spliced image for forming a target video. And color balance in the video stitching process is realized.

The invention relates to a short video stitching and distributing method, a program and a storage medium, the method comprises the following steps: constructing an intelligent layered material library, the intelligent layered material library comprises a six-dimensional material management system, which is respectively a frame picture material, a background video material, a dynamic patch material, a background music material, a transition special effect material and a dynamic text material; the dynamic combination duplicate removal engine realizes intelligent combination and duplicate removal of each material in the intelligent layered material library to generate a short video, and the dynamic combination duplicate removal engine adopts a double-factor duplicate removal mechanism of a frequency control module and a content detection module to ensure that the generated short video is unique in intelligent combination and content presentation of each material; and the intelligent distribution control system completes high-efficiency compliance distribution of short video contents through a multi-stage state circulation and real-time decision-making mechanism. Through large-scale commercial verification, the generation amount of a single template per hour is increased from 80 to 380, and the material reuse rate is reduced from 47% to 8.5%; the image content similarity is reduced from 61.2% to 4.3%, and the audio repetition rate is reduced from 58.7% to 2.1%.

The invention discloses a video processing method and device, equipment and a medium. The method comprises the following steps: acquiring a plurality of initial videos collected by a plurality of cameras; performing picture feature extraction based on the plurality of initial videos to obtain a plurality of static features and a plurality of dynamic features; performing feature fusion on the plurality of static features and the plurality of dynamic features to obtain an interested image, the interested image being used for representing that the initial videos collected by the at least two cameras comprise images of the same area; and based on the interested image, performing video stitching on the plurality of initial videos to obtain a panoramic video. According to the embodiment of the invention, a panoramic image of a blind area can be provided for a vehicle owner in real time, the possibility of an accident is reduced, and a clear video image can be conveniently provided after the accident occurs.

The invention belongs to the technical field of civil transportation aviation airport aircraft monitoring, and discloses a panoramic aircraft monitoring system and method based on video stitching and an electronic map. The method comprises the following steps: acquiring a vehicle position, a personnel position, aircraft information and flight dynamic information, and acquiring high-definition camera video stream data by a video gateway; performing video stitching processing on the acquired high-definition camera video stream data; the electronic map GIS server provides an electronic map service; carrying out panoramic video fusion processing on the electronic map and the spliced video, calculating the position information of the aircraft, and completing personnel management, vehicle management, flight dynamic information management and monitoring mode management; and reporting normal monitoring and exception handling conditions to the server through the client. According to the invention, a video fusion and electronic map function complementarity technology is adopted, all-weather panoramic video safety monitoring of the aircraft in different modes is realized, and invading personnel and vehicles can be actively found and alarmed.

The invention relates to the technical field of intelligent monitoring, in particular to an embedded multi-lens panoramic video intelligent monitoring system and a construction method thereof, a computing energy SE5 micro server and an NVIDIA Jetson board card construction system are integrated, a deep learning neural network is adapted to the computing energy SE5 micro server, and the NVIDIA Jetson board card construction system is adapted to the NVIDIA Jetson board card construction system. The functions of network model weight conversion, sample generation, deployment training, test analysis and the like are completed; embedded spherical panoramic splicing software for lookup table calculation and GPU parallel acceleration is adapted on a Jetson board card platform to complete lookup table import, pixel mapping, suture line fusion and CUDA deployment and optimization functions, and meanwhile, a YOLO-based vehicle illegal parking detection, retrograde driving detection and human-vehicle statistics module is designed according to the parking lot monitoring requirements of the highway service area, so that the parking lot monitoring requirements of the highway service area are met. According to the method, the real-time splicing and intelligent analysis processing functions of the high-resolution panoramic video are realized on a heterogeneous embedded platform through collaborative optimization, and the application bottleneck of OMS panoramic video splicing and intelligent analysis processing on the embedded platform at present is solved.

The present invention belongs to the field of video surveillance technology, and discloses a video splicing method and system for multi-camera surveillance, and a processor, comprising: dividing a surveillance area into a plurality of partition units, arranging at least one camera in each partition unit; and creating an interactive interface for a user to input a preset surveillance target; obtaining the partition video data of each partition unit in real time, performing frame number synchronization processing on the plurality of groups of partition video data, so as to align them on a time axis; cutting each group of partition video data respectively according to a plurality of time periods, and capturing and splicing the preset surveillance target, obtaining the marked video units corresponding to the preset surveillance target, and then connecting them in series to form a collection, and creating a corresponding video directory on the interactive interface; through fine time management and efficient video splicing, the continuity and relevance of the surveillance video are improved, so that the user can quickly access the relevant video clips, and the efficiency of the surveillance system and the user experience are greatly improved.

The invention provides a video stitching method and system based on object tracking, and relates to the technical field of video stitching, and the method comprises the steps: obtaining a to-be-processed video file, converting the to-be-processed video file into a frame sequence with a timestamp through a decoder, calculating a feature difference and a motion vector based on a key frame recognition algorithm, determining a feature frame in the frame sequence; performing gray level conversion on the feature frame to generate a gray level frame and a spectrogram corresponding to the gray level frame, removing image noise in the spectrogram, performing color correction to obtain a standard image, tracking an object in the standard image through an optical flow tracking algorithm according to the standard image, and generating an image analysis result; determining a Hessian matrix corresponding to each pixel point in the standard image according to an image analysis result, constructing a scale space according to the Hessian matrix, determining a key point and generating a feature descriptor, performing image matching according to the feature descriptor, selecting an optimal matching pair, and performing image splicing according to an image stitching algorithm to obtain a spliced image.

The invention relates to a fully mechanized coal mining face dynamic video image fusion method. The method comprises the following steps: extracting representative feature points in an image; performing pairwise matching on the feature points by using normalized mutual closing and mutual information; a homography matrix between the two images is calculated through the coordinates of the corresponding points, and then a projective transformation function is called; one image is converted into a view angle of another image, in order to ensure robustness, a ransac algorithm is used to screen feature points, and obvious outboard points are filtered out; and performing grid discretization on the image to be spliced, calculating a homography matrix of each grid, and splicing the grids. According to the invention, high-precision image processing and real-time data transmission technologies are combined, the smoothness and accuracy of the video splicing effect are ensured, the video fusion rate is improved, a comprehensive and high-efficiency solution is provided to meet the application requirements of different scenes, and the method plays an important role in improving the mining efficiency of a fully mechanized coal mining face and ensuring safe production.

The invention relates to an asset management method and device based on model and video fusion and a storage medium, and is applied to the technical field of logistics storage asset management, and the method comprises the steps: obtaining park warehouse logistics asset data, and dividing the park warehouse logistics asset data into two categories: physical asset data and digital asset data; constructing a twin model of each asset of the park warehouse logistics, wherein the twin model is divided into an entity asset twin model and a virtual asset twin model; wherein when the solid asset twinborn model is constructed, virtual-real mapping of an equipment physical entity and a 3D model is realized through combination of a digital twinborn technology and a video stitching fusion technology, and time-space consistency fusion of a real video stream and a virtual three-dimensional scene is realized; according to the scheme of the invention, all-around protection of physical assets and digital assets of the park is realized, the authenticity and integrity of data are ensured, the credibility among links in supply chain management is increased, resource configuration is optimized, and finally the purpose of improving enterprise performance and enterprise value is achieved.

The invention discloses a method for improving video stitching quality based on an improved optimal stitching line algorithm, relates to the field of application of vehicle-mounted cameras, the field of panoramic image fusion, the field of reversing parking and the field of unmanned driving, and solves the common problems of image distortion, obvious stitching lines, discontinuous stitching areas and the like in the video stitching process. An improved optimal suture line algorithm is selected, and the method can automatically find the optimal overlapping area and the optimal suture line position, so that the distortion and discontinuity phenomena in the splicing process are reduced. By improving the splicing effect, the method can be widely applied to the fields of panoramic video production, virtual reality and the like, and the user experience is remarkably improved.

The invention discloses a garbage rapid identification method based on an unmanned environmental sanitation vehicle-mounted looking-around camera, and belongs to the technical field of image identification, and the method comprises the steps: obtaining an original image with a synchronous timestamp according to a multi-path unmanned vehicle-mounted fisheye camera, and carrying out the rapid rendering through OpenGL by employing a calibrated internal and external parameter pixel-level fusion technology, and obtaining an original image with a synchronous timestamp; a bird's-eye view angle image is obtained; and a Lang-Segment-Anything depth model is utilized to carry out garbage instance segmentation, and garbage coordinates are obtained through identification. According to the method, the aerial view angle image is generated through the surround-view video stitching technology, the trained Lang-Segment-Anything depth model is used for carrying out garbage detection on the aerial view angle image, lower video memory occupation and hardware computing resource requirements are achieved, the dependence of garbage rapid identification on training data is reduced, and the efficiency of garbage rapid identification is improved. The problems that the view of a single camera is limited, and a target object crosses and shields the camera are solved.

1. Name of the product in this design: Visible light splicing monitoring equipment. 2. Purpose of this design: To use multi-channel video stitching for wide-angle observation of a scene. 3. The key design features of this product are its overall shape. 4. The image or photograph that best illustrates the design's key points: a 3D model.

A video coding mechanism for view-dependent video coding is disclosed. The mechanism includes receiving a spherical video signal spliced from a multi-directional video stream. The spherical video signal is mapped into a plurality of sub-picture video signals, each of which includes a sequence of sub-pictures. The plurality of sub-picture video signals are coded into a plurality of sub-picture bitstreams such that, when decoded in a decoder, each pixel in each sub-picture has a value equal to a corresponding pixel in a whole picture composed of the sub-pictures after decoding. The plurality of sub-picture bitstreams form a plurality of sub-picture tracks, and it is indicated that the sub-picture tracks conform to a specific video profile. The sub-picture bitstreams are sent to a decoder to support decoding and displaying a virtual reality video view.

The invention discloses a video stitching method and device based on an embedded platform, and the method comprises the steps: collecting a video stream with an overlapping region through two cameras, carrying out the processing of the first frame data on the embedded platform, obtaining a homography matrix, and calculating the overlapping region; determining a suture line by using an optimal suture line algorithm, and performing color correction and fusion on the first frame by using an optimized histogram matching method and a fade-in and fade-out method; detecting a moving object by using a frame difference method, setting a current frame as an updated frame, an updated suture line and a color correction function when the moving object passes through the vicinity of the suture line, avoiding ghosting and blurring, and periodically updating a homography matrix in order to eliminate errors; and generating pixel mapping from the data of the first frame and the updated frame, storing a color correction function, directly performing coordinate mapping and color correction on other frames, accelerating a fusion process by using hardware, and finally displaying a spliced video on a display device in real time. The splicing quality is improved while the real-time performance is ensured, and the spliced image is quickly obtained and displayed on the display device in real time.

This application discloses a panoramic stitching method, apparatus, device, and storage medium based on multi-camera systems, relating to the field of image processing technology. The method includes: acquiring calibration images collected by multiple cameras, wherein the calibration images include common calibration areas of adjacent cameras; identifying calibration board corner features in the calibration images and obtaining calibration parameters for each camera based on these features; generating a configuration file according to the calibration parameters; and processing the video streams collected by the multiple cameras based on the configuration file to obtain a panoramic video stream. This method solves the problems of low calibration accuracy and reliance on manual experience and complex online calculations in existing technologies under long-distance, large field-of-view conditions. It achieves standardization and automation of the calibration process and enables efficient, high-precision real-time panoramic video stitching on embedded devices, reducing the system's dependence on high-performance processing platforms and overall cost.

The embodiment of the invention provides a bucket wheel machine unattended system and method based on video stitching, and the system obtains the global high-precision visual information of a bucket wheel machine operation area and an accurate material pile semantic segmentation mask image through the panoramic image stitching and image recognition of the original video streams of a plurality of cameras. Meanwhile, the external parameters of the dynamic camera are solved in real time by combining with the PLC pose data of the bucket wheel machine, the two-dimensional semantic segmentation mask graph and the synchronized laser radar point cloud are efficiently fused, the material pile edge features are accurately mapped to the three-dimensional space, the high-precision three-dimensional material pile edge point cloud is obtained, and therefore the defects of the laser radar in semantic recognition are overcome. And finally, based on the three-dimensional material pile edge point cloud updated in real time and the current pose data of the bucket wheel machine, the system can intelligently carry out operation path planning, the operation path planning is decomposed into PLC control instructions, and autonomous, safe and accurate operation of the bucket wheel machine in the complex and changeable material pile environment is achieved.

The invention relates to a marine unstructured camera video stitching method, which comprises the following steps: S1, acquiring video stream data of a shipborne camera, the video stream data being initial data required for calculating stitching parameters; s2, the initial data obtained in the step 1 are processed, splicing mapping parameters are obtained, and the splicing mapping parameters comprise cylindrical projection mapping parameters, homography matrixes between adjacent cameras, self exposure compensation parameters and optimal suture lines; splicing mapping parameters are stored in a file form, and the parameters are loaded to a memory in a GPU mapping table form during subsequent splicing; and S3, on the basis of the splicing mapping parameters obtained in the step S2, carrying out online splicing on the video images. According to the method, the problem that the ship camera array is difficult to calibrate is solved, a more stable splicing effect is achieved in different illumination scenes, and compared with a traditional video splicing method, the method is higher in dynamic scene adaptability.

A kind of distributed video splicing device, it is related to video splicing technical field, including with several local input modules of external image device connection, with the management module of several local input modules connection, with the output module of management module connection, with the network streaming media input module of management module connection, output module is connected with external display device, local input module includes with the input interface of external image device connection, with the input conversion chip of input interface electrical connection, with the input FPGA of input conversion chip electrical connection, input FPGA is electrically connected with management module, input conversion chip is used to output RGB signal to input FPGA.The technical scheme provided by the utility model aims to realize integrated design, and can solve the technical problem of network streaming media data processing.

Disclosed herein are an apparatus and method for 360-degree video stitching. The apparatus for 360-degree video stitching includes memory for storing at least one program, and a processor for executing the program, wherein the program is configured to stitch features of multiple input images based on at least one parameter included in a 360-degree stitching function description template, and then creating a single 360-degree video, the 360-degree stitching function description template includes a configuration parameter that is an array of function parameters, the configuration parameter includes a stitching parameter, a camera parameter, a feature parameter, and a projection parameter, the feature parameter includes a method for extracting respective features from multiple input images, and the projection parameter includes a projection type that is a kind of a projection plane onto which the multiple input images are projected.

The present invention provides a video splicing method and system based on object tracking, which relate to the technical field of video splicing. The method and system include the following steps: obtaining a video file to be processed, converting the video file to be processed into a frame sequence with a timestamp through a decoder, calculating feature differences and motion vectors based on a key frame recognition algorithm, and determining feature frames in the frame sequence; performing grayscale conversion on the feature frames to generate grayscale frames and spectrograms corresponding to the grayscale frames, removing image noise in the spectrogram and performing color correction to obtain a standard image; tracking an object in the standard image through an optical flow tracking algorithm based on the standard image to generate an image analysis result; determining a Hessian matrix corresponding to each pixel point in the standard image based on the image analysis result, constructing a scale space based on the Hessian matrix, determining key points and generating feature descriptors, performing image matching based on the feature descriptors, selecting an optimal matching pair, and performing image splicing based on an image stitching algorithm to obtain a spliced image.

The invention discloses a water surface detection and identification method for water supervision and law enforcement security guards, and relates to a water surface detection and identification method. The invention aims to solve the problems that an existing detection and recognition method is single in function, various illegal regulations of a shipping ship cannot be well supervised, and illegal regulations of the ship cannot be processed in time due to the fact that the acquisition speed of a ship image is delayed. The method comprises the following steps: step 1, constructing a data set; step 2, establishing an image video stitching algorithm; step 3, training the data set in the step 1 in batches, and training the identification network by adopting different grouping methods to improve the accuracy and reliability of the identification network; and step 4, carrying out image identification on the spliced video stream. The invention belongs to the technical field of overwater safety supervision and identification.

A method for displaying large-format virtual reality video on a nonvirtual reality device includes identifying a location chosen by an operator comprising determining a point of interest at the location and picking a frame of action at the location to be provided in relation to the point of interest, the location is such that the point of interest and the frame of action are captured with a camera at the location, the point of interest to be accessible by a viewer in an interactive environment on a non-virtual reality device; recording a large-format video of the frame of action at the location; clarifying the large-format video into a finished large-format video file, the clarifying comprising video sorting wherein the large-format video is sorted to subsequently undergo video stitching to derive an equirectangular video, the equirectangular video then undergoing video adjusting which results in the finished large-format video file, and reframing the finished large-format video file wherein the reframing comprises manipulating the finished large-format video file into a standard aspect ratio video for displaying in the interactive environment viewable on the non-virtual reality device such that the limited viewable area is exported as a standard aspect ratio video.

The invention relates to the technical field of image processing, and discloses a video stitching method, system, device, medium and product, and the method comprises the steps: carrying out the key point matching of a left visual angle image and a right visual angle image, screening an initial key point pair set through a random sampling consistency algorithm, and obtaining a key point pair set; based on this set, a homography matrix is determined. And splicing the left view angle image and the right view angle image of the current frame through the homography matrix by using the key point pair set of the current frame. And by means of an optical flow method, tracking a key point pair set from the current frame to the next frame, updating the key point pair set as the key point pair set of the current frame, and continuing splicing of the left-view-angle image and the right-view-angle image. The process lasts until all video frame images are spliced, and finally key points in each frame image are tracked through an optical flow method, and a homography matrix is accurately determined, so that the splicing speed and quality are improved.

The invention provides a video stitching method, system and related equipment, which are applied to the technical field of data processing, and the video stitching method comprises the following steps: obtaining multiple paths of video streams input by monitoring equipment, and decoding the multiple paths of video streams to obtain multiple paths of decoded video data of the multiple paths of video streams; performing feature extraction on the multi-channel decoded video data through a neural network processor to obtain multi-channel video feature information of the multi-channel video streams; performing feature matching on the multi-channel video feature information through a neural network processor to obtain a multi-channel feature matching result of the multi-channel video streams; when the multi-channel video feature information is subjected to feature matching to obtain a multi-channel feature matching result of the multi-channel video stream, removing mismatching points in the multi-channel feature matching result in parallel; and through a neural network processor, aligning the multiple paths of video frames according to the effective feature matching points in the multiple paths of feature matching results, and generating target video stitching data. The video stitching efficiency and the resource utilization rate can be improved.

The invention discloses a time-space consistency video stitching method and device, and relates to the technical field of video stitching. The method comprises the step of realizing high-precision video stitching through dual-channel feature extraction and spatio-temporal joint optimization. The method comprises the following steps: firstly, respectively extracting shallow layer and deep layer features of two paths of video sequences by adopting a StarNet-s050 model; constructing a space distortion module comprising a context correlation layer, RegressNet1 and RegressNet2 to generate a space distortion matrix before optimization, and obtaining a final space distortion matrix through an auxiliary training head; a time sequence distortion module is used for extracting space-time dynamic features, and space-time smooth increment is calculated in combination with smooth constraints; and finally, inputting the corrected space-time distortion matrix and an original video into a splicing module to generate a fusion sequence. According to the method, the problems of deformation difference of a multi-view video in a space dimension and fuzziness on a time axis are effectively solved, and the video stitching quality is remarkably improved through hierarchical feature fusion and space-time consistency modeling.

The invention relates to the technical field of multi-channel video stitching, in particular to a multi-channel video processing method. The method comprises the following steps: decoding n paths of videos to be subjected to panoramic stitching to obtain n paths of video frame sequences; video frames included in each video frame sequence are stored in corresponding queues according to the sequence of acquisition time from morning to evening; obtaining the number of video frames stored in each queue in the n queues at the current moment; if qi is smaller than a first preset value, frame loss processing is not carried out on the queue of the ith path; if qi is greater than or equal to a first preset value and less than a second preset value, performing first preset frame loss processing on the ith queue; if qi is greater than or equal to a second preset value and less than a third preset value, performing second preset frame loss processing on the ith queue; and if qi is greater than or equal to a third preset value, carrying out third preset frame loss processing on the ith queue. According to the invention, real-time synchronous processing of multiple paths of videos can be carried out before panoramic stitching.