159 results about "Video fusion" patented technology

The invention provides a monitoring video fusion system and a monitoring video fusion method based on a three-dimension space scene. Video frames are extracted from a monitoring video data stream and are projected to a three-dimension space scene so as to realize full-space-time stereo fusion of video data and three-dimension scene data and change a traditional mode in which a map application can only be statically displayed; and a plurality of channels of real-time monitoring videos deployed in different geographic locations and a three-dimension model in a monitoring area are registered and fused so as to generate a large-range three-dimension panoramic dynamic monitoring picture and realize real-time global control on the overall security situation of the monitoring area.

The invention relates to the field of computer application technique and traffic management, in particular to a multi-view video fusion and traffic parameter collecting method for large-scale scene traffic monitoring. The fusion method comprises the steps of collection and decoding of videos of viewpoint video sources, transformation and splice fusion of adjacent view frame images, and image rendering of the frame images after fusion of the multi-view video fusion. According to the method, real-time collection, decoding, video frame transformation registering and texture mapping are performed on multi-path parallel videos, and therefore fused traffic large-scale scene videos are obtained; texture characteristic analysis is performed on roads in a traffic large-scale scene image sequence to obtain real-time traffic parameters, used for traffic analysis and evaluation, such as the traffic queuing length, the non-motor vehicle density, the traffic flow and travel time of the roads in various directions of the area.

The invention discloses an automatic news splitting method for volume broadcast television supervision. The automatic news splitting method for volume broadcast television supervision comprises the steps that broadcast television data are initialized to automatically obtain a news program voice frequency waveform and a video image, audio and video features of the news data are extracted and comprise host detection, subtitling detection and traction and voice detection, a vision candidate point and a voice candidate point of a news item boundary are obtained through a heuristic rule, the news item boundary is calculated in a positioning mode according to audio and video fusion, a processing result provided in the previous steps is stored into a knowledge base to serve as knowledge resources supporting supervision requirements after artificial check. The automatic news splitting method for volume broadcast television supervision has the advantages that the constructed audio and video features accord with the description of the news item boundary, the designed audio and video fusion strategy fits with a news item organization structure, and therefore the news splitting process is higher in execution efficiency, higher in column robustness and more ideal in result compared with an existing method.

An infrared and visible light video fusion method based on moving target detection belongs to the technical field of video fusion. A moving target is detected through low-rank sparse representation, the target is extracted using the low-rank and sparse time slices along X-T and Y-T planes, the integrity of the target detected is ensured by spatial information, and the robustness and accuracy of detection are improved. Then, the structure information of an image can be better described through non-subsample shearlet transform with a good fusion effect. The method has the advantages of high computational efficiency, unlimited filtering direction, translational invariance, and the like, and improves the fusion effect. In addition, the low-frequency sub-band coefficients are fused according toa sparse representation rule, the high-frequency sub-band coefficients are fused according to a weighting rule taking a target saliency map as a weighting factor, and a better fusion effect is achieved. Therefore, the infrared and visible light video fusion method based on moving target detection presented by the invention is more robust, and has a better fusion effect.

The invention relates to the technical field of comprehensive situation monitoring and commanding. The invention particularly relates to a video fusion and video linkage method based on a three-dimensional scene and electronic equipment. The method comprises the steps of three-dimensional modeling of a monitoring area, planning and deployment of a scene and a target camera, enhancement, jitter elimination and correction processing of a scene video, recognition and analysis of a scene video, three-dimensional matching and fusion of the scene video and a thermodynamic diagram thereof and a hotspot target, three-dimensional matching and linkage of the target camera, monitoring and correction of pose offset of the scene camera and the like. Accurate space matching and fusion display of a scenecamera video image, a thermodynamic diagram of the scene camera video image, a hotspot target and a scene three-dimensional model are realized; the target camera is intelligently dispatched to obtaina fine image of the hotspot target; accurate space matching and fusion display of other situation awareness information, equipment facility information and task management and control information anda scene three-dimensional model are realized; full-dimensional situation fusion monitoring based on a three-dimensional scene and intelligent space positioning analysis and associated information fusion display based on hotspot inspection, planned tasks and detection alarm are achieved, and the intelligent level and application efficiency of a comprehensive situation monitoring command system areremarkably improved.

The invention relates to the technical field of road traffic state detection, and particularly relates to a road running state detection method and system based on radar and video fusion. The method comprises the following steps: 1, carrying out the data collection of a moving target through a millimeter-wave radar and a video detector, and carrying out the preprocessing of the data; 2, converting millimeter wave radar data coordinates into video pixel coordinate system coordinates, and registering the time of the millimeter wave radar and the time of a video detector to realize mapping of a redundant vehicle region of interest of the millimeter wave radar to a video image and completing fusion of space and time; 3, performing vehicle identification on the region of interest by using a convolutional neural network obtained through historical image data training, determining the region of interest of a vehicle, and eliminating radar false alarm information; and 4, carrying out traffic statistical data calculation according to a vehicle identification result, and acquiring traffic operation state parameters in a certain time period, wherein the parameters comprise a flow, an average speed and a queuing length.

The invention relates to a three-dimensional visual unattended substation intelligent linkage system based on video fusion. The system comprises a 3D video live-action fusion subsystem, an intelligentinspection subsystem, a sensor subsystem, a rail machine inspection subsystem, a door magnet and perimeter alarm subsystem, a dome camera linkage subsystem, a flame recognition and early warning subsystem and a monitoring center, and all the subsystems are interconnected and intercommunicated with the monitoring center. The three-dimensional visual unattended substation intelligent linkage systemis realized by fusing three-dimensional videos, the all-weather, omnibearing and 24-hour uninterrupted intelligent monitoring of a substation is realized, and the arbitrary browsing and viewing of athree-dimensional real scene of the substation and alarm prompting of faults in the substation are realized; a worker can watch the videos in the monitoring room, the real-time monitoring and dispatching command of a plurality of substations under administration are achieved, the worker does not need to inspect power transformation facilities and equipment every day, and the monitoring capacity and the working efficiency are improved.

The embodiment of the invention provides a virtual gift display method, device and equipment and a storage medium, and relates to the technical field of videos, and the method comprises the steps: receiving image data of a scene uploaded by a client, and generating a panoramic image; issuing the panoramic image to a client to render and display so as to fuse the anchor video to a set area of the panoramic image; identifying the scene type of the scene according to the image data, screening out candidate virtual gifts matched with the scene type from a virtual gift library, and issuing the candidate virtual gifts to the client; and receiving a target virtual gift selected by the user and fed back by the client, adding the target virtual gift to the anchor video, and displaying the special effect of the target virtual gift in the panoramic image. According to the technical scheme, the visual effect that audiences are personally close to the scene where the anchor is located is achieved,the virtual gift is pushed according to the scene, the content and the special effect of the virtual gift better conform to the scene where the current anchor video is located, the expressive force ofthe virtual gift effect is enhanced, and the enthusiasm of the audiences for giving gifts to the anchor is improved.

The invention relates to a panoramic monitoring system based on mixed reality and a video intelligent analysis technology. Overall situation control and detail target staring control are achieved through real-time fusion of a three-dimensional model and video monitoring. The system comprises four platforms of three-dimensional video fusion, two-dimensional panoramic stitching, historical video backtracking and three-dimensional plan deployment, and mainly has the functions of panoramic monitoring, high-low association, gun-ball linkage, crowd density analysis, border crossing alarm, three-dimensional plan deployment and historical video backtracking.

The invention belongs to the technical field of traffic target tracking, and discloses a radar and video fusion traffic target tracking method and system, equipment and a terminal. The method comprises the steps of: determining a single-sensor target tracking problem, namely selecting a platform bridge test scene to carry out radar and video data collection and analysis; performing space-time matching, namely selecting an open site with a high test position, and controlling the number of targets; performing coordinate system matching debugging by adopting single-target test scene data; and constructing a radar and video fusion algorithm based on a fuzzy set theory, namely carrying out target classification and fuzzy evaluation problem classification, and determining a target judgment criterion. According to the radar and video fusion traffic target tracking method and system, two common traffic information acquisition sensor millimeter wave radars and cameras are selected, a radar and video fusion traffic target tracking algorithm based on a fuzzy set is provided, and high-precision and high-accuracy target tracking is realized by using a multi-sensor fusion algorithm under the condition of reducing the complexity of a single-sensor tracking algorithm.

The invention provides a three-dimensional video fusion method and system based on WebGL. According to the invention, there is no need to process a video source, and the method comprises the steps: accessing an HTTP video stream, updating a video texture object based on WebGL, updating and setting a near cutting surface, a far cutting surface and a camera position and orientation of a view cone ofan observation camera, then updating the scene depth of an observation view angle, projecting and restoring to an observer camera coordinate system, fusing with the live-action model, performing distortion correction on the camera, and finally realizing a video area cutting effect by adopting masking. The problems in the prior art are solved, three-dimensional video fusion is achieved on the basis of WebGL, the projection area is cut, adjacent videos can be prevented from being displayed in an overlapped mode, distortion correction is conducted on the cameras, and therefore the good display effect can be achieved for the cameras with large distortion and the situation that the installation positions are low.

The invention discloses a data processing method, a first server, a second server and a storage medium. The method comprises the steps that the first server receives control information, pose information and audio information sent by a virtual reality device; the first server renders the application image according to the received control information and pose information to obtain a rendered videoimage; and the first server fuses the received audio information and the rendered video image to obtain audio and video fusion data of the virtual reality device. The first server fuses the receivedaudio information and the rendered video image to obtain the audio and video fusion data of the virtual reality device, so that the virtual reality device has an audio interaction function, and the user experience is improved.

The invention discloses a night vision anti-corona video processing method based on heterogeneous image fusion. According to the method, the continuous optimal cosine included angle threshold of the video content is determined by researching the cosine included angle theta of the feature vectors of the two frames of images and the correlation between the non-linear correlation information entropyNCIE and the frame removal rate, redundant frames in a video sequence are abandoned, and only anti-corona fusion processing is performed on reserved frames, so that the processing efficiency of the algorithm can be greatly improved; the problem of data expansion caused by a night vision anti-corona video fusion method in an information fusion process is solved; the original frame numbers of the extraction frames are reserved as time marks, the number of frames to be inserted between the extraction frames is determined, and the video frame rate after frame removal is recovered; the motion vector of the object is calculated by utilizing the inter-frame content difference, and the motion vector between the to-be-interpolated frame and the reference frame is obtained by endowing different self-adaptive weights to the reference motion vector, so that the to-be-interpolated frame image synchronous with the original video is constructed, and the problem that the content of the video after frame interpolation is not synchronous with the content of the original video is solved.

The embodiment of the invention relates to the technical field of image processing, and discloses a video fusion method, electronic equipment and a storage medium. The method comprises the steps thatthe color value and transparency of a target pixel point and the color value of a video pixel point are acquired, the target pixel point is located in a target selection area of a background image, the video pixel point is located in a material video inserted into the target selection area, and the position of the video pixel point corresponds to the target pixel point; a fusion color value is calculated according to the color value and transparency of the target pixel point and the color value of the video pixel point; and the color value of the target pixel point is modified into the fused color value. By modifying the color value of the target pixel point into the fused color value, sawteeth can be prevented from appearing at the edge of the target selection area of the background imageand the edge of the material video inserted into the target selection area.

The invention provides a video playing method, a display terminal and a storage medium, and the method comprises the steps: obtaining video fragments needed by video playing, and enabling the video fragments to comprise a panoramic video fragment and a plane video fragment; selecting video fragments for video playing according to the playing sequence of the video, and detecting whether a video frame of the currently selected video fragment corresponds to a view angle switching identifier or not; and if the view angle switching identifier exists, correspondingly selecting the plane video fragment or the panoramic video fragment for playing after the currently selected video fragment is the panoramic video fragment or the plane video fragment and the video fragment is played. According to the scheme, mutual switching between the panoramic video fragments and the planar video fragments can be realized according to the view angle switching identifier, so that planar video playing is certainly interspersed between the two panoramic videos of which the view angles need to be switched on the premise of ensuring the adjustability of the playing view angles through a video fusion playing technology, and the playing switching is not abrupt.

The invention discloses a video processing method and device and an electronic device, and the method comprises the steps of obtaining two to-be-fused videos, wherein the visual effect features of theimages in the two videos are different; determining a main video and an auxiliary video in the two videos; fusing the auxiliary video and the main video; and in the process of fusing the auxiliary video and the main video, controlling the visual effect feature presented by an image part belonging to the auxiliary video in the fused video to be the same as the visual effect feature of the main video by adjusting the video effect feature of the image in the auxiliary video. According to the scheme, the image quality of the fused video can be improved.

The invention relates to a stadium three-dimensional video fusion visual monitoring system. A plurality of cameras and a monitoring platform are arranged in each area of a stadium, and the cameras shoot videos in the front range of the corresponding area and transmit video images and video tags to a video fusion module; the monitoring platform comprises a three-dimensional model construction module for constructing a three-dimensional scene model of the stadium based on a 3D GIS technology; and the video fusion module analyzes an area to which the transmitted video image belongs based on the video label, performs video fusion on the video images transmitted by the cameras belonging to the same area, and visually embeds the fused video image into the area in the three-dimensional scene model. According to the method, the sub-lens monitoring videos which are located at different positions and have different visual angles are fused into the three-dimensional scene model in real time, real-time global monitoring of an overall large scene in a monitoring area range is realized, any camera video screen does not need to be switched, various emergencies are conveniently commanded and handled in time, and the practical efficiency of video monitoring is greatly improved.

The embodiment of the invention relates to the field of information processing, and discloses a video fusion method, electronic equipment and a storage medium. The video fusion method comprises the following steps: acquiring a target instruction; drawing a first display area for displaying the inserted video in a preset background image according to the target instruction; drawing at least one second display area in the background image according to the shape of the first display area, the second display area being used for displaying the material video; and synthesizing the background image,the insertion video and the material video to generate a fused video. According to the method, the playing areas are set for the inserted video in the preset background picture, and the shapes of theplaying areas corresponding to the to-be-fused material video are set according to the shapes of the playing areas of the inserted video, so that the two playing areas can be fused more harmoniously,video fusion has a personalized background and playing areas, and the video fusion interestingness is improved.

The invention provides a target detection method and system based on millimeter-wave radar and video fusion, and the method comprises the steps: firstly filtering invalid targets obtained by the millimeter-wave radar and a camera, and reducing the target detection range; under the condition that spatial synchronization of the millimeter-wave radar and the camera is ensured, target matching of detection results of the millimeter-wave radar and the camera is carried out; and calculating a target detection intersection-union ratio, judging the accuracy of target matching according to the target detection intersection-union ratio, and further performing second target matching by adopting a global nearest neighbor data association algorithm under the condition that the recognition accuracy cannot be judged, thereby realizing target matching of detection objects of the millimeter wave radar and the camera as many as possible. The missed detection rate of the target object can be reduced, and the accuracy of identification matching is ensured at the same time.

The invention discloses a traffic facility vector recognition, extraction and analysis system based on point cloud data and an AI technology, and belongs to the technical field of intelligent traffic. In order to solve the problems that an existing traffic control department monitors road vehicles and traffic facilities in a picture or plane signal mode, certain limitation exists in the mode, workers cannot visually obtain actual data of the facilities and the vehicles, and therefore errors can occur in use in some applications. The three-dimensional live-action modeling technology engine is a three-in-one engine and is a three-in-one autonomous engine of a data engine, a map engine and a video engine. Holographic description, immersive and immersive experience command are realized by adopting video fusion, multi-map integrated multi-view application, first-person-view multi-lens fusion high and low point linkage indoor and outdoor linkage and real-time video real-time face vehicle feature behavior real-time structured analysis.

The invention discloses an indoor and outdoor panoramic house viewing video fusion method. The method comprises the following steps: a house plane house type graph, a community road distribution graph, indoor virtual three-dimensional image data and outdoor live-action three-dimensional image data are imported; a user can select a house viewing mode by himself/herself and plan a house viewing route by himself/herself, so that a virtual-real fused panoramic house viewing video can be automatically generated along the house viewing route. The method has the effects that the aerial triangulationtechnology in the existing surveying and mapping technology is effectively utilized, a user can define a route by himself/herself, a video is automatically generated, indoor and outdoor panorama virtuality and reality are fused, online naked eye 3D indoor and outdoor panorama house viewing experience is achieved, and the house viewing experience feeling is effectively improved.

The invention discloses an AR-based three-dimensional holographic real-time interaction system and method. The system comprises 3D fusion processing equipment, first audio and video acquisition equipment and audio and video playing equipment, wherein the 3D fusion processing equipment is arranged at a place A, the first audio and video acquisition equipment acquires audios and videos in a scene ofthe place A, and the 3D fusion processing equipment performs 3D fusion on the video acquired at the site A to form a fused video capable of being displayed stereoscopically; audio and video processing equipment, second audio and video acquisition equipment, audio playing equipment and holographic projection display equipment, wherein the audio and video processing equipment is arranged at a placeB, the second audio and video acquisition equipment acquires audios and videos in a scene at the place B, the audio and video processing equipment sends the audios and videos acquired at the place Bto the place A, the audio playing equipment plays the audios sent from the place A, and the holographic projection display equipment is used for stereoscopically displaying the fused video sent from the place A with a holographic projection effect. According to the invention, the A-place main body can be stereoscopically reproduced in the B place in a holographic projection manner, so that the experience of interactive communication is improved.