51 results about "Ghosting" patented technology

The invention relates to a video snapshot compression imaging reconstruction method and system. The method comprises the following steps: inputting a video frame sequence and a time-varying mask set thereof into a measurement model to obtain initial estimation; constructing a reconstruction network which comprises a feature extraction module, a gating residual network module and a video reconstruction module; the feature extraction module comprises two three-dimensional convolution layers, each three-dimensional convolution layer is connected with an activation function, and the feature extraction module extracts initial features from the initial estimation; inputting the initial features into a gating residual network module, and outputting reconstruction information features; and the video reconstruction module fuses the reconstruction information features, and performs up-sampling and detail refining to reconstruct a video sequence. According to the method, on the premise that parameters and computing power are hardly increased, ghosting and flickering are effectively restrained, the stability of long-time reconstruction is improved, and an effective scheme is provided for SCI reconstruction with the high compression ratio, the super-definition resolution ratio and the long sequence.

The invention discloses an image processing method, an electronic device, a vehicle and a computer readable storage medium, and the method comprises the steps: obtaining vehicle-mounted images of at least two adjacent cameras of the vehicle, and projecting foreground region images of the at least two adjacent cameras to a first plane when detecting that a foreground object exists in the vehicle-mounted images, and splicing the foreground area images projected to the first plane to obtain a spliced foreground image. Therefore, the foreground image can be determined on the basis of the projection of the foreground area image on the first plane, so that the situation of defects such as ghosting or dislocation in the foreground image obtained by splicing can be avoided to a certain extent, and the quality of a panoramic image obtained by the foreground image can be guaranteed; and the user experience of the panoramic monitoring image system can be guaranteed.

The application discloses a panoramic depth high dynamic range imaging system and method based on compound eye structure, relates to the technical field of computational imaging and image processing, and synchronously collects and multi-scale motion estimation ensures the time sequence consistency between sub-images, effectively reduces the splicing dislocation and ghosting caused by the rapid movement or partial occlusion of an object, and improves the stability of a dynamic scene; an adaptive HDR fusion mechanism based on exposure difference and local features preferentially retains high-contrast unsaturated region details through intelligent weight distribution, overcomes the overexposure and underexposure problems under backlight or light mutation, and makes the output image naturally smooth in the bright-dark transition area; in addition, multi-scale depth synthesis and edge perception filtering work cooperatively, enhances the depth estimation accuracy of a low-texture area, avoids depth jumping and edge blurring, and guarantees the overall definition of the panoramic depth image; meanwhile, rolling shutter correction and space-time interpolation compensation further reduce dynamic ghosting and noise interference.

The invention relates to a millimeter-wave-based local amplification display device and a control method, and the method comprises the steps: obtaining three-dimensional point cloud data of a human head through the scanning of a millimeter-wave radar, extracting the contour features of the human head, calculating and generating a circular frame parameter matched with the contour of the human head, and carrying out the overlapping display of a circular frame on a display module according to the circular frame parameter. The circular frame is used for defining the boundary of the local amplification area; performing real-time image processing on the picture in the selected area of the circular frame through the FPGA chip; by applying the method, the aiming precision and the game winning rate can be improved, the global view field can be kept, the'tunnel view field 'effect can be avoided, meanwhile, self-adaptive personalized adaptation is carried out according to the shape of the head of each person, the comfort can be effectively improved, operation is convenient and fast, and fine adjustment is supported; in addition, the scheme is based on hardware-level real-time processing, low delay and high smoothness are achieved, and jamming or smear caused by processing delay is avoided; and the game fairness can be maintained through the non-intrusive design.

The embodiment of the invention relates to a video interpolation frame generation method and device, display equipment and a storage medium, and the method comprises the steps: segmenting a current frame of a target video into a current frame main body layer and a current frame background layer, and segmenting a reference frame into a reference frame main body layer and a reference frame background layer; determining the matching degree between each background information block in the background layer of the current frame and each background information block in the background layer of the reference frame, dividing the background information blocks into repeated background information blocks and newly added background information blocks according to the matching degree, and splicing the processed background information blocks to generate a background layer interpolation frame after fusion processing; generating a main body layer interpolation frame for the current frame main body layer and the reference frame main body layer; and generating a complete interpolation frame according to the background layer interpolation frame and the main body layer interpolation frame. Therefore, the phenomena of dislocation, ghosting and void of the main body and the background in the video picture are remarkably reduced, and the visual coherence and the motion stability of the interpolation frame and the utilization efficiency of computing resources are improved.

The invention discloses an NPU-based expressway monitoring video high dynamic range fusion enhancement method and system, and relates to the technical field of image enhancement processing, and the method comprises the steps: obtaining RAW data frames outputted by an image sensor supporting the LOFIC technology in a single physical exposure period; extracting a bright frame, a middle frame and a dark frame at the same exposure moment to form three RAW subframes; respectively carrying out ISP preprocessing to obtain three frames of RGB; splicing the three frames of RGB into 9 channels for input according to channels, inputting the neural network model operated by the NPU for fusion and enhancement, and outputting 3-channel high-dynamic range RGB; and encoding the output image and outputting to a storage or transmission interface. Through the technical scheme of the invention, the loss of details such as ghosting, overexposure and underexposure is reduced, and the monitoring imaging stability of tunnel entrances, backlighting and night vehicle lamp scenes is improved.

The application discloses a method and device for removing ghosting, an electronic device and a computer readable storage medium. The method comprises: determining a ghosting area in a to-be-processed image through a ghosting detection model; determining target ghosting pixels in each ghosting sub-area according to a reference image, wherein the reference image and the to-be-processed image come from the same video stream, the ghosting sub-area is obtained by dividing the ghosting area, and the number of the ghosting sub-areas is more than two; screening a target ghosting sub-area according to the number of the target ghosting pixels in each ghosting sub-area; and replacing each target ghosting sub-area in the to-be-processed image with a corresponding area of the reference image to obtain a first target image. Through the application, the damage to the original image background during ghosting removal can be reduced, and the difference between the image after ghosting removal and the original image can be avoided.

The information processing apparatus includes a motion compensation unit, an occlusion region detection unit, a ghosting removal unit, and a DNN. A motion compensation unit performs motion compensation on past frame estimation results and generates a corrected history frame image. The occlusion region detection unit detects an occlusion region in which ghosting may occur in the correction history frame image on the basis of a motion vector representing the motion of the subject between the frames. The ghosting removal unit performs ghosting removal processing with respect to the occluded region. The DNN estimates the current frame based on the corrected historical frame image in which the ghost removal process has been performed and the current frame image to be processed.

Techniques are disclosed for denoising videos. In some embodiments, video frames are denoised using a denoising model that includes an encoder-decoder architecture and attention modules. During training of the denoising model, the attention modules learn weightings to upweight certain dimensions of input features to help pixel registration, remove ghosting artifacts, and improve temporal consistency when the frames of a video are being denoised. The denoising model can also be used to train a student denoising model that has a same architecture as, but is smaller and faster than, the denoising model. After training, noisy video frames can be input into the denoising model and / or the student denoising model to generate corresponding denoised video frames.

Provided is a lens device, an imaging device, and an optical filter unit that can suppress the generation of ghost images and light spots. A lens device (100) includes, in order from an object side in an optical path, a first optical filter (134A, 134B) and a second optical filter (136A, 136B). The first optical filter (134A, 134B) is composed of an optical filter (e.g., a band-pass filter) having a light transmission band in a specific wavelength region. The second optical filter (136A, 136B) is composed of an optical filter (a band-stop filter) having a light absorption band in a wavelength region different from the light transmission band of the first optical filter.

The embodiment of the invention provides a multi-exposure image fusion method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of image processing. According to the method, distinguishing and modeling of a moving object and a static background in a dynamic scene are achieved by generating a moving area weight map, a median threshold bitmap, a superpixel area map and a basic weight map. The median threshold bitmap and the superpixel area map are used for correcting the motion area weight map, the space consistency and the boundary fitting degree of motion detection are improved, motion interference in the basic weight map is eliminated through the final motion weight map, and an accurate fusion weight map is obtained. On this basis, multi-exposure fusion is completed in combination with an original image sequence, ghosting artifacts caused by object movement can be effectively suppressed while highlight and shadow details are reserved, and the quality and authenticity of the fused image are improved.

The application discloses a multi-path video real-time splicing processing method based on an embedded platform and particularly relates to the technical field of image processing, which comprises the following steps: obtaining multiple images with consistent time stamps through hardware frame synchronization, calculating the light flow module length of the overlapping area after pre-alignment through cylindrical projection to generate a binary mask, establishing a control grid in the overlapping area to perform sparse disparity estimation and correction to obtain a sparse disparity map, up-sampling the disparity map to a dense disparity map, constructing a composite energy map containing a spatial color gradient cost and a time penalty cost, modulating the spatial cost by using the binary mask and smoothing the time penalty map, obtaining a dynamic avoidance seam through shortest path search, and forming an adaptive feathering band with the seam as the center. The application effectively eliminates static disparity ghosting and motion object half-cut artifacts under limited computing resources and realizes high-quality real-time panoramic splicing.

The invention relates to an image ghosting processing method and device, equipment and a storage medium. The method comprises the following steps: before shooting an image by using an image acquisition device, obtaining a preview data stream of the image acquisition device for a current shooting scene, and obtaining continuous multi-frame first images from the preview data stream; determining whether the current photographing scene is a highlight motion scene according to the multiple frames of first images; under the condition of determining that the current photographing scene is the highlight motion scene, controlling the image acquisition equipment to acquire multiple frames of second images in an exposure mode; and performing ghosting removal processing on the multiple frames of second images to generate a target image. According to the method, judgment is carried out through a highlight motion scene, it is ensured that image data needing to be processed are within a dynamic range, basic data of ghosting existence are provided, meanwhile, multiple frames of second images are collected under the same exposure condition, the ghosting situation in the multiple frames of second images is more prominent, the ghosting removal accuracy is improved, and the ghosting removal efficiency is improved. And higher information quality of the target image is ensured.

The invention provides a video frame rate adjusting method and system based on an LED display device, a medium, a program and a terminal, different frame compensation strategies are selected according to a second motion intensity value, and when low motion is needed and only one frame needs to be inserted, frame repetition, zero motion estimation and zero additional delay are adopted to ensure that the rhythm is natural and the real-time performance is met; and switching to motion compensation frame insertion when the system is in medium-high motion or needs multi-frame insertion, reconstructing an intermediate state according to displacement, continuously restoring a motion track, and inhibiting jitter and trailing. Moreover, when the motion compensation frame insertion strategy is executed, afterglow compensation is carried out on the insertion frame, so that the phenomena of smear, ghosting, local brightness overexposure and the like caused by the inherent afterglow effect of LED pixel points in the LED display device when a high-speed motion picture is played are avoided.

A VR headset, belonging to the field of head-mounted display technology, addresses the issue that in gaming and entertainment scenarios, the 3D movement of the user's head can easily cause the VR headset's headband to slip. Combined with device play and inertial jitter, this can lead to overall device misalignment and loosening, resulting in optical focusing distance misalignment, blurred images, ghosting, and dizziness. Existing lens adjustment solutions cannot solve the device shifting problem, and long-term use can easily induce latent strabismus. Furthermore, significant offline dizziness can occur when switching between virtual and real scenes. This invention includes a display device with a fixed connecting base on its top. This invention can adaptively follow the 3D movement of the head, solving the headband slippage and overall device misalignment problems, maintaining stable optical focusing, avoiding blurring, ghosting, and dizziness, reducing the risk of strabismus, alleviating offline dizziness, improving wearing comfort, reducing component wear, and adapting to high-motion scenarios such as gaming and entertainment.

The invention provides a ghosting detection method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a to-be-detected image; performing defect region extraction on the to-be-detected image to obtain a candidate defect region set; dividing the to-be-detected image to obtain a plurality of image partitions; for a candidate defect region pair formed by any two candidate defect regions in the candidate defect region set, determining a relative azimuth angle of the candidate defect region pair; determining an image partition to which the candidate defect region pair belongs, and obtaining a ghosting feature condition corresponding to the image partition to which the candidate defect region pair belongs; according to the ghosting feature condition and the relative azimuth angle, a ghosting detection result is determined, and the ghosting detection result is whether the candidate defect area contains ghosting or not. According to the scheme, efficient and accurate ghosting detection is realized.

The invention discloses an image splicing method and device and a computer program product, and the method comprises the steps: respectively mapping images collected by cameras at different positions to a pre-established imaging spherical surface, and obtaining respective mapping images; layering each mapping image according to the movement speed of the scenery in each mapping image to obtain a multi-layer image; and respectively setting the same scene distance hierarchy for the images with the similar movement speeds, and splicing the images with the same scene distance hierarchy to generate a panoramic image. According to the method, the image is layered based on speed, so that smooth transition and natural fusion from close shot to long shot are ensured, the problems of ghosting and dislocation in traditional panoramic stitching are effectively solved, and the quality and flexibility of image stitching in a large parallax scene are remarkably improved.

The invention discloses an embedded real-time video stitching method based on dynamic suture line optimization and time domain smoothing. The method comprises the following steps: performing multi-thread synchronous acquisition and preprocessing on left and right video streams; extracting features on the key frame and obtaining an initial homography matrix, smoothing the time domain of the homography matrix, and multiplexing or restricting updating when the matching quality is insufficient to suppress picture jitter; constructing an energy diagram in the overlapped region ROI (region of interest), searching an optimal vertical suture line with the minimum accumulated cost from top to bottom by utilizing dynamic programming, and reducing dynamic ghosting; a hard mask and a soft mask are generated in a suture line neighborhood and are respectively used for a high-frequency layer and a low-frequency layer for multi-band fusion, high-gradient side forced retention is performed on a position where a pixel difference exceeds a threshold value in a mixed band, and finally, a Laplacian pyramid is only constructed near an overlapping region, and memory copying is performed in a non-overlapping region. The real-time performance and the splicing visual quality can be considered.

The invention discloses an image sequence correction method and device based on time and space, equipment and a medium, and relates to the technical field of image processing, and the method comprises the steps: removing blind pixels and noise points of a kth frame of infrared image based on median filtering, and obtaining an initial expected image; filtering and fusing the initial expected image based on guide filtering and side window filtering to obtain a fused expected image; according to the (k-1) th frame of infrared image and the (k-2) th frame of infrared image, obtaining the global difference, the local difference and the image smoothness between the frames, and updating the adaptive step length; and substituting the adaptive step length of the fused expected image and the (k-1) th frame of infrared image into a preset image correction formula for calculation to obtain a target expected image after correction of the kth frame of infrared image. According to the method, the edge details of the image are kept through joint filtering, and the adaptive step length is updated based on the space-time sequence information, so that the image correction formula is more accurate, the non-uniformity is removed while the details are kept, and the'ghosting 'phenomenon of the image sequence is effectively avoided.

The embodiment of the invention provides a refreshing method of ink screen equipment, electronic equipment and a storage medium, the ink screen equipment comprises a first ink screen and a second ink screen, the method comprises the following steps: playing a first video on the first ink screen, and displaying a first text on the second ink screen; determining a first refresh type of the first video, and determining a second refresh type of the first text; according to the first refreshing type and the second refreshing type, the first ink screen and the second ink screen are refreshed, and refreshing is used for eliminating ghosting in the first ink screen and the second ink screen. According to the method, the corresponding refresh types of the first ink screen and the second ink screen are determined respectively, and differential refresh is executed according to the refresh types, so that the problems of full-screen flicker and video playing lagging caused by double-screen synchronous refresh are effectively avoided, the video watching fluency and the text display definition are improved, and the user experience is improved. Therefore, the use experience of the user is improved.

The invention discloses a ghosting-free waveguide type head-up display system and a ghosting-free imaging method, and belongs to the technical field of vehicle-mounted display. The system comprises an image generation module, a collimation optical system, a waveguide assembly and a vehicle windshield. The HUD light emitted by the waveguide assembly only contains the P polarization component and is emitted to the glass surface at the incidence angle close to the Brewster angle of the windshield, and the characteristic that the reflectivity of the first surface approaches zero when the P polarization light is emitted at the Brewster angle is utilized, so that an HUD image is only reflected by the second surface to form a single virtual image; therefore, the ghosting problem caused by double reflection of the front surface and the rear surface in the traditional HUD is thoroughly eliminated. According to the system, a wedge-shaped windshield is not needed, the manufacturing complexity and cost are reduced, meanwhile, the waveguide technology is combined to achieve compact structure and large-view-field display, and the imaging definition and the driving safety are remarkably improved.

The invention relates to a dynamic splicing method and system based on a binocular camera, and belongs to the technical field of video image processing. The method comprises the following steps: synchronously acquiring left and right field-of-view image data through a binocular camera, and carrying out stereo correction, so that left and right image polar lines are horizontally aligned to eliminate vertical offset; key points are extracted from the corrected image, feature descriptors are calculated for matching, and mismatching is eliminated through a robust estimation model; then calculating a horizontal offset between the images according to a matching result, and taking the horizontal offset as a core splicing parameter; and finally, carrying out registration and fusion on the image overlapping region based on the offset, and outputting a splicing result after cutting, color balancing and coding. According to the binocular dynamic splicing method, the feature matching search space is reduced from two dimensions to one dimension through stereo correction, a single horizontal offset model is adopted, the problems that a traditional splicing method in a dynamic scene is poor in real-time performance, dislocation and ghosting are prone to occurring and the like are effectively solved, and high-quality and high-efficiency binocular dynamic splicing is achieved.

The application provides a video image splicing method and device, terminal equipment and storage medium, which are suitable for the technical field of data processing, and the method comprises the following steps: acquiring fisheye video image information shot by multiple fisheye cameras, time information corresponding to the fisheye video image information, current time information and equivalent focal length information of the fisheye cameras; determining multiple fisheye video image information corresponding to time information smaller than a preset time difference threshold value as multiple fisheye video image information to be processed; performing transformation processing on the multiple fisheye video image information to be processed to generate multiple video images to be spliced; performing splicing processing on the multiple video images to be spliced to generate an initial spliced video image; and performing ghost correction processing on the initial spliced video image to generate a target spliced video image. The application splices video images shot by multiple fisheye cameras, and improves the intuitiveness, effectiveness and reliability of remote monitoring of a work site.

The application discloses a display screen detection method and device, the method comprises the following steps: firstly, acquiring the image of the detected screen when it is lighted and the image of the qualified screen when it is lighted; then, calculating the first row and column coordinates corresponding to the multiple pixel points of the detected screen and the second row and column coordinates corresponding to the multiple pixel points of the qualified screen from the image of the detected screen and the image of the qualified screen respectively; then, calculating the center coordinates and / or area size of each pixel area according to the first row and column coordinates and the second row and column coordinates, wherein the pixel area is composed of multiple pixel points; finally, establishing the evaluation formula of the detected screen according to the center coordinates and / or area size of the first row and column coordinates and the second row and column coordinates, which is used for evaluating whether the detected screen is qualified. When detecting the to-be-detected screen, the offset degree, screen size, ghosting and distortion of the current to-be-detected screen are evaluated, if the score of any one of them is less than the threshold value, the to-be-detected screen is considered to be unqualified, and the offset degree and the screen size are two indexes that cannot be detected by human eyes, the application can provide accurate information and improve the detection efficiency.

The application discloses a visual SLAM system and method for an automatic driving vehicle, and the system comprises an image preprocessing module, a multi-target tracking module, a visual odometer module, an object state updating module and a back-end optimization module. The method comprises the following steps: S1, preprocessing the image through an instance segmentation network; S2, distinguishing the dynamic and static states of objects; S3, estimating the initial camera pose; S4, removing dynamic objects; and S5, performing an optimization strategy on the image key frame. The application has the beneficial effects that in the visual image, the dynamic objects can be efficiently filtered out, the ghosting in mapping is effectively reduced, the accuracy and robustness of positioning are improved, and the applicability of the automatic driving vehicle in a dynamic environment is improved.

The invention relates to the technical field of holographic display, and discloses a multi-view dynamic holographic imaging mechanical rotating device which comprises a holographic imaging device, the holographic imaging device further comprises a driving device, an outer frame is installed at the output end of the driving device, and holographic fan blades are arranged on the inner side face of the outer frame; the sensing mechanism and the self-adaptive air pressure vibration suppression mechanism are used for collecting in-place installation electric signals and vibration air pressure data correspondingly and transmitting the electric signals and the vibration air pressure data to a monitoring system for analysis and judgment, abnormity caused by incomplete installation or connection degradation can be found in time, and the safety of the device is improved. A traditional lagging mode depending on manual observation is changed; through real-time monitoring and automatic inhibition of abnormal vibration of the holographic fan blades, the device fundamentally reduces LED display track offset caused by fan blade jumping, and effectively avoids the problems of blurring, jittering or ghosting of a holographic image.

The invention provides an image fusion method based on a differential thought, and the method comprises the steps: obtaining an extended and cut target image block as a processing starting point, preserving the edge and context information of an original image, carrying out the bidirectional verification matching of multi-scale feature points, improving the matching reliability, and generating an initial spliced image based on accurate geometric transformation. Quantitative analysis is carried out by dividing sub-regions and calculating a pixel mean value, finally, pixel values of the sub-regions are dynamically adjusted according to mean value differences, splicing is carried out again, and smooth optimization is directly carried out on splicing seams. Multi-scale features and bidirectional verification enhance the adaptability of the algorithm to different image qualities and scenes, a differential adjustment strategy acts on local splicing seams, ghosting and brightness discontinuity can be effectively eliminated, meanwhile, image details are kept, and then high-quality and high-efficiency image superposition is achieved.

This invention provides a zone-controlled active shutter 3D glasses, relating to the field of 3D glasses technology. It includes a glasses body, a microcontroller minimum system, an infrared receiving circuit, a left lens driving circuit, and a right lens driving circuit. A television emits infrared light via a synchronization signal transmitter. The infrared receiving circuit receives the emitted infrared light and is connected to the microcontroller minimum system. The microcontroller minimum system is connected to the left and right lens driving circuits, which respectively drive the left and right lenses on the glasses body. The microcontroller minimum system, infrared receiving circuit, left lens driving circuit, and right lens driving circuit are all located on the glasses body. This invention uses LCD lenses for zone control, which can solve all ghosting problems, preventing 3D motion sickness and improving the visual experience.