1130 results about "Imaging Signal" patented technology

The present invention relates to the technical field of cross-modal image signal reconstruction. Disclosed is a cross-modal joint source-channel coding and decoding method adaptable to changeable scenarios. The method comprises: first designing a Transformer encoder-based cross-modal channel coding and decoding optimization solution, so as to achieve the performance improvement and robustness of a channel encoder and a channel decoder; then designing a cross-modal source coding and decoding optimization solution for haptic-to-image generation based on a latent diffusion model, so that under an image signal loss scenario, haptic information is used to guide image generation; and finally, incorporating transfer learning technology, so as to reduce additional training costs caused by a system facing changeable cross-modal communication scenarios such as a changeable channel signal-to-noise ratio and different transmission tasks. Under cross-modal changeable communication scenarios, the joint source-channel coding and decoding method provided in the present invention can solve the problems of the inability of a receiving end to well complete image reconstruction, and additional model training costs caused by changeable channel environments and scenarios.

The invention relates to a naked eye 3D binocular image acquisition and real-time processing system based on hardware synchronous triggering, and belongs to the technical field of image processing and three-dimensional display. According to the system, a hardware synchronous triggering mechanism is adopted, a time sequence synchronous control unit is used for sending a synchronous pulse signal to a binocular image sensor, and strict synchronization of left and right viewpoint image acquisition is ensured. The image signal processing unit processes collected original data, the stereo parallax correction module performs epipolar correction, and the sub-pixel interleaving module generates a composite view frame according to grating parameters of the display terminal. The system realizes high-speed data transmission through a double-buffer direct memory access DMA mechanism. The problems of visual tearing and weak stereoscopic impression caused by asynchronous binocular image acquisition in the prior art are solved, nanosecond-level synchronization precision is realized, optical crosstalk is reduced, and smoothness and comfort of stereoscopic display are ensured.

The embodiment of the invention discloses a scanning NV probe microscope which comprises an atomic force microscopy system used for detecting surface topography information of a sample and an optical detection magnetic resonance system used for detecting surface magnetic field distribution information of the sample, and the atomic force microscopy system comprises a vibration arm and a diamond probe. The optical detection magnetic resonance system comprises an NV color center, a transition excitation light path and a fluorescence detection light path; a sample to be scanned and the transition excitation light path are respectively positioned on two opposite sides of the diamond probe, and the transition excitation light path and the fluorescence detection light path are positioned on the same side of the diamond probe; a first metal coating film is arranged on one side, close to the sample, of the diamond probe and is used for blocking surface fluorescence of the sample. According to the scanning NV probe microscope provided by the embodiment of the invention, the metal coating is arranged at the bottom of the diamond probe to block stray fluorescence from the surface of the sample, so that the problems of low magnetic field imaging signal-to-noise ratio and limited measurement precision of the existing scanning NV probe microscope are solved.

A high-order driving auxiliary lane changing trajectory planning method for an intelligent vehicle comprises the steps that laser radar and camera data are obtained, and feature vectors of obstacles are extracted after the data are processed by an ISP at the front end of a chip of the intelligent vehicle; constructing a spatio-temporal joint attention network model, inputting the feature vector of the obstacle into the spatio-temporal joint attention network model, calculating an interaction weight between the vehicle and the obstacle through a self-attention mechanism, and synchronously outputting predicted trajectory distribution of the obstacle and a candidate planning trajectory cluster of the vehicle; introducing a dynamic game in the game theory, and constructing a comprehensive cost function in combination with the interaction weight to obtain a screened track; and taking the screened trajectory as an initial value, inputting the initial value into a rear-end quadratic programming optimizer on the premise of meeting vehicle dynamics constraints, carrying out numerical optimization solution, searching an optimal programming sequence, and finally finishing lane changing trajectory planning. According to the invention, the interactive perception capability and riding comfort of the intelligent vehicle in a complex traffic scene can be improved.

The invention discloses a liquid crystal display device for improving contrast based on movable light guide lattice points and a light guide layer and a control method of the liquid crystal display device. The device comprises a backlight module, a dynamic light guide layer, a liquid crystal display panel and a control system. The dynamic light guide layer is packaged by two transparent substrates to form a sealed cavity, the cavity is filled with transparent base liquid and movable micro units with different refractive indexes, and transparent electrode arrays are arranged on the inner surfaces of the substrates. The control system controls the electrode array to generate a corresponding electric field according to brightness and darkness distribution of an input image signal, drives the micro-units to move in the base liquid and gather to the position below an image brightness field area so as to enhance light output, and meanwhile enables the micro-units to be dispersed below a dark field area so as to reduce light leakage. According to the invention, a static light guide structure is changed into a dynamic programming system, and the real-time pixel-level matching of backlight distribution and display content is realized, so that the contrast ratio is remarkably improved, the halo is inhibited, and the power consumption is reduced. The invention also protects the core component of the dynamic light guide layer and the corresponding control method.

A display device includes a pixel unit that includes a plurality of pixels, a compensator configured to receive sensing data from the pixel unit in a sensing period and that detects and compensates for a characteristic of the pixels, and a timing controller configured to convert an image signal received from an outside into image data.

An image capturing apparatus for capturing an object and generate an image, displaying the image, performing signal processing for the image, and accepting an input from a user, wherein the image is displayed with a vectorscope superimposed thereon, the vectorscope indicating a distribution of color components included in the image based on a hue and a color density and an index for specifying a range of a skin color region in the image, a display position of the index on the vectorscope is specified based on the hue and the color density values, and a size of the index is specified by the range of the skin color region value, and processing is performed for decreasing a detail level of an image signal of the image having a color component included in the index.

The invention provides a polarization hyperspectral water quality monitoring system and method, and the system comprises a tower footing polarization hyperspectral imaging module which is disposed on a building beside a to-be-detected water area, and carries out the area array staring scanning of the to-be-detected water area through a polarization hyperspectral imager, so as to obtain a water body polarization hyperspectral image signal of the to-be-detected water area; the image spectral data processing module is used for deducting dark current and spurious signals from the water body polarization hyperspectral image signals, and calculating the water body spectral reflectivity of the water area to be measured according to the water body polarization hyperspectral image signals by combining a gray value and reflectivity relation model constructed by using the hyperspectral image signals of the gray scale calibration plate; and the water quality parameter spatial distribution inversion module is used for performing inversion on the to-be-detected water quality parameters of the to-be-detected water area according to a pre-constructed water quality parameter inversion model and the water body spectral reflectivity. According to the technical scheme, the integration level is high, the automation degree is high, rapid deployment can be achieved, and all-day continuous unattended monitoring can be achieved.

Systems and techniques are described for image signal processor motion detection. In various examples, first image data including pixel values may be generated, where each pixel value is associated with a respective color tag of a color filter array. A first set of the pixel values corresponding to a first block may be determined. A second set of pixel values may be determined based on a respective pixel value of the first set and the respective color tag associated with that respective pixel value. A first intensity value associated with the first block may be determined based on the second set of pixel values. A second intensity value associated with a reference block may be determined. A comparison value representing a difference between the first intensity value and the second intensity value may be determined. A signal indicating detected motion may be sent based on the comparison value.

The invention provides a photoelectric pod tracking method and system for an unmanned aerial vehicle platform. The photoelectric pod tracking method comprises the steps of collecting multi-mode sensor original data of the unmanned aerial vehicle platform in a target scene through a photoelectric pod; performing image processing on the original data of the multi-modal sensor by using a self-adaptive image signal processing algorithm based on a deep reinforcement learning model to obtain an optimized multi-modal image; performing semantic feature extraction on the optimized multi-modal image by using a double-flow neural network to obtain deep multi-semantic association features, and performing fusion processing on the deep multi-semantic association features to obtain a unified feature map in a target scene; based on the unified feature map, using a Transform model to track a target of the unmanned aerial vehicle platform in the target scene to obtain real-time coordinate information of the target; when the target is tracked, self-adaptive image processing is carried out based on the original data of the multi-mode sensor, and stable and efficient tracking of the target in the target scene by the photoelectric pod is facilitated.

The invention discloses an assembly type steel structure connection quality detection method and system, and relates to the technical field of steel structure assembly and intelligent detection, and the method comprises the steps: collecting node vibration, strain and image signals, carrying out the preprocessing, and constructing a detection data set; calculating characteristic parameters of connection of the bolt and the weld joint based on the detection data set, and outputting a comparability index through normalized mapping; performing weighted synthesis on the comparability index of the bolt connection index and the weld joint connection, generating a node quality score, and establishing a grading threshold parameter; and calling a node quality score and a grading threshold parameter, executing a segmentation judgment function to output a node quality grade, and executing data verification on a segmentation judgment function result. According to the method, multi-source signals are synchronously collected and subjected to standardized processing, the connection characteristics of bolts and welding seams are fused, a unified quality scoring and grading judgment system is established, and quantitative and traceable evaluation of the connection quality of the fabricated steel structure is achieved.

The invention discloses a multi-sensor fusion target scoring system high-precision positioning method, and relates to the technical field of target scoring positioning, and the method comprises the following steps: building a transient interference recognition channel based on the electromagnetic response of a shock wave sensor, obtaining the electromagnetic disturbance of the bullet hit front edge, and generating an interference time sequence; performing delay triggering on the image sensor according to the interference time sequence, and avoiding an interference peak value to form a safe exposure time period; performing charge pre-release on the image acquisition chain before safe exposure; carrying out synchronous compensation on the shock wave signal based on energy distribution of charge pre-release, so that the shock wave signal and image energy response are symmetrical and mutually stable in a time domain; and dynamic shielding control is carried out on a space coupling path between the two types of sensors by utilizing an energy balance region formed in the mutual stable state. Through energy symmetric compensation and dynamic shielding control of shock waves and image signals, time-space separation and synchronous mutual stability of the signals are achieved, and high precision and stability of target scoring positioning under high-energy shooting are ensured.

The invention relates to a receiver for a laser radar, the laser radar and terminal equipment. The receiver comprises an SPAD chip, the SPAD chip comprises a pixel array, the pixel array extends along a first direction and a second direction, the pixel array comprises a first pixel array, the first pixel array comprises first pixels and is configured to receive echoes, reflected by an object, of detection light of the laser radar and output echo signals; and a second pixel array including second pixels and configured to receive visible light and output an image signal; wherein the first pixel and the second pixel are aligned in the second direction, the pixel array further comprises a dummy pixel, and the dummy pixel is located between the first pixel and the second pixel in the first direction.

An electronic device is provided. The electronic device includes a display, an image sensor, an image signal processor for processing frames transmitted from the image sensor, a scaler arranged between an output end of an image pipeline and an input end of the display, memory, comprising one or more storage media, storing instructions, one or more processors operatively connected to the display, the image sensor, the image signal processor, the scaler, and the memory, wherein the instructions, when executed by the one or more processors individually or collectively, cause the electronic device to acquire, from the image sensor, a first frame of a first zoom magnification, control that a second frame to Nth frames are image-processed at the first zoom magnification through the image signal processor while the first frame of the first zoom magnification processed through the image signal processor is output to the display, receive a user input for requesting the display of a second zoom magnification, which differs from the first zoom magnification at the time of N+1 frame acquisition, request the image signal processor to process the N+1 frame, set to transmit, to the scaler, a second zoom magnification request at the time of N+1 frame acquisition, and allow the scaler to scale, in a second frame output order, at the second zoom magnification requested at the time of N+1 frame acquisition, a second frame processed at the first zoom magnification in the image signal processor so as to transmit same to the display.

A smart safety system can include an internal camera configured to photograph an inside of a workplace, a beam projector configured to illuminate a worker when the worker is located inside the workplace, a fence lighting device located in an upper end of a fence of the workplace, and an integrated controller configured to receive an image signal from the internal camera and process the image signal to determine whether the worker is located in the workplace, when the worker is located in the workplace as a result of determination, control the beam projector to illuminate the worker in a first color beam, and control the fence lighting device to emit light in a second color.

An auto-exposure control is proposed for high dynamic range images, along with a neural network for exposure selection that is trained jointly, end-to-end with an object detector and an image signal processing (ISP) pipeline. Corresponding method and system for high dynamic range object detection are also provided.

The invention discloses an intelligent enhancement method for a road image under a low-illumination condition, and belongs to the technical field of computer vision and video processing, and the method comprises the following steps: S1, calculating an actual illumination value of a current road scene; s2, adaptively adjusting the exposure time; s3, targeted noise reduction; s4, color temperature correction; s5, enhancing the image contrast; s6, performing strong light suppression to obtain a final current road scene image; under extremely low illumination, the image signal-to-noise ratio is increased by more than 40%, the color rendition degree is larger than or equal to 90%, clear full-color images can be output without external light supplementation, meanwhile, the strong light inhibition rate of vehicle headlights and the like is larger than or equal to 95%, the overexposure area is reduced to be lower than 5% of the original area, the algorithm processing delay is smaller than or equal to 40 ms, the real-time monitoring requirement is met, and the method is suitable for highway night scenes.

The present invention relates to the technical field of haptic signal generation. Disclosed is a signal-to-noise ratio adaptive haptic signal reconstruction method with joint source-channel optimization, comprising: preprocessing an image corresponding to each object and a haptic vibration signal generated by sliding; constructing a cross-modal joint encoder for generating hierarchical fusion features, constructing a cross-modal joint decoder, and inputting preprocessed training data into the constructed cross-modal joint encoder and cross-modal joint decoder for training; and inputting in pairs haptic signals and image signals under test into the cross-modal joint encoder and the optimal cross-modal joint decoder to reconstruct a target haptic signal. The signal-to-noise ratio adaptive haptic signal reconstruction method with joint source-channel optimization provided by the present invention simplifies encoding training processes, better performs modal feature fusion, improves the robustness of models to channel variations, and allows the models to exhibit higher haptic signal reconstruction stability under a wider range of signal-to-noise ratio variations.

Devices, systems, and methods are provided for imaging cholesteatoma, e.g., using an endoscope including a light source configured to deliver visible light at one or more narrowband wavelengths distally from the endoscope selected to cause autofluorescence in target tissue, a camera coupled to the imaging element to acquire image signals of locations beyond the distal end, and one or more filters configured to remove wavelengths of light in the image signals acquired by the camera including the one or more narrowband wavelengths of visible light.

An auto-exposure control is proposed for high dynamic range images, along with a neural network for exposure selection that is trained jointly, end-to-end with an object detector and an image signal processing (ISP) pipeline. Corresponding method and system for high dynamic range object detection are also provided.

The invention relates to the field of printing industry automation, and discloses a printed matter quality intelligent detection and data tracing system. Comprising a multi-modal data synchronous acquisition and preprocessing module for establishing working condition parameter and image signal space-time mapping, a physical constraint dynamic reference generation module for generating a controlled reference image by using a conditional generative adversarial network, and a differential abnormal flow analysis module for extracting abnormal signal space-time evolution characteristics. The knowledge-based causal inference module is used for carrying out fault attribution in combination with an equipment physical fingerprint database; the disturbance injection-based adaptive causal calibration module is used for executing active detection in a security envelope; and the knowledge graph self-evolution module is used for updating a model based on verification data. Real-time physical process parameters are fused to a reference image generation process, dynamic characteristics are extracted by using differential abnormal flow, and fault attribution is carried out in combination with an equipment physical fingerprint database, so that accurate tracing of physical root causes of printing defects and closed-loop adaptive learning of a diagnosis model are realized.

The invention provides a signal processing method of an image sensor, which comprises the following steps of: starting a transfer transistor by using a relatively low first starting voltage during LCG to read an image signal of the LCG, and starting the transfer transistor by using a relatively high second starting voltage during HCG to read an image signal of the HCG. Wherein the first turn-on voltage is smaller than the voltage for completely transferring the full well charge of the photodiode to the floating diffusion region under the LCG, so as to ensure that the charge in the photodiode is not completely emptied when the image signal of the LCG is read; the second turn-on voltage is greater than or equal to the voltage for completely transferring the residual charge of the photodiode to the floating diffusion region under the HCG, so that the charge in the photodiode can be completely transferred under low illumination. Compared with the prior art, the method can ensure that charges in the FD cannot exceed a readable range during LCG and HCG, read data distortion cannot be caused, the storage area does not need to be increased, the FD potential change amplitude is not too large during two times of charge transfer, noise can be reduced, the problem of transverse stripes of a lamp tube can be minimized, and the HDR image quality can be improved.

The invention discloses a high-speed snapshot system and method, and relates to the technical field of image acquisition. The system comprises a trigger detection module, an image acquisition module, a processing and control module, a DDR cache chip and a storage and transmission module. The image acquisition module adopts a high-speed CMOS (Complementary Metal-Oxide-Semiconductor Transistor) image sensor and works in a high-frame-rate mode which is not lower than 120 frames per second under a preset resolution ratio; the processing and control module adopts a system-level chip integrated with an image signal processor and a hardware encoder; the DDR cache chip is connected with the processing and control module through a memory bus and serves as a high-speed data buffer pool. Through cooperative work of a high-frame-rate sensor and a hardware-level encoder and cooperation of independent DDR cache, clear, continuous and frame-loss-free snapshot of high-speed moving targets such as flying insects is realized, and the problems of image blurring and incomplete data caused by insufficient frame rate and limited data processing capability in the prior art are solved. The system is high in integration level, flexible in deployment and suitable for field monitoring and laboratory research.

The invention relates to the field of concrete beam damage detection, in particular to an ultrasonic imaging method for concrete beam damage detection, which comprises the following steps: arranging a linear array comprising a plurality of ultrasonic probes on a single-side contactable surface of a to-be-detected concrete beam; preparing a multi-channel ultrasonic transmitting and receiving instrument, and connecting the multi-channel ultrasonic transmitting and receiving instrument with the sensor array and the control computer; a multi-channel ultrasonic device is used to work in a full-matrix capture mode, in the full-matrix capture mode, each probe is sequentially excited to emit ultrasonic pulses, and time domain signals received by all the probes of the array are synchronously recorded to obtain an original full-matrix data set. According to the method, strong scattering noise generated by the concrete aggregate can be inhibited through the deep convolutional neural network so as to improve the signal-to-noise ratio of the image, the sound velocity field conforming to the non-uniform characteristic of the concrete can be constructed through local sound velocity inversion and iteration based on the strong reflection points, the problems of imaging artifacts and form distortion are avoided, and the accuracy of the imaging process is improved. And the concrete damage detection precision is ensured.

The invention relates to the technical field of unmanned aerial vehicle water conservancy exploration, in particular to an unmanned aerial vehicle water conservancy exploration intelligent system and method based on multi-source data fusion, and the system comprises an image collection module which is used for collecting water surface information and outputting an original image signal through an airborne multispectral polarization imaging unit; and the image preprocessing module is used for executing geometric correction based on the original image signal so as to output a corrected image signal. According to the method, a fusion weight calculation mechanism is introduced among multiple spectral bands, and the target detection depth and the spectral signal-to-noise ratio model are combined, so that the adaptive weight fusion of the multi-source spectral data is realized, and the complementarity of information of different bands is effectively enhanced; the spectrum contrast ratio, the detail fidelity and the target prominence of the generated exploration image are obviously improved, and higher accuracy is provided for quantitative analysis and feature recognition of the water body environment.

A projection device comprises a light source module, a light source driving circuit and a control circuit. The light source module comprises at least one light source. The light source driving circuit is coupled to the light source module. The light source driving circuit is used for controlling at least one light source of the light source module to be turned on according to the enable signal. The control circuit is coupled to the light source driving circuit. The control circuit is used for providing an enable signal to the light source driving circuit. The control circuit is used for controlling the number of times of generating the enable signal in a frame period according to the frame rate of the first image signal. In a frame period, the product of the number of times that at least one light source of the light source module receives the enable signal and the frame rate of the first image signal is greater than or equal to a reference value. The invention further provides a control method of the projection device. The projection device and the control method thereof provided by the invention can have better image quality.

The invention discloses a lossless switching and synchronizing system for multi-modal operation image signals, which relates to the technical field of multi-modal operation image signal processing and comprises an optical flow field coding module, a scene perception decision engine, a time-sharing imaging control module, a data co-processing interface and an exception handling unit. The optical flow field coding module constructs a unified space-time grid, and maps ultrasonic, endoscope and MRI images to grid nodes through cross-modal optical flow field calculation to generate a synchronous frame sequence; the scene perception decision engine dynamically outputs an optimal image mode combination instruction based on instrument position and tissue deformation strain rate data; the time-sharing imaging control module analyzes the instruction and generates imaging equipment excitation signal time sequence configuration; and the data co-processing interface encapsulates the synchronization frame sequence into a DICOM-RT format and transmits the synchronization frame sequence to the display terminal. The abnormality processing unit monitors signal abnormality and generates a compensation frame. According to the system, high-precision space-time synchronization and dynamic intelligent switching of multi-modal images are realized, and the precision and reliability of surgical navigation are improved.

An auto-exposure control is proposed for high dynamic range images, along with a neural network for exposure selection that is trained jointly, end-to-end with an object detector and an image signal processing (ISP) pipeline. Corresponding method and system for high dynamic range object detection are also provided.

The invention discloses a Raw domain moire removing method based on Mama, and relates to the technical field of image signal processing. The invention relates to a Mamba-based Raw domain moire removal method, which comprises the following steps that: S1, a Mamba-based Raw domain moire removal model is constructed, and the model adopts a U-Net type multi-scale encoder-decoder architecture; s2, designing a selective scanning module based on time and space, and adaptively focusing on a space-time region with significant moire; s3, training the model by using a deep learning Pytorch framework, and repeatedly traversing the VDRawmoire data set until the model is converged; s4, inputting multiple frames of Raw domain moire images into the model, and outputting a single-frame RGB image reconstruction result after moire removal; according to the method disclosed by the invention, the Moire removal performance of the Raw domain is improved to a new height by utilizing proposed selective scanning based on time and space.

The invention discloses an immunofluorescence imaging method for driving tyramine signal amplification based on chemiluminescence and application thereof, and relates to the technical field of biomedical imaging. The immunofluorescence imaging method comprises the following steps: carrying out first incubation on a to-be-detected sample and a peroxidase-labeled antibody; performing second incubation on the to-be-detected sample after the first incubation and a tyramine substrate containing a fluorophore under a dark condition; adding a chemiluminescent substrate solution into the to-be-detected sample after the second incubation, and carrying out image acquisition; wherein the antibody can be specifically bound with a target protein; the tyramine substrate can generate active free radicals under the catalysis of peroxidase, so that the active free radicals are covalently cross-linked with tyrosine residues; the chemiluminescent substrate solution comprises hydrogen peroxide and luminol. The immunofluorescence imaging method improves imaging signal and fluorescence stability, effectively reduces background interference and phototoxicity, is suitable for long-time stable fluorescence immunoimaging, and is especially suitable for high-sensitivity detection of low-expression protein markers.