28982 results about "Image resolution" patented technology

A system and method are disclosed for generating hyperspectral images from multi-modal sensor data including RGB, LiDAR, thermal, and near-infrared inputs. Training data includes hyperspectral images and corresponding multi-modal measurements. Spectral band grouping is performed based on correlation coefficients. A multi-modal decomposition network with cross-modal attention mechanisms generate reconstructed hyperspectral images by fusing complementary sensor information. A fine-tuning network creates reconstructed RGB images. A comprehensive quality assurance system analyzes spectral consistency, cross-modal coherence, and fusion artifacts to generate quality metrics. Missing data compensation strategies handle corrupted sensor inputs using information from other modalities. The system includes temporal integration for video sequences and multi-resolution processing for different sensor resolutions. Quality metrics guide network weight adjustments to improve reconstruction accuracy while maintaining robustness to sensor failures and environmental variations.

Using a pre-trained and fixed Vision Transformer (ViT) model as an external semantic prior, a generator is trained given only a single structure / appearance image pair as input. Given two input images, a source structure image and a target appearance image, a new image is generated by the generator in which the structure of the source image is preserved, while the visual appearance of the target image is transferred in a semantically aware manner, so that objects in the structure image are “painted” with the visual appearance of semantically related objects in the appearance image. A self-supervised, pre-trained ViT model, such as a DINO-VIT model, is leveraged as an external semantic prior, allowing for training of the generator only on a single input image pair, without any additional information (e.g., segmentation / correspondences), and without adversarial training. The method may generate high quality results in high resolution (e.g., HD).

The invention discloses an unmanned aerial vehicle routing inspection line adaptive obstacle detection method and system based on a monocular camera. The method comprises the steps of obtaining initial flight parameters, evaluating and optimizing the flight parameters based on scene complexity, collecting an original image sequence and carrying out quality evaluation and exposure compensation. Constructing a multi-resolution feature pyramid, extracting feature descriptors, and performing feature matching and verification; performing multi-constraint pose optimization and depth estimation based on a feature matching result, and reconstructing a three-dimensional point cloud; calculating direction enhancement response to extract a power line candidate area, performing multi-view line segment matching and three-dimensional reconstruction, and analyzing dynamic characteristics of the power line; and based on the power line three-dimensional model and the depth map, carrying out obstacle segmentation, calculating an obstacle distance, evaluating a risk level, and generating early warning information and a monitoring scheme. According to the invention, different scenes can be adaptively processed, the obstacle risk can be accurately identified and evaluated, and the inspection efficiency and reliability are improved.

The present invention provides a three-dimensional reconstruction method integrating a laser radar and oblique photography, comprising: S1, acquiring an oblique image and image data and preprocessing same to obtain a first oblique image, wherein the image data comprises POS data; S2, acquiring coordinates of a ground control point and high-precision POS data; S3, correcting the oblique image to obtain a second oblique image; S4, performing aerotriangulation on the second oblique image, and obtaining an effective matching point pair by means of improved SIFT; S5, performing combined adjustment on the basis of the effective matching point pair and performing dense matching to obtain a dense point cloud; S6, acquiring a laser point cloud and preprocessing same; S7, unifying the coordinates of the laser point cloud and the dense point cloud, and using improved ICP to obtain a fused point cloud; and S8, constructing a triangulated irregular network and performing texture mapping to generate a three-dimensional model. In the present invention, on the basis of the advantages of high resolution and strong anti-interference capability of a laser radar, defects in an oblique photography three-dimensional model are mitigated, and meanwhile, an oblique image is corrected and an algorithm used in feature matching is improved, thereby improving the precision, integrity and efficiency of the three-dimensional model.

The present invention discloses an edge-guided RGBD underwater salient object detection method with multi-attention, which includes the steps of: S1 performing channel-dimension preprocessing on RGB image and depth map and serially connecting them to obtain an RMD image; S2 inputting the RMD image into a trained salient object detection model including an encoder structure and a decoder structure; and S3 obtaining salient images and edge images output from the salient object detection model as object detection results, in which the encoder generates feature maps with reduced resolution layer by layer using the RMD image based on a residual neural network, and the decoder structure includes an edge detection branch used to fuse the feature maps layer by layer, and a saliency detection branch used to fuse the feature maps and edge feature maps layer by layer. The present invention preprocesses the input image with underwater imaging features, and uses an edge prediction image to guide multi-layer salient object detection, thereby enhancing edge details of the salient image.

The invention discloses a visible light and infrared image fusion method based on cross-modal dynamic collaboration. The method comprises the following steps: respectively extracting texture detail features of a visible light image and thermal radiation features of an infrared image through a visible light encoder and an infrared encoder; spatial alignment and channel complementarity optimization of cross-modal features are realized by using a heterogeneous attention collaboration module; and performing layered fusion on deep semantics and shallow detail features through a dynamic gating multi-scale decoder to generate a high-resolution fusion image. According to the method, the problems of feature dislocation, detail loss and unreasonable fusion weight distribution caused by modal difference in the prior art are solved, the detail fidelity, the thermal target saliency and the complex scene adaptability of the fusion image can be remarkably improved, and a high-robustness fusion result is provided for low-illumination environment perception and multi-modal target recognition.

The invention discloses a high-precision image processing method and system based on illumination adaptive compensation, and relates to the technical field of computer vision and image processing, and the method comprises the steps: inputting an original image, and dividing the image into a high-frequency edge layer, an intermediate-frequency texture layer and a low-frequency illumination layer through a multi-scale residual network; acquiring illumination intensity, color temperature and scene categories in real time by using an ambient light sensor and a scene semantic segmentation model, and generating dynamic compensation parameters; carrying out dynamic range expansion on a low-frequency illumination layer based on a physical illumination model, and adjusting the weight of highlight suppression and dark area enhancement through a self-adaptive S-shaped exposure curve; a double-branch generative adversarial network is adopted, noise suppression and super-resolution reconstruction are carried out on the high-frequency layer, and texture detail enhancement is carried out on the intermediate-frequency layer; aligning the data of the depth camera and the infrared sensor with the visible light image through a cross-modal fusion module; and performing tone mapping on the fused image based on human visual characteristics, and outputting an enhanced image with a high dynamic range and reserved details.

Provided herein are methods of enhancing spatial resolution of an analyte using sandwich maker system. The methods and systems used herein include a first substrate that includes a plurality of probes that include a capture domain and a spatial domain and a second substrate that includes a plurality of probes comprising a capture domain and a spatial domain.

A method for aligning a sample to an array is provided. An image of sample image of a sample can be received by a data processor. The sample image having a first resolution. An array image including an overlay of an array with the sample and an array fiducial can be received by the data processor. The array image having a second resolution lower than the first resolution of the sample image. The sample image can be registered to the array image by aligning the sample image and the array image. An aligned image can be generated based on the registering. The aligned image can include an overlay of the sample image with the array. The aligned image can be provided by the data processor. A method for detecting fiducials associated with an array is provided. Systems and non-transitory computer readable mediums performing the method are also provided.

The invention discloses a stainless steel surface defect detection method based on machine vision, and relates to the field of material defect detection.The stainless steel surface defect detection method comprises the steps that stainless steel surface images are collected, the collected multispectral surface images are subjected to image fusion, and a multispectral composite image is generated; performing detail enhancement on the low-resolution image through a super-resolution reconstruction algorithm to obtain a high-resolution image set; positioning a defect area position from the high-resolution image set through a defect detection algorithm, and obtaining a defect position data set; extracting a historical image defect feature set and a real-time image defect feature set from the defect position data set, and constructing a defect classification model according to the historical image defect feature set; inputting the real-time image defect feature set into a defect classification model, and performing defect classification and evaluation to obtain a defect classification data set; and generating and distributing a defect detection report. By combining the multispectral imaging algorithm, the super-resolution reconstruction algorithm and the defect classification model, the automation, precision and efficiency of stainless steel surface defect detection are improved.

The invention discloses a machine vision-based resistor disc defect online detection system and a grading method, relates to the technical field of industrial machine vision detection, and solves the defect problems in the aspects of multi-scale defect dynamic perception, cross-level feature interaction and process adaptive optimization in the prior art. According to the scheme, metal reflection interference is inhibited through Retinex illumination correction and a combined denoising model; adopting a deformable convolution kernel and cavity space pyramid pooling to realize gradient entropy driving dynamic sensing of the multi-scale defect; constructing a bidirectional cross-layer attention network to realize early fusion of high-resolution details and high-level semantics; modeling local-global feature physical association based on a graph attention network and a self-supervised message passing mechanism; integrating reinforcement learning and a memristor random calculation unit to form a closed-loop parameter optimization system; according to the method, the multi-scale defect detection precision, the cross-modal feature fusion efficiency and the system adaptive capacity under complex working conditions are remarkably improved.

The invention discloses a photovoltaic cleaning robot based on automatic path planning and an operation method thereof, relates to the technical field of robots, and solves the problem of cleaning blind spots in an existing cleaning robot and the endless loop risk of a path planning algorithm. According to the invention, the surface information of the photovoltaic panel is accurately captured through the multispectral acquisition module, a high-resolution and high-definition comprehensive image is generated through the data fusion processing module, then dirt is accurately identified on different scales by using a multi-scale pyramid structure and an adaptive feature fusion mechanism, and an attention mechanism and environmental perception data are combined, so that the real-time performance of the system is improved. The recognition threshold is dynamically adjusted, and misrecognition and missing detection are reduced; and finally, enabling the robot to autonomously learn in a complex environment and optimize an obstacle avoidance strategy through a dynamic obstacle avoidance algorithm based on deep reinforcement learning. The intelligent level and the cleaning effect of an existing photovoltaic cleaning robot are greatly improved.

The invention discloses a video super-resolution reconstruction method and system, and relates to the technical field of video restoration processing, and the method comprises the steps: collecting a to-be-reconstructed video frame sequence and a reference frame sequence; extracting a dense optical flow field between the reference frame and the target frame; performing geometric alignment on the target frame to the reference frame according to the dense optical flow field to obtain a motion consistency feature; performing feature extraction on the video frame sequence through a parameterized residual scaling module; inputting the extracted features into a bidirectional propagation module to process forward and backward image sequences respectively, extracting time sequence forward features and time sequence reverse features, and fusing the features to obtain detail features; carrying out adaptive fusion on the motion consistency features and the detail features, and sending the fused features into a reconstruction network to obtain deep visual features; pixel-level adaptive reconstruction is realized according to the deep visual features, and a super-resolution video sequence is obtained; according to the method, the feature space consistency is kept, and meanwhile, the feature matching precision in a complex motion scene is remarkably improved.

The invention relates to the technical field of image processing, and particularly discloses a remote sensing image super-resolution reconstruction method and system based on a prior diffusion model, and the method comprises the steps: carrying out the shallow feature information extraction of a low-resolution image, and obtaining a shallow feature map; the method comprises the following steps: performing multi-scale down-sampling and convolution fusion processing on a shallow feature map and a high-resolution image, and performing high-frequency information extraction and adaptive high-frequency enhancement processing on the processed feature map to obtain condition information; according to the method, deep mining of high-frequency information is carried out on a low-resolution image input as condition information, so that the high-frequency information in the low-resolution image gradually approaches a high-resolution image, and the reconstruction precision is improved; the noise prediction network model guides step-by-step noise removal in the back diffusion process, and the detail reduction capability and precision of natural disaster remote sensing image super-resolution reconstruction are improved.

A system for AI-supported leak detection and localization in water distribution infrastructures, consisting of: a large number of distributed sensor nodes mounted along a water pipe, each sensor node comprising the following: a pressure sensor configured to measure local hydraulic pressure fluctuations within the pipeline with a resolution of at least 0.01 bar; a flow sensor configured to measure the volume flow within the pipeline with an accuracy of at least ±0.5% of the measured value; an acoustic sensor configured to detect vibration signatures caused by leaks in a frequency range between 50 Hz and 20 kHz; an embedded microcontroller with integrated analog-to-digital conversion circuitry for digitizing sensor outputs; a wireless communication module configured to transmit time-synchronized sensor data to a cloud-based processing platform; and a local energy subsystem with a rechargeable battery and an optional circuit for generating photovoltaic energy; the cloud-based processing platform includes an artificial intelligence engine that comprises the following: a data acquisition module configured to receive and decode the transmitted sensor data and to perform time alignment; a supervised learning module that is trained on historical data of flagged leaks and non-leaks to classify incoming sensor patterns; an unsupervised learning module configured to detect anomalies by modeling normal operating baselines of the pipeline; and a topology-aware localization module configured to determine leak coordinates using the topology of the pipeline network, modeling the propagation of hydraulic waves, and estimating the arrival time difference from multi-node acoustic detections; and wherein the system is configured to provide real-time leak alerts and georeferenced visualization via a remote monitoring interface.

The invention provides an abdomen multi-organ image segmentation method fusing multi-scale features, and the method comprises the steps: S1, constructing a space detail fusion module extraction network, which comprises a space attention module, a channel attention module, an up-sampling operation, a down-sampling operation and a feature smoothing operation; s2, designing an encoder, and connecting the encoder with the space detail fusion module; s3, transmitting a plurality of features with different resolutions obtained by the encoder to a decoder through jump connection for information recovery; and S4, arranging the abdominal multi-organ medical image data set to perform model training, and performing multi-organ segmentation prediction on the abdominal multi-organ medical image. According to the method, local and global information is fully utilized, multi-scale feature information is combined, the image feature extraction and expression capability of the model is improved, and the segmentation precision of multiple organs of the abdomen is improved.

The invention provides an intelligent image signal processing method and system based on multi-modal fusion. According to the invention, a multi-mode input signal is received, is divided into a spatial distribution feature extraction region and a dynamic change trajectory capture region, and is decomposed into a penetrability feature layer and a substance reflection feature layer; carrying out association mapping on missing pixel information in the dynamic change trajectory capture region and energy distribution of the penetrability feature layer to generate enhanced dynamic trajectory data, identifying a determined reflection mode in the substance reflection feature layer, and carrying out frequency domain superposition on corresponding frequency band response and the spatial distribution feature extraction region; generating a composite spatial feature, then constructing a multi-modal joint optimization model, then adjusting the contribution ratio of the two data, and generating a fused image signal; the technical scheme provided by the invention not only solves the problems of detail loss, artifact generation and poor dynamic adaptability caused by single-mode limitation, but also improves the spatial resolution and tracking precision of the image signal.

The invention discloses a high-resolution remote sensing image semantic segmentation model and segmentation method, and relates to the technical field of remote sensing image processing, and the model comprises a feature representation and preliminary fusion coding module, a deep feature processing and fusion coding module, and a decoding and feature reconstruction module. A self-adaptive weighted fusion module is introduced into the feature representation and preliminary fusion coding module, and effective fusion of multi-modal data is realized by dynamically adjusting weights of different modal features; the deep feature processing and fusion coding module realizes gradual enhancement of features and deep fusion of cross-modal information through a multi-level sparse attention mechanism and a gating fusion mechanism combined with attention; and the decoding and feature reconstruction module recovers the low-resolution feature map generated by the encoder to the high resolution of the input image through step-by-step up-sampling and multi-scale feature fusion. The method is superior to the prior art in the aspects of calculation efficiency, segmentation precision and robustness for processing complex scenes.

The invention relates to the technical field of intelligent detection in the electronic manufacturing industry, in particular to a PCB warping degree intelligent evaluation system integrating visual positioning and multi-modal sensing, which comprises a multi-modal sensing unit, a visual positioning unit, an intelligent evaluation engine and a closed-loop control unit, the multi-modal sensing unit integrates laser displacement, infrared thermal imaging and strain sensors to acquire three-dimensional deformation, temperature and stress data; the visual positioning unit realizes sub-pixel-level positioning by using a high-resolution industrial camera and a feature point matching algorithm, and compensates vibration errors; the intelligent evaluation engine fuses data based on a time-space synchronization protocol, predicts a thermal deformation trend through an improved multi-modal convolutional neural network, and dynamically adjusts a qualified threshold value; and the closed-loop control unit executes sorting and rechecking according to an evaluation result, and optimizes warping and leveling parameters. According to the system, multi-dimensional accurate detection and intelligent control are realized, the PCB warping degree detection accuracy is effectively improved, the process can be dynamically optimized according to the production working condition, and the equipment fault risk is reduced.

The invention discloses a panchromatic sharpening method based on multi-resolution panchromatic feature guidance, which comprises the following steps: firstly, designing a multi-resolution feature extraction network based on a spatial frequency Transform module, and respectively extracting multi-scale features from panchromatic and up-sampled multispectral images; secondly, in order to restrain and optimize the extracted detail features, a multi-head self-attention-based texture injection module is adopted to extract a dependency relationship between panchromatic and multispectral features, and more similar detail features are guided to be injected; thirdly, in order to solve information loss caused by multispectral image up-sampling, multi-level detail features are injected into a multispectral reconstruction network, the detail features are learned step by step and reconstructed to a panchromatic image size, and a spectrum fusion module based on adaptive channel attention is utilized to reconstruct a fused image in a high-quality mode; and finally, optimizing the model performance by combining reconstruction loss based on L1 norm, structural similarity constraint and transmission perception loss in training. According to the method, the spectral fidelity and the spatial resolution of the fused image are remarkably improved.

The invention provides a textile defect detection method based on machine vision, and the method comprises the steps: obtaining a corresponding camera resolution parameter, an algorithm complexity parameter and a detection sensitivity parameter from a database according to a textile quality requirement, and carrying out the initialization setting of a machine vision system; performing feature extraction on the optimized textile surface image, extracting texture and morphological features related to wrinkle flaws, and constructing a feature spectrum capable of reflecting wrinkle features; identifying a suspected wrinkle flaw area in the characteristic spectrum, determining the contour of the flaw, and obtaining the position and range information of the wrinkle flaw; according to a pre-established wrinkle defect type database, performing mode matching on the quantized wrinkle characteristics, and if the matching degree exceeds a preset threshold value, determining the specific type of the wrinkle defect; and a support vector machine algorithm is adopted to classify the wrinkle degree quantitative indexes, wrinkle depth and density parameters are combined, different levels of wrinkle flaws are divided, and the wrinkle severity is evaluated.

The invention discloses an automatic labeling and acquisition standardization method and system based on video content, and the method comprises the steps: decoding a video file into a processable video frame sequence, carrying out the standardization processing, unifying the format and the coding standard, and adjusting the resolution and the frame rate; performing content analysis on the standardized video frame sequence, extracting key frames, identifying objects, scenes and actions, and generating a video analysis result and a preliminary label; according to a video content analysis result, separating an audio stream from the video to carry out noise reduction processing and voice-to-text analysis, and combining the processed text with the video content analysis result to generate multi-modal comprehensive annotation information; based on the comprehensive labeling information, taking feedback of the user in video retrieval, label clicking and watching behaviors as an adjustment basis of label weights, and updating weight distribution of labels by analyzing user behavior data; labeling information and weight distribution are integrated into an index database, and indexes are updated in real time according to user behaviors and content changes.

The invention discloses a fault detection method for high-resolution infrared thermal imaging display, and relates to the technical field of power equipment monitoring. According to the fault detection method for the high-resolution infrared thermal imaging display, a thermal imaging image of the surface of power equipment is obtained through high-resolution infrared thermal imaging equipment, dynamic correction is carried out on a temperature field in combination with environmental parameters and load current, and an interference-free temperature matrix is generated. The method comprises the following steps: modeling a heat conduction relationship between equipment by using a graph neural network, detecting a temperature abnormal region through a U-Net segmentation network, and generating an abnormal region mask and temperature space features; the time sequence correlation between temperature fluctuation and electrical parameters is analyzed through a dynamic time warping algorithm, and continuous faults and instantaneous interference are distinguished. And based on small sample transfer learning, in combination with a pre-training feature extractor and an attention mechanism, fault type classification is carried out, and fault types and confidence coefficients are output. Therefore, efficient and accurate detection of power equipment faults is realized.

The invention provides an optical lens high-precision three-dimensional reconstruction method and system, and the method comprises the steps: building a mapping relation between lens characteristics and three-dimensional reconstruction parameters according to the imaging principles, optical path structures and aberration characteristics of different optical lenses, and obtaining the parameter configuration of different lens types; obtaining optical lens parameters of a to-be-reconstructed scene, and preliminarily determining parameters including point cloud density, gridding resolution and texture mapping precision corresponding to the lens in combination with parameter configuration of different lens types; filtering, denoising and down-sampling are carried out on the high-density point cloud, triangularized grid reconstruction is carried out on the point cloud according to a set gridding resolution, and a gridding three-dimensional model of the scene is generated; original image information is mapped to the gridding three-dimensional model, the texture sampling rate and the fusion mode are controlled according to preset mapping precision, and a three-dimensional reconstruction model with vivid textures is obtained.

The invention relates to the technical field of photography focusing control, in particular to a photography focusing control method based on machine vision. Comprising the following steps: collecting and preprocessing multi-frame image data; detecting a target area in the image through a machine vision technology and a deep learning algorithm, marking a main body object and dynamically adjusting a focusing priority; extracting multi-dimensional visual features by using a sparse coding algorithm, and constructing a dynamic focusing optimization model based on the features to calculate an optimal focusing parameter; the imaging definition and the focusing effect are evaluated in real time through a fuzzy logic control algorithm, and focusing parameters are adjusted according to feedback; and the photographic equipment is controlled to generate a high-resolution focused image or video data, so that the optimal imaging effect is ensured. According to the method, artificial intelligence and an optimization algorithm are utilized, the intelligent level of the photographic equipment is improved, the focusing capability and the imaging quality of the photographic equipment in a complex scene are improved, convenient and efficient photographing experience is provided for a user, and meanwhile dependence on manual operation is reduced.

The invention provides a virtual reality building roaming method and system based on scene rendering, and relates to the technical field of virtual reality, and the method comprises the steps: dividing building three-dimensional model data through an octree space segmentation algorithm, and determining a detail level threshold according to a viewpoint distance, and constructing a multi-level detail model. And baking the basic illumination chartlet by using a pre-calculation irradiance transmission technology, and performing real-time synthesis in combination with the multi-resolution shadow chartlet. And calculating illumination by adopting a physics-based rendering method, and fusing the illumination with the scene light and shadow synthesis data to generate dynamic illumination rendering data. And determining a current viewpoint based on the spatial position and attitude data of the virtual reality head-mounted display, performing view cone elimination and shielding elimination, and performing GPU instantiation rendering on visible building data. And the rendered image is optimized through high dynamic range processing and a time domain anti-aliasing technology, and a final scene image is generated in combination with an atmospheric scattering algorithm. According to the invention, the rendering efficiency and scene reality sense of virtual reality building roaming can be effectively improved.

Disclosed systems and methods convert user-supplied textual content into animated videos. Textual input is received and processed to identify narrative elements such as characters, settings, and events. These elements are then transformed into visual scene components. Still images generated based on these components are subsequently animated in line with the narrative context. The system can automatically implement storytelling techniques adapted to incorporate neuroscience principles. The system also synthesizes speech for dialogues or narrations using voice synthesis technology that considers emotional markers, tone, and pace. Generated media and metadata are stored in a data storage system that maintains data integrity and enables efficient retrieval. Users can interact with an export interface to choose video resolution, format, and sharing options. A feedback system employing machine learning algorithms collects and analyzes user feedback for real-time adjustments to the generated animated video.

The invention provides a remote sensing image super-resolution method based on a diffusion model and a multi-modal large language model, and relates to the technical field of image processing. According to the method, a pre-trained stable diffusion model is adopted, the model is trained on a large-scale data set, the stable and detailed super-resolution effect can be achieved, and the convergence speed is higher. According to the method, a multi-mode large language model is used for enhancing the semantic comprehension ability of the model, and detailed content description and texture description are provided. The invention also introduces an additional classifier which provides global information and a simple signal about the LR. The prior information is adaptively integrated into a diffusion model through a cross attention module. And finally, through combination of the strong generation capability of the stable diffusion model and the semantic understanding capability of the MLLM, the method provided by the invention is excellent in the aspect of remote sensing image reconstruction, and excellent performance is realized in the aspect of quality of a plurality of images on different data sets.

According to the medical image segmentation method and device based on spatial perception and frequency domain information, the precision and robustness of medical image segmentation are effectively improved by combining frequency domain information guidance and a multi-head state spatial perception technology. Frequency domain transformation is performed on a medical image, high-frequency and low-frequency components of the image are separated by using a multi-scale decomposition technology, and low-frequency features are extracted to obtain global information. By introducing a learnable noise filtering mechanism, noise and irrelevant background information in a frequency domain are suppressed, so that the model can be focused on a lesion area more accurately. A multi-head perception visual state space module is designed on a bottleneck layer, lesion features of different scales are captured through a multi-scale adaptive feature fusion mechanism, and the capability of segmenting small-size lesions and complex structures is enhanced. A context focusing attention mechanism is introduced into jump connection, fusion of global information and local details is further enhanced, and the accuracy of a segmentation result is ensured; and finally, recovering a high-resolution segmented image through a decoder.

Systems and techniques are described for performing foveated sensing. In some aspects, a method (e.g., implemented by an image sensor) can include capturing sensor data for a frame associated with a scene, obtaining information corresponding to a region of interest (ROI) associated with the scene, generating a first portion (having a first resolution) of the frame corresponding to the ROI, generating a second portion of the frame having a second resolution, and outputting (e.g., to an image signal processor (ISP)) the first portion and the second portion. In some aspects, a method (e.g., implemented by an ISP) can receive, from an image sensor, sensor data for a frame associated with a scene, generating a first version (having a first resolution) of the frame based on an ROI associated with the scene, and generating a second version of the frame having a second resolution (lower than the first resolution).