86results about How to "Increase frame rate" patented technology

The invention provides a three-dimensional reconstruction method, device and equipment for an image in a capsule endoscope cavity, and belongs to the technical field of image processing. The method comprises the following steps: acquiring a first image set shot by the capsule endoscope in a cavity; performing frame rate enhancement on the first image set based on a pre-trained depth perception model to form a second image set; rejecting unqualified images in the second image set based on corner detection of each second image in the second image set to form a third image set; and recognizing three-dimensional scene information of the capsule endoscope based on the third image set, and performing three-dimensional reconstruction on the cavity based on the three-dimensional scene information. According to the method, the three-dimensional image reconstruction quality can be improved, and the three-dimensional reconstruction process does not need to depend on additional sensor equipment.

The invention provides a data zero-copy rendering optimization method and device based on hard decoding, and the method comprises the steps: creating a client display window, and initializing OpenGL ES equipment and EGL interface context; aVC video data to be decoded are acquired, and the AVC video data are decoded by using a video hard decoder, so that Mppframe information can be obtained; according to the Mppframe information, EGLImageKHR image data is created, according to the EGLImageKHR image data, and according to the EGLImageKHR image data, texture binding is carried out in a glEGLImageTargetTexture2DOES mode, and updating of texture data is completed. And executing texture drawing according to the texture data, a preset texture coordinate and a rendering state, and completing display rendering through eglSwap Buffer. The CPU consumption can be obviously reduced, and the high-quality and high-frame-rate rendering capability is supported.

The embodiment of the invention discloses an ultrasonic harmonic image generation method and device, electronic equipment and a medium. A specific embodiment of the method comprises the following steps: controlling an ultrasonic transmitting probe to transmit a low-frequency ultra-harmonic signal; controlling an ultrasonic receiving probe to receive the echo signal set to be detected; carrying out compressed sampling processing on the echo signal set to be detected and then carrying out signal reconstruction to obtain a reconstructed echo signal set; carrying out delay superposition processing on the reconstructed echo signal set to obtain a superposed echo signal; performing signal filtering decomposition processing on the superposed echo signals to obtain a super-harmonic signal set; performing envelope detection on the super-harmonic signal set to obtain an echo amplitude information set; and generating a target area ultrasonic harmonic image set, and sending the target area ultrasonic harmonic image set to a target terminal for display. According to the embodiment, by transmitting the low-frequency signal and receiving the ultra-harmonic signal, the attenuation of the received signal can be reduced, the signal penetration depth can be improved, the purity of the received signal can be improved, and the quality and the resolution of the generated ultrasonic harmonic image can be improved.

The invention discloses a model display control method and device based on a digital twin system, and a medium. The method comprises the following steps: acquiring comprehensive information of a model; performing polygon simplification on the components of the model according to the simplification rate of the components in the comprehensive information to obtain a simplified component set; and rendering the component set according to the attribute data of the component set, and performing display control on the component set of the rendered model. According to the model display control method and device based on the digital twin system and the medium, accurate polygon simplification is performed on model components by using the simplification rate, and the model data volume is remarkably reduced, so that the loading speed is increased, and the system performance is improved; according to the method, rendering and display control are carried out by utilizing the attribute data of the component set, so that the model can still present a high-quality visual effect after being simplified, and the problem that the loading speed of the model is difficult to improve so as to carry out effective display control on the model can be solved.

The invention discloses an ultrasonic full-focusing full-matrix data compression method which is based on the following steps: in a full-matrix acquisition process, because the distance between two adjacent array elements is very close, after the two adjacent array elements are excited, echo data sampled by all the array elements have extremely strong correlation; therefore, by calculating the residual error of the echo data of the two adjacent continuous array elements, as the correlation of the echo data acquired when the two adjacent continuous array elements are excited is very strong, a lot of small data exist in the difference value, and the FMC data can be greatly compressed in a lossless manner by adopting exponential Golomb coding on the difference value; therefore, the requirement of data transmission on bandwidth can be reduced, so that the real-time requirement of detection is met; and under the same data bandwidth, more full-matrix acquisition data can be transmitted, so that the frame rate of FMC full-focus imaging is improved.

The invention provides a lens-free dynamic imaging system and a lens-free dynamic imaging method with distinguishable motion. The system comprises a laser light source, a binary optical mask, an image sensor and image processing equipment, coherent light emitted by the laser light source is coded and modulated by the binary optical mask and then propagated to the image sensor, the image sensor collects multiple frames of diffraction images of a moving sample and transmits the collected images to the image processing device, and the image processing device reconstructs the images through a neural network method. According to the image reconstruction method, physical priori knowledge of a lensless diffraction propagation model is fused into implicit neural representation, and a space-time priori loss and bidirectional memory training method is designed for network training, so that artifacts and blur generated by moving target imaging can be effectively reduced, and a high-resolution and high-quality imaging result can be obtained.

The invention provides an instant depth acquisition method, a three-dimensional imaging method, equipment and a medium. The method comprises the following steps: acquiring a current-moment first point cloud frame of a to-be-acquired scene and a current-moment first image frame of the to-be-acquired scene; the first point cloud frame comprises first point cloud acquisition and a first depth map; the first image frame comprises a plurality of first target areas; the process of acquiring the point cloud acquisition at the next moment comprises the following steps: carrying out region adaptive scanning and global scanning on a scene to be acquired based on a plurality of first target regions of a first image frame, a first depth map and scanning angle resolutions set by different target regions; acquiring point cloud acquisition at the next moment; and acquiring a depth map at the next moment based on point cloud acquisition at the next moment. According to the method, on the basis of the point cloud and the image frame at the current moment, the point cloud collection and the depth map at the next moment can be obtained in real time, and real-time obtaining and processing of depth information are achieved.

The invention provides a multi-shape batch rendering method suitable for a GPU without hardware batch processing capability, and relates to the technical field of computer graphic rendering, the method comprises the following steps: pre-defining path drawing instruction templates of various graphic primitives and text characters; traversing and analyzing all to-be-rendered graphics and text elements of the current frame, and uniformly converting the to-be-rendered graphics and text elements into a path instruction sequence and coordinate parameters; separately storing the instruction and the parameter in a global array; sorting and combining all elements according to the rendering hierarchy to generate a global instruction stream and a parameter stream; and finally, packaging the complete instruction stream and the parameter stream into a single drawing command, and submitting the single drawing command to a GPU (Graphics Processing Unit) through one-time calling to complete the whole-frame rendering. According to the method, unified batch processing of graphs and texts on the path level can be realized, the GPU calling times are remarkably reduced, and the interface rendering efficiency and smoothness on resource-limited equipment such as smart watches and health bracelets are greatly improved.

The application provides an image acquisition module, an electronic device and a face image acquisition system, and relates to the technical field of image acquisition.The image acquisition module comprises an image sensor and a light source driving module;an output end of the image sensor is electrically connected with a first input end of the light source driving module, and the output end of the image sensor outputs a light-on control signal;an output end of the light source driving module is electrically connected with a light source;the image sensor is used for acquiring an image;and the light source driving module is used for driving the light source.In this way, the image acquisition module is used, the light-on control signal is issued and image acquisition are both performed by the image sensor, so that the control process of image acquisition is simplified;the light source driving module is controlled to light up the light source by the sensor outputting the light-on control signal, and the image acquisition is correspondingly matched with the image acquisition of the sensor, so that high-frame-rate image acquisition is realized.

This invention provides a visual sensor chip, comprising a pixel array composed of pixel units; wherein each pixel unit has a corresponding temporal difference path and a spatial difference path, or a corresponding intensity path, a temporal difference path, and a spatial difference path. This invention integrates the dual-path characteristics of the human visual system into existing visual sensor chips, thereby significantly improving the chip's ability to perceive spatiotemporal dynamic information and achieving high-precision, high-frame-rate, high-dynamic-range, and highly efficient and robust visual representation.

The application relates to a method and system for realizing 90-degree integer multiple rotation of an image, wherein the method comprises the following steps: an FPGA receives original image data output by an image sensor and image processing parameters issued by an ARM, the image processing parameters at least including width, height and a rotation angle, wherein the rotation angle is an integer multiple of 90 degrees; the original image data is preprocessed and demosaiced to obtain a full-color image in RGB or YUV format; according to the width, height and rotation angle of the image, a coordinate transformation formula for 90-degree integer multiple rotation is used to determine the position mapping relationship between each source pixel in the full-color image and a target pixel after rotation; the full-color image is written into a BRAM cache in a ping-pong mode, and each pixel is read according to the order of the position mapping relationship and written into a target address in a DDR, wherein the target address in the DDR is calculated according to the position relationship.

This invention discloses a CPWC beamforming method based on adaptive parameter zero-subtraction imaging, applied to ultrasound imaging signal processing. It involves transmitting ultrasonic waves to a target object using an ultrasound array element module and acquiring the echo imaging signal dataset; calculating a time-delayed imaging dataset based on the echo imaging signal dataset using a delay processing module; calculating an adaptive offset parameter based on the time-delayed imaging dataset using a model combining the generalized coherence factor and the mean-standard deviation coefficient; and calculating the final imaging beamforming signal using a zero-subtraction imaging beamforming model based on the adaptive offset parameter and the time-delayed imaging dataset. This method effectively solves the contrast-resolution-speckle quality trade-off problem caused by fixed offset in zero-subtraction imaging, improving imaging quality, and is particularly suitable for high-frame-rate ultrasound CPWC imaging.

The invention discloses a high-dynamic optical spectral imaging system and imaging method suitable for a dynamic scene, belongs to a photoelectric sensor imaging system, solves the problem of complicated operation of a high-dynamic imaging system, and comprises a front lens module, a variable-ratio splitter module, a variable integral exposure module and an imaging module, wherein the front lens module is used for adjusting an aperture and a focal length, the imaging system generally adopts a rear light splitting single-camera system form, and a main body adopts a set of front imaging optical-mechanical system to adapt to the limitation of a large-aperture camera on weight, cost and structural complexity; the imaging module adopts two paths of sensors to image a motion scene at the same time, so that registration and image artifacts caused by multi-frame imaging are avoided; a flexible acquisition strategy is introduced into the imaging method, and each path of sensor enables the capturable brightness intervals of the sensors to be overlapped through variable integral time exposure, so that the expansion of the dynamic range of the system is completed.

A method and system for fusing visual positioning with visual odometer pose, relying on a real-time high-frame-rate visual odometer and visual positioning pose running on a device, and eliminating poses with large positioning errors through RANSAC's Sim3 estimation. By solving the loose coupling of the transformation matrix parameters, a stable similarity transformation from visual odometer to visual positioning is obtained. The stable similarity transformation is converted into a smooth similarity transformation through linear interpolation to avoid pose jumping, and the high-frame-rate visual odometer is converted to a visual positioning coordinate system in real time through a smooth similarity transformation to obtain a pose with the same frame rate as the visual odometer. Compared with the pose obtained by direct positioning, the pose obtained by the method and system for fusing visual positioning with visual odometer pose of the present invention has higher accuracy, better stability, and higher frame rate, and has higher practical value.

The invention provides a casting model mesh simplification method based on a Unity 3D platform, which reduces the rendering and calculation burden by simplifying the mesh structure of a casting model and reducing the number of vertexes and triangular surfaces of the model, solves the problem of higher rendering pressure caused by high complexity of the casting 3D model, and improves the rendering efficiency. And the accuracy of the 3D model is ensured while the simplification is realized.

A light-receiving element according to an embodiment of the present disclosure includes: a semiconductor substrate (11) including a photoelectric conversion region; a first first electrically-conductive region (13A) provided at an interface of one surface of the semiconductor substrate (11) and coupled to a first electrode (16); a second first electrically-conductive region (13B) provided at the interface of the one surface and around the first first electrically-conductive region (13A) and coupled to a second electrode (17); and a third first electrically-conductive region (13C) provided at the interface of the one surface and around the second first electrically-conductive region (13B) and being in an electrically floating state.

Techniques for operating an AR system include determining a hand gesture formed by a user based on a sequence of two-dimensional images acquired from a near-infrared camera across a skin of a wrist of the user. Specifically, an image capture device disposed on a band worn on a user's wrist includes a source of electromagnetic radiation, such as a light emitting diode in the IR wavelength band in the user's wrist, and an infrared (IR) detector that produces a two-dimensional image sequence of a region within the dermis layer in the user's wrist. From this sequence, gesture detection circuitry determines a value of a biological flow metric, e.g., a change in a perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the value of the bio-flow metric to the specific hand / finger movement that determines the gesture.

The invention relates to the technical field of spectral imaging, in particular to a non-angle-sensitive silicon-based video multispectral imaging system, which comprises a first lens, a second lens, an aperture diaphragm, a triplet lens, a doublet lens, a third lens and a beam splitting module which are sequentially arranged along an optical axis from an object plane to an image plane, an incident light beam sequentially passes through the first lens, the second lens, the aperture diaphragm, the triplet lens, the doublet lens and the third lens to enter the beam splitting module for beam splitting, and a first light beam and a second light beam are obtained. The first camera receives the first light beam and performs imaging, and the second camera receives the second light beam and performs imaging. According to the invention, the influence of the light included angle can be eliminated through the optical structure, additional calculation of the spectral image is not needed, and the spectral measurement precision is improved.

The invention relates to the technical field of endoscope imaging, in particular to an ultrahigh-frame-rate endoscope photoacoustic imaging system and an imaging processing method, which are based on a control unit, accurately synchronizes a time sequence to control emission of pulse laser, high-speed scanning of a high-speed scanning galvanometer and acquisition of photoacoustic signals. And performing three-dimensional SVD tissue suppression, interactive ROI extraction, light intensity consistency positioning, independent component SVD filtering and mode-based speed correction on the acquired photoacoustic signals to obtain a dynamic map containing the blood flow velocity and the flow velocity vector direction, thereby realizing photoacoustic endoscopic imaging with ultrahigh frame rate in the visual field range of the endoscope. The high-frame-rate blood flow vectorization measurement is further realized, and the method is suitable for dynamic monitoring and quantitative analysis of the blood flow of the microcirculation of the visceral organs.

The invention discloses a grid detail level-based fixation point rendering method and device, and the method comprises the steps: carrying out the segmentation and simplification of a to-be-rendered grid, obtaining a micro-grid of each level of detail level, recording the related information of the micro-grid, including a detail level bounding ball and a detail level error of the micro-grid, a detail level bounding ball and a detail level error of a parent micro-grid of the micro-grids; in each frame, using a camera, fixation point information and micro-grid related information to select micro-grids of each level of detail level; and rendering all the selected micro-grids for each frame by using a grid shader, so that the rendering overhead can be greatly reduced and the rendering frame rate can be improved under the condition that the picture impression of a user is not obviously reduced.

The present application relates to the technical field of machine vision, and provides a multi-view camera relative pose estimation method based on IMU rotation axis direction prior, comprising: depth parameterization is carried out to the translation vector formed by a multi-view camera system from a first time to a second time, and the generalized epipolar constraint of the multi-view camera system is reconstructed based on the depth parameter; the relative pose estimation problem of the multi-view camera in the multi-view camera system is converted into a single variable cubic polynomial root seeking by using the rotation axis direction prior information provided by an inertial measurement unit and combining the reconstructed generalized epipolar constraint; after single variable root seeking, the rotation matrix and the translation vector of the multi-view camera system from the first time to the second time are solved based on the root seeking result, and the relative pose estimation result is obtained. While maintaining competitive estimation accuracy, the calculation efficiency can be significantly improved, and the present application provides an efficient and practical scheme for the implementation of multi-view vision positioning in an automatic driving system.

The application provides a video rendering method and system based on a computing shader and Xpixmap, compared with an opengl display and a graphics pipeline mode, the computing shader can fully call general computing resources of a GPU, as long as the computing resources are sufficient, high resolution and high frame rate video rendering can be supported, and the processing capacity is greatly improved compared with the graphics pipeline mode. Compared with the opengl display mode, the use of the Xpixmap display mode reduces the multiple copying of the video frame, and further improves the efficiency of the video rendering and display. The scheme fully calls the computing resources of the GPU, renders YUV into RGBA and directly stores in the buffer area corresponding to the Xpixmap, and then uses the X function to submit the display, compared with the opengl display and the graphics pipeline mode, the scheme has higher efficiency, stronger processing capacity and adaptability, and is especially suitable for a graphics processing pipeline with insufficient capacity but powerful general computing capacity.

A processor of a control device for controlling an optical sensor that receives reflected light of irradiation light for each scanning line Ls switched along a scanning direction alpha in a scanning frame Fs. An integer of 2 or more is defined as N, and a region in which N rows of light-receiving elements are arranged in the scanning direction (alpha) in the optical sensor is defined as a region of interest (ROI) in which light-receiving data is read for each scanning line (Ls). The processor performs: shifting a region of interest (ROI) of each scan line (Ls) by an amount of a light-receiving element column (47) that is equal to or less than (N-1) columns in each of successive scan frames (Fs); and integrating the light reception data read out from the region of interest (ROI) of each scan line (Ls) for each scan frame (Fs) by the amount of scan frames (Fs) from the current to the past (N-1) frame, thereby outputting as sensing data.

The invention relates to a focal plane readout circuit in an imaging system, in particular to a high-linearity low-power-consumption analog readout circuit based on charge transmission, and belongs to the technical field of photoelectronics and microelectronics. The reading circuit is especially suitable for but not limited to a CMOS image sensor and an infrared detector.

The application discloses a kind of double host electronic glasses and its image acquisition, processing and display method, belong to image processing technical field, a kind of double host electronic glasses, including: glasses frame, monocular vst perspective unit and the power supply unit compatible with monocular vst perspective unit, the monocular vst perspective unit is equipped with two groups, and two groups monocular vst perspective unit respectively independently handles the image of left and right eyes, the monocular vst perspective unit includes, display component, the display component includes optical module and micro display screen;Sampling component, the sampling component includes corresponding camera module with display component;Soc host unit, the Soc host unit undertakes corresponding monocular image processing task;Realize the frame level synchronous display and the relatively synchronous display of degradable under the premise of not forwarding image data of double eyes, to ensure that electronic glasses can still maintain at least single eye real-time picture output under abnormal condition, high-speed data link is equipped between the Soc host unit.

The present invention proposes a millimeter wave synthetic aperture radar imaging device based on an arc antenna array, comprising a control and processing terminal, a mechanical rotating mechanism and a SISO linear array, wherein the SISO linear array comprises a plurality of transceiver array elements, the plurality of transceiver array elements are arranged in an arc shape, and the distance between two adjacent transceiver array elements is the same, the SISO linear array is arranged on the mechanical rotating mechanism, the control and processing terminal is respectively connected to the mechanical rotating mechanism and the SISO linear array signal, and the control and processing terminal is loaded with a SAR imaging algorithm of an echo signal. The device breaks through the limitations of traditional SISO-SAR by introducing a one-dimensional arc SISO linear array and combining it with a mechanical rotating structure, increases the viewing angle, and realizes all-round imaging of the environment.

The invention discloses an image processing method, device and equipment and a readable storage medium, and belongs to the technical field of video processing. The method is executed by a terminal and comprises the following steps: acquiring multiple frames of images continuously acquired by an image sensor; processing the multiple frames of images based on at least one fusion strategy to obtain target images, wherein the target images are a group of images used for high dynamic range image processing; wherein the fusion strategy is used for indicating at least one of the following items: a reference image; fusing the auxiliary images; fusing the number of images contained in the target; and outputting the frame rate.

The invention relates to the technical field of artificial intelligence and medical first-aid robots, and provides a multi-body-position neck area visual perception method and system for unmanned autonomous cricothyroid membrane puncture in order to solve the problems that missing detection or false detection is likely to occur and the system robustness is seriously insufficient at present. Comprising the following steps: S1, constructing a first-aid airway neck data set; s2, on the basis of the first-aid airway neck data set, constructing a lightweight YOLOv8n target detection model; s3, the lightweight YOLOv8n target detection model is trained; and S4, carrying out evaluation on the trained lightweight YOLOv8n target detection model. Training is carried out based on a self-built EAND multi-body-position neck area data set, and the YOLOv8n model can effectively adapt to neck shape changes under various non-standard body positions such as supine, side-lying and semi-sitting. In a real test set containing complex illumination, clothes shielding and motion blur, the model accuracy reaches 0.988, mAP 0.5 reaches 0.964, the method is obviously superior to other methods, and the problem that a traditional model fails after changing a body position due to data deviation is solved.

The present application relates to the field of photoelectric detection and intelligent identification, in particular to a cat-eye target detection active imaging system and method based on intelligent vision, comprising: an active illumination module for outputting a pulse laser with adjustable parameters, actively illuminating a target scene, and exciting a cat-eye effect backscatter echo of an optical device in the target scene; a coaxial imaging acquisition module for receiving the backscatter echo of the target scene and collecting information; an intelligent vision processing module for intelligently processing the received image data, outputting target information and scene perception data; an adaptive control module for constructing a closed-loop control link according to the scene perception data and the target information; a display and storage module for realizing human-computer interaction, displaying and storing real-time imaging pictures and target information. Thus, the problems of high false alarm rate, limited detection distance, poor environmental adaptability, and inability to realize target fine classification and continuous tracking in the prior art are solved.

The present invention discloses a method for estimating continuous human posture based on key point motion estimation, which applies a motion estimation block matching algorithm to human key point tracking to obtain a continuous human posture result, and uses a human posture estimator based on a deep neural network to continuously correct the result. The present invention can realize the estimation of continuous human posture in a video stream, wherein the human posture is specifically reflected in the coordinate position of the key points of the human body in the video frame. Compared with the posture estimation method that completely relies on a deep neural network, the posture estimation method proposed by the present invention has the advantages of high frame rate, low hardware requirements, and the recognition result has the advantages of time series continuity; compared with the posture estimation method that completely relies on the motion estimation algorithm, the present invention can correct the accumulated error and improve the estimation accuracy.