30results about How to "Increase frame rate" patented technology

The invention provides a multi-shape batch rendering method suitable for a GPU without hardware batch processing capability, and relates to the technical field of computer graphic rendering, the method comprises the following steps: pre-defining path drawing instruction templates of various graphic primitives and text characters; traversing and analyzing all to-be-rendered graphics and text elements of the current frame, and uniformly converting the to-be-rendered graphics and text elements into a path instruction sequence and coordinate parameters; separately storing the instruction and the parameter in a global array; sorting and combining all elements according to the rendering hierarchy to generate a global instruction stream and a parameter stream; and finally, packaging the complete instruction stream and the parameter stream into a single drawing command, and submitting the single drawing command to a GPU (Graphics Processing Unit) through one-time calling to complete the whole-frame rendering. According to the method, unified batch processing of graphs and texts on the path level can be realized, the GPU calling times are remarkably reduced, and the interface rendering efficiency and smoothness on resource-limited equipment such as smart watches and health bracelets are greatly improved.

This invention provides a visual sensor chip, comprising a pixel array composed of pixel units; wherein each pixel unit has a corresponding temporal difference path and a spatial difference path, or a corresponding intensity path, a temporal difference path, and a spatial difference path. This invention integrates the dual-path characteristics of the human visual system into existing visual sensor chips, thereby significantly improving the chip's ability to perceive spatiotemporal dynamic information and achieving high-precision, high-frame-rate, high-dynamic-range, and highly efficient and robust visual representation.

The application relates to a method and system for realizing 90-degree integer multiple rotation of an image, wherein the method comprises the following steps: an FPGA receives original image data output by an image sensor and image processing parameters issued by an ARM, the image processing parameters at least including width, height and a rotation angle, wherein the rotation angle is an integer multiple of 90 degrees; the original image data is preprocessed and demosaiced to obtain a full-color image in RGB or YUV format; according to the width, height and rotation angle of the image, a coordinate transformation formula for 90-degree integer multiple rotation is used to determine the position mapping relationship between each source pixel in the full-color image and a target pixel after rotation; the full-color image is written into a BRAM cache in a ping-pong mode, and each pixel is read according to the order of the position mapping relationship and written into a target address in a DDR, wherein the target address in the DDR is calculated according to the position relationship.

The invention relates to the technical field of endoscope imaging, in particular to an ultrahigh-frame-rate endoscope photoacoustic imaging system and an imaging processing method, which are based on a control unit, accurately synchronizes a time sequence to control emission of pulse laser, high-speed scanning of a high-speed scanning galvanometer and acquisition of photoacoustic signals. And performing three-dimensional SVD tissue suppression, interactive ROI extraction, light intensity consistency positioning, independent component SVD filtering and mode-based speed correction on the acquired photoacoustic signals to obtain a dynamic map containing the blood flow velocity and the flow velocity vector direction, thereby realizing photoacoustic endoscopic imaging with ultrahigh frame rate in the visual field range of the endoscope. The high-frame-rate blood flow vectorization measurement is further realized, and the method is suitable for dynamic monitoring and quantitative analysis of the blood flow of the microcirculation of the visceral organs.

The present application relates to the technical field of machine vision, and provides a multi-view camera relative pose estimation method based on IMU rotation axis direction prior, comprising: depth parameterization is carried out to the translation vector formed by a multi-view camera system from a first time to a second time, and the generalized epipolar constraint of the multi-view camera system is reconstructed based on the depth parameter; the relative pose estimation problem of the multi-view camera in the multi-view camera system is converted into a single variable cubic polynomial root seeking by using the rotation axis direction prior information provided by an inertial measurement unit and combining the reconstructed generalized epipolar constraint; after single variable root seeking, the rotation matrix and the translation vector of the multi-view camera system from the first time to the second time are solved based on the root seeking result, and the relative pose estimation result is obtained. While maintaining competitive estimation accuracy, the calculation efficiency can be significantly improved, and the present application provides an efficient and practical scheme for the implementation of multi-view vision positioning in an automatic driving system.

The application provides a video rendering method and system based on a computing shader and Xpixmap, compared with an opengl display and a graphics pipeline mode, the computing shader can fully call general computing resources of a GPU, as long as the computing resources are sufficient, high resolution and high frame rate video rendering can be supported, and the processing capacity is greatly improved compared with the graphics pipeline mode. Compared with the opengl display mode, the use of the Xpixmap display mode reduces the multiple copying of the video frame, and further improves the efficiency of the video rendering and display. The scheme fully calls the computing resources of the GPU, renders YUV into RGBA and directly stores in the buffer area corresponding to the Xpixmap, and then uses the X function to submit the display, compared with the opengl display and the graphics pipeline mode, the scheme has higher efficiency, stronger processing capacity and adaptability, and is especially suitable for a graphics processing pipeline with insufficient capacity but powerful general computing capacity.

The invention relates to a focal plane readout circuit in an imaging system, in particular to a high-linearity low-power-consumption analog readout circuit based on charge transmission, and belongs to the technical field of photoelectronics and microelectronics. The reading circuit is especially suitable for but not limited to a CMOS image sensor and an infrared detector.

The application discloses a kind of double host electronic glasses and its image acquisition, processing and display method, belong to image processing technical field, a kind of double host electronic glasses, including: glasses frame, monocular vst perspective unit and the power supply unit compatible with monocular vst perspective unit, the monocular vst perspective unit is equipped with two groups, and two groups monocular vst perspective unit respectively independently handles the image of left and right eyes, the monocular vst perspective unit includes, display component, the display component includes optical module and micro display screen;Sampling component, the sampling component includes corresponding camera module with display component;Soc host unit, the Soc host unit undertakes corresponding monocular image processing task;Realize the frame level synchronous display and the relatively synchronous display of degradable under the premise of not forwarding image data of double eyes, to ensure that electronic glasses can still maintain at least single eye real-time picture output under abnormal condition, high-speed data link is equipped between the Soc host unit.

The invention relates to the technical field of artificial intelligence and medical first-aid robots, and provides a multi-body-position neck area visual perception method and system for unmanned autonomous cricothyroid membrane puncture in order to solve the problems that missing detection or false detection is likely to occur and the system robustness is seriously insufficient at present. Comprising the following steps: S1, constructing a first-aid airway neck data set; s2, on the basis of the first-aid airway neck data set, constructing a lightweight YOLOv8n target detection model; s3, the lightweight YOLOv8n target detection model is trained; and S4, carrying out evaluation on the trained lightweight YOLOv8n target detection model. Training is carried out based on a self-built EAND multi-body-position neck area data set, and the YOLOv8n model can effectively adapt to neck shape changes under various non-standard body positions such as supine, side-lying and semi-sitting. In a real test set containing complex illumination, clothes shielding and motion blur, the model accuracy reaches 0.988, mAP 0.5 reaches 0.964, the method is obviously superior to other methods, and the problem that a traditional model fails after changing a body position due to data deviation is solved.

The invention discloses a Gaussian splash rendering method and device based on a UE5 rendering pipeline. The method comprises the following steps: acquiring an attribute set of each three-dimensional Gaussian and transmitting the attribute set to a CUDA renderer; determining each visible three-dimensional Gaussian; calculating a three-dimensional Gaussian color for the visible three-dimensional Gaussian; partitioning a screen to obtain screen blocks; a screen space bounding box of the visible three-dimensional gausses is calculated, and intersection testing is carried out on the screen blocks and the two-dimensional gausses corresponding to the visible three-dimensional gausses; for each screen block, sorting each two-dimensional Gaussian according to a z component value of a camera space Gaussian position of each visible three-dimensional Gaussian according to an intersection test result, and calculating a first color corresponding to each pixel in the screen block according to a sorting result and each three-dimensional Gaussian color; and comparing the z component value corresponding to each visible three-dimensional Gaussian with the scene depth map in the UE5 engine, calculating a second color according to the comparison result, each first color and the scene color map, and outputting the second color. The rendering efficiency is improved, and the color distortion degree is reduced.

The invention provides a pixel reading circuit and a control method thereof, and the pixel reading circuit comprises a photoelectric conversion module, a gain adjustment module, a correlated double sampling module, a gain control feedback module and an output module. The gain adjusting module is used for carrying out integral processing on the light current signal to obtain integral voltage, the correlated double sampling module is used for sampling the integral voltage to obtain effective signal voltage, and the gain control feedback module is used for generating a gain control signal based on the effective signal voltage so as to adjust integral gain. And the output module buffers and outputs the effective signal voltage. According to the circuit provided by the invention, the correlated double sampling function is integrated in the pixel, the number of used switches is small, time sequence control is simple, the pixel area is reduced, the chip integration degree is high, multiple times of transmission of signals between the pixel and the column-level circuit is avoided, the processing pressure of the column-level circuit is relieved, and the system frame rate is improved.

The present disclosure provides an image sensor and a driving method. The driving method includes the following steps. During a standard scan in a high frame rate mode, a plurality of first control signals generated according to a first clock pulse frequency are provided by a portion of a plurality of drivers to a plurality of target gate lines included in a portion of a plurality of gate line groups. During a fast scan in the high frame rate mode, a plurality of second control signals generated according to a second clock pulse frequency are provided by the portion of the plurality of drivers to a plurality of remaining gate lines included in the portion of the plurality of gate line groups, and the first clock pulse frequency is slower than the second clock pulse frequency.

This application provides a method, electronic device, and medium for generating a fused radar envelope, relating to the field of three-dimensional radar information display technology. The method includes: generating a corresponding envelope geometry model based on the parameters of each radar in a multi-radar array using a three-dimensional digital earth visualization tool; extracting the vertex coordinates and inter-vertex indices of multiple first vertices in the envelope geometry model, and performing coordinate system transformation on the vertex coordinates of the multiple first vertices; constructing a buffer geometry model for each radar based on the transformed vertex coordinates and inter-vertex indices using a three-dimensional graphics processing tool; fusing the multiple buffer geometry models corresponding to the multiple radars; coloring the fused mesh model according to the multiple overlaps corresponding to multiple second vertices in the fused mesh model; and generating a fused radar envelope representing the coverage relationship of multiple radars that can be displayed in a web browser.

The application provides a dynamic image enhancement method and system based on liquid crystal polarization adaptive modulation, and relates to the technical field of optical imaging and information processing. The method comprises the following steps: collecting target polarization observation images under illumination light of different polarization states, and constructing a polarization image sequence; establishing a mathematical model of a voltage-phase delay response model and a modulation intensity model containing a liquid crystal polarization modulator; fitting model parameters of the modulation intensity model according to the current polarization image sequence, and judging convergence by using a sampling uncertainty evaluation function; if convergence is achieved, the optimal model parameters of the modulation intensity model are determined; if convergence is not achieved, new target polarization observation images are collected and re-evaluated until convergence is achieved; and according to the optimal model parameters, a spatio-temporal joint constraint-based enhancement reconstruction model is used to reconstruct the current polarization image sequence, so as to generate an enhanced image and a dynamic enhancement video stream. The application can separate target signals and noise components in real time and with high precision, and realizes dynamic image enhancement.

The utility model discloses a double-host glasses framework with multiplied computing power, which belongs to the technical field of image processing, two groups of Soc host units in local closed-loop operation are arranged in the glasses framework, the two groups of Soc host units respectively and independently process images of left and right eyes, a high-speed data link is arranged between the Soc host units, and the Soc host units are connected with the high-speed data link. The Soc host units undertake image processing tasks of corresponding single eyes, respectively process image data of the left eye and the right eye in parallel through the two groups of independent Soc host units to form a local closed loop, and cooperatively work by using a high-speed data link which only transmits control information; therefore, calculation power multiplication is realized while a binocular pixel path is decoupled, the display delay is remarkably reduced, and the redundancy safety of the system is improved.

The application discloses a target capturing method based on vision and 3D radar, and belongs to the field of data processing, aiming to solve the problem of high precision requirement of 3D laser radar in identifying target objects. In the method, the target object is detected in real time through visual recognition, and when the target object is detected, the central angle thereof is output and transmitted to the 3D laser radar algorithm part through ROS2 topic communication. After the 3D laser radar receives the output angle value a0, data processing is performed to obtain a fifth distance; and then the obtained M fifth distances are sequentially subjected to average filtering, low-pass filtering, Kalman filtering and difference filtering, so that the final distance is obtained. The application can realize real-time capturing and positioning of the target object at a frequency of more than 10 Hz at a low cost, and complete the target object tracking task with long distance, high precision, high reliability and high frame rate. The final distance error obtained by the method is less than 5 cm.

This disclosure provides a model tile loading method, apparatus, and storage medium. The method includes: determining the user's browsing state based on first and second information; abandoning the dequeueing operation of tile identifier information in the network resource loading queue in response to the browsing state being fast browsing; performing the dequeueing operation of tile identifier information in the network resource loading queue in response to the browsing state being normal browsing; loading the tile identified by the dequeueed tile identifier information in response to the tile being visible in the current frame; and abandoning the loading of the tile identified by the dequeueed tile identifier information in response to the tile being not visible in the current frame. This disclosure can avoid invalid downloads of network resources and avoid CPU consumption caused by parsing downloaded resources, indirectly improving the frame rate of browsing VR space.

The invention discloses a display device and a video signal display method. The display device comprises a display; the controller is in communication connection with the display and is configured to extract resolution information of the current video signal according to the decoded video signal; when the resolution represented by the resolution information is smaller than a preset resolution, preprocessing the video signal to obtain a standard video signal, and controlling a logic board of the display to be adjusted to a multiplying mode so as to output the standard video signal; and when the resolution represented by the resolution information is greater than or equal to a preset resolution, preprocessing the video signal to obtain a standard video signal, and controlling a logic board of the display to be adjusted to a common mode so as to output the standard video signal. According to the invention, the output mode of the display can be dynamically switched according to the resolution of the video signal, the smooth display frame of the low-resolution video signal is ensured, the problem that the definition of the high-resolution video signal is reduced is avoided, and the user experience is improved.

The application discloses a convolutional neural network lightweight method based on YOLOv3, first, ordinary convolution kernels in the convolutional neural network of YOLOv3 are split into depth convolution DW and point convolution PW; then, the L2 norm calculation bounding box loss in the convolutional neural network of YOLOv3 is changed into generalized intersection over union calculation loss; finally, the improved YOLOv3 is mapped into FPGA by Xilinx Vitis AI, and the lightweight algorithm is verified by inference in FPGA. The improved algorithm has the advantages of obviously reduced model size and calculation amount, and the detection accuracy is not obviously reduced; meanwhile, the frame rate is improved, and the performance of real-time operation and inference of the algorithm in the edge device is ensured.

The utility model discloses an endoscope system and light source device thereof, light source device includes: light source subassembly, including at least three light source parts, at least three light source parts are used for emitting different spectrum's light respectively, at least three light source parts include first light source group and second light source group, first light source group includes at least one light source part, and second light source group includes at least two light source parts, switching component, for switching shielding to the light path of each light source part contained in second light source group, make the light of each light source part contained in second light source group emit and emit alternately to light combination component, light combination component is used for the light of different spectrum is converged and emits to endoscope mirror body. The utility model discloses an endoscope system can fuse multiple imaging modes and can switch different imaging modes flexibly, and can reduce the complexity of light source device control, prolong the light source life and improve frame rate, can also make endoscope's camera device volume reduce.

This invention discloses a high frame rate ultrasound plane wave tensor completion method based on T-SVD and angle regularization, belonging to the field of ultrasound imaging technology. The method includes: acquiring data; encoding selected and unselected angles into TCP codes; transmitting the encoded image along a specified angle; constructing a mask matrix Ω to form an incomplete tensor X containing partially known data; zero-padding the acquired RF data to expand it to the full size; reconstructing the data corresponding to the missing angles from the incomplete tensor; iteratively solving the problem using the alternating direction multiplier method; determining whether the convergence error convergence criterion has been met; and, after iteration, completing the tensor X to obtain the full angles. Composite imaging is then performed based on the obtained complete RF data. This invention solves the problems of slow convergence speed, high computational complexity, and unsmooth completion results in existing tensor completion algorithms. Under conditions of extremely limited angle sampling, this invention achieves a balance between high frame rate and high quality in ultrasound imaging through efficient low-rank tensor completion.

This application relates to the field of laser projection 3D reconstruction technology, and discloses a global depth estimation method, system, medium, and program product based on multi-line lasers. The laser projection 3D reconstruction system includes a camera and four laser light sources. The camera is located at the center of a quadrilateral formed by the laser light sources. The laser light sources in the horizontal direction emit lasers of the same wavelength, while those in the vertical direction emit lasers of different wavelengths. The method includes: performing laser separation on the laser projection image acquired by the camera to obtain two image matrices; processing each image matrix based on the camera's intrinsic parameter matrix and the calibrated laser curve mapping relationship to obtain a contour point cloud; performing point cloud completion on the image matrix containing the contour point cloud using a visual basic model to obtain a depth map; and converting the depth map into an image containing a globally dense point cloud. This application enables the acquisition of reconstructed images with high frame rate and high accuracy of the global field of view.

The application relates to a BIM model vector data processing method and system, wherein the method comprises the following steps: converting component geometric information of a BIM model into vectorized data. Based on the vectorized data, a spatial hierarchical index structure is established, wherein the hierarchical index structure is used for storing spatial positions and topological relations among components. The vectorized data is compressed and stored in slices based on the spatial positions, so that optimized vectorized data is obtained. Through a parallel computing framework, the optimized vectorized data is processed in parallel, so that data processed in parallel is obtained. Through a standardized interface, the data processed in parallel is output, so as to support cross-platform applications. The application solves the problem of how to improve the BIM model vector data processing efficiency in the related art.

The application provides a point cloud data processing method, system and device based on spatial serialization, the method comprising: sorting point cloud data by using a six-way standard sequence sorting method to obtain point cloud data sequences; dynamically and automatically selecting focal point blocks in the sequenced data according to a view cone and screen projection error, and dynamically adjusting the LOD level of each focal point block to obtain sequenced LOD data; after the sequenced LOD data is managed by VIBO block management, performing triangle optimization reconstruction; using a UV space remapping algorithm, performing patch and texture alignment processing on the point cloud surface after triangle optimization reconstruction, and performing multi-format texture packing to complete rendering output. The application reduces unnecessary calculation and memory access through dynamic adjustment of the LOD of the focal point block and VIBO block caching. Through dynamic LOD adjustment and optimized triangle reconstruction technology, combined with efficient texture packing and decompression, the rendering frame rate can be significantly improved while details are maintained.

This application relates to the field of endoscopic imaging technology, and in particular to an ultra-high frame rate endoscopic photoacoustic imaging system and imaging processing method. Based on the precise synchronous timing control of pulsed laser emission by the control unit, high-speed scanning of the high-speed scanning galvanometer, and acquisition of photoacoustic signals, the system performs three-dimensional SVD tissue suppression, interactive ROI extraction, light intensity consistency localization, independent component SVD filtering, and mode-based velocity correction on the acquired photoacoustic signals to obtain a dynamic spectrum containing the magnitude and direction of blood flow velocity. This achieves ultra-high frame rate photoacoustic endoscopic imaging within the endoscopic field of view, and further enables high frame rate blood flow vectorization measurement, which is suitable for dynamic monitoring and quantitative analysis of organ microcirculation blood flow.

The application provides a pixel unit, a pixel array, an image sensor and a traffic device. The pixel unit comprises: a signal source circuit connected to a first reset power supply, configured to reset based on the first reset power supply and generate a voltage signal through photoelectric conversion; and a storage circuit connected to a second reset power supply and the signal source circuit, configured to reset based on the second reset power supply and store the voltage signal generated by the signal source circuit; wherein a signal path between the signal source circuit and the first reset power supply is independent of a signal path between the storage circuit and the second reset power supply. The application is used to reduce the charging and discharging time of the capacitor and improve the frame rate.

This invention discloses a multi-dimensional perceptual gaze-point rendering method, system, and medium. The multi-dimensional perceptual gaze-point rendering method is characterized by the following steps: S1, acquiring the user's eye-tracking data in real-time within a virtual reality environment; S2, dividing the rendering sequence into saccade windows, recovery windows, and stable gaze windows; S3, constructing a multi-dimensional visual perception model that integrates saccade sequence features; S4, acquiring the perception critical frequency and mapping it to a resolution scaling factor to guide rasterization operations in the graphics pipeline; S5, invoking the resolution scaling factor and performing dynamic resolution rendering in the graphics rendering pipeline based on the resolution scaling factor. The system includes a data acquisition module, an event detection module, a model calculation module, a rendering scheduling module, and a graphics drawing module. This invention is rationally designed, effectively utilizing computing resources, improving the rendering system's frame rate, and enhancing the user experience.

The invention provides an image acquisition method, an image acquisition sensor and electronic equipment, relates to the technical field of image acquisition, and aims to realize high-frame-rate image acquisition. The method comprises the following steps: reading image data generated by current exposure from an FIFO (First In First Out) storage space, and transmitting the read image data; recording the total amount of the currently read image data of the current exposure in the time period of transmitting the image data generated by the current exposure; under the condition that the total amount of the currently read image data is larger than or equal to a target threshold value, next exposure is carried out, the target threshold value enables the currently unread image data of the current exposure not to be covered by the image data generated by the next exposure in the FIFO storage space, and the current unread image data of the current exposure in the FIFO storage space is not covered by the image data generated by the next exposure. The current unread image data of the current exposure is the remaining image data except the current read image data in the image data generated by the current exposure.

This invention provides a virtual terminal incremental interface rendering system, method, and terminal based on the ISOBUS standard. It first calculates the new hash value of each attribute based on interface object attribute update data extracted from ISOBUS messages, and compares this new hash value with the corresponding attribute hash value cached by the object cache management module to accurately identify the actual changed attributes. Based on this, it determines the update method and generates an update data packet embedding the current version number. Then, considering the visibility of each interface object, user attention, and update frequency, it calculates the rendering priority, combines the target frame rate and rendering time budget, selects the set of objects to be rendered in the current frame, and performs incremental rendering. This invention achieves efficient incremental updates through hash change detection, differential data packet generation, and intelligent rendering scheduling technologies, effectively reducing data transmission volume, improving frame rate, and reducing latency, demonstrating significant performance advantages and broad application prospects.

The invention discloses an intelligent bag taking method and system based on target recognition analysis, and relates to the technical field of target recognition. The method comprises the following steps of bag taking interference analysis, bag taking identification analysis and bag taking decision feedback. According to the method, the bag taking interference analysis result is obtained based on the bag taking identification interference parameters so as to judge whether to carry out image dynamic acquisition adjustment or not, if yes, bag taking dynamic identification analysis is carried out after the image dynamic acquisition adjustment is carried out, and if not, bag taking dynamic identification analysis is directly carried out; recognition errors caused by ambient light changes or other factors are effectively avoided, recognition of the bag taking action is more accurate, whether a bag taking decision feedback mechanism is triggered or not is judged after bag taking dynamic recognition analysis is conducted, if yes, bag taking decision feedback is executed, and if not, image dynamic recognition optimization is executed, so that the bag taking action is more accurate. The reliability of the automatic bag taking machine in actual operation is effectively improved, and then recognition of the bag taking process of the automatic bag taking machine is more accurately carried out.