264results about "Conversion by changing video signal frequency" patented technology

The invention discloses a panoramic video frame insertion method based on a potential diffusion model. The method comprises the following steps: compressing an input image to a potential space by using a panoramic perception vector quantization variational auto-encoder to obtain potential features; constructing initial noise, and fusing the motion features extracted by the panoramic optical flow adapter to obtain condition information; performing iterative denoising operation on the potential features of the intermediate frame to obtain final potential features of the intermediate frame; and restoring the final potential features of the intermediate frame into a frame insertion image of a pixel space through a condition decoder. According to the panoramic video frame interpolation method provided by the invention, the potential diffusion model and the panoramic characteristic enhancement technology are combined, so that the perception quality of a frame interpolation result can be remarkably improved, details and complex textures of a pole region can be better reserved, and a high-quality time interpolation solution is provided for immersive panoramic video application.

The invention relates to the technical field of digital twinning, particularly provides a digital twinning scene adaptive optimization method based on point cloud data, and solves the problems that smoothness and detail presentation cannot be balanced during network fluctuation, and a scene prediction optimization mechanism based on space-time semantic analysis is not established. The method comprises the following steps: data preprocessing and hierarchical construction: carrying out preprocessing of abnormal point elimination, missing value complementation and density adjustment on original point cloud data, dividing key and common regions according to scene requirements, and constructing a multi-scale and multi-resolution hierarchical point cloud data system; the method can deeply analyze the spatio-temporal dynamic characteristics of the point cloud data through the technologies of spatio-temporal dynamic semantic segmentation, dynamic change monitoring, prediction optimization and the like, processes the continuous time sequence point cloud data after adaptive transmission, models a time dependency relationship and extracts local and global characteristics in time and space dimensions respectively, and improves the accuracy of point cloud data processing. Accurate identification of object types, positions and dynamic change information is realized.

The invention discloses a real-time video processing system based on an ampere-path FPGA. The real-time video processing system comprises an SD card, an ampere-path FPGA board card and an HDMI displayer. The SD card is used for storing original video data in a Bayer format; the A-path FPGA board card comprises an FPGA end and an ARM end, the FPGA end comprises an SD card reading control module, an image cache FIFO module, a Bayer-to-RGB module, a seven-in-one image processing module, an SDRAM read-write control module and an HDMI display control module, the first four modules are connected in sequence, and the SDRAM read-write control module is connected with the Bayer-to-RGB module, the seven-in-one image processing module and the HDMI display control module; wherein the ARM end comprises a Cortex-M0 processor core, an AHBLiite-Interconnect data bus and all peripheral interfaces, and all the modules are connected in sequence; the ARM end comprises a Cortex-M0 processor core, an AHBLiite-Interconnect data bus and all the peripheral interfaces; the ampere-path FPGA board card is used for completing all video processing functions; and the HDMI display outputs the processed video. The method is good in video processing effect, low in resource consumption, high in flexibility, high in stability and low in hardware cost, and the hardware is 100% localized.

The invention relates to the technical field of optical communication, in particular to an automobile headlamp communication system and method based on image frame interpolation, comprising a transmitting end and a receiving end, a vehicle-mounted central control system of the transmitting end is used for receiving input to-be-transmitted information, and an ambient light detection module evaluates an external illumination condition in response to the input of the to-be-transmitted information; an image gray value and frame insertion frequency are set based on the illumination intensity, the image coding module codes information to be transmitted based on the set image gray value to generate a projection image frame, and the projection module inserts the projection image frame into a normal illumination frame sequence of a vehicle lamp based on the frame insertion frequency and projects the projection image frame to an external environment; the image acquisition module of the receiving end is used for acquiring a projection image frame, the image decoding module preprocesses the projection image frame and then decodes the projection image frame, and the information to be transmitted is restored and sent to the vehicle-mounted central control system. According to the invention, vehicle lamp communication at a certain distance in a traffic environment can be realized on the premise of ensuring normal vehicle lamp illumination.

The invention belongs to the technical field of image processing, and particularly relates to a binocular camera low-delay synchronization method, which comprises the following steps of: respectively establishing data queues for a main view acquisition stream and an auxiliary view acquisition stream, and acquiring an acquisition frame with an acquisition time identifier from the data queues; taking an acquisition moment identifier of a certain acquisition frame in the main view acquisition stream as unified target time; on the basis of at least two acquisition frames in a unified target time neighborhood in the auxiliary view acquisition stream, a re-projection auxiliary view frame in the unified target time is generated by executing a cross-view stream time re-projection algorithm; and taking an acquisition frame in the main view acquisition stream as a reference acquisition frame, forming a time synchronization frame pair together with the re-projection auxiliary view frame, and outputting the time synchronization frame pair. According to the method, the synchronization precision and stability are improved under the low-delay condition, the hardware dependence and the storage overhead are reduced, and the method has the advantages of being high in real-time performance, high in adaptability, easy to implement and good in expandability.

The invention discloses a high-definition video docking station device, an integrated system and a communication method. The device comprises a main control module, a protocol conversion module, a power management module, a video processing module, a dynamic bandwidth allocation unit, a plurality of video output interfaces and a peripheral expansion unit. The main control module receives an input video signal and performs shunting, compression and protocol analysis; the protocol conversion module manages interface protocol switching, equipment detection and power supply negotiation; the power management module converts input voltage into multi-stage system voltage and provides a reverse charging function; the video processing module is used for splitting an input video signal into multiple paths of independent video streams and reducing the bandwidth; the dynamic bandwidth allocation unit is used for dynamically adjusting the resolution or refresh rate of the video stream; and the peripheral expansion unit is connected with the low-speed peripheral through the independent data channel. The device supports three paths of 4K and 60Hz synchronous output, has high energy efficiency, intelligent bandwidth management and good compatibility, and is suitable for multi-screen cooperation, industrial control and high-resolution display application scenes.

The invention discloses an active prevention measure and system based on individual emergency protection. The method comprises the steps of hardware module integration and test, core function logic development, cloud system architecture construction, power supply and industrial design and system integration and compliance authentication. The invention belongs to the technical field of campus safety, and particularly relates to an active prevention measure and system based on individual emergency protection, and the scheme adopts a magnetic latching relay to realize physical disconnection, adopts a dual authentication process, sets a one-way communication system, and carries out dynamic sound pressure adjustment based on environmental noise; an end-to-end encryption channel is developed, a double-encryption mode is adopted, a dynamic fragmentation storage technology is applied, an encryption channel is established, key exchange and video fragmentation hash verification are adopted, an equipment state vector is defined, and a 3D convolutional neural network is adopted to identify violent behaviors.

The invention belongs to the technical field of image acquisition, and discloses a field image acquisition method and system. The method comprises the following steps: acquiring real-time field images and videos by using an edge computing gateway, and extracting a plurality of real-time key frame images; image segmentation is carried out, and the real-time attention of the real-time image area is obtained; lossless compression and dynamic encryption are carried out; collecting real-time network quality data of the transmission network, and generating a real-time data transmission strategy; uploading the plurality of encrypted real-time image compression packets to a cloud data center according to a real-time data transmission strategy; and restoring the plurality of encrypted real-time image compression packets of each real-time foreground image by using the cloud data center to obtain a restored real-time field image video. According to the invention, the problems of low data transmission efficiency, insufficient security, centralized processing bottleneck, high energy consumption and poor transmission reliability in the prior art are solved.

An electronic device includes: a frame rate conversion (FRC) circuit configured to perform image quality processing and FRC; memory storing one or more instructions; and at least one processor configured to execute the one or more instructions to: identify whether a picture adjustment mode is enabled or disabled, based on a quick media switching (QMS) mode being enabled; determine whether to bypass the FRC circuit, based on whether the picture adjustment mode is enabled or disabled; and based on determining whether to bypass the FRC circuit, perform control to process an input image based on the FRC circuit or based on bypassing the FRC circuit.

Aspects presented herein relate to methods and devices for display processing including an apparatus, e.g., a GPU or a CPU. The apparatus may obtain a first frame and a second frame of a plurality of frames in a scene. The apparatus may also calculate a set of first motion vectors in the first frame and a set of second motion vectors in the second frame, where the set of first motion vectors and the set of second motion vectors are calculated based on a block matching procedure. Further, the apparatus may estimate at least one third frame in the plurality of frames based on the set of first motion vectors in the first frame and the set of second motion vectors in the second frame, where the at least one third frame is subsequent to the second frame in the plurality of frames.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

Systems and techniques are described herein for interpolating image data. For instance, a method for interpolating image data is provided. The method may include processing a first image frame and a second image frame using a motion estimator to generate first motion vectors, wherein the motion estimator comprises a machine-learning model trained to generate motion vectors based on image frames; projecting the first motion vectors to generate second motion vectors; and generating a third image frame based on the first image frame, the second image frame, and the second motion vectors.

The embodiment of the invention discloses a video processing method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of video processing, and the method comprises the steps: judging whether a to-be-played video meets a preset image quality enhancement condition or not at a decoding stage of the to-be-played video; if the image quality enhancement condition is satisfied, carrying out resolution enhancement on the to-be-played video; performing local color monitoring on the enhanced to-be-played video to obtain a monitoring result; and performing local color enhancement or dynamic frame insertion processing on the video to be played according to the monitoring result. Therefore, the display effect of the low-resolution video can be remarkably improved in the decoding stage, improvement is carried out in the aspects of resolution, color, frame rate and the like, parameters such as resolution, color, frame rate and the like are dynamically adjusted, and the display effect of the low-resolution video is improved.

This disclosure provides systems, methods, and devices for image processing that support improved image quality. In a first aspect, a method of image processing includes determining a scene condition for an image sensor of an image capture device; receiving motion data regarding movement of the image capture device; configuring the image sensor of the image capture device with a first image sensor configuration determined based on the motion data and the scene condition; receiving image data from the image sensor captured with the first image sensor configuration; and determining a video sequence by processing the image data based on the motion data and the scene condition. Other aspects and features are also claimed and described.

The invention provides an image resolution adjusting method and an electronic device. The method comprises the following steps: running a target application program to obtain a target image with a first resolution based on a first frame rate; selecting a target memory from the plurality of buffer memories according to the utilization rate of each of the plurality of buffer memories during the running of the target application program; processing the target image through an image processing model and a target memory to adjust the resolution of the target image from the first resolution to a second resolution, the second resolution being higher than the first resolution; and controlling the display interface to present the target image with the second resolution based on the first frame rate. Therefore, the user experience and the image processing efficiency of the electronic device can be effectively improved.

A device for image processing includes an image sensor configured to capture a first set of image frames; a buffer configured to store information indicative of luminance of each image frame of the first set of image frames; and processing circuitry configured to: retrieve, from the buffer, the information indicative of luminance of each image frame of the first set of image frames; determine a flicker correction parameter based on the luminance across each of the first set of image frames; and generate additional image frames that are for display based on the flicker correction parameter.

Aspects presented herein relate to methods and devices for display processing including an apparatus, e.g., a CPU or a DPU. The apparatus may monitor at least one display task associated with a set of display software threads. The apparatus may also detect that a loading time of the at least one display task is less than a loading time threshold or that a panel frame rate is less than a frame rate threshold. Further, the apparatus may obtain a first configuration for at least one thread of the set of display software threads and a second configuration for the at least one thread. The apparatus may also adjust an execution of the at least one display task from being associated with the first configuration for the at least one thread to being associated with the second configuration for the at least one thread.

Positions of an image capture device may be used to determine a position-based time-lapse video frame factor. Apparent motion between pairs of images may be used to determine a visual-based time-lapse video frame rate factor. A time-lapse video frame rate for a time-lapse video may be determined based on the position-based time-lapse video frame factor and the visual-based time-lapse video frame rate factor.

The invention provides a video monitoring frame insertion method and device, computer equipment and a storage medium, and belongs to the field of video monitoring frame insertion, and the method comprises the steps: extracting a plurality of key frames in a historical video; the method comprises the following steps: replacing the attention WA of a window in a SwinCS module of a Transform network with a cross-scale window attention mechanism CSWA, forming a multi-frame synthesis module Multi-SynBlock through kernel estimation, mask estimation, offset estimation, deviation estimation and a deformable convolution module, and forming a multi-scale pin model through the improved Transform network and the Multi-SynBlock network; a key frame in a historical video is used as input, a multi-scale pin model is trained, and an intermediate frame at any time position is generated. According to the frame insertion algorithm, the frame rate of coal mine video monitoring can be effectively improved, motion blur and picture tearing are reduced, clearer and smoother monitoring pictures are provided, and the efficiency and response speed of coal mine safety management are improved under the conditions of low cost and no increase of operation load.

In various examples, systems and methods are disclosed that perform motion detection across image frames, such as optical flow determination, to synchronize an asynchronous frame with respect to a target time for the asynchronous frame. For example, image frames from a sensor can be processed by an optical flow accelerator to detect displacement across the image frames, and the displacement can be used to interpolate a modified frame at the target time. This can be used to perform data collection and combining operations such as stitching and / or reconstruction. The synchronization can be performed from sensor data from sensors such as cameras, LIDAR sensors, and / or RADAR sensors.

This information processing device is connected to a display device (14) capable of updating frame images at a variable refresh rate, and the device executes a process for rendering a frame image, transmits the rendered frame image to the display device (14), measures the rendering time required for the frame image rendering process, and changes the operating condition for the rendering process in accordance with the measured rendering time.

The invention provides a low earth orbit satellite network video code rate determination method and device and electronic equipment. The method comprises the following steps: acquiring link state information of a low earth orbit satellite network link; predicting whether a link reconstruction event occurs at the next moment based on the link state information; and under the condition of predicting that a link reconstruction event occurs in the low earth orbit satellite network link at the next moment, dividing a time domain into independent control intervals, and independently determining the video block code rate at the next moment based on the network state of the independent control interval in each independent control interval. According to the method, the satellite network reconstruction event is predicted, and the video code rate is independently determined in the interval mode in the reconstruction event period, so that the video live broadcast experience quality in the low-orbit satellite network environment is improved.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

The invention discloses a self-adaptive video transmission control method based on unmanned aerial vehicle bandwidth perception. The method comprises the steps that S1, an unmanned aerial vehicle video system sends a bandwidth perception data frame to a ground receiving end; s2, the ground end returns a bandwidth state data frame, wherein the bandwidth state data frame comprises a received signal strength indication (RSSI) and a frame loss rate (FLR) index; s3, the unmanned aerial vehicle video system analyzes the bandwidth state data frame and evaluates the channel quality grade; s4, the unmanned aerial vehicle video system calculates a buffer proportion factor of the annular buffer area; s5, the unmanned aerial vehicle video system calls a pre-constructed adaptive transmission control model, transmission parameters are updated according to the channel quality grade and the buffer proportion factor, and the transmission parameters comprise transmission video quality and coding parameters; s6, transmitting video data according to the updated transmission parameters of the unmanned aerial vehicle video system; and S7, the ground end receives the video data and decodes and plays the video data. According to the invention, the problem of poor adaptability in different network environments when the unmanned aerial vehicle sends the video data with the fixed channel parameters is solved, and the video transmission quality is improved.

A method for interpolating video frames, includes: obtaining at least two key frames of a video, for which a motion estimation is to be performed, detecting repetitive pattern regions on the at least one key frame of the at least two key frames, estimating motion between the at least one key frame of the at least two key frames and a point in time, for which an interpolated frame will be obtained by feeding the at least two key frames and the repetitive pattern regions to a trained motion estimation neural network.

Provided is an electronic device configured to participate in video conference by using artificial intelligence (AI), the electronic device including a display and a processor configured to execute one or more instructions. The processor configured to obtain, from a server, image data generated by first encoding first image related to another electronic device participating in video conference, and AI data related to AI downscaling from original image to first image, obtain second image corresponding to first image by performing first decoding on image data, determine whether to perform AI upscaling on second image, based on importance of the other electronic device, based on determining to perform AI upscaling, obtain third image by performing AI upscaling on second image through an upscaling deep neural network and provide third image to display, and based on determining not to perform AI upscaling, provide second image to display.

The invention provides a video frame extraction method and device, a storage medium and computer equipment. The method comprises the following steps: reading packet structures of a plurality of video frames of a plurality of main code stream video data; obtaining a type identifier of each video frame according to the packet structure; and determining the video frames of which the type identifiers are I frame identifiers as key frames, and extracting the key frames of the plurality of main code stream video data to a video decoder for decoding, so that the video decoding equipment only needs to decode the I frames, the workload of the video decoder is reduced, and the video decoding efficiency is improved on the premise of completely keeping the image quality of the main code stream unchanged. The decoding pressure of a video decoder is greatly reduced, and the shooting parameter configuration of the camera corresponding to each main code stream video data is not influenced at all.

The invention provides an MIPI-based sending device and method and electronic equipment, and the device comprises a switching and receiving unit MIPISWITCH which is used for selecting any one data input mode from a plurality of preset data input modes, selecting any one input interface from a plurality of data input interfaces corresponding to the selected data input mode, and switching the selected data input mode to the selected data input interface. Acquiring image data of any channel through the selected input interface; the processing unit is used for acquiring the image data from the switching and receiving unit MIPISWITCH and outputting the image data to any one of the transmitting units MIPISANSMITTER according to a preset time sequence requirement; and the sending unit MIPITRANSMITTER is used for determining a sending mode of the image data and sending the image data according to the sending mode, and the sending mode is used for determining a receiving end of the image data. According to the invention, when the image data is sent, the image data of different paths can be flexibly switched to be sent.

A curation system may be used by a number of collaborative users in order to capture and manage audio and video content. Content is captured by a capture device and streamed in near real-time to a storage and management server. The management server is configured to provide interfaces to remote collaborative users via computers and other devices to allow content to be viewed as it is captured, or after it is captured. Collaborative users may also modify content by submitting metadata to be associated with content in order to add comments, keywords, clips, notes, and other organizational and classifying information to sections of the content. The server is also configured to transcribe audio and video content, and associate transcription metadata with the content to allow it to be further captioned, searched, and organized. Shared interfaces allow users to collaboratively edit and publish content while minimizing wasted effort.