160 results about "Video rate" patented technology

Communication is an important issue in man-to-robot interaction. Signs can be used to interact with machines by providing user instructions or commands. Embodiment of the present invention include human detection, human body parts detection, hand shape analysis, trajectory analysis, orientation determination, gesture matching, and the like. Many types of shapes and gestures are recognized in a non-intrusive manner based on computer vision. A number of applications become feasible by this sign-understanding technology, including remote control of home devices, mouse-less (and touch-less) operation of computer consoles, gaming, and man-robot communication to give instructions among others. Active sensing hardware is used to capture a stream of depth images at a video rate, which is consequently analyzed for information extraction.

Communication is an important issue in man-to-robot interaction. Signs can be used to interact with machines by providing user instructions or commands. Embodiment of the present invention include human detection, human body parts detection, hand shape analysis, trajectory analysis, orientation determination, gesture matching, and the like. Many types of shapes and gestures are recognized in a non-intrusive manner based on computer vision. A number of applications become feasible by this sign-understanding technology, including remote control of home devices, mouse-less (and touch-less) operation of computer consoles, gaming, and man-robot communication to give instructions among others. Active sensing hardware is used to capture a stream of depth images at a video rate, which is consequently analyzed for information extraction.

An endoscopic video system and method using a camera with a single color image sensor, for example a CCD color image sensor, for fluorescence and color imaging and for simultaneously displaying the images acquired in these imaging modes at video rates in real time is disclosed. The tissue under investigation is illuminated continuously with fluorescence excitation light and is further illuminated periodically using visible light outside of the fluorescence excitation wavelength range. The illumination sources may be conventional lamps using filters and shutters, or may include light-emitting diodes mounted at the distal tip of the endoscope.

A system, method and device for the capture and display of high-resolution stereoscopic or monoscopic wide fields-of-view (FOV) at still or video rates, presenting techniques and designs for distance measuring, for changing the working stereo capture range of a stereoscopic image capture device, and for playing pre-recorded or transmitted stereoscopic video image data through a player unit. The system supports multiple independent viewers and image analysis sub-systems of various types utilizing hardware, software and firmware. Further included is a stereoscopic videoconferencing embodiment that captures and transmits an entire room's view and automatically directs focus of images.

Original-quality MPEG coded video is processed to produce reduced-quality MPEG coded video at a reduced bit rate. The processing is based on a scale factor between average frame size of the original-quality MPEG coded video and a desired average frame size of the reduced-quality MPEG coded video. For each Discrete Cosine Transform (DCT) block of each frame, the processing calculates a size of the block of the reduced frame by scaling the original block size by the scale factor, and removes a sufficient number of bits from the original block to obtain substantially the calculated size. In addition, the processing accumulates excess bits when the block size reduction eliminates more bits from a block than are necessary for the desired reduction of the size of the block, and any excess bits are used for processing a number of following blocks.

An electronic imaging sensor. The sensor includes an array of photo-sensing pixel elements for producing image frames. Each pixel element defines a photo-sensing region and includes a charge collecting element for collecting electrical charges produced in the photo-sensing region, and a charge storage element for the storage of the collected charges. The sensor also includes charge sensing elements for sensing the collected charges, and charge-to-signal conversion elements. The sensor also includes timing elements for controlling the pixel circuits to produce image frames at a predetermined normal frame rate based on a master clock signal (such as 12 MHz or 10 MHz). This predetermined normal frame rate which may be a video rate (such as about 30 frames per second or 25 frames per second) establishes a normal maximum per frame exposure time. The sensor includes circuits (based on prior art techniques) for adjusting the per frame exposure time (normally based on ambient light levels) and novel frame rate adjusting features for reducing the frame rate below the predetermined normal frame rate, without changing the master clock signal, to permit per frame exposure times above the normal maximum exposure time. This permits good exposures even in very low light levels. (There is an obvious compromise of lowering of the frame rate in conditions of very low light levels, but in most cases this is preferable to inadequate exposure.) These adjustments can be automatic or manual.

A system, method and device for the capture and display of high-resolution stereoscopic or monoscopic wide fields-of-view (FOV) at still or video rates, presenting techniques and designs for distance measuring, for changing the working stereo capture range of a stereoscopic image capture device, and for playing pre-recorded or transmitted stereoscopic video image data through a player unit. The system supports multiple independent viewers and image analysis sub-systems of various types utilizing hardware, software and firmware. Further included is a stereoscopic videoconferencing embodiment that captures and transmits an entire room's view and automatically directs focus of images.

Method for dynamically optimizing bandwidth allocation in a variable bitrate conference environment. Conference means with two or more outputs are provided, where each one can output data at different rates, in order to support two or more endpoints which may have different media rates. Two or more endpoints are connected to these conference means for participating in the conference. Whenever more than one video rate is used by participants during the conference, each set of output rates is selected from all possible combinations of output rates in the conference means, wherein the lowest output rate in each selected set is the entry rate of the endpoint joining the conference at the lowest rate. A Quality Drop Coefficient (QDC) for each endpoint that joins the conference is determined for each selected set, wherein the QDC is computed according to the endpoint entry rate and the highest rate, among the output rates of each selected set, that is lower or equal to said endpoints' entry rate. A Quality Drop Value (QDV) is calculated for each of the selected sets, wherein, preferably, the set of output rates with the lowest QDV is determined as the optimal video rate set to select. The video rate of all the endpoints having a video rate above the highest optimal video rate is reduced to the highest optimal video rate, if required, and the video rate of other endpoints having video rate between two consecutive levels of optimal video rates is reduced to the lowest level among said levels. Whenever a change occurs in either the amount of participating endpoints in the conference or in the declared bit rate capability of the participating endpoints, the video rates of all the outputs are recalculated.

A holographic direct-view display system uses holographic integral imaging techniques that is an auto stereoscopic way to reproduce parallax and occlusion. The display is not resolution limited and is scalable to display life size images if desired. The system can be used to transmit 3D depictions of a scene at video and sub-video rates as well as other information, such as images of documents or computer generated images. The images may be captured, transmitted and displayed in real-time (or near real-time) for telepresence or stored for time-shifted display. The system combines integral holography, a pulsed laser to record the hologram at high speed and a dynamic refreshable holographic material such as a photorefractive polymer as a recording media. The system uses techniques to write, read and erase the updateable hologram that allow the holographic material, hence direct-view display to remain stationary throughout each of the processes for continuous presentation of the hologram to the audience. The system may write, read and erase at the same time and continuously to increase throughput. This system may also use additional novel techniques to improve brightness, efficiently implement a full-parallax display and to implement a full-color display in a transmission geometry.

An endoscopic video system and method using a camera with a single color image sensor, for example a CCD color image sensor, for fluorescence and color imaging and for simultaneously displaying the images acquired in these imaging modes at video rates in real time is disclosed. The tissue under investigation is illuminated continuously with fluorescence excitation light and is further illuminated periodically using visible light outside of the fluorescence excitation wavelength range. The illumination sources may be conventional lamps using filters and shutters, or may include light-emitting diodes mounted at the distal tip of the endoscope.

A system and method provide a video coding system for adaptively transcoding videos based on video coding complexity (VCC). A VCC engine of the system is configured to generate a measure of how difficult to encode a source video based on a trained VCC model. A video rate-distortion modeling engine of the system is configured to estimate a rate-distortion model and a scaling model. The VCC model, rate-distortion model and the scaling model are trained on a video corpus of the system. The trained VCC model, rate-distortion model and the scaling model are used by an adaptive bitrate transcoding sub-system to transcode a source video with an optimized bitrate and visual quality. The trained VCC model, rate-distortion model and the scaling model are further used by an adaptive resolution transcoding sub-system to transcode a source video with an optimized resolution and visual quality.

A method and device for improving rate controlling in video coding of sequences including a series of Inter frames separated by Intra frames, when a decoding delay is considered, comprise for each Inter frame of the series: computing a target frame size, computing a maximum buffer level related to a position of each Inter frame relative to a previous Intra frame and an upcoming Intra frame, and optimizing a transmission buffer level in response to the computed target frame size and the computed maximum buffer level.

A solid state image pickup device has a high-resolution pixel array consisting of a plurality of photo-receptive elements disposed at a high density. A low-resolution whole picture scanning unit outputs low-resolution whole picture data by reading out and scanning the wholeness with the resolution of the pixel array lowered. A high-resolution partial picture scanning unit outputs high-resolution partial picture data by partial readout and scanning with high-resolution of the pixel array kept. A switching unit provides a switching between the low-resolution whole picture scanning unit and the high-resolution partial picture scanning unit within a frame period to thereby output in sequence the low-resolution whole picture data and the high-resolution partial image data at a speed equal to or greater than the video rate. A picture extraction processing unit automatically determines the extracting position of a high-resolution partial picture at the next frame, based on the low-resolution whole picture data, to thereby instruct the high-resolution partial picture scanning unit on the extracting position.

A methodology and apparatus is described that registers images outputted by at least two video camera sensors that are not necessarily bore-sighted nor co-located together. Preferably this can be performed in real-time at least at video rate. The two video camera sensors can be either of similar or two different modalities (e.g., one can be intensified visible, while the other can be thermal infrared) each possibly with a different field-of-view. The methodology and apparatus take advantage of a combination of Inertial Measurement Units (IMUs) information and image registration between the two camera sensors from computational image processing. In one preferred embodiment, the system uses a rifle mounted weapon sight camera sensor and a helmet mounted sensor camera. The aim point of the weapon sight camera sensor (e.g., typically at the image center) zeroed to the true rifle aim point is digitally overlayed as a reticle on the video image from the helmet sensor, displayed on a head mounted display (HMD). In another embodiment pixel-level image fusion is displayed across the overlapping field-of-view of the rifle mounted camera sensor weapon sight with the helmet mounted camera image.

The present invention comprises an optical apparatus, methods and uses for real-time (video-rate) multimodal imaging, for example, contemporaneous measurement of white light reflectance, native tissue autofluorescence and near infrared images with an endoscope. These principles may be applied to various optical apparati such as microscopes, endoscopes, telescopes, cameras etc. to view or analyze the interaction of light with objects such as planets, plants, rocks, animals, cells, tissue, proteins, DNA, semiconductors, etc. Multi-band spectral images may provide morphological data such as surface structure of lung tissue whereas chemical make-up, sub-structure and other object characteristics may be deduced from spectral signals related to reflectance or light radiated (emitted) from the object such as luminescence or fluorescence, indicating endogenous chemicals or exogenous substances such as dyes employed to enhance visualization, drugs, therapeutics or other agents. Accordingly, one embodiment of the present invention discusses simultaneous white light reflectance and fluorescence imaging. Another embodiment describes the addition of another reflectance imaging modality (in the near-IR spectrum). Input (illumination) spectrum, optical modulation, optical processing, object interaction, output spectrum, detector configurations, synchronization, image processing and display are discussed for various applications.

An apparatus and method for transmitting and receiving data in a wireless communication network are provided, in which a terminal includes a transmitter for determining a video rate using at least one of collected radio channel information and a streaming parameter received from a corresponding terminal, converting video data included in multimedia data to video streaming data using the determined video rate, and transmitting streaming data including the video streaming data, and a receiver for receiving a streaming parameter as a feedback for the transmitted streaming data from the corresponding terminal.

Exchanging of videoconference data between a first endpoint and a second endpoint via a network includes receiving, at the first endpoint, statistical data relating to transmission of first videoconference data. In particular, the first videoconference data is data that is transmitted previously from the first endpoint to the second endpoint via the network, and the statistical data relates to network performance characteristics during transmission of the first videoconference data. An approximately optimized data transmission rate for the network performance characteristics is determined, based on the statistical data. The output bit rate of a video encoder associated with the first endpoint is adjusted, such that second videoconference data, relating to the same videoconference at a time that is later than the first videoconference data, is encoded to provide output data at an adjusted output bit rate for being transmitted via the network at approximately the optimized data transmission rate.

An encoder and corresponding method are disclosed for performing video rate control to meet network traffic model restrictions, including pre-encoding the sequence of pictures for each of a plurality of quantization parameter values, selecting for each picture of the sequence one of the plurality of quantization parameter values responsive to the quantization parameter values and bitrate operating points of the neighboring pictures in the sliding time window, and encoding each picture of the sequence using the quantization parameter value selected for that picture.

A system and method provides content-adaptive bitrate video transcoding of a source video for a video hosting service. The system is coupled to a video coding complexity engine and video rate-distortion modeling engine of the video hosting service. The system is configured to receive the video coding complexity score of the source video and a trained rate-distortion model and a scaling model. A target bitrate estimation module of the system is configured to calculate an initial target bitrate based on the video coding complexity using the trained rate-distortion model. A bitrate refinement module of the system is configured to adjust the initial target bitrate with respect to the resolution and / or frame rate of the transcoded source video. An adaptive video coder of the system is configured to transcode the source video with the adjusted target bitrate.

A wearable pixelated apparel video-displaying system is disclosed comprising at least one flexible lightweight pixelated material having a contiguous imaging surface comprised of a multitude of pixels capable of displaying typical video rate, video image content which is contiguous in appearance and which covers up to all of the surface. The apparatus is equipped to playback, control and display imagery according to the size and the shape of one or more pixelated material segments making up the video-displaying apparel. The apparatus has an input / output interface a digital media content playback device, a user interface means for a user to communicate with the apparatus and to control the playback of at least one source of video content. In one embodiment the pixelated-image displaying apparel is contiguously formed into a single garment. In a second embodiment a plurality of apparel segments are adjoined to one another by attachment, and are electronically coupled together.

In a holographic surveillance system (10) for near real-time imaging of a target (15), a source of RF radiation directs a non-amplified reference beam of pulsed coherent RF electromagnetic radiation toward a target. An array of antennas (31) receives a reflected beam from the target together with a component of the reference beam so as to produce a signal representative of phase and amplitude data of received energy, and a processor (20) processes the signals so as to produce a holographic image for display on a display device coupled to the processor.

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique increasingly used in the life sciences during the past decades. An all-solid-state fluorescence-lifetime-imaging microscope (1) with a simple lock-in imager (4) for fluorescence lifetime detection is described. The lock-in imager (4), originally developed for 3D vision, embeds all the functionalities required for FLIM in a compact system. Its combination with a light-emitting diode (2) yields a cost-effective and user-friendly FLIM unit for wide-field microscopes. The system is suitable for nanosecond lifetime measurements and achieves video-rate imaging capabilities.

Fluorescence lifetime imaging microscopy (FLIM) is a powerful technique increasingly used in the life sciences during the past decades. An all-solid-state fluorescence-lifetime-imaging microscope (1) with a simple lock-in imager (4) for fluorescence lifetime detection is described. The lock-in imager (4), originally developed for 3D vision, embeds all the functionalities required for FLIM in a compact system. Its combination with a light-emitting diode (2) yields a cost-effective and user-friendly FLIM unit for wide-field microscopes. The system is suitable for nanosecond lifetime measurements and achieves video-rate imaging capabilities.

The present invention relates to converting media bitstreams across different networks in a media gateway without any algorithmic delay, and reduces the computation load within the transmission in the situation where the bandwidth of the outgoing network varies dynamically. A first embodiment of the present invention provides an apparatus and a method for a Reduced-Algorithmic-Delay Media Stream Unit Conversion module which is a light weight Simple Pass-Through operation. A second embodiment of the present invention provides an apparatus and a method for a Reduced-Algorithmic-Delay Video Rate Conversion. An alternative embodiment provides an apparatus and a method for a Smart Pass-Through Operation which involves switching between the Simple Pass-Through and the Rate Converter. The methods and apparatuses provided by the first and second embodiment can be used as a stand alone system, or as part of the module of the alternative embodiment.

In a head detachable camera comprising a camera head and an image processing unit which does not have an exclusive line for notifying the type of image sensing device used in the camera head, when the power switch is turned on, vertical interval data signal processing units of the camera head and the image processing unit are set to a predetermined communication mode, such as one conforming to the NTSC video mode. Under this situation, identification information showing the number of pixels and the video rate used in the image sensing device is transmitted from the camera head by multiplexing the identification information in a blanking period of an image signal, and the communication mode of the camera head is changed in accordance with the number of pixels and the video rate of the image sensing device, if necessary. In the image processing unit, the communication mode is set to one corresponding to the received identification information, and the image processing unit transmits a clock and synchronizing signals corresponding to the communication mode to the camera head.

A CMOS imager in which a CMOS image sensor, a color image processing module and an image compression module are all provided on a single die. Both the color image processing module and the image compression module incorporate pipelined architectures to process the image data at a video rate in a massively parallel fashion.

An example system can monitor the stress and fatigue of a subject. The system can include a light source configured to direct illuminating light onto a face of the subject. The illuminating light can reflect off the face of the subject to form reflected light. The system can include collection optics that collect a portion of the reflected light and produce video-rate images of the face of the subject. The system can include an image processor configured to locate an eye in the video-rate images, extract fatigue signatures from the located eye, and determine a fatigue level of the subject, in part, from the fatigue signatures. The image processor can also be configured to locate a facial region away from the eye in the video-rate images, extract stress signatures from the located facial region, and determine a stress level of the subject from the stress signatures.

The invention discloses a laser speckle blood stream imaging processing system and method based on SOC (System on Chip) / IP (Internet Protocol) solution. The process of acquiring, processing and displaying a laser speckle blood stream image is completely implemented by a hardware circuit; and a multistage production line technique and a parallel processing unit are introduced into the design of the processing core, so that the system can implement laser speckle blood stream imaging real-time processing at video rate at lower clock frequency (about 50MHz). The scheme greatly reduces the power consumption and volume of the laser speckle blood stream imaging system, and provides a design method of a portable laser speckle blood stream imaging instrument. The scheme is implemented by an IP core designed according to hardware description language, and can be implemented by a discrete circuit element, an FPGA (field programmable gate array) and an ASIC (application-specific integrated circuit) chip.

Method for dynamically optimizing bandwidth allocation in a variable bitrate conference environment. Conference means with two or more outputs are provided, where each one can output data at different rates, in order to support two or more endpoints which may have different media rates. Two or more endpoints are connected to these conference means for participating in the conference. Whenever more than one video rate is used by participants during the conference, each set of output rates is selected from all possible combinations of output rates in the conference means, wherein the lowest output rate in each selected set is the entry rate of the endpoint joining the conference at the lowest rate. A Quality Drop Coefficient (QDC) for each endpoint that joins the conference is determined for each selected set, wherein the QDC is computed according to the endpoint entry rate and the highest rate, among the output rates of each selected set, that is lower or equal to said endpoints' entry rate. A Quality Drop Value (QDV) is calculated for each of the selected sets, wherein, preferably, the set of output rates with the lowest QDV is determined as the optimal video rate set to select. The video rate of all the endpoints having a video rate above the highest optimal video rate is reduced to the highest optimal video rate, if required, and the video rate of other endpoints having video rate between two consecutive levels of optimal video rates is reduced to the lowest level among said levels. Whenever a change occurs in either the amount of participating endpoints in the conference or in the declared bit rate capability of the participating endpoints, the video rates of all the outputs are recalculated.

The invention relates to a simple video code rate control method, which comprises bit rate preset process and quantified parameter adjustment, wherein the bit rate preset process uses video sequence character to preset the code rate; the quantified parameter adjustment uses the video sequence character to predict the code complexity, to evaluate the quantified parameters; the video sequence character is the differential diagram representing the local motion of video sequence. The invention has the advantages that: it can adjust the code rate distribution via the change to video content; the quantified parameters have simple calculation, with adaptive content; the code distribution and adjustment can match the change of video content; and it uses accumulation refresh statistic method to avoid time delay.