648 results about "Data reduction" patented technology

A system configured to optimize access to stored chunks of data is provided. The system comprises a vLUN layer, a mapped LUN layer, and a mapping layer disposed between the vLUN and the mapped LUN. The vLUN provides a plurality of logical chunk addresses (LCAs) and the mapped LUN provides a plurality of physical chunk addresses (PCAs), where each LCA or PCA stores a respective chunk of data. The mapping layer defines a layout of the mapped LUN that facilitates efficient read and write access to the mapped LUN.

A data storage and retrieval device and method is disclosed. The device includes at least one magnetic storage medium configured to store target data and at least one re-configurable logic device comprising an FPGA coupled to the at least one magnetic storage medium and configured to read a continuous stream of target data therefrom, having been configured with a template or as otherwise desired to fit the type of search and data being searched. The re-configurable logic device is configured to receive at least one search inquiry in the form of a data key and to determine a match between the data key and the target data as it is being read from the at least one magnetic storage medium. This device and method can perform a variety of searches on the target data including without limitation exact and approximate match searches, sequence match searches, image match searches and data reduction searches. This device and method may be provided as part of a stand-alone computer system, embodied in a network attached storage device, or can otherwise be provided as part of a computer LAN or WAN. In addition to performing search and data reduction operations, this device may also be used to perform a variety of other processing operations including encryption, decryption, compression, decompression, and combinations thereof.

A method for gathering medical information sorting it by statistically and medically based rules, and condensing it into a data set which enables medical providers to practice medicine in a more efficient manner. The medical information may be gathered from insurance billing records and patient responses to statistically-validated medical status questionnaires. The patient population may be a defined one, being composed of all patients in a group which is being treated by an individual medical provider or a group of providers at any particular time. The financial transactions to be monitored may be formatted electronically into one or more standard formats as well as medical diagnosis and medical procedure information which has been transmitted in standard codes. These data sets are gathered in electronic format by being copied from the feeder computer system into another computer which does the required rules-based data reduction.

A “forward” delta data management technique uses a “sparse” index associated with a delta file to achieve both delta management efficiency and to eliminate read latency while accessing history data. The invention may be implemented advantageously in a data management system that provides real-time data services to data sources associated with a set of application host servers. To facilitate a given data service, a host driver embedded in an application server connects an application and its data to a cluster. The host driver captures real-time data transactions, preferably in the form of an event journal that is provided to the data management system. In particular, the driver functions to translate traditional file/database/block I/O into a continuous, application-aware, output data stream. In an illustrative embodiment, a given application aware data stream is processed through a multi-stage data reduction process to produce a compact data representation from which an “any point-in-time” reconstruction of the original data can be made.

With audio data reduction on the basis of ISO/IEC standard 11172-3, a frame length varying by 8 bits is used at a sampling frequency of 44.1 kHz in order to arrive, on average, at a particular fixed data rate. The lengthening of a data frame is signalled by a padding bit in the header of the frames. The invention dispenses with evaluation of the padding bit. Instead, the mean frame length L is calculated, L is rounded down to the next integer, for the subsequent frame it is first established whether the expected sync word for this frame appears, and, if this is so, this frame is decoded without taking into account the padding bit, but if the expected sync word for this frame does not appear, the decoding of the frame is started one 8-bit later without taking into account the padding bit.

A closed-loop vision system is disclosed that utilizes a concept known as Dynamically Reconfigurable Vision (DRV), which is adaptive image sensing driven by a computer or human operator's response to changing scenery. The system reduces the amount of irrelevant video information sensed and thus achieves more effective bandwidth and computational resource utilization, as compared to traditional vision systems. One or more reconfigurable photodetector arrays sensitive to either visible, infrared or ultraviolet radiation are present in the DRV system. These photodetector arrays feature on-chip means for spatial and temporal data reduction implemented through multiple independently controllable, time-correlated, frequently overlapping windows on the photodetector array that may be programmed according to their size, location, resolution, integration time, and frame rate. All photodetector array windows are dynamically reconfigurable in real time on a frame-by-frame basis. Furthermore, a DRV system is constructed in a client-server architecture in which a vision processor client passes window request command messages to the reconfigurable photodetector array server, which in turn delivers the requested video back to the client processor. The ability to simultaneously reconfigure, integrate, process, and readout multiple photodetector array video windows is an important characteristic of the DRV system.

A data storage and retrieval device and method is disclosed. The device includes at least one magnetic storage medium configured to store target data and at least one re-configurable logic device comprising an FPGA coupled to the at least one magnetic storage medium and configured to read a continuous stream of target data therefrom, having been configured with a template or as otherwise desired to fit the type of search and data being searched. The reconfigurable logic device is configured to receive at least one search inquiry in the form of a data key and to determine a match between the data key and the target data as it is being read from the at least one magnetic storage medium. This device and method can perform a variety of searches on the target data including without limitation exact and approximate match searches, sequence match searches, image match searches and data reduction searches. This device and method may be provided as part of a stand-alone computer system, embodied in a network attached storage device, or can otherwise be provided as part of a computer LAN or WAN.

A surface inspection system, as well as related components and methods, are provided. The surface inspection system includes a beam source subsystem, a beam scanning subsystem, a workpiece movement subsystem, an optical collection and detection subsystem, and a processing subsystem. The signal processing subsystem comprises a series of data acquisition nodes, each dedicated to a collection detection module and a plurality of data reduction nodes, made available on a peer to peer basis to each data acquisition nodes. Improved methods for detecting signal in the presence of noise are also provided.

A method dramatically reduces the amount of data to be stored and transferred in a networked storage system. Preferably, the network storage system provides continued data protection through mirroring/replication, disk-to-disk backup, data archiving for future retrieval, and Information Lifecycle management (ILM). The idea is to leverage the parity computation that exists in RAID systems. By caching, transferring, and storing data parity or delta bytes of changes on a block as opposed to data block itself, substantial data reduction is possible without using sophisticated compression algorithms at the production side to minimize performance impacts upon production servers. Data can be computed using the parity/delta and previously existing data at mirror side, replication side, backup storage, or at retrieval time upon events such as failures or ILM operations.

Method and apparatus for extracting intra-coded video frames from a video data stream including inter-coded video frames and intra-coded video frames to produce reduced resolution intra-coded video frames suitable for recording in trick play tape segments of a tape for later play back and display during video tape recorder trick play operation. A plurality of methods and apparatus for buffering and selecting received intra-coded video frames for recording in trick play tape segments to support a plurality of trick play modes of operation are disclosed. In addition, a plurality of different data reduction methods and apparatus are disclosed for generating reduced resolution intra-coded frames from the received full resolution intra-coded video frames.

Replica correlation processing, and associated representative signal-data reduction and reconstruction techniques, are used to detect signals of interest and obtain robust measures of received-signal parameters, such as time differences of signal arrival and directional angles of arrival, that can be used to estimate the location of a cellularized-communications signal source. The new use in the present invention of signal-correlation processing for locating communications transmitters. This enables accurate and efficient extraction of parameters for a particular signal even in a frequency band that contains multiple received transmissions, such as occurs with code-division-multiple-access (CDMA) communications. Correlation processing as disclosed herein further enables extended processing integration times to facilitate the effective detection of desired communications-signal effects and replication measurement of their location-related parameters, even for the communications signals modulated to convey voice conversations or those weakened through propagation effects. Using prior, constructed, signal replicas in the correlation processing enables elimination of the inter-site communications of the signal representations that support the correlation analyses. Reduced-data representations of the modulated signals for voiced conversation, or for the variable components of data communications, are used to significantly reduce the inter-site communications that support the correlation analyses.

A system and method for reducing the data-rate when processing video, particularly wide-angle video.

The present invention relates to methods for protecting a data signal using the following techniques: applying a data reduction technique to reduce the data signal into a reduced data signal; subtracting the reduced data signal from the data signal to produce a remainder signal; embedding a first watermark into the reduced data signal to produce a watermarked, reduced data signal; and adding the watermarked, reduced data signal to the remainder signal to produce an output signal. A second watermark may be embedded into the remainder signal before the final addition step. Further, cryptographic techniques may be used to encrypt the reduced data signals and to encrypt the remainder signals before the final addition step. The present invention also relates to a system for securing a data signal including: computer devices for applying a data reduction technique to reduce the data signal into a reduced data signal; means to subtract the reduced data signal from the data signal to produce a remainder signal; means to apply a first cryptographic technique to encrypt the reduced data signal to produce an encrypted, reduced data signal; means to apply a second cryptographic technique to encrypt the remainder signal to produce an encrypted remainder signal; and means to add the encrypted, reduced data signal to the encrypted remainder signal to produce an output signal.

The present invention relates to methods for protecting a data signal using the following techniques: applying a data reduction technique to reduce the data signal into a reduced data signal; subtracting the reduced data signal from the data signal to produce a remainder signal; embedding a first watermark into the reduced data signal to produce a watermarked, reduced data signal; and adding the watermarked, reduced data signal to the remainder signal to produce an output signal. A second watermark may be embedded into the remainder signal before the final addition step. Further, cryptographic techniques may be used to encrypt the reduced data signals and to encrypt the remainder signals before the final addition step. The present invention also relates to systems for securing a data signal. Such systems may include computer devices for applying a data reduction technique to reduce the data signal into a reduced data signal and means to subtract the reduced data signal from the data signal to produce a remainder signal. Such systems may include means to apply a first cryptographic technique to encrypt the reduced data signal to produce an encrypted, reduced data signal and means to apply a second cryptographic technique to encrypt the remainder signal to produce an encrypted remainder signal; and means to add the encrypted, reduced data signal to the encrypted remainder signal to produce an output signal.

A secured data transfer system (10) and method is disclosed in accordance with an embodiment of the invention that enables sensitive data to be securely exchanged from a user/client's mobile device (12), phone, personal digital assistant (PDA), or the like to a back-end host (28), flowing through many hops and points in an public network, for example the Internet and/or in applications such as service provider's wireless networks, without being exposed to any security gaps in between servers. The system and method provides a secure solution that plugs the gaps and ensures a true end-to-end, bank-grade secured transaction exchange between the user/client's mobile device (12) and the back-end host (28) and using caching method for network traffic data reduction techniques.

Mechanisms are provided for performing efficient compression and deduplication of data segments. Compression algorithms are learning algorithms that perform better when data segments are large. Deduplication algorithms, however, perform better when data segments are small, as more duplicate small segments are likely to exist. As an optimizer is processing and storing data segments, the optimizer applies the same compression context to compress multiple individual deduplicated data segments as though they are one segment. By compressing deduplicated data segments together within the same context, data reduction can be improved for both deduplication and compression. Mechanisms are applied to compensate for possible performance degradation.

The invention discloses a real-time image compression and reduction method based on a plurality of palettes. The real-time image compression and reduction method comprises the following steps of: preassembling and fixing the palettes, cutting a source image into blocks with a fixed size, reading an RGB (Red-Green-Blue) color value of each pixel point of each block, then carrying out color space transformation on the color values, and carrying out statistics on color systems of the images by a color histogram based on main colors; then carrying out color value matching according to color system palettes corresponding to the color systems, and finding the best palette; then replacing the value of each pixel point of the image into an index number of the palettes, and carrying out recompression on the indexed data, thus reaching a higher compression rate; and in transmission on a network, only transmitting the indexed data after compression without transmitting palette data of the color systems, thus achieving the purpose of reducing transmission of data amount. A receiving end only needs to decompress the data, obtain the indexed data, then carry out image data reduction according to the palettes of the local color system and then display the data.

In accordance with the teachings described herein, systems and methods are provided for analyzing transactional data. A similarity analysis program may be used that receives time-series data relating to transactions of an organization and performs a similarity analysis of the time-series data to generate a similarity matrix. A data reduction program may be used that receives the time-series data and performs one or more dimension reduction operations on the time-series data to generate reduced time-series data. A distance analysis program may be used that performs a distance analysis using the similarity matrix and the reduced time-series data to generate a distance matrix. A data analysis program may be used that performs a data analysis operation, such as a data mining operation, using the distance matrix to generate a data mining analysis of the transactional data.

The invention discloses a method, system, server and computer program product of automatically reducing the amount of form related data, e.g. extensible markup language data, sent to a receiving terminal. In the method, a user interface description is analyzed to determine, which parts of the form related data are relevant for the receiving terminal. Based on the analysis, unnecessary parts of the form related data are pruned and the pruned form related data is sent to the receiving terminal. In one embodiment of the invention, XForms is analyzed to determine, which parts of an extensible markup language data are relevant for the receiving terminal.

The present invention relates to a method for estimating blood glucose levels using a noninvasive optical coherence tomography- (OCT-) based blood glucose monitor. An algorithm correlates OCT-based estimated blood glucose data with actual blood glucose data determined by invasive methods. OCT-based data is fit to the obtained blood glucose measurements to achieve the best correlation. Once the algorithm has generated sets of estimated blood glucose levels, it may refine the number of sets by applying one or more mathematical filters. The OCT-based blood glucose monitor is calibrated using an Intensity Difference plot or the Pearson Product Moment Correlation method.

In various embodiments, a high-density solid-state storage unit includes a plurality of flash cards. Each flash card has a flash controller that incorporates one or more resources for facilitating compression and decompression operations. In one aspect, data reduction and data reconstruction operations can be performed in-line as data is stored to and retrieved from flash memory. In another aspect, data reduction and data reconstruction operations can be performed as a service. Any one of the plurality of flash cards can be used to provide data reduction or data reconstruction services on demand for any type of data, including system data, libraries, and firmware code.

The invention provides seminal computational approaches utilizing data from non-rare cells to detect rare cells, such as circulating tumor cells (CTCs). The invention is applicable at two distinct stages of CTC detection; the first being to make decisions about data collection parameters and the second being to make decisions during data reduction and analysis. Additionally, the invention utilizes both one and multi-dimensional parameterized data in a decision making process.