154 results about "Duplicate content" patented technology

Methods and systems consistent with the present invention identify a repeating content in a data stream. A hash function is computed for at least one portion of a plurality of portions of the data stream. The at least one portion of the data stream has benign characters removed therefrom to prevent the identification of a benign string as the repeating content. At least one counter of a plurality of counters is incremented responsive to the computed hash function result. Each counter corresponds to a respective computed hash function result. The repeating content is identified when the at least one of the plurality of counters exceeds a count value. It is verified that the identified repeating content is not a benign string.

A media content database is created and maintained by comparing the media items from two related media streams. Segments of media items from the streams are sampled and stored. Samples from one stream are matched against samples from the other stream to identify any repeating content in the streams. A reviewer observes the matched samples representing the repeating content and provides identifying meta-data for that content. The identified media content is then added to the media content database, where it can be used at a later time in an application that requires media content recognition.

A system and method for retrieval and transfer of encrypted content from a failed set-top box. When content is recorded to the storage device of a set-top box, the content is encrypted with a content instance key. This content instance key is encrypted with the public key of the set-top box and a duplicate of the content instance key is encrypted by another public key other than the public key of the set-top. In the event the set-top fails, the encrypted content on the storage device may be retrieved from the storage device by decrypting the duplicate content instance key with the private key that corresponds with the public key that encrypted the duplicate of the content instance key.

Method of providing and presenting content to a user is disclosed. A user may provide inputs such as categories, topics, key words; inputs as to quantity, quality, emphasis and/or inclusion; inputs as to order of presentation, geography or temporal characteristics. These inputs are used to create a presentation format. This format is populated with content using a systemic program and algorithms. The content comes from various sources. The sources are selected by a secondary party that is not the user. A user may interact with the presentation by skipping, saving, rewinding, indicating like or dislike or requesting more related content. User interactivity is recorded by the systemic program. The systemic program records what content has been presented to a specific user so that a subsequent presentation does not repeat content. One result of this method is a personalized news and information radio station.

According to one embodiment, a digital stream, inclusive of an Internet Protocol (IP) datagram, is transmitted to a digital device. IP datagram comprises an IP header and a body segmented including a plurality of packets in an MPEG format such as MPEG-2 or MPEG-4 for example. The plurality of packets comprises (i) a first packet including a payload having content and a header that comprises a first packet identifier to indicate a type of the content contained in the payload of the first packet, and (ii) a second packet including a payload and a secondary packet identifier to indicate that its payload includes content duplicative of the content contained in the first packet. The second packet precedes the first packet in the digital stream. Upon detecting the presence of duplicative content, the duplicative content is recovered, but the content contained in the payload of the first packet is disregarded.

A method and system for detecting certain types of content, such as advertisements, using acoustical means from a media stream. The method uses two matching processes to detect and identify repeated content, the starting and end boundaries of which are then found. This content is used as the basis to find non-repeated content (such as less-frequently repeated advertisements) that are typically located in proximity to repeated content and can be evaluated using Gaussian mixture models (GMMs). The system that implements this method can be used for advertisement detection and monitoring for traditional media, such as television and radio, as well as for Internet-based media, such as streaming video, streaming audio and podcasts. The system can also be used to detect and identify copyrighted material in Internet traffic.

Methods, system and computer readable medium for detecting duplicate content in a pair of media files prior to publication on a webpage include generating fingerprints for the contents of each of the pair of media files. The fingerprints of one of the pair of media file are then compared with the fingerprints of another of the pair of media files to compute a similarity score. The similarity score is compared against an established threshold. If the similarity score exceeds the established threshold, it is determined that the two media files are substantial duplicate of one another.

The invention discloses a data backup method and a data backup device of a cloud storage system. The data backup method of the cloud storage system comprises the following steps of: recording modification conditions of a target data set of a client; determining a difference part of current content and backed-up content of the data set according to the recorded modification condition; and after receiving a backup operation trigger instruction, performing backup operation on the determined difference part. By applying the technical scheme provided by the embodiment of the invention, backup of a user file system at the client can be effectively managed, the operation of a user is effectively facilitated in an automatic backup mode, and the manual cost on the user side is reduced. The backup of a large amount of repeated contents each time is avoided in an incremental backup mode, so that the occupation of backup time and backup space is reduced.

An outer decoder and an inner decoder encode a block of information to be transmitted, to improve protection by adding redundancy. The redundancy permits decoding of the information from less than a complete encoded block of information. Time re-alignment of two transmissions of the same content from two base stations can mitigate the problem of duplicated frames. The user of the subscriber station can experience seamless service without repetition of content, even when handing over to a new cell while receiving a buffer of broadcast content.

The invention discloses a reading scanning display method of problem answer, which comprises the following steps: 1. clustering the answer; grouping the multiple answers of one question into several types according to the similarities of answer content; 2. fusing multiple answers in one type or each type of several types; doing uniform operation of the answer in the same type. The method and system avoids the waste of repeating scanning time, which improves the efficiency of reading answer or other information.

The invention provides for duplication of educational course content and associated files, data, and settings. The content duplication systems provides for prioritization of duplication requests, duplication status monitoring, renumbering of duplicated content items, automatic linking of duplicated content to source content, and duplication reporting.

Provided are methods, apparatus and computer programs for improved data storage and management. The invention can be implemented in a replacement or add-on to existing operating system file systems. Files in a file system are separated into a set of information components and then all information components of the file system are analyzed to identify duplication of information content. When information components with duplicate content are identified, duplicates are deleted from physical storage and indexes are generated to reflect inclusion of the retained copy of an information component in a plurality of different files. Improvements to content searching is enabled, since relevant components can be identified without retrieving whole files and since search results will include fewer duplicate results.

A mobile communication device uses a condensed text message store wherein individual messages of a thread are stored in such a manner that the thread can later be reconstructed for display. By storing individual messages rather than thread objects including duplicative content, device memory is conserved. Network bandwidth can also be preserved by sending only individual messages between the device and a central server (which server may also utilize a condensed message store).

The embodiment of the invention discloses a method for processing report data, a reporting system and a related device thereof, which are used for improving user experience. The method of the embodiment comprises the following steps of: acquiring a report template and a report filtering condition, wherein the report template at least comprises a page attribute; determining a non-repeated content value of a grouping field which is contained in a date table matched with the report filtering condition and is associated with the page attribute; generating different pages according to the non-repeated content value; and filling data table items of the content value having the same grouping field into a corresponding page in the data table items matched with the report filtering condition. The embodiment of the invention also provides the reporting system and the related device thereof. The method, the system and the device can effectively improve the user experience.

A system and method for indexing and retrieval of document images in an MMR system having repeated content is described. The system provides one or more hierarchical shared content indices that produce faster and/or more accurate search results. The system is also advantageous because the number and configuration of the hierarchical shared content indices is automated, scalable and efficient for processing documents with partially repeated content. In particular, the MMR matching unit includes a hierarchical shared content index (HSCI) and associated methods of use for processing images where the MMR system includes repeated content. The present invention also includes a number of novel methods including a method for adding an image to a hierarchical shared content index; a method for deleting an image from the hierarchical shared content index, and a method for using the hierarchical shared content index for image recognition, as well as a method for combining multiple MMR indexes into a hierarchical MMR index.

A recording device executes unattended recording after suspending dubbing when a preset recording time draws near during the dubbing, and saves dubbing-status information showing the suspension position of the dubbing. The recording device reads the dubbing status information after the end of the unattended recording, and resumes the dubbing from the suspension position. If suspension/resumption during the dubbing of a single source content results in a plurality of duplicate contents, the recording device edits the duplicate contents into a single content or a single playback route.

A method for indexing a plurality of documents, that includes a plurality of duplicate documents, first identifies one or more duplicate groups of documents from among the plurality of documents. Then, one index of content for the duplicate group is created instead of indexing the content from every document within the duplicate group. However, in contrast to the content index, an index of metadata for each of the documents in the duplicate group is created. Thus the content of each duplicate group is indexed only once, while a search engine using such indexing techniques retains the capability to answer queries as if the duplicated content was indexed for each document of the group.

A Duplicate Content Storage and Access Program (DCSAP) identifies duplicate content, stores the duplicate content in one location, and provides a doclink to the stored duplicate content so that the doclink may be automatically replaced with the duplicate content. DCSAP examines email to determine whether the email contains a section identifier. A section identifier is a data element assigned by an algorithm in such a manner that no two section identifiers can be the same. If the email does not contain a section identifier, DCSAP embeds a section identifier into the email and forwards the email. If the email contains a section identifier, DCSAP extracts the section. DCSAP stores the extracted section in a repository and creates a doclink to the stored section. DCSAP then embeds a section identifier in the remainder of the email, and forwards the remainder and the doclink to the recipient. The doclink may be activated by the recipient, or it may be activated automatically. When activated the doclink resolves into the text of the corresponding section in the repository. Additional features such as security permissions, sorting preferences, and display effects may be added to the doclink.

The invention discloses a Chinese web page text deduplication system and a Chinese web page text deduplication method. The deduplication system comprises an index server and a search server, wherein the index server comprises a web page text preprocessing module, a combined characteristic sentence extraction module and a digital signature calculation module; and the search server comprises a web page text capture module and a Hash query module. The deduplication method comprises the following steps of: normalizing a web page text; extracting a combined characteristic sentence of the text; calculating a digital signature of the combined characteristic sentence; and comparing the digital signature with the existing digital signature in a Hash table, and judging whether the digital signature is duplicated or not. By the deduplication system and the deduplication method, a search engine can quickly and accurately determine and remove a large number of Chinese web pages with duplicated contents in the Internet; and when the search engine captures a new web page, the digital signature of the web page is calculated and compared with the digital signature of the web page, which has been stored by the search engine, whether the web page is duplicated or not is judged, and the web page is not stored if the web page is duplicated, so that the waste of a storage space is avoided, and the search accuracy of the search engine is improved simultaneously.

Method and computer program product for reducing storage space requirements in a computer file system comprising linkable files are provided. The method allows creating a list of each file eligible for storage reduction. The listed files are processed to determine files comprising duplicative content. At least one of the following is performed: a) determining a presence of an existent link pointing to files with duplicative content, or b) in the absence of an existent link, creating a link for coupling files with duplicative content. One may then eliminate storage space for any redundant duplicative content, thereby reducing storage size requirements for the file system.

Web pages that share a common layout and/or functionality are associated with at least one master page and at least one endpoint page. Each master page specifies a common layout and/or functionality that are intended to be shared between the web pages. The master pages also include content place holders that identify content segments that are intended to be replaced by content that is obtained from the at least one endpoint page. When a client system requests one of the web pages, the server system merges the appropriate master page and endpoint page into a resulting page that can be rendered as the requested web page by the client system. This enables web pages sharing common features to be created automatically, in real-time, and transparently to the client system, and without having to redundantly store duplicative content for each of the web pages at the server system.