Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Similar article duplicate removal method and device, terminal and computer readable storage medium

A technology of articles and texts, which is applied to computer-readable storage media and similar to the fields of deduplication of articles, can solve problems such as the decline of reading experience, and achieve the effects of improving reading experience, ensuring the quality of delivery, and ensuring practicability

Active Publication Date: 2020-03-27
UC MOBILE CHINA CO LTD
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the process of providing graphic or video services to users, due to various reasons, there are a large number of similar or even identical articles on the Internet. Sending a large amount of content to users will cause the client to see repeated content continuously, and the reading experience will decline

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Similar article duplicate removal method and device, terminal and computer readable storage medium
  • Similar article duplicate removal method and device, terminal and computer readable storage medium
  • Similar article duplicate removal method and device, terminal and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0055] The terms "comprising" and "having" and any variations thereof in the description and claims of the present invention are intended to cover a non-exclusive inclusion, for example, a process comprising a series of steps or a device of structure need not be limited to the expressly listed Instead, those structures or steps may include other steps or structures not expressly listed or inherent to the process or device.

[0056] figure 1 It is a schematic ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a similar article duplicate removal method and device, a terminal and a computer readable storage medium, the method comprises the steps that a candidate set comprising at least two to-be-processed articles is acquired according to a preset recall mode, and the recall mode comprises at least one of the following modes: a title mode, a keyword mode, an image-text hash mode and a full text hash mode; similarity analysis processing is performed on the to-be-processed articles in the candidate set to obtain similarity information between the to-be-processedarticles; and similar articles in the candidate set are determined according to the similar information, and duplicate removal processing is performed on the similar articles. According to a technical scheme provided by the invention, a candidate set comprising to-be-processed articles is obtained through four preset recall modes, by obtaining the similar information between the articles to be processed, determining the similar articles in the candidate set according to the similar information, and performing duplicate removal processing on the similar articles, repeated issuing of the same or similar articles can be avoided, so that the issuing quality of services can be ensured, and the reading experience of users is effectively improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a method, device, terminal and computer-readable storage medium for deduplication of similar articles. Background technique [0002] With the rapid development of science and technology, people's living habits and lifestyles are undergoing revolutionary changes. The development of the Internet not only facilitates people's lives, but also greatly increases the channels for people to obtain information. [0003] In the existing technology, the information flow recommendation system can combine user portraits, long-term interests, short-term interests and behaviors, etc., to provide users with accurate delivery services of graphics, text and videos. However, in the process of providing graphic or video services to users, due to various reasons, there are a large number of similar or even identical articles on the Internet. Sending a large number of content to users...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/332G06F16/23G06F40/205G06F9/54G06K9/62
CPCG06F9/546G06F2209/548G06F18/22
Inventor 孙涛
Owner UC MOBILE CHINA CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com