Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device, equipment and storage medium

A data processing and quantitative technology, applied in the direction of electrical digital data processing, special data processing applications, other database retrieval, etc., can solve the problems of long time consumption and low efficiency, and achieve the effect of improving efficiency and saving time

Active Publication Date: 2022-04-29
TENCENT TECH (SHENZHEN) CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, when there are many objects in the current cycle, this one-by-one data processing method has the problems of long time consumption and low efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, equipment and storage medium
  • Data processing method and device, equipment and storage medium
  • Data processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0031] Please refer to figure 1 , which shows a schematic diagram of a solution implementation environment provided by an embodiment of the present application. The solution implementation environment may be a Hadoop architecture 100 , including a Hadoop distributed file system (Hadoop Distributed FileSystem, HDFS) 120 and a MapReduce (map-reduce) engine 140 .

[0032] The Hadoop architecture 100 is a framework for solving offline batch processing of data, and its core parts are a distributed file system 120 and a MapReduce engine 140 . HDFS is a distributed file system based on Hadoop, and MapReduce is a computing framework based on Hadoop.

[0033] Distributed file system 120 is a distributed file system designed to run on co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and device, equipment and a storage medium, and relates to the technical field of computers and Internet of Vehicles. The embodiment of the invention can be applied to vehicle-mounted or other scenes. The method comprises the steps that a full-quantity object set in a historical period and an object set of a current period are obtained, the full-quantity object set comprises identifiers of full-quantity objects in the historical period, and the object set of the current period comprises identifiers of multiple objects in the current period; the object set of the current period is divided into K subsets, the subsets comprise identifiers of part of objects in the current period, and K is an integer larger than 1; the K subsets are compared with the total object set, a newly-added object set of the current period is obtained, and the newly-added object set of the current period comprises identifiers of objects which appear in the current period and do not appear in the historical time period. According to the data processing method and device, the time required for data processing is saved, and the data processing efficiency is improved.

Description

technical field [0001] The embodiments of the present application relate to the technical fields of computers and Internet of Vehicles, and in particular, to a data processing method, device, device, and storage medium. Background technique [0002] At present, in some Internet of Vehicles products, statistics are usually collected on newly added objects, so that developers can more clearly grasp the situation of users and make corresponding changes. [0003] In related technologies, if you want to calculate new objects, you will sort the object collection in the current cycle, and compare the objects in the object collection in the current cycle with the full object collection in the historical period one by one to filter out the current A collection of newly added objects for the period. In this way, all new objects will be filtered out as much as possible. [0004] However, when there are many objects in the current cycle, this one-by-one data processing method has the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/903G06F11/34G06K17/00
CPCG06F16/903G06F11/3414G06K17/0022
Inventor 钟子宏
Owner TENCENT TECH (SHENZHEN) CO LTD