Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and device

A data processing device and data processing technology, applied in the field of data processing, can solve the problems of high cost of cached data, inability to configure enough capacity, and reduced model prediction accuracy, so as to reduce the amount of cached data, compress the total amount of data, and reduce the amount of cached data. cost effect

Active Publication Date: 2021-01-05
BEIJING DIDI INFINITY TECH & DEV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Compared with hard disks, using memory to cache user characteristic data can increase the access speed by 1-2 orders of magnitude, but the cost of caching data is also higher. At the same time, it is impossible to configure enough capacity for caching data. Using memory caching The data must be calculated carefully, and part of the user characteristic data must be discarded when it is necessary to reduce the accuracy of the model prediction

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041]The exemplary embodiments will be described in detail here, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of devices and methods consistent with some aspects of the application as detailed in the appended claims.

[0042]The terms used in this application are only for the purpose of describing specific embodiments, and are not intended to limit the application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present application provides a data processing method and device. In the present application, the data processing method may include: for any characteristic dimension i of the original data set, select a characteristic value Mi from all the characteristic values ​​of the characteristic dimension i, and record the mapping relationship between each i and Mi; the original data The set includes at least one feature dimension; cache the feature values ​​other than Mi on each feature dimension in the original data set; when the query request is received, query it in the cache; according to the query request and the pre-recorded mapping relationship, the The feature value whose value is empty in the cache is converted to the corresponding Mi, and the query result is generated according to the conversion result. The technical solution of the present application can improve cache efficiency and reduce cache cost.

Description

Technical field[0001]This application relates to the field of data processing technology, and in particular to a data processing method and device.Background technique[0002]With the popularization of machine learning and data mining technologies, for every user request, Internet platform-level products are likely to use one or more machine learning models to comprehensively analyze the hundreds of thousands of dimensional attributes of users to determine user behavior Analysis and prediction can provide users with more personalized services, optimize user experience, and improve the overall operating efficiency of the platform. The user scale of the platform is multiplied by hundreds of feature dimensions. How to complete model prediction calculations for such a large amount of data under the constraint of millisecond delay is a challenge facing the platform architecture.[0003]In related technologies, in order to improve response speed, the online service system will configure a cac...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2455G06F16/2453
CPCG06F16/24539G06F16/24552
Inventor 杨文君李奘常智华凌宏博曹利锋杨帆
Owner BEIJING DIDI INFINITY TECH & DEV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com