Data processing method, device, storage medium and electronic device
By determining the target and uncollected data type in the scenario, obtaining supplementary data from the preset database for data replenishment processing, the problem of poor flexibility of electronic devices during data replenishment operation is solved, and more efficient data replenishment and intelligent services are achieved .
Patent Information
- Application Number
- CN201910282471.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-04-09
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2039-04-09
AI Technical Summary
Electronic devices have poor flexibility when performing data replenishment operations and cannot effectively supplement uncollected data based on the scene.
By determining the target data type and collected data type in the current scenario, determining the uncollected data type, and obtaining corresponding supplementary data from the preset database for data replenishment.
It improves the flexibility of electronic devices when data replenishment operations, can provide targeted data supplements according to the scenario, and improves the accuracy and user experience of intelligent services.
Smart Images

Figure CN111797290B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of electronic equipment, and in particular, relates to a data processing method, device, storage medium and electronic equipment. Background Art
[0002] When providing services based on artificial intelligence, electronic devices can first collect various types of data, and then provide intelligent services based on the collected data, such as pushing content of interest to users. However, in some cases, the data collected by the electronic device may be incomplete. At this time, the electronic device needs to complete the uncollected data, and then provide intelligent services based on the completed data. However, in the related art, the electronic device has poor flexibility when performing data completion operations. Summary of the invention
[0003] The embodiments of the present application provide a data processing method, device, storage medium and electronic device, which can improve the flexibility of the electronic device when performing data completion operations.
[0004] The present application provides a data processing method, including:
[0005] Determine a target data type and a first data type in a current scenario, wherein the target data type is the type of data to be collected, and the first data type is the type of data that has been collected;
[0006] Determine a second data type according to the target data type and the first data type, where the second data type is a type of data that has not been collected;
[0007] Acquire a preset database corresponding to the current scene, wherein the preset database stores data of each type in the target data type;
[0008] Acquire data belonging to the second data type from a preset database and determine it as supplementary data;
[0009] According to the supplementary data, data completion processing is performed.
[0010] The present application provides a data processing device, including:
[0011] A first determination module, used to determine a target data type and a first data type in a current scenario, wherein the target data type is a type of data to be collected, and the first data type is a type of data that has been collected;
[0012] A second determining module, configured to determine a second data type according to the target data type and the first data type, wherein the second data type is a type of data that has not been collected;
[0013] An acquisition module, used for acquiring a preset database corresponding to the current scene, wherein the preset database stores data of various types in the target data type;
[0014] A third determining module, configured to obtain data of the second data type from the preset database and determine the data as supplementary data;
[0015] A processing module is used to perform data completion processing according to the supplementary data.
[0016] An embodiment of the present application provides a storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes the data processing method provided by the embodiment of the present application.
[0017] An embodiment of the present application also provides an electronic device, including a memory and a processor, wherein the processor is used to execute the data processing method provided in the embodiment of the present application by calling a computer program stored in the memory.
[0018] In this embodiment, the electronic device may first determine the type of data that is not collected in the current scene (i.e., the second data type), and then obtain data belonging to the second data type in a preset database corresponding to the current scene, and determine the obtained data belonging to the second data type as supplementary data. Afterwards, the electronic device may perform data completion processing in the current scene based on the supplementary data. Since this embodiment may perform data completion processing based on the scene, this embodiment may improve the flexibility of the electronic device when performing data completion operations. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The technical solution and beneficial effects of the present application will be made apparent by describing in detail the specific implementation methods of the present application in conjunction with the accompanying drawings.
[0020] Figure 1 It is a schematic diagram of a panoramic perception architecture of an electronic device provided in an embodiment of the present application.
[0021] Figure 2 It is a flowchart of the data processing method provided in the embodiment of the present application.
[0022] Figure 3 It is another flowchart of the data processing method provided in an embodiment of the present application.
[0023] Figures 4 to 6 It is a scenario diagram of the data processing method provided in an embodiment of the present application.
[0024] Figure 7 It is a structural diagram of a data processing device provided in an embodiment of the present application.
[0025] Figure 8 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
[0026] Fig. 9 It is another structural schematic diagram of the electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0027] Please refer to the drawings, where the same component symbols represent the same components. The principle of the present application is illustrated by implementing it in an appropriate computing environment. The following description is based on the illustrated specific embodiments of the present application, which should not be considered as limiting other specific embodiments of the present application that are not described in detail herein.
[0028] Please refer to Figure 1 , Figure 1 Schematic diagram of application scenarios of the data processing method provided in the embodiment of the present application. The data processing method can be applied to an electronic device. A panoramic perception architecture is provided in the electronic device. The panoramic perception architecture is an integration of hardware and software for implementing the data processing method in the electronic device.
[0029] Among them, the panoramic perception architecture includes information perception layer, data processing layer, feature extraction layer, scenario modeling layer and intelligent service layer.
[0030] The information perception layer is used to obtain information about the electronic device itself or information in the external environment. The information perception layer may include multiple sensors. For example, the information perception layer includes multiple sensors such as distance sensors, magnetic field sensors, light sensors, acceleration sensors, fingerprint sensors, Hall sensors, position sensors, gyroscopes, inertial sensors, attitude sensors, barometers, heart rate sensors, etc.
[0031] Among them, the distance sensor can be used to detect the distance between the electronic device and the external object. The magnetic field sensor can be used to detect the magnetic field information of the environment in which the electronic device is located. The light sensor can be used to detect the light information of the environment in which the electronic device is located. The acceleration sensor can be used to detect the acceleration data of the electronic device. The fingerprint sensor can be used to collect the fingerprint information of the user. The Hall sensor is a magnetic field sensor made according to the Hall effect, which can be used to realize the automatic control of the electronic device. The position sensor can be used to detect the current geographical location of the electronic device. The gyroscope can be used to detect the angular velocity of the electronic device in all directions. The inertial sensor can be used to detect the motion data of the electronic device. The attitude sensor can be used to sense the attitude information of the electronic device. The barometer can be used to detect the air pressure of the environment in which the electronic device is located. The heart rate sensor can be used to detect the heart rate information of the user.
[0032] The data processing layer is used to process the data obtained by the information perception layer. For example, the data processing layer can perform data cleaning, data integration, data transformation, data reduction, etc. on the data obtained by the information perception layer.
[0033] Among them, data cleaning refers to cleaning the large amount of data obtained by the information perception layer to eliminate invalid data and duplicate data. Data integration refers to integrating multiple single-dimensional data obtained by the information perception layer into a higher or more abstract dimension to comprehensively process multiple single-dimensional data. Data transformation refers to converting the data type or format of the data obtained by the information perception layer so that the transformed data meets the processing requirements. Data reduction refers to maximizing the reduction of data volume while keeping the original appearance of the data as much as possible.
[0034] The feature extraction layer is used to extract features from the data processed by the data processing layer to extract features included in the data. The extracted features can reflect the state of the electronic device itself, the state of the user, or the environmental state of the environment in which the electronic device is located.
[0035] Among them, the feature extraction layer can extract features or process the extracted features through filtering, packaging, integration and other methods.
[0036] The filtering method refers to filtering the extracted features to delete redundant feature data. The packaging method is used to screen the extracted features. The integration method refers to integrating multiple feature extraction methods together to build a more efficient and accurate feature extraction method for extracting features.
[0037] The scenario modeling layer is used to construct a model based on the features extracted by the feature extraction layer, and the obtained model can be used to represent the state of the electronic device, the state of the user, or the state of the environment, etc. For example, the scenario modeling layer can construct a key value model, a pattern identification model, a graph model, an entity relationship model, an object-oriented model, etc. based on the features extracted by the feature extraction layer.
[0038] The intelligent service layer is used to provide intelligent services to users based on the model constructed by the scenario modeling layer. For example, the intelligent service layer can provide basic application services to users, perform system intelligent optimization for electronic devices, and provide personalized intelligent services to users.
[0039] In addition, the panoramic perception architecture may also include multiple algorithms, each of which can be used to analyze and process data, and the multiple algorithms may constitute an algorithm library. For example, the algorithm library may include Markov algorithm, implicit Dirichlet distribution algorithm, Bayesian classification algorithm, support vector machine, K-means clustering algorithm, K-nearest neighbor algorithm, conditional random field, residual network, long short-term memory network, convolutional neural network, recurrent neural network and other algorithms.
[0040] It is understandable that the execution subject of the embodiments of the present application may be an electronic device such as a smart phone or a tablet computer.
[0041] See also Figure 2 , Figure 2 : is a flow chart of a data processing method provided in an embodiment of the present application, and the flow chart may include:
[0042] In 101, a target data type and a first data type in a current scenario are determined, where the target data type is the type of data to be collected, and the first data type is the type of data that has been collected.
[0043] When providing services based on artificial intelligence, electronic devices can first collect various types of data, and then provide intelligent services based on the collected data, such as pushing content of interest to users. However, in some cases, the data collected by the electronic device may be incomplete. At this time, the electronic device needs to complete the uncollected data, and then provide intelligent services based on the completed data. However, in the related art, the electronic device has poor flexibility when performing data completion operations.
[0044] In 101 of the embodiment of the present application, for example, the electronic device may first determine the type of data to be collected in the current scene, and determine it as the target data type. Also, the electronic device may determine the type of data already collected in the current scene, and determine it as the first data type.
[0045] In one implementation, both the target data type and the first data type may be one or more data types.
[0046] In 102, a second data type is determined according to the target data type and the first data type, where the second data type is a type of data that has not been collected.
[0047] For example, after determining the target data type and the first data type, the electronic device can determine the second data type based on the target data type and the first data type, wherein the second data type is the type of data that has not been collected. It is understandable that the data of the second data type is the missing data in the current scenario.
[0048] For example, the types of data that need to be collected in the current scene (i.e., the target data type) include A, B, C, D, E, F, G, H, and I. The types of data that have been collected in the current scene (i.e., the first data type) include A, B, C, D, and I, and the electronic device can determine that the types of data that have not been collected (i.e., the second data type) include E, F, G, and H.
[0049] In 103, a preset database corresponding to the current scene is obtained, and each type of data in the target data type is stored in the preset database.
[0050] For example, after determining the second data type, the electronic device can obtain a preset database corresponding to the current scene, wherein the preset database stores data of various types in the target data type. For example, the preset database corresponding to the current scene stores data of each data type in the nine data types of A, B, C, D, E, F, G, H, and I.
[0051] In 104, data belonging to the second data type is acquired from a preset database and determined as supplementary data.
[0052] For example, after acquiring a preset database corresponding to the current scene, the electronic device may acquire data belonging to the second data type from the preset database and determine the data as supplementary data.
[0053] For example, after obtaining the preset database corresponding to the current scene, the electronic device can obtain data belonging to the four data types of E, F, G, and H from the preset database, and determine these data as supplementary data. For example, the electronic device obtains data data5 belonging to the E data type from the preset database, obtains data data6 belonging to the F data type from the preset database, obtains data data7 belonging to the G data type from the preset database, and obtains data data8 belonging to the H data type from the preset database. Afterwards, the electronic device can determine data5, data6, data7, and data8 as supplementary data.
[0054] In 105, data completion processing is performed based on the supplementary data.
[0055] For example, after determining the supplementary data, the electronic device can perform data completion processing according to the supplementary data. For example, after the electronic device obtains the supplementary data data5, data6, data7, and data8, the electronic device can perform data completion processing of the target data type. For example, as mentioned above, the first data type of the data collected by the electronic device is A, B, C, D, and I, wherein the collected data of data type A is data1, the collected data of data type B is data2, the collected data of data type C is data3, the collected data of data type D is data4, and the collected data of data type I is data9. Then, the electronic device can perform data completion processing by processing the supplementary data data5, data6, data7, data8 and the collected data data1, data2, data3, data4, and data9 into a group of data that needs to be collected in the current scenario.
[0056] It is understandable that in this embodiment, the electronic device can first determine the type of data that is not collected in the current scene (i.e., the second data type), and then obtain the data belonging to the second data type in the preset database corresponding to the current scene, and determine the obtained data belonging to the second data type as supplementary data. Afterwards, the electronic device can perform data completion processing in the current scene based on the supplementary data. Since this embodiment can perform data completion processing according to the scene, this embodiment can improve the flexibility of the electronic device when performing data completion operations.
[0057] It should be noted that the data processing method provided in this embodiment can be applied to Figure 1 The data processing layer in the panoramic perception architecture shown. The data processing method provided in this embodiment enables the electronic device to complete the data collected by itself, and the data completed by the data processing layer can be input into the feature extraction layer for feature extraction, and the scenario modeling layer can be modeled according to the data features extracted by the feature extraction layer. The data obtained by modeling can be input into the intelligent service layer, and the intelligent service layer can provide intelligent services to the users of the electronic device based on the data, such as pushing information suitable for the current scenario to the users.
[0058] See also Figure 3 , Figure 3 Another flowchart of the data processing method provided in the embodiment of the present application may include:
[0059] In 201 , the electronic device obtains scene information of different scenes and various types of data collected in advance.
[0060] For example, the electronic device may first obtain scene information of different scenes. For example, the electronic device may first obtain different scenes, and then represent the different scenes with digital codes. For example, scenes may include home, company, travel, business trip, fitness, etc. The electronic device may use the number 0 to represent the home scene, the number 1 to represent the company scene, the number 3 to represent the travel scene, the number 4 to represent the business trip scene, the number 5 to represent the fitness scene, and so on. That is, the electronic device may number the scenes sequentially.
[0061] In addition, the electronic device can obtain various types of data collected in advance. These types may include weather data, GPS location data, temperature data, application runtime data, user data, and the like. The various types of data obtained by the electronic device may be specific data values. For example, weather data may be represented by the numbers 0, 1, and 2. Among them, the number 0 may represent a sunny day, the number 1 may represent a cloudy day, the number 2 may represent a rainy day, and the like. The GPS location data may be specific longitude and latitude data. The temperature data may be a specific temperature value, such as 25 degrees, 28 degrees, or 30 degrees, and the like. The application runtime data may be the length of time that a specific application runs.
[0062] In 202, with various types of data collected in advance as input and scene information of each scene as output, the electronic device learns the weight values corresponding to each type in each corresponding scene by using a logistic regression model.
[0063] In 203 , in each scenario, the electronic device sorts the weight values corresponding to each type in descending order of the values.
[0064] In 204, the electronic device determines the types with weight values ranked in a preset order as the data types of the corresponding scenes.
[0065] For example, 202, 203, and 204 may include:
[0066] After obtaining scene information of different scenes and various types of data collected in advance, for each scene, the electronic device can use the various types of data collected in advance as input and the scene information of the scene as output, and use a logistic regression model to learn the weight values corresponding to each type in the scene.
[0067] After learning the weight values corresponding to each type in each scenario, in each scenario, the electronic device can sort the weight values corresponding to each type in descending order, and determine the type with the weight value ranked in a preset order as the data type corresponding to the scenario.
[0068] For example, for a home scene, its scene information may be its digital code 0. Then, the electronic device may use various types of pre-collected data as input of the logistic regression model, use the digital code 0 of the home scene as output of the logistic regression model, and use the logistic regression model to learn the weight values of various (data) types in the home scene.
[0069] After obtaining the weight values of each type in the home scene, the electronic device can train the weight values of each type in the home scene in order from large to small values, and determine the type ranked in a preset order as the data type corresponding to the home scene.
[0070] For example, the various types of data collected in advance include the following data types A, B, C, D, E, F, G, H, I, J, K, L, M, N, O, and P. For the scene at home, the electronic device uses the data of the above data types collected in advance as the input of the logistic regression model, uses the digital code 0 of the scene at home as the logistic regression model, and uses the logistic regression model to learn that the weight values corresponding to the 16 data types A, B, C, D, E, F, G, H, I, J, K, L, M, N, O, and P in the scene at home are 0.15, 0.1, 0.18, 0.09, 0.07, 0.06, 0.05, 0.05, 0.06, 0.01, 0.03, 0.02, 0.02, 0.04, 0.04, and 0.03, respectively. Afterwards, the electronic device can determine the type with the weight value ranked in the preset order as the data type corresponding to the scene at home. For example, the electronic device may determine the types with the weight values ranked in the first 9 digits (i.e., the first to ninth digits) as the data types corresponding to the home scene. For example, since the weight values of the 9 types (data) A, B, C, D, E, F, G, H, and I are ranked in the first 9 digits, the electronic device may determine A, B, C, D, E, F, G, H, and I as the data types corresponding to the home scene.
[0071] For another example, the various types of data collected in advance also include the following data types A, B, C, D, E, F, G, H, I, J, K, L, M, N, O, P. For the company scenario, the electronic device uses the data of the above data types collected in advance as the input of the logistic regression model, uses the digital code 1 of the company scenario as the logistic regression model, and uses the logistic regression model to learn the weight values corresponding to the 16 data types A, B, C, D, E, F, G, H, I, J, K, L, M, N, O, P in the home scenario. Afterwards, the electronic device can also determine the type with the weight value ranked in the top 9 (i.e., the first to the ninth) as the data type corresponding to the company scenario. For example, since the weight values of the 9 (data) types A, B, D, F, H, J, L, M, N are ranked in the top 9, the electronic device can determine A, B, D, F, H, J, L, M, N as the data type corresponding to the company scenario.
[0072] It can be understood that the data type corresponding to each scenario determined in 204 is the type of data that needs to be collected in the scenario.
[0073] In 205 , the electronic device sets a database corresponding to each scene, and each type of data in the data type corresponding to the scene is stored in the corresponding database.
[0074] For example, after determining the data type corresponding to each scene, the electronic device may set up a database corresponding to each scene, wherein the database stores various types of data in the data type corresponding to the scene.
[0075] For example, the data types corresponding to the scene at home include A, B, C, D, E, F, G, H, and I. Then the electronic device can set up a database corresponding to the scene at home, and the database stores data of the nine data types A, B, C, D, E, F, G, H, and I.
[0076] For example, the data types corresponding to the company scenario include A, B, D, F, H, J, L, M, and N. Then the electronic device can set up a database corresponding to the company scenario, which stores data of the nine data types A, B, D, F, H, J, L, M, and N.
[0077] In one implementation, the process of the electronic device setting a database corresponding to each scenario in 205 may include:
[0078] In each scenario, the electronic device obtains various types of data collected in advance, and obtains the data type corresponding to the scenario;
[0079] The electronic device acquires data of a data type corresponding to the scenario from various types of data collected in advance;
[0080] The electronic device selects data that meets a preset quality condition from data of a data type corresponding to the scene;
[0081] According to the data satisfying the preset quality condition, the electronic device sets a database corresponding to the scene.
[0082] For example, the data in the database corresponding to each scene can be obtained from various types of data pre-collected in the process of 201. Due to the difference in quality of different data, such as the type of GPS data, some of the collected GPS data are relatively complete, while some GPS data are relatively incomplete. Therefore, for example, when establishing a database, when it is necessary to obtain data of type A data, the electronic device can filter high-quality data from the pre-collected data of type A, and store the filtered high-quality data in the database as data of type A data. Among them, high-quality data can be data that meets preset quality conditions. After obtaining the data that meets the preset quality conditions, the electronic device can set the database corresponding to the scene according to the data that meets the preset quality conditions. That is, each scene is provided with a separate, corresponding database, which stores data of the data type corresponding to the scene.
[0083] In one embodiment, the preset quality condition may be a quality condition set according to a data quality assessment standard. The data quality assessment standard may include the noise level of the data, the missing rate of the data, the integrity of the data, etc. For example, the preset quality condition may be that the noise level is less than a preset first threshold. Alternatively, the preset quality condition may be that the missing rate of the data is less than a preset second threshold. Alternatively, the preset quality condition may be that the integrity of the data is greater than a preset third threshold, and so on. Of course, the preset quality condition may also include two or more conditions at the same time, such as the preset quality condition may be that the noise level is less than a preset first threshold and the missing rate of the data is less than a preset second threshold, and so on.
[0084] In one embodiment, for each piece of data, the electronic device can calculate a value for indicating the quality of the piece of data. For example, when the noise level is used as the evaluation standard for data quality, for each piece of data, the electronic device can calculate a value for indicating the noise level of the piece of data, and then the electronic device can compare the value with a preset first threshold. If the value is greater than or equal to the preset first threshold, it means that the piece of data has a large noise and is not high-quality data. If the value is less than the preset first threshold, it means that the piece of data has a small noise and is high-quality data.
[0085] In one embodiment, when it is necessary to establish a database and filter out data of a certain data type from pre-collected data for storage in the database, after selecting high-quality data of the data type from the pre-collected data, the electronic device can sort the numerical values used to represent the data quality in descending order, and then filter out the data ranked in a preset order to determine the data of the certain data type to be stored in the database.
[0086] It can be understood that, through the above processes 201 to 205, the electronic device predetermines the type of data that needs to be collected in each scenario, and sets up a separate corresponding database for each scenario, which stores data belonging to the type of data that needs to be collected in the scenario.
[0087] In 206 , the electronic device determines a target data type and a first data type in the current scenario, where the target data type is the type of data that needs to be collected, and the first data type is the type of data that has been collected.
[0088] For example, electronic devices can collect data in the scene and push information based on the collected data.
[0089] Then, when the electronic device pushes information to the user in the current scene, the electronic device can first determine the type of data that needs to be collected in the current scene, and determine it as the target data type. In addition, the electronic device can determine the type of data that has been collected in the current scene, and determine it as the first data type.
[0090] In 207 , the electronic device determines a second data type according to the target data type and the first data type, where the second data type is a type of data that has not been collected.
[0091] For example, after determining the target data type and the first data type, the electronic device can determine the second data type based on the target data type and the first data type, wherein the second data type is the type of data that has not been collected. It can be understood that the data of the second data type is the missing data in the data required for information push in the current scenario.
[0092] For example, the current scene is a home scene. According to the process from 201 to 204, the electronic device predetermines that the types of data to be collected in the home scene include A, B, C, D, E, F, G, H, and I. Then, in 206, the electronic device can determine that the target data types in the current scene are A, B, C, D, E, F, G, H, and I. If the types of data collected in the current scene (i.e., the first data type) include A, B, C, D, and I, the electronic device can determine that the types of data not collected (i.e., the second data type) include E, F, G, and H.
[0093] In 208 , the electronic device obtains a preset database corresponding to the current scenario, in which each type of data in the target data type is stored.
[0094] For example, after determining the second data type, the electronic device can obtain a preset database corresponding to the current scene, wherein the preset database stores data of various types in the target data type. For example, the preset database corresponding to the current home scene stores data of each of the nine data types A, B, C, D, E, F, G, H, and I.
[0095] In 209 , the electronic device obtains data belonging to the second data type from a preset database and determines the data as supplementary data.
[0096] For example, after acquiring a preset database corresponding to the current scene, the electronic device may acquire data belonging to the second data type from the preset database and determine the data as supplementary data.
[0097] For example, after obtaining the preset database corresponding to the current scene, the electronic device can obtain data belonging to the four data types of E, F, G, and H from the preset database, and determine these data as supplementary data. For example, the electronic device obtains data data5 belonging to the E data type from the preset database, obtains data data6 belonging to the F data type from the preset database, obtains data data7 belonging to the G data type from the preset database, and obtains data data8 belonging to the H data type from the preset database. Afterwards, the electronic device can determine data5, data6, data7, and data8 as supplementary data.
[0098] In 210, the electronic device performs data completion processing according to the supplementary data.
[0099] For example, after determining the supplementary data, the electronic device can perform data completion processing according to the supplementary data. For example, after the electronic device obtains the supplementary data data5, data6, data7, and data8, the electronic device can perform data completion processing of the target data type. For example, as mentioned above, the first data type of the data collected by the electronic device is A, B, C, D, and I, wherein the collected data of data type A is data1, the collected data of data type B is data2, the collected data of data type C is data3, the collected data of data type D is data4, and the collected data of data type I is data9. Then, the electronic device can perform data completion processing by processing the supplementary data data5, data6, data7, data8 and the collected data data1, data2, data3, data4, and data9 into a group of data that needs to be collected in the current scenario.
[0100] For example, after obtaining the supplementary data data5, data6, data7, and data8, the electronic device can push information in the current scenario based on data data1, data2, data3, data4, data5, data6, data7, data8, and data9.
[0101] That is, in one implementation, after the electronic device performs the data completion process in 210, the following process may also be included:
[0102] Based on the data of the first data type and the supplementary data, the electronic device recommends information in the current scenario.
[0103] See also Figures 4 to 6 , Figures 4 to 6 A schematic diagram of a scenario of a data processing method provided in an embodiment of the present application.
[0104] For example, the electronic device predetermines the type of data that needs to be collected in each scenario, and sets up a separate corresponding database for each scenario, which stores data belonging to the type of data that needs to be collected in the scenario. For example, the electronic device determines that the data types that need to be collected in the home scenario include 9 types of A, B, C, D, E, F, G, H, and I, and sets up a database corresponding to the home scenario, which stores data belonging to each of the 9 types of A, B, C, D, E, F, G, H, and I. For another example, the electronic device determines that the data types that need to be collected in the company scenario include 9 types of A, B, D, F, H, J, L, M, and N, and sets up a database corresponding to the company scenario, which stores data belonging to each of the 9 types of A, B, D, F, H, J, L, M, and N, and so on.
[0105] For example, the electronic device needs to push information of interest to the user in the current scene. At this time, the electronic device can first determine what kind of scene the current scene is and start collecting data. After that, the electronic device can determine the target data type and the first data type in the current scene. The target data type is the type of data to be collected, and the first data type is the type of data that has been collected. For example, Figure 4 As shown, the current scene is a home scene, so the electronic device can determine that the target data types include A, B, C, D, E, F, G, H, and I. In addition, Figure 5 As shown, the electronic device collects data1, data2, data3, data4, and data9. Among them, the data types of data1, data2, data3, data4, and data9 are A, B, C, D, and I, respectively. That is, the electronic device determines that the types of the collected data include A, B, C, D, and I. Then, the electronic device can determine the type of the data that has not been collected, that is, the second data type, for example, including E, F, G, and H.
[0106] Afterwards, the electronic device can obtain a preset database corresponding to the home scene, and obtain data belonging to the second data type from the preset database. For example, the electronic device obtains data data5 belonging to the E data type from the preset database, obtains data data6 belonging to the F data type from the preset database, obtains data data7 belonging to the G data type from the preset database, and obtains data data8 belonging to the H data type from the preset database. Figure 6 shown.
[0107] After obtaining data5, data6, data7, and data8, the electronic device can perform data completion processing based on data5, data6, data7, and data8, and push information in the current scenario based on a set of data data1, data2, data3, data4, data5, data6, data7, data8, and data9 after the data completion processing.
[0108] In this embodiment, by specifically completing data in predetermined data types in different scenarios, the amount of data and calculations required for data completion processing can be reduced, thereby improving the intelligence level of data completion.
[0109] See also Figure 7 , Figure 7 The data processing device 300 may include: a first determination module 301 , a second determination module 302 , an acquisition module 303 , a third determination module 304 , and a processing module 305 .
[0110] The first determination module 301 is used to determine the target data type and the first data type in the current scenario, where the target data type is the type of data to be collected and the first data type is the type of data that has been collected.
[0111] The second determination module 302 is used to determine a second data type according to the target data type and the first data type, where the second data type is a type of data that has not been collected.
[0112] The acquisition module 303 is used to acquire a preset database corresponding to the current scene, wherein the preset database stores data of various types in the target data type.
[0113] The third determining module 304 is configured to obtain data of the second data type from the preset database and determine the data as supplementary data.
[0114] The processing module 305 is used to perform data completion processing according to the supplementary data.
[0115] In one implementation, the first determining module 301 may also be used to:
[0116] Obtain scenario information for different scenarios and various types of data collected in advance;
[0117] Based on the scene information and the pre-collected data of each type, a data type corresponding to each scene is learned.
[0118] In one implementation, the first determining module 301 may be used to:
[0119] Using the pre-collected data of various types as input and the scene information of each scene as output, a logistic regression model is used to learn the weight values corresponding to each type in each corresponding scene;
[0120] According to the weight values corresponding to each type in each scenario, the data type corresponding to each corresponding scenario is determined.
[0121] In one implementation, the first determining module 301 may be used to:
[0122] In each scenario, sort the weight values corresponding to each type in descending order;
[0123] The types whose weight values are ranked in a preset order are determined as the data types of the corresponding scenes.
[0124] In one implementation, the first determining module 301 may also be used to:
[0125] A database corresponding to each scene is set, and each type of data in the data type corresponding to the scene is stored in the corresponding database.
[0126] In one implementation, the first determining module 301 may be used to:
[0127] In each scenario, obtain the pre-collected data of various types and obtain the data type corresponding to the scenario;
[0128] Acquire data of a data type corresponding to the scenario from the various types of data collected in advance;
[0129] Selecting data that meets a preset quality condition from the data of the data type corresponding to the scene;
[0130] A database corresponding to the scene is set according to the data satisfying the preset quality condition.
[0131] In one implementation, the processing module 305 may also be used to:
[0132] Information recommendation in the current scenario is performed based on the data of the first data type and the supplementary data.
[0133] An embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes the process in the data processing method provided in this embodiment.
[0134] An embodiment of the present application also provides an electronic device, including a memory and a processor, wherein the processor is used to execute the process in the data processing method provided in this embodiment by calling a computer program stored in the memory.
[0135] For example, the electronic device may be a mobile terminal such as a tablet computer or a smart phone. Figure 8 , Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
[0136] The electronic device 400 may include components such as a sensor 401, a memory 402, and a processor 403. Those skilled in the art will appreciate that Figure 8 The electronic device structure shown in the figure does not constitute a limitation of the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.
[0137] The sensor 401 may include a gyro sensor (eg, a three-axis gyro sensor), an acceleration sensor, or other sensors.
[0138] The memory 402 may be used to store applications and data. The applications stored in the memory 402 include executable codes. The applications may be composed of various functional modules. The processor 403 executes various functional applications and data processing by running the applications stored in the memory 402.
[0139] The processor 403 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device and processes data by running or executing applications stored in the memory 402 and calling data stored in the memory 402, thereby monitoring the electronic device as a whole.
[0140] In this embodiment, the processor 403 in the electronic device will load the executable code corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 403 will run the application program stored in the memory 402 to execute:
[0141] Determine a target data type and a first data type in a current scenario, wherein the target data type is the type of data to be collected, and the first data type is the type of data that has been collected;
[0142] Determine a second data type according to the target data type and the first data type, where the second data type is a type of data that has not been collected;
[0143] Acquire a preset database corresponding to the current scene, wherein the preset database stores data of each type in the target data type;
[0144] Acquire data belonging to the second data type from a preset database and determine it as supplementary data;
[0145] According to the supplementary data, data completion processing is performed.
[0146] See also Fig. 9 The electronic device 500 may include components such as a sensor 501, a memory 502, a processor 503, a display screen 504, a speaker 505, and a microphone 506.
[0147] The sensor 501 may include a gyro sensor (eg, a three-axis gyro sensor), an acceleration sensor, or other sensors.
[0148] The memory 502 may be used to store applications and data. The applications stored in the memory 502 include executable codes. The applications may be composed of various functional modules. The processor 503 executes various functional applications and data processing by running the applications stored in the memory 502.
[0149] The processor 503 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device and processes data by running or executing applications stored in the memory 502 and calling data stored in the memory 502, thereby monitoring the electronic device as a whole.
[0150] The display screen 504 can be used to display information such as images and text, the speaker 505 can be used to play sound signals, and the microphone 506 can be used to pick up sound signals in the surrounding environment.
[0151] In this embodiment, the processor 503 in the electronic device will load the executable code corresponding to the process of one or more application programs into the memory 502 according to the following instructions, and the processor 503 will run the application program stored in the memory 502 to execute:
[0152] Determine a target data type and a first data type in a current scenario, wherein the target data type is the type of data to be collected, and the first data type is the type of data that has been collected;
[0153] Determine a second data type according to the target data type and the first data type, where the second data type is a type of data that has not been collected;
[0154] Acquire a preset database corresponding to the current scene, wherein the preset database stores data of each type in the target data type;
[0155] Acquire data belonging to the second data type from a preset database and determine it as supplementary data;
[0156] According to the supplementary data, data completion processing is performed.
[0157] In one embodiment, before determining the target data type and the first data type in the current scene, the processor 503 may also execute: obtaining scene information of different scenes and various types of data collected in advance; and learning the data type corresponding to each scene based on the scene information and the various types of data collected in advance.
[0158] In one embodiment, when the processor 503 executes the learning of the data type corresponding to each scene based on the scene information and the pre-collected data of each type, it can execute: using the pre-collected data of each type as input and the scene information of each scene as output, using the logistic regression model to learn the weight values corresponding to each type under each corresponding scene; and determining the data type corresponding to each corresponding scene based on the weight values corresponding to each type under each scene.
[0159] In one embodiment, when the processor 503 executes the weight values corresponding to each type in each scenario to determine the data type corresponding to each corresponding scenario, it can execute: in each scenario, sorting the weight values corresponding to each type in descending order of values; and determining the type with the weight value ranked in a preset order as the data type of each corresponding scenario.
[0160] In one implementation, before determining the target data type and the first data type in the current scenario, the processor 503 may further execute: setting a database corresponding to each scenario, wherein the corresponding database stores data of each type in the data type corresponding to the scenario.
[0161] In one embodiment, when the processor 503 executes the setting of the database corresponding to each scene, it can execute: in each scene, obtain the pre-collected data of each type, and obtain the data type corresponding to the scene; obtain data of the data type corresponding to the scene from the pre-collected data of each type; select data that meets preset quality conditions from the data of the data corresponding to the scene; and set the database corresponding to the scene based on the data that meets the preset quality conditions.
[0162] In one implementation, after performing the data completion process, the processor 503 may further execute: performing information recommendation in the current scenario based on the data of the first data type and the supplementary data.
[0163] In the above embodiments, the description of each embodiment has its own focus. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the data processing method above, and will not be repeated here.
[0164] The data processing device provided in the embodiment of the present application belongs to the same concept as the data processing method in the above embodiment. Any method provided in the data processing method embodiment can be run on the data processing device. The specific implementation process is detailed in the data processing method embodiment and will not be repeated here.
[0165] It should be noted that, for the data processing method described in the embodiment of the present application, a person of ordinary skill in the art can understand that all or part of the process of implementing the data processing method described in the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor, and the execution process may include the process of the embodiment of the data processing method. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), etc.
[0166] For the data processing device of the embodiment of the present application, each functional module can be integrated into a processing chip, or each module can exist physically separately, or two or more modules can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a disk or an optical disk.
[0167] The above is a detailed introduction to a data processing method, device, storage medium and electronic device provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A data processing method, characterized in that: include: Acquire scene information of different scenes and various types of data collected in advance; use the various types of data collected in advance as input and the scene information of each scene as output, and use the model to learn the data type corresponding to each corresponding scene; Setting a database corresponding to each scene, wherein each type of data in the data type corresponding to the scene is stored in the corresponding database; When the electronic device needs to push information to the user in the current scenario, determine the target data type and the first data type in the current scenario, where the target data type is the type of data to be collected and the first data type is the type of data that has been collected; Determine a second data type according to the target data type and the first data type, where the second data type is a type of data that has not been collected; Acquire a preset database corresponding to the current scene, wherein the preset database stores data of each type in the target data type; Acquire data belonging to the second data type from a preset database and determine it as supplementary data; According to the supplementary data, data completion processing is performed.
2. The data processing method according to claim 1, characterized in that: The method uses the pre-collected data of various types as input and the scene information of each scene as output, and uses the model to learn the data type corresponding to each corresponding scene, including: Using the pre-collected data of various types as input and the scene information of each scene as output, a logistic regression model is used to learn the weight values corresponding to each type in each corresponding scene; According to the weight values corresponding to each type in each scenario, the data type corresponding to each corresponding scenario is determined.
3. The data processing method according to claim 1, characterized in that: The determining of the data type corresponding to each corresponding scene according to the weight value corresponding to each type in each scene includes: In each scenario, sort the weight values corresponding to each type in descending order; The types whose weight values are ranked in a preset order are determined as the data types of the corresponding scenes.
4. The data processing method according to claim 1, characterized in that: The setting of the database corresponding to each scenario includes: In each scenario, obtain the pre-collected data of various types and obtain the data type corresponding to the scenario; Acquire data of a data type corresponding to the scenario from the various types of data collected in advance; Selecting data that meets a preset quality condition from the data of the data type corresponding to the scene; A database corresponding to the scene is set according to the data satisfying the preset quality condition.
5. The data processing method according to claim 1, characterized in that: After the data completion process is performed, the method further includes: Information recommendation in the current scenario is performed based on the data of the first data type and the supplementary data.
6. A data processing device, characterized in that: include: The preprocessing module is used to obtain scene information of different scenes and various types of data collected in advance; Using the pre-collected data of various types as input and the scene information of each scene as output, the model is used to learn the data type corresponding to each corresponding scene; Setting a database corresponding to each scene, wherein each type of data in the data type corresponding to the scene is stored in the corresponding database; A first determination module, configured to determine a target data type and a first data type in the current scenario when the electronic device needs to push information to the user in the current scenario, wherein the target data type is the type of data to be collected, and the first data type is the type of data that has been collected; A second determining module, configured to determine a second data type according to the target data type and the first data type, wherein the second data type is a type of data that has not been collected; An acquisition module, used for acquiring a preset database corresponding to the current scene, wherein the preset database stores data of various types in the target data type; A third determining module, configured to obtain data of the second data type from the preset database and determine the data as supplementary data; A processing module is used to perform data completion processing according to the supplementary data.
7. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 5.
8. An electronic device, comprising a memory and a processor, characterized in that: The processor is configured to execute the method according to any one of claims 1 to 5 by calling the computer program stored in the memory.
Citation Information
Patent Citations
Automatic application program sequencing system and method
CN106331330A
Data caching method, device and system
CN107623702A
Data source supplementing method and device, computer equipment and storage medium
CN108897772A
Data Processing Method and Device
US20170185873A1
