Data processing method, device, computer equipment and computer readable storage medium

Abstract

The embodiments of the present application provide a data processing method, apparatus, computer equipment and computer-readable storage medium, which can determine whether the legacy data already exists in the cloud when reporting data if there is legacy data in the pre-sending area, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time; if there is no legacy data in the cloud, the data to be reported is sent to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud. Since the embodiments of the present application can determine whether the legacy data already exists in the cloud when there is legacy data in the pre-sending area, duplicate checking of the legacy data is performed, thereby improving the efficiency of duplicate checking and reducing the loss of computer equipment performance; since when the legacy data does not exist in the cloud, the legacy data and the data to be reported can be reported from the pre-sending area to the cloud together, thereby improving the efficiency of data reporting.

Description

Technical Field

[0001] The present application relates to the technical field of data transmission, and in particular to a data processing method, apparatus, computer equipment and computer-readable storage medium. Background Art

[0002] Data tracking is a method of data collection. At present, the data collected by the software development kit for data tracking and the data tracking method used in smart homes are generally collected locally and saved in the local database, and then reported from the local database to the cloud database. After the cloud returns a success or failure result, the data is processed in the local database. In the process of reporting data from the local database to the cloud database, if the local database does not receive the return result from the cloud database, the data reported to the cloud will continue to remain in the local database and will continue to be reported next time. If the data is successfully reported to the cloud database, it will continue to be reported next time, which will cause duplicate reporting and seriously affect the company's big data analysis.

[0003] The current method to solve duplicate reporting is to check the data for duplicates in the cloud. There are two solutions for checking data for duplicates in the cloud database: one is to check for duplicates every time the data is reported to the cloud database. This processing method will cause a loss of computer performance for high-frequency data reporting operations; the other is to check the data reported to the cloud database for duplicates within a specific time. The disadvantage of this processing method is that the duplicate checking is not timely, and if the time interval between duplicate checking is long, there will be a situation where the amount of duplicate checking is relatively large, which will bring greater computing pressure to the computer equipment and cause a loss of computer equipment performance. Both solutions will result in low duplicate checking efficiency and loss of computer equipment performance. Summary of the invention

[0004] The embodiments of the present application provide a data processing method, apparatus, computer equipment and computer-readable storage medium, which can improve the efficiency of duplicate checking and reduce the loss of computer equipment performance.

[0005] A data processing method, comprising:

[0006] When reporting data, if there is legacy data in the pre-sending area, it is determined whether there is legacy data in the cloud, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time;

[0007] If there is no legacy data in the cloud, the data to be reported is sent to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud.

[0008] Accordingly, an embodiment of the present application provides a data processing device, including:

[0009] The judging unit may be used to judge whether the cloud already has the legacy data if there is the legacy data in the pre-sending area when reporting the data, wherein the legacy data includes the data that has not been deleted after the pre-sending area reported the data to the cloud last time;

[0010] The sending unit may be configured to send the data to be reported to the pre-sending area when there is no legacy data in the cloud, and instruct the pre-sending area to report the legacy data and the data to be reported to the cloud.

[0011] In some embodiments, the judgment unit can be specifically used to obtain characteristic information of the legacy data when reporting data if there is legacy data in the pre-sending area, and compare the characteristic information of the legacy data with the characteristic information of the storage data stored in the cloud; if the characteristic information of the legacy data matches the characteristic information of the storage data stored in the cloud, it is determined that the legacy data already exists in the cloud; if the characteristic information of the legacy data does not match the characteristic information of the storage data stored in the cloud, it is determined that no legacy data exists in the cloud.

[0012] In some embodiments, when the judgment unit compares the characteristic information of the legacy data with the characteristic information of the storage data stored in the cloud, it can be specifically used to obtain target characteristic information of the storage data stored in the cloud; compare the characteristic information of the legacy data with the target characteristic information; if the characteristic information of the legacy data is the same as the target characteristic information, it is determined that the legacy data already exists in the cloud; if the characteristic information of the legacy data is different from the target characteristic information, it is determined that the legacy data does not exist in the cloud.

[0013] In some embodiments, when obtaining the target characteristic information of the storage data stored in the cloud, the judgment unit can be specifically used to obtain storage data whose storage time meets a preset time threshold from the cloud; and extract the target characteristic information of the storage data.

[0014] In some embodiments, the data processing device further includes a deletion unit, which can be specifically used to delete the legacy data from the pre-sending area when there is legacy data in the cloud, and then send the data to be reported to the pre-sending area.

[0015] In some embodiments, the sending unit can be specifically used to obtain the remaining storage capacity of the pre-sending area if there is no legacy data in the cloud; extract the data to be reported corresponding to the remaining storage capacity from the local database, and store the data to be reported in the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud.

[0016] In some embodiments, when the sending unit extracts the data to be reported corresponding to the remaining storage capacity from the local database and stores the data to be reported in the pre-sending area, it can be used to determine the amount of data to be reported according to the remaining storage capacity; determine the order of time for collecting the data to be reported; extract the corresponding amount of data to be reported from the local database according to the order of time for collecting the data to be reported, and store the data to be reported in the pre-sending area.

[0017] In addition, an embodiment of the present application also provides a computer device, including a memory and a processor; the memory stores a computer program, and the processor is used to run the computer program in the memory to execute any data processing method provided in the embodiment of the present application.

[0018] In addition, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. The computer program is suitable for loading by a processor to execute any data processing method provided in the embodiment of the present application.

[0019] In the embodiment of the present application, when reporting data, if there is legacy data in the pre-sending area, it can be determined whether the legacy data already exists in the cloud, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time; if there is no legacy data in the cloud, the data to be reported is sent to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud. Since the embodiment of the present application can determine whether the legacy data already exists in the cloud when there is legacy data in the pre-sending area, it can check for duplicates of the legacy data, thereby improving the efficiency of checking for duplicates and reducing the loss of computer equipment performance; since when there is no legacy data in the cloud, the legacy data and the data to be reported can be reported from the pre-sending area to the cloud together, thereby improving the efficiency of data reporting. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 It is a scenario schematic diagram of the data processing method provided in the embodiment of the present application;

[0022] Figure 2 1 is a flowchart of a data processing method provided in an embodiment of the present application;

[0023] Figure 3 FIG2 is a flow chart of a data processing method provided in an embodiment of the present application;

[0024] Figure 4 It is a schematic diagram of a process for determining whether legacy data already exists in the cloud provided by an embodiment of the present application;

[0025] Figure 5 It is a flow chart of extracting the to-be-reported data corresponding to the remaining storage capacity from the local database and storing the to-be-reported data in the pre-sending area provided by an embodiment of the present application;

[0026] Figure 6 3 are schematic diagrams of the process of the data processing method provided in the embodiment of the present application;

[0027] Figure 7 is a structural schematic diagram of a data processing device provided in an embodiment of the present application;

[0028] Figure 8 It is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0030] The embodiments of the present application provide a data processing method, device, computer equipment and computer readable storage medium. The data processing device can be integrated in a computer equipment, which can be a server or a terminal.

[0031] Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, network acceleration services (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms. The terminal can be a smart TV, smart phone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, etc., but is not limited to this. The terminal and the server can be directly or indirectly connected via wired or wireless communication, and this application does not limit this.

[0032] For example, see Figure 1Taking the data processing device integrated in a smart TV as an example, the user operates the application of the smart TV, and the smart TV collects data on the user's operation on the application through data embedding points. The data is stored in the local database as data to be reported. When the smart TV reports data, if there is legacy data in the pre-sending area, it determines whether there is legacy data in the cloud, where the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time; if there is no legacy data in the cloud, the data to be reported is sent from the local database to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud.

[0033] Among them, the data to be reported can be stored in the local database of the smart TV, that is, the user operates the application on the smart TV, and the smart TV collects the data of the user's application operation through data embedding points, and stores the data as data to be reported in the local database.

[0034] The pre-sending area may be a data processing area in a smart TV.

[0035] It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0036] This embodiment will be described from the perspective of a data processing device, which can be specifically integrated in a computer device, which can be a server or a terminal. The terminal can include a smart TV, a tablet computer, a laptop computer, a personal computer (PC), a wearable device, a virtual reality device, or other smart devices that can acquire data.

[0037] like Figure 2 As shown, the specific process of the data processing method is as follows:

[0038] 101. When reporting data, if there is legacy data in the pre-sending area, it is determined whether there is legacy data in the cloud.

[0039] Among them, the legacy data includes the data that has not been deleted after the pre-sending area reported data to the cloud last time.

[0040] 102. If there is no legacy data in the cloud, the data to be reported is sent to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud.

[0041] Among them, the embodiment of the present application can store the data to be reported in the local database according to the chronological order of the data collection time to be reported, and then extract the data to be reported stored in the local database to the pre-sending area according to the chronological order of the data collection time to be reported.

[0042] In addition, the embodiment of the present application can also store the data to be reported in a sub-local database in the local database according to the importance of the data to be reported, and then extract the data to be reported from the corresponding sub-local database to the pre-sending area according to the importance of the data to be reported. The importance of the data to be reported can be set according to the settings for different applications. For example, the data to be reported is divided into primary data, secondary data and tertiary data according to the importance. The data to be reported obtained from application A is used as primary data, the data to be reported obtained from application B and application C is used as secondary data, and the data to be reported obtained from application D is used as tertiary data. Data to be reported with different importance is stored in different sub-local databases, and the data to be reported carries the identification of the application. In this way, the sub-local database where the data to be reported is stored can be determined based on the identification of the application. If there are multiple data to be reported of the same level in the sub-local database, the computer device can extract the data to be reported to the pre-sending area according to the order of the time of collection of the data to be reported.

[0043] In the embodiment of the present application, when reporting data, if there is legacy data in the pre-sending area, it can be determined whether the legacy data already exists in the cloud, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time; if there is no legacy data in the cloud, the data to be reported is sent to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud. Since the embodiment of the present application can determine whether the legacy data already exists in the cloud when there is legacy data in the pre-sending area, it can check for duplicates of the legacy data, thereby improving the efficiency of checking for duplicates and reducing the loss of computer equipment performance; since when there is no legacy data in the cloud, the legacy data and the data to be reported can be reported from the pre-sending area to the cloud together, thereby improving the efficiency of data reporting.

[0044] like Figure 3 As shown, the specific process of the data processing method is as follows:

[0045] 201. When reporting data, if there is legacy data in the pre-sending area, it is determined whether there is legacy data in the cloud.

[0046] Among them, the legacy data includes the data that has not been deleted after the pre-sending area reported data to the cloud last time.

[0047] Among them, after the data is reported from the pre-sending area to the cloud, when the cloud returns the report success information to the pre-sending area, the pre-sending area deletes the data from the pre-sending area. When the cloud returns the report failure information to the pre-sending area or no pre-sending area receives the cloud return information, the pre-sending area retains the data.

[0048] Specifically, Figure 4 As shown, the specific process of determining whether legacy data already exists in the cloud in the embodiment of the present application is as follows:

[0049] A1. When reporting data, if there is legacy data in the pre-sending area, characteristic information of the legacy data is obtained.

[0050] Among them, the embodiment of the present application can determine whether legacy data is stored in the pre-sending area based on detecting the storage capacity of the pre-sending area, and can also determine whether legacy data is stored in the pre-sending area based on the data identifier of the legacy data.

[0051] The characteristic information of the legacy data may be a data identifier of the legacy data or an MD5 value of the legacy data.

[0052] A2. Compare the characteristic information of the legacy data with the characteristic information of the stored data stored in the cloud.

[0053] The stored data refers to the data to be reported or the legacy data reported from the pre-sending area and stored in the cloud.

[0054] The characteristic information of the stored data may be a data identifier of the stored data or an MD5 value of the stored data.

[0055] Specifically, the computer device can obtain target feature information of the storage data stored in the cloud; and compare the feature information of the legacy data with the target feature information.

[0056] In the embodiment of the present application, the computer device can obtain the target characteristic information of the storage data stored in the cloud from the cloud according to the identification of the application. For example, the data to be reported in the pre-sending area carries the identification of the application, and the storage data stored in the cloud also carries the identification of the application. The computer device identifies the application identification of the data to be reported in the pre-sending area, and based on the application identification of the data to be reported, obtains the target characteristic information of the storage data corresponding to the application identification of the data to be reported from the cloud.

[0057] In addition to the above, the computer device can also obtain storage data whose storage time meets a preset time threshold from the cloud; and extract target feature information of the storage data.

[0058] The storage time may be the time when the data to be reported is stored in the cloud. The data to be reported is called stored data after it is stored in the cloud.

[0059] The preset time threshold may be the time corresponding to the Nth to last data to be reported stored in the cloud, where N is a natural number. Thus, the storage data whose storage time satisfies the preset time threshold and is obtained by the computer device may be storage data whose storage time is less than the preset time threshold.

[0060] The preset time threshold can also be an interval. For example, the preset time threshold is the time corresponding to the Nth to last data stored in the cloud to be reported to the time corresponding to the Mth to last data stored in the cloud to be reported, where N is a natural number, M is a natural number, and N is less than M.

[0061] A3. If the characteristic information of the legacy data matches the characteristic information of the stored data stored in the cloud, it is determined that the legacy data already exists in the cloud.

[0062] Among them, there are multiple ways for a computer device to determine whether the characteristic information of legacy data matches the characteristic information of storage data stored in the cloud. For example, when the characteristic information of legacy data is the same as the characteristic information of storage data, the characteristic information of legacy data and the characteristic information of storage data stored in the cloud are said to match; for example, the characteristic information of legacy data and the characteristic information of storage data are spliced ​​to obtain the spliced ​​characteristic information, and the spliced ​​characteristic information is compared with the preset characteristic information. When the spliced ​​characteristic information is the same as the preset characteristic information, the characteristic information of legacy data and the characteristic information of storage data stored in the cloud are said to match.

[0063] Specifically, if the feature information of the legacy data is the same as the target feature information, it is determined that the legacy data already exists in the cloud.

[0064] For example, the characteristic information is a data header, and the target characteristic information is a target data header. If the data header and the target data header are different, it is determined that no storage data matching the characteristic information is stored in the cloud.

[0065] A4. If the characteristic information of the legacy data does not match the characteristic information of the stored data stored in the cloud, it is determined that there is no legacy data in the cloud.

[0066] There are many ways for a computer device to determine that the characteristic information of legacy data and the characteristic information of storage data stored in the cloud do not match. For example, when the characteristic information of the legacy data and the characteristic information of the storage data are different, it can be said that the characteristic information of the legacy data and the characteristic information of the storage data stored in the cloud do not match. For example, the characteristic information of the legacy data and the characteristic information of the storage data are spliced ​​to obtain the spliced ​​characteristic information, and the spliced ​​characteristic information is compared with the preset characteristic information. When the spliced ​​characteristic information and the preset characteristic information are different, it can be said that the characteristic information of the legacy data and the characteristic information of the storage data stored in the cloud do not match.

[0067] Specifically, if the feature information of the legacy data is different from the target feature information, it is determined that there is no legacy data in the cloud.

[0068] For example, the characteristic information is a data header, and the target characteristic information is a target data header. If the data header and the target data header are different, it is determined that no storage data matching the characteristic information is stored in the cloud.

[0069] 202. If there is no legacy data in the cloud, obtain the remaining storage capacity of the pre-sending area.

[0070] For example, the storage capacity of the pre-sending area can store 1000 pieces of data to be reported, and the pre-sending area currently stores 10 pieces of legacy data, so it can be determined that the remaining storage capacity of the local database can store 990 pieces of data to be reported.

[0071] For example, the embodiment of the present application can determine the corresponding amount of data to be reported that can be stored in the remaining storage capacity of the pre-sending area according to the size of the remaining storage capacity and the size of the data to be reported.

[0072] 203. Extract the data to be reported corresponding to the remaining storage capacity from the local database, and store the data to be reported in the pre-sending area, so as to instruct the pre-sending area to report the remaining data and the data to be reported to the cloud.

[0073] Among them, the data to be reported can be stored in the local database of the computer device, that is, the user operates the application on the computer device, and the computer device collects the data of the user's operation on the application through data embedding points, and stores the data as data to be reported in the local database.

[0074] Specifically, Figure 5 As shown, the embodiment of the present application extracts the to-be-reported data corresponding to the remaining storage capacity from the local database, and stores the to-be-reported data in the pre-sending area. The specific process includes:

[0075] B1. Determine the amount of data to be reported based on the remaining storage capacity.

[0076] B2. Determine the order of collection time for the data to be reported.

[0077] The collection time refers to the time when the computer device first collects the data to be reported.

[0078] B3. According to the order of the collection time of the data to be reported, a corresponding amount of data to be reported is extracted from the local database, and the data to be reported is stored in the pre-sending area.

[0079] In addition to the above, the embodiments of the present application can also extract a corresponding amount of data to be reported from the local database according to the importance of the data to be reported, and store the data to be reported in the pre-sending area. For example: the local database includes multiple sub-local databases, and the data to be reported is stored in different sub-local databases according to the importance. For example, the data to be reported is divided into primary data, secondary data and tertiary data according to the importance, and the data to be reported obtained from application A is used as primary data, the data to be reported obtained from application B and application C is used as secondary data, and the data to be reported obtained from application D is used as tertiary data. Data to be reported with different importance is stored in different sub-local databases, and primary data is more important than secondary data, and secondary data is more important than tertiary data. The computer device extracts the data to be reported in an amount corresponding to the remaining storage capacity from the primary data, secondary data and tertiary data in turn.

[0080] Among them, the embodiment of the present application can report the legacy data from the pre-sending area to the cloud, and then report the data to be reported from the pre-sending area to the cloud.

[0081] Among them, the embodiment of the present application can report the data to be reported in the pre-sending area to the cloud according to the order of the collection time of the data to be reported.

[0082] In addition, the embodiment of the present application can also report the data to be reported from the pre-sending area to the cloud according to the importance of the data to be reported. The pre-sending area can have multiple sub-pre-sending areas, and the data to be reported is stored in the sub-pre-sending area corresponding to the pre-sending area according to the importance of the data to be reported. For example, the data to be reported is divided into primary data, secondary data and tertiary data according to the importance, and the data to be reported obtained from application A is used as primary data, the data to be reported obtained from application B and application C is used as secondary data, and the data to be reported obtained from application D is used as tertiary data. Data to be reported with different importance is stored in different sub-pre-sending areas, and the data to be reported carries the identification of the application. In this way, the computer device can detect the identification of the application to determine the sub-pre-sending area where the data to be reported is stored. If there are multiple data to be reported of the same level in the sub-pre-sending area, the computer device can report the data to be reported to the cloud according to the order of the time of collection of the data to be reported.

[0083] Specifically, in this embodiment, if there is no legacy data in the cloud, the computer device sends the data to be reported to the pre-sending area. The specific process may be: if there is no legacy data in the cloud, the computer device detects the occupancy of the current running memory; when the occupancy is lower than a preset threshold, at least one data to be reported to the cloud is extracted from the local database, and the data to be reported is stored in the pre-sending area.

[0084] In the embodiment of the present application, a performance monitor can be installed on the computer device to detect the amount of memory used for operation. The preset threshold can be 30% or 50%, which is determined according to specific needs.

[0085] In the embodiment of the present application, when the occupancy is lower than a preset threshold, the data to be reported in the local database is stored in the cloud. It can be understood that when the occupancy of the computer device is low, that is, the computer device currently has no application running or the application is almost not running, in this way, the process of reporting the data to be reported from the local database to the cloud has almost no adverse effect on the operation of the computer device application.

[0086] In addition, in the embodiment of the present application, if there is legacy data in the cloud, the computer device deletes the legacy data from the pre-sending area and then sends the data to be reported to the pre-sending area.

[0087] Specifically, the data to be reported stored in the pre-sending area is reported to the cloud. When the computer device receives a message from the cloud indicating that the report is successful, it is determined that there is legacy data in the cloud. After deleting the legacy data from the pre-sending area, the data to be reported is sent from the local database to the pre-sending area. The data to be reported is sent from the local database to the pre-sending area. The data to be reported can be sent from the local database to the pre-sending area according to the order of the collection time of the data to be reported or the importance of the data to be reported. See the above for details and will not be repeated here.

[0088] In the embodiment of the present application, when reporting data, if there is legacy data in the pre-sending area, it can be determined whether the legacy data already exists in the cloud, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time; if there is no legacy data in the cloud, the data to be reported is sent to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud. Since the embodiment of the present application can determine whether the legacy data already exists in the cloud when there is legacy data in the pre-sending area, it can check for duplicates of the legacy data, thereby improving the efficiency of checking for duplicates and reducing the loss of computer equipment performance; since when there is no legacy data in the cloud, the legacy data and the data to be reported can be reported from the pre-sending area to the cloud together, thereby improving the efficiency of data reporting.

[0089] In order to better illustrate the above embodiment, Figure 6 As shown, further explanation is given below.

[0090] The data to be reported is transmitted from the local database of the computer device to the pre-sending area, and the pre-sending area reports the data to be reported to the cloud.

[0091] The local database is responsible for transmitting the data to be reported to the pre-sending area. The local database transmits the data to be reported to the pre-sending area, and the pre-sending area returns the transmission result of the data to be reported to the local database. The transmission result includes transmission success, transmission failure, and the number of data to be reported.

[0092] The pre-sending area interacts with the cloud. Each time the pre-sending area reports data to the cloud, if there is legacy data in the pre-sending area, the data to be reported in the pre-sending area will be checked for duplication with the stored data stored in the cloud, that is, the data identifier of the legacy data in the pre-sending area will be compared with the data identifier of the stored data stored in the cloud to determine whether the legacy data in the pre-sending area exists in the cloud.

[0093] If the data identifier of the legacy data in the pre-sending area is the same as the data identifier of the stored data in the cloud, it means that the legacy data exists in the cloud. The cloud returns the result that the legacy data exists in the cloud to the pre-sending area, and the computer device controls the deletion of the corresponding legacy data in the pre-sending area.

[0094] If the data identifier of the legacy data in the pre-sending area is different from the data identifier of the stored data in the cloud, it means that the legacy data does not exist in the cloud. The cloud returns the result that the legacy data does not exist in the cloud to the pre-sending area, and the computer device controls the legacy data to be retained in the pre-sending area.

[0095] Then, the computer device determines how much remaining storage capacity there is in the pre-sending area, and determines the amount of data to be reported that is transmitted from the local database to the pre-sending area based on the remaining storage capacity. Then, the computer device notifies the local database of the transmission status of the data to be reported, and the transmission status of the data to be reported refers to the amount of data to be reported that is transmitted from the local database to the pre-sending area. The storage capacity of the pre-sending area can be set in advance, and the computer device can transmit the data to be reported to the pre-sending area in the order of the time of collection of the data to be reported.

[0096] If the legacy data does not exist in the cloud, the legacy data and the data to be reported are reported to the cloud from the pre-sending area.

[0097] If the remaining data exists in the cloud, the data to be reported is reported to the cloud from the pre-sending area.

[0098] The cloud returns the result of the data reporting to the pre-sending area. If the pre-sending area receives the result of successful reporting returned by the cloud, the data corresponding to the successful reporting result in the pre-sending area is deleted.

[0099] In order to better implement the above method, an embodiment of the present application also provides a data processing device, which can be integrated into a computer device, such as a server or terminal, and the terminal may include a smart TV, a tablet computer, a laptop computer and / or a personal computer, etc.

[0100] For example, Figure 7 As shown, the data processing device may include a judging unit 301, a sending unit 302, and a deleting unit 303, as follows:

[0101] (1) a determination unit 301;

[0102] The judgment unit 301 can be used to judge whether there is legacy data in the cloud when reporting data, if there is legacy data in the pre-sending area, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time.

[0103] Optionally, the judgment unit 301 can be used to obtain characteristic information of the legacy data and compare the characteristic information of the legacy data with the characteristic information of the storage data stored in the cloud when reporting data; if the characteristic information of the legacy data matches the characteristic information of the storage data stored in the cloud, it is determined that the legacy data already exists in the cloud; if the characteristic information of the legacy data does not match the characteristic information of the storage data stored in the cloud, it is determined that the legacy data does not exist in the cloud.

[0104] Optionally, when comparing the characteristic information of the legacy data with the characteristic information of the storage data stored in the cloud, the judgment unit 301 can be used to obtain target characteristic information of the storage data stored in the cloud; compare the characteristic information of the legacy data with the target characteristic information; if the characteristic information of the legacy data is the same as the target characteristic information, it is determined that the legacy data already exists in the cloud; if the characteristic information of the legacy data is different from the target characteristic information, it is determined that the legacy data does not exist in the cloud.

[0105] Optionally, when obtaining target feature information of storage data stored in the cloud, the judgment unit 301 can be used to obtain storage data whose storage time meets a preset time threshold from the cloud; and extract the target feature information of the storage data.

[0106] (2) a sending unit 302;

[0107] The sending unit 302 may be configured to send the data to be reported to the pre-sending area when there is no legacy data in the cloud, and instruct the pre-sending area to report the legacy data and the data to be reported to the cloud.

[0108] The sending unit 302 can be used to obtain the remaining storage capacity of the pre-sending area if there is no legacy data in the cloud; extract the data to be reported corresponding to the remaining storage capacity from the local database, and store the data to be reported in the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud.

[0109] When the sending unit 302 extracts the data to be reported corresponding to the remaining storage capacity from the local database and stores the data to be reported in the pre-sending area, it can be used to determine the amount of data to be reported according to the remaining storage capacity; determine the order of time for collecting the data to be reported; extract the corresponding amount of data to be reported from the local database according to the order of time for collecting the data to be reported, and store the data to be reported in the pre-sending area.

[0110] (3) Deleting unit 303;

[0111] The deleting unit 303 may be configured to delete the legacy data from the pre-sending area when there is legacy data in the cloud, and then send the data to be reported to the pre-sending area.

[0112] As can be seen from the above, the judgment unit 301 of the embodiment of the present application can determine whether the legacy data already exists in the cloud when reporting data if there is legacy data in the pre-sending area, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time; the sending unit 302 can send the data to be reported to the pre-sending area if there is no legacy data in the cloud, so as to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud. Since the embodiment of the present application can determine whether the legacy data already exists in the cloud when there is legacy data in the pre-sending area, it can check for duplicates of the legacy data, thereby improving the efficiency of checking for duplicates and reducing the loss of computer equipment performance; since when the legacy data does not exist in the cloud, the legacy data and the data to be reported can be reported from the pre-sending area to the cloud together, thereby improving the efficiency of data reporting.

[0113] The present application also provides a computer device, such as Figure 8 As shown, it shows a schematic diagram of the structure of the computer device involved in the embodiment of the present application, specifically:

[0114] The computer device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that Figure 8 The computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. Among them:

[0115] The processor 401 is the control center of the computer device. It uses various interfaces and lines to connect various parts of the entire computer device. By running or executing software programs and / or modules stored in the memory 402 and calling data stored in the memory 402, it executes various functions of the computer device and processes data, thereby monitoring the computer device as a whole. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and computer programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 401.

[0116] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, a computer program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

[0117] The computer device also includes a power supply 403 for supplying power to various components. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. The power supply 403 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0118] The computer device may further include an input unit 404, which may be used to receive input digital or character information communications and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.

[0119] Although not shown, the computer device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 401 in the computer device will load the executable files corresponding to the processes of one or more computer programs into the memory 402 according to the following instructions, and the processor 401 will run the computer programs stored in the memory 402, thereby realizing various functions, as follows:

[0120] When reporting data, if there is legacy data in the pre-sending area, it is determined whether there is legacy data in the cloud, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time;

[0121] If there is no legacy data in the cloud, the data to be reported is sent to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud.

[0122] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0123] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0124] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. The computer program can be loaded by a processor to execute any data processing method provided in the embodiment of the present application.

[0125] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0126] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0127] Since the instructions stored in the computer-readable storage medium can execute the steps in any data processing method provided in the embodiments of the present application, the beneficial effects that can be achieved by any data processing method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0128] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the various optional implementations provided in the above embodiments.

[0129] The above is a detailed introduction to a data processing method, device, computer equipment and computer-readable storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data processing method, characterized in that: include: When reporting data, if there is legacy data in the pre-sending area, it is determined whether the legacy data already exists in the cloud, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time; If the legacy data does not exist in the cloud, the data to be reported is sent to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud; If the legacy data exists in the cloud, the legacy data is deleted from the pre-sending area, and then the data to be reported is sent to the pre-sending area.

2. The data processing method according to claim 1, characterized in that: When reporting data, if there is legacy data in the pre-sending area, determining whether the legacy data already exists in the cloud includes: When reporting data, if there is legacy data in the pre-sending area, characteristic information of the legacy data is obtained, and the characteristic information of the legacy data is compared with characteristic information of the storage data stored in the cloud; If the characteristic information of the legacy data matches the characteristic information of the stored data stored in the cloud, it is determined that the legacy data already exists in the cloud; If the characteristic information of the legacy data does not match the characteristic information of the storage data stored in the cloud, it is determined that the legacy data does not exist in the cloud.

3. The data processing method according to claim 2, characterized in that: The comparing the characteristic information of the legacy data with the characteristic information of the stored data stored in the cloud includes: Obtaining target feature information of the storage data stored in the cloud; Comparing the characteristic information of the legacy data with the target characteristic information; If the characteristic information of the legacy data matches the characteristic information of the stored data stored in the cloud, determining that the legacy data already exists in the cloud includes: If the characteristic information of the legacy data is the same as the target characteristic information, it is determined that the legacy data already exists in the cloud; If the characteristic information of the legacy data does not match the characteristic information of the stored data stored in the cloud, determining that the legacy data does not exist in the cloud includes: If the characteristic information of the legacy data is different from the target characteristic information, it is determined that the legacy data does not exist in the cloud.

4. The data processing method according to claim 3, characterized in that: The obtaining target feature information of the storage data stored in the cloud includes: Acquire storage data whose storage time meets a preset time threshold from the cloud; The target feature information of the stored data is extracted.

5. The data processing method according to claim 1, characterized in that: If the legacy data does not exist in the cloud, sending the data to be reported to the pre-sending area to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud, includes: If the legacy data does not exist in the cloud, obtaining the remaining storage capacity of the pre-sending area; The data to be reported corresponding to the remaining storage capacity is extracted from the local database, and the data to be reported is stored in the pre-sending area, so as to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud.

6. The data processing method according to claim 5, characterized in that: The extracting the to-be-reported data corresponding to the remaining storage capacity from the local database and storing the to-be-reported data in the pre-sending area includes: Determining the amount of the data to be reported according to the remaining storage capacity; Determining the sequence of the collection time of the data to be reported; According to the sequence of the collection time of the data to be reported, a corresponding amount of data to be reported is extracted from the local database, and the data to be reported is stored in the pre-sending area.

7. A data processing device, characterized in that: include: A judging unit, configured to judge whether the cloud already has the legacy data if there is legacy data in the pre-sending area when reporting data, wherein the legacy data includes data that has not been deleted after the pre-sending area reported data to the cloud last time; a sending unit, configured to send the data to be reported to the pre-sending area if the legacy data does not exist in the cloud, so as to instruct the pre-sending area to report the legacy data and the data to be reported to the cloud; The deleting unit is used to: when there is legacy data in the cloud, delete the legacy data from the pre-sending area, and then send the data to be reported to the pre-sending area.

8. A computer device, characterized in that: It comprises a memory and a processor; the memory stores a computer program, and the processor is used to run the computer program in the memory to execute the data processing method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor to execute the data processing method according to any one of claims 1 to 6.

Images