Data processing method and device and electronic equipment
A data processing and data technology, applied in the field of communication, can solve problems such as indefinite combination and multi-dimensional query
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0100] Based on the idea of the above data processing scheme, such as image 3 As shown, it is the flow of the data processing method shown in the embodiment of the present invention Figure 1 , which can be accessed via figure 2 The execution of the data processing device 230 shown in is completed. Such as image 3 As shown, the data processing method includes the following steps:
[0101] S310. Obtain the horizontally segmented original data in the database, and aggregate the original data to form an intermediate state data table.
[0102] Wherein, the database may be a relational database. After the database data is split horizontally, the data will be distributed in at least one main table (such as figure 1 The main form A) and at least one additional form (such as figure 1 In the attached table B).
[0103] In order to synchronously transmit each attribute column in a piece of data to the search engine, it is necessary to aggregate the attributes in the attached...
Embodiment 2
[0109] Such as Figure 4 Shown is the flow of the data processing method of the embodiment of the present invention Figure II . The difference from the method shown in Embodiment 1 is that a preferred implementation scheme of aggregating raw data to form an intermediate state data table is adopted. Such as Figure 4 As shown, the following steps can also be performed at the beginning of the method:
[0110] S410. Obtain the horizontally segmented original data in the database.
[0111] Wherein, the original data may include main table data and supplementary table data.
[0112] S420, adding a multi-value column field in the main table.
[0113] For example, in figure 1 Add a KeyValue field in main table A as a multi-value column field. The so-called multi-value column means that there can be multiple attribute values in the column.
[0114] S430. Write the extended attribute in the attached table that belongs to the same primary key as the main table in the form of ...
Embodiment 3
[0126] Such as Figure 5 Shown is the flow of the data processing method of the embodiment of the present invention Figure three . The difference from the method shown in Embodiment 1 is that this embodiment mainly focuses on the elaboration of the corresponding processing when the processed database data is the main table data. Such as Figure 5 As shown, the method includes the following steps:
[0127] S510. Obtain main table data of at least one main table that has been horizontally split in the database.
[0128] For example, the main table data of at least one of the above-mentioned main table A in the relational database that has been split horizontally is acquired.
[0129] S520. Synchronize the master table data to the preset search engine, and set an index for the data.
[0130] Since the data structures of the master tables A are the same, each master table A can be directly synchronized to the search engine without data aggregation (that is, cross-cutting). ...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More