A data processing device

Abstract

The present application discloses a data processing device, which includes a central processing module, a network switching module and a data processing module. The central processing module and the data processing module are connected through the network switching module, and the data processing module is connected with an external device through the network switching module; the central processing module is used to analyze and process the received task processing instructions to obtain tasks to be processed; the network switching module is used to send the tasks to be processed sent by the central processing module to the data processing module; the data processing module is used to process the tasks to be processed, obtain processing results, and send the processing results to the external device through the network switching module. This reduces the dependence on the central processing module and better improves the processing capacity of the data processing device.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a data processing device. Background Art

[0002] With the rapid rise of artificial intelligence technology, there is a large amount of data that needs to be analyzed and processed intelligently. Intelligent analysis and processing includes the process of data acquisition, analysis, storage and forwarding, which requires data processing equipment to have high processing capabilities.

[0003] The traditional data processing equipment architecture is mainly centered on the CPU (Central Processing Unit), which makes the data acquisition, analysis, storage and forwarding tasks mainly rely on the CPU's processing power. However, as the amount of data continues to grow, in order for data processing equipment to meet computing power requirements, it is necessary to improve the CPU specifications, which will not only increase the power consumption and cost of the entire machine, but also the CPU specifications are limited. If the performance cannot meet the requirements, it will become a bottleneck for improving data processing capabilities. Summary of the invention

[0004] The main technical problem solved by the present application is to provide a data processing device that can reduce the dependence on the central processing module and improve the processing capability of the data processing device.

[0005] In order to solve the above technical problems, a technical solution adopted in the present application is: a data processing device is provided, which includes a central processing module, a network switching module and a data processing module, the central processing module and the data processing module are connected through the network switching module, and the data processing module is connected to an external device through the network switching module; the central processing module is used to analyze and process the received task processing instructions to obtain tasks to be processed; the network switching module is used to send the tasks to be processed sent by the central processing module to the data processing module; the data processing module is used to process the tasks to be processed, obtain processing results, and send the processing results to the external device through the network switching module.

[0006] In some embodiments, the data processing module is used to process the task to be processed and obtain the processing result, including: the data processing module obtains the data to be processed that matches the task to be processed from the preset database of the external device through the network switching module; the data processing module analyzes and processes the data to be processed to obtain the processing result.

[0007] In some embodiments, the task to be processed includes the address of the data to be processed, and the step in which the data processing module obtains the data to be processed matching the task to be processed from the preset database of the external device through the network switching module includes: the data processing module sends a data request instruction to the external device through the network switching module, and the data request instruction is generated based on the task to be processed; the data processing module receives the data to be processed corresponding to the data request instruction sent by the external device through the network switching module, and the data to be processed is data determined by the external device through traversal in the preset database based on the address of the data to be processed in the received data request instruction.

[0008] In some embodiments, the central processing module is used to analyze and process the received task processing instructions to obtain the steps of tasks to be processed, including: the central processing module is used to determine the processing attributes of each data processing module according to the task processing instructions; the central processing module is used to determine the tasks to be processed of the target data processing module according to the processing attributes of each data processing module.

[0009] In some embodiments, the processing attributes of the data processing module characterize the data processing volume of the data to be processed by the data processing module, and the central processing module is used to determine the to-be-processed tasks of the target data processing module according to the processing attributes of each data processing module, including: the central processing module is used to determine the resource data required to execute the to-be-processed tasks according to the to-be-processed tasks; the central processing module is used to determine the target data processing module from each data processing module according to the resource data required for the to-be-processed tasks and the data processing volume of each data processing module, and distributes the to-be-processed data of the to-be-processed tasks to each target data processing module through the network switching module to obtain the to-be-processed tasks of the target data processing module.

[0010] In some embodiments, the processing attributes of the data processing module represent the processing classification of different categories of data to be processed by the data processing module, and the central processing module is used to determine the steps of the target data processing module's tasks to be processed according to the processing attributes of each data processing module, including: the central processing module is used to obtain the data category of the data to be processed in the tasks to be processed; the central processing module selects the target data processing module from each data processing module according to the data category of the data to be processed and the processing attributes of each data processing module, and transmits the corresponding tasks to be processed to the corresponding target data processing modules through the network switching module, so as to obtain the tasks to be processed of each target data processing module.

[0011] In some embodiments, the data processing device also includes a storage module, which is connected to the central processing module. The data processing device also includes: the data processing module is used to send the processing results to the central processing module through the network switching module; the central processing module is used to send the received processing results to the storage module; the storage module is used to store and process the received processing results.

[0012] In some embodiments, the data processing device further includes a service management port and a data port, the central processing module is connected to the external device via the service management port, and the network switching module is connected to the external device via the data port.

[0013] In some embodiments, the external device includes a front-end server, and the central processing module analyzes and processes the received task processing instruction to obtain the task to be processed, including:

[0014] In response to the task initiation operation of the target object, the central processing module receives the task processing instruction sent by the front-end server; the central processing module analyzes and processes the received task processing instruction to obtain the task to be processed.

[0015] In some embodiments, the external device also includes a switch and a front-end server, and the switch is respectively connected to the central processing module and the network switching module; the step of the data processing module sending the processing result to the external device through the network switching module includes: the data processing module sends the processing result to the network switching module; the network switching module sends the processing result to the front-end server through the switch.

[0016] Compared with the traditional scheme that is centered on the central processing module and overly relies on the processing power of the central processing module, the present application provides a data processing device, which includes a central processing module, a network switching module and a data processing module. The central processing module and the data processing module are connected through the network switching module, and the data processing module is connected to the external device through the network switching module; the central processing module is used to analyze and process the received task processing instructions to obtain the tasks to be processed; the network switching module is used to send the tasks to be processed sent by the central processing module to the data processing module; the data processing module is used to process the tasks to be processed, obtain the processing results, and send the processing results to the external device through the network switching module. Thus, the connection between the data processing module and the external device is realized through the network switching module, and the data processing module can realize data transmission with the external device without going through the central processing module, which reduces the dependence on the central processing module and better improves the processing power of the data processing device. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work, among which:

[0018] Figure 1 is a schematic structural diagram of an exemplary embodiment of a conventional data processing device;

[0019] Figure 2 is a schematic structural diagram of an exemplary embodiment of a data processing device shown in the present application;

[0020] Figure 3 is a structural diagram of an exemplary embodiment of a data processing system shown in the present application;

[0021] Figure 4 It is a schematic diagram of an exemplary embodiment of an application process of a data processing system shown in the present application. DETAILED DESCRIPTION

[0022] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It will be appreciated that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only some but not all structures related to the present application are shown in the drawings. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the art without making creative work are within the scope of protection of the present application.

[0023] First see Figure 1 , Figure 1 It is a structural diagram of an exemplary embodiment of a traditional data processing device. In the traditional scheme, the analysis process of the data processing device is as follows: the CPU central processing module obtains the tasks to be processed issued from the external device through the service management port and the switch device; the CPU pulls the corresponding data stream from the external device through the data port according to the address of the data to be processed in the task to be processed; the CPU distributes the pulled data stream to each data processing module through PCIE (Peripheral Component Interconnect Express, a high-speed serial computer expansion bus standard) for analysis and processing to obtain the processing results; each data processing module transmits the processing results back to the CPU through PCIE, and then the CPU transmits them to the external device, and stores the processing results.

[0024] It can be seen that traditional data processing equipment is centered on the CPU. Whether it is business processing or data transmission, it needs to go through the CPU central processing module. The overall performance of CPU-centric data processing equipment depends on the processing power of the CPU, which usually makes the CPU a bottleneck for the data processing module to fully utilize its computing power. For example, the data processing module can complete the intelligent analysis of 256 video streams, but due to the limitation of CPU performance, the intelligent server can only access, intelligently analyze, forward and store 128 videos.

[0025] In order to match the computing power of the data processing module, the CPU specifications and performance can be improved, but the improvement of specifications will increase the power consumption of the whole machine, as well as the overall cost and equipment complexity. At the same time, due to the limitations of chassis structure and heat dissipation, the increase in CPU specifications is also limited. In other words, the overall performance of CPU-centric data processing equipment will reach a bottleneck due to the upper limit of CPU specifications, which is not conducive to increasing the intelligence density of a single device.

[0026] Based on this, this application proposes a data processing device. For details, please refer to Figure 2 , Figure 2 It is a schematic structural diagram of an exemplary embodiment of a data processing device shown in the present application.

[0027] Specifically, the data processing device of this embodiment includes the following modules: a central processing module, a network switching module and a data processing module. The central processing module and the data processing module are connected through the network switching module, and the data processing module is connected to the external device through the network switching module.

[0028] The central processing module, also known as the central processing unit, is the core component of the computer and is responsible for executing instructions and processing data. In the present embodiment, the central processing module is used to analyze and process the received task processing instructions to obtain the tasks to be processed. The task processing instructions can be issued to the central processing module by an external device, or they can be task processing instructions stored in the central processing module, such as tasks that are executed regularly. The tasks to be processed can be tasks to be processed assigned to each data processing module. Exemplarily, the task processing instructions can be analyzed and processed according to the processing attributes of each data processing module to obtain the tasks to be processed of each data processing module. The tasks in the task processing instructions can also be evenly divided and processed to obtain the tasks to be processed of each data processing module. The tasks to be processed can be processing of images or videos, such as image enhancement processing, video decoding, intelligent analysis or encoding.

[0029] In actual applications, the central processing module is also responsible for a series of business management, such as the management of the data processing equipment chassis, the management of the data processing module, and the migration of the tasks executed by the data processing module when an abnormality occurs. The central processing module can also connect to external devices through the business management port and receive task processing instructions issued by external devices, including compression, coding, OSD (Object Storage Device, object storage) and other services.

[0030] The network switching module is connected to the central processing module, the data processing module and the external device respectively. Compared with the traditional bus interconnection between the PCIE module and the central processing module, forming a master-slave relationship, and being unable to communicate and connect directly with the external device, this embodiment replaces the traditional PCIE module with a network switching module, and communicates in a network manner through network port mapping to form a distributed multi-master relationship, so that the external device can access the service on the internal network of the data processing device. After the network configuration is performed, not only the data transmission inside the data processing device can be realized through the network switching module, but also the data transmission between the data processing device and the external device can be realized through the network switching module. Exemplarily, the network switching module can not only realize the data transmission between the central processing module and the data processing module, but also realize the data transmission between the data processing module and the external device. Specifically, the network switching module can send the pending tasks sent by the central processing module to the data processing module, and / or, send the processing results sent by the data processing module to the central processing module, and / or, send the pending data sent by the external device to the data processing module, and / or, send the processing results sent by the data processing module to the external device, etc.

[0031] The data processing module can also be called an intelligent module, which provides intelligent services. The data processing module is used to process the tasks to be processed, obtain the processing results, and send the processing results to the external device through the network exchange module. Each data processing module in the data processing device is an independent subsystem, and can communicate with the central processing module and the external device respectively through the network exchange module. Exemplarily, the central processing module sends the tasks to be processed to the data processing module through the network exchange module; after the data processing module receives the tasks to be processed, it pulls the data to be processed from the external device through the network exchange module according to the tasks to be processed, and processes the data to be processed to obtain the processing results, and then sends the processing results to the central processing module and the external device respectively through the network exchange module. As an example, the data processing module can decode, intelligently analyze, and encode the video stream, and the obtained processing results include intelligent data streams, pictures, events, etc., and these data streams are returned to the external device.

[0032] It can be seen that the data processing device of the embodiment of the present application includes a central processing module, a network switching module and a data processing module, the central processing module and the data processing module are connected through the network switching module, and the data processing module is connected to the external device through the network switching module; the central processing module is used to analyze and process the received task processing instructions to obtain the tasks to be processed; the network switching module is used to send the tasks to be processed sent by the central processing module to the data processing module; the data processing module is used to process the tasks to be processed, obtain the processing results, and send the processing results to the external device through the network switching module. Thus, the connection between the data processing module and the external device is realized through the network switching module, and the data processing module can realize data transmission with the external device without going through the central processing module, which reduces the dependence on the central processing module and better improves the processing capacity of the data processing device.

[0033] Furthermore, when processing the task to be processed, the data processing module needs to obtain the data to be processed that matches the task to be processed from the preset database of the external device through the network switching module; the data processing module analyzes and processes the data to be processed to obtain the processing result.

[0034] The central processing module sends the pending tasks to the data processing module through the network exchange module. After receiving the pending tasks, the data processing module needs to pull the corresponding pending data from the external device according to the pending tasks because the pending tasks do not include the pending data. In other embodiments, the pending tasks sent by the central processing module to the data processing module include the pending data, and the data processing module can analyze and process the pending data in the pending tasks sent by the central processing module to obtain the processing results.

[0035] As an example, after receiving the pending task sent by the central processing module through the network switching module, if there is unacquired pending data in the pending task, the data processing module can pull the corresponding pending data from the preset database in the external device through the network switching module. The preset database can be a pre-stored database including the pending data. The preset database can be created by the user and the corresponding pending data can be uploaded, or the video stream or image collected by each front-end device can be obtained and stored in the preset database. In other embodiments, the data processing module can also directly pull the corresponding pending data from the front-end IPC (IP Camera).

[0036] It can be seen that the communication connection between the data processing module and the external device is realized through the network switching module. Compared with the traditional data processing equipment, which requires the central processing module to pull the corresponding data to be processed from the external device and then send the data to be processed to the data processing module, this embodiment can transmit data without relying on the central processing module, which greatly reduces the load pressure of the central processing module.

[0037] Among them, in some embodiments, the correspondence between the data to be processed and the address of the data to be processed of the data to be processed can be stored in the preset database. After the data processing module receives the address of the data to be processed in the task to be processed sent by the central processing module, it sends a data request instruction to the external device through the network switching module, and the data request instruction is generated based on the task to be processed; the data processing module receives the data to be processed corresponding to the data request instruction sent by the external device through the network switching module, and the data to be processed is the data determined by the external device through traversal in the preset database based on the address of the data to be processed of the data to be processed in the received data request instruction.

[0038] The data request instruction may be an instruction for the data processing module to request an external device to obtain the data to be processed. Exemplarily, the data request instruction may be generated based on the task to be processed, and may specifically include the address of the data to be processed and the corresponding request statement.

[0039] Specifically, the data processing module establishes a connection with the external device through the network switching module, and constructs a data request instruction based on the address of the data to be processed of the data to be processed; after the external device receives the data request instruction from the data processing module, it traverses a preset database storing the correspondence between the data to be processed and the address of the data to be processed according to the address of the data to be processed in the data request instruction, determines the data to be processed corresponding to the address of the data to be processed, and sends the data to be processed to the corresponding data processing module; the data processing module receives the data to be processed corresponding to the data request instruction sent by the external device through the network switching module.

[0040] In other embodiments, the data processing module can also generate a data request instruction based on the data type and related parameters of the data to be processed in the task to be processed, for example, the task to be processed is to perform statistical processing on numerical data; the external device traverses and processes a preset database that stores the correspondence between the data to be processed and the data type to be processed according to the data request instruction, and determines the corresponding data to be processed; the data processing module receives the data to be processed corresponding to the data type to be processed in the data request instruction, which is sent by the external device through the network switching module.

[0041] Furthermore, the pending tasks of each data processing module are the pending tasks determined by the central processing module after analyzing and processing the received task processing instructions. Specifically, the central processing module is used to determine the processing attributes of each data processing module according to the task processing instructions; the central processing module is used to determine the pending tasks of the target data processing module according to the processing attributes of each data processing module.

[0042] The processing attribute may be a characteristic of each data processing module for data processing and analysis. The central processing module may manage each data processing module, including the allocation of resource data, the scheduling of data processing modules, and the detection of the running status of data processing modules. After the central processing module receives the task processing instruction, it performs task allocation according to the processing attributes of each data processing module and determines the pending tasks of each data processing module. In some embodiments, the central processing module may first determine and manage each data processing module, and then allocate the pending tasks in the task processing instruction according to the processing attributes of each data processing module. In other embodiments, the central processing module may also configure each data processing module according to the pending tasks in the task processing instruction after obtaining the task processing instruction, determine the data processing modules required for each pending task, and after configuration, allocate the corresponding pending tasks to the corresponding data processing modules.

[0043] In some embodiments, the processing attributes may include characterizing the data processing volume of the data processing module on the data to be processed, and the central processing module is used to determine the resource data required to execute the task to be processed based on the task to be processed; the central processing module is used to determine the target data processing module from each data processing module based on the resource data required for the task to be processed and the data processing volume of each data processing module, and distribute the data to be processed of the task to be processed to each target data processing module through the network switching module to obtain the task to be processed of the target data processing module.

[0044] The resource data required to execute the pending tasks include computing resources, hardware resources, and storage resources. After receiving the task processing instruction, the central processing module obtains the resource data required for each pending task. Generally speaking, the larger the amount of pending data in the pending tasks, the higher the urgency of the pending tasks, or the larger the space occupied by the pending data of the pending tasks, the more resource data required.

[0045] The central processing module obtains the data processing capacity of each data processing module. The data processing capacity of the data processing module can be the data processing capacity of the data processing module in a unit time. The central processing module assigns the pending tasks to the target data processing modules of the corresponding data processing capacity according to the resource data required to execute the pending tasks. In some application scenarios, the central processing module sorts the resource data required for each pending task in the task processing instruction from large to small, and sorts the data processing capacity of the idle data processing modules from large to small, and then assigns the pending tasks to the corresponding target data processing modules according to the sorting, for example, assigning the pending tasks with the largest required resource data to the data processing module with the largest data processing capacity. In other application scenarios, the central processing module can also select the target data processing module whose data processing capacity just meets the pending tasks from the data processing modules according to the resource data required for each pending task, so as to reduce resource waste.

[0046] In other embodiments, the processing attributes also include characterizing the processing classification of different categories of data to be processed by the data processing module, and the central processing module is used to obtain the data category of the data to be processed in the task to be processed; the central processing module selects the target data processing module from each data processing module according to the data category of the data to be processed and the processing attributes of each data processing module, and transmits the corresponding task to be processed to the corresponding target data processing module through the network switching module to obtain the task to be processed of each target data processing module.

[0047] Each data processing module can process data to be processed of different data categories. After receiving the task processing instruction, the central processing module obtains the data category of the data to be processed in each task to be processed, and obtains the processing classification of each data processing module, and assigns the tasks to be processed including different data categories to the data processing modules of the corresponding processing classification. In some application scenarios, after obtaining the task processing instruction, the central processing module configures and processes each data processing module according to the data category of the data to be processed in each task to be processed in the task processing instruction, and determines the data category of the data to be processed processed by each data processing module; then the corresponding task to be processed is assigned to the corresponding data processing module for analysis and processing. In other application scenarios, the central processing module first plans the processing classification of each data processing module for different categories of data to be processed, and then assigns each task to be processed to the corresponding data processing module.

[0048] The data category may indicate the type of data to be processed, such as image data, digital data, and video data, etc., and each data processing module may be configured to process image data, digital data, and video data, etc. The data category may also indicate the data attribute of the data to be processed, such as high-resolution images, medium-resolution images, and low-resolution images, etc., and each data processing module may be configured to process high-resolution images, medium-resolution images, and low-resolution images, etc.

[0049] It should be noted that a data processing module can be configured to process multiple data categories, and a task to be processed may also include data to be processed of multiple data categories. Therefore, the central processing module can assign the same task to be processed including different data categories to the same data processing module, or assign different tasks to be processed to the same data processing module.

[0050] In other embodiments, the central processing module may also assign each task to be processed to a data processing module of a corresponding processing classification according to the data processing type of the task to be processed. For example, the data processing type includes but is not limited to image enhancement, image blurring, etc.

[0051] In other embodiments, the central processing module may also allocate tasks to be processed including different data categories according to the data processing volume of each data processing module. It is understandable that the resource data required for the data to be processed of different data categories are also different, so the corresponding tasks to be processed may be allocated to the data processing modules of the corresponding data processing volume according to the resource data required for the data to be processed of different data categories. For example, the resource data required for processing a high-resolution image is usually higher than the resource data required for processing a low-resolution image.

[0052] In other embodiments, the data processing device also includes a storage module, which is connected to the central processing module. The storage process includes: the data processing module is used to send the processing results to the central processing module through the network switching module; the central processing module is used to send the received processing results to the storage module; the storage module is used to store and process the received processing results.

[0053] The storage module is mainly set according to actual business needs. The data processing module can send part or all of the data to the central processing module through the network switching module, and the central processing module sends it to the storage module for storage and processing. The data sent by the data processing module can include processing results, and can also include original data and processing results, etc. This realizes local storage of data, which is convenient for users to query.

[0054] In other embodiments, the data processing device also includes a service management port and a data port. The service management port is used to forward signaling streams and can communicate through a specific protocol; the data port is used to transmit data streams and process actual data exchanges. The central processing module is connected to external devices through the service management port to receive and forward services. The network switching module is connected to external devices through the data port to pull data from the data processing module and forward processing results. In other embodiments, the central processing module can also be connected to external devices through the data port to transmit data.

[0055] In other embodiments, the data processing system may include a data processing device and an external device, the external device including a front-end server, and the central processing module analyzes and processes the received task processing instructions to obtain the steps of the task to be processed, including: in response to the task initiation operation of the target object, the central processing module receives the task processing instructions sent by the front-end server; the central processing module analyzes and processes the received task processing instructions to obtain the task to be processed.

[0056] The front-end server is also called a platform server, which has an interactive function and is a server that can be operated by the target object. When the target object initiates a task, the front-end server generates a task processing instruction according to the corresponding task and sends it to the central processing module. The central processing module receives the task processing instruction sent by the front-end server, analyzes and processes the received task processing instruction, and obtains the task to be processed. In other embodiments, the central processing module can also receive the task processing instruction of the periodic task, and there is no need to receive the task processing instruction sent by the front-end server.

[0057] In some other embodiments, the data processing system includes an external device and a data processing device, and the external device further includes a switch and a front-end server, see Figure 3 , Figure 3 The present invention is a structural diagram of an exemplary embodiment of a data processing system shown in the present invention. The switch is connected to the central processing module and the network switching module respectively; the step of the data processing module sending the processing result to the external device through the network switching module includes: the data processing module sends the processing result to the network switching module; the network switching module sends the processing result to the front-end server through the switch.

[0058] The switch can forward data and signaling flows and realize the communication connection between the data processing device and the front-end server. Specifically, the front-end server sends the task processing instruction to the central processing module through the switch and the service management port; the central processing module can send the processing status to the front-end server through the service management port and the switch; in addition, the data processing module can pull the corresponding data to be processed from the preset database through the network switching module, the data port and the switch; and send the processing result to the front-end server through the network switching module, the data port and the switch.

[0059] Finally combined Figure 4 The application process of the data processing system of the embodiment of the present application is further described as follows:

[0060] First, the network configuration and module port mapping are carried out to realize the communication connection between the data processing device and the external device. Then the front-end server generates the task processing instruction, which is forwarded to the data processing device through the switch. The switch sends the task processing instruction to the central processing module through the business management port; the central processing module analyzes and processes the received task processing instruction to obtain the task to be processed; the task to be processed is assigned to each data processing module through the network switching module; the data processing module directly pulls the data to be processed from the front-end IPC data source through the network switching module, data port and switch according to the address of the data to be processed in the task to be processed; the data processing module analyzes and processes the data to be processed and obtains the processing result; the data processing module forwards the processing result to the front-end server through the network switching module, data port and switch, and can also forward the processing result to the central processing module through the network switching module at the same time, and the central processing module sends it to the storage module for storage processing.

[0061] It can be seen from this that the embodiment of the present application provides a data processing device that is decentralized from the central processing module, by separating key tasks such as business management, data storage, intelligent analysis, and data stream access and forwarding. The central processing module is responsible for business management and data storage, and the data processing module is responsible for intelligent analysis and data stream access and forwarding, which greatly reduces the performance requirements of the central processing module, so that the central processing module is no longer a bottleneck of the data processing system. In addition, under the same intelligent analysis performance, the power consumption and cost of the data processing device can be achieved by reducing the specifications of the central processing module; and the reduction in equipment power consumption allows the data processing module of the data processing device to be made more dense, increasing the upper limit of the number of intelligent analysis paths and the upper limit of performance of the data processing device.

[0062] The above description is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A data processing device, characterized in that: The data processing device comprises a central processing module, a network switching module and various data processing modules, wherein the central processing module and various data processing modules are connected via the network switching module, and various data processing modules are connected to external devices via the network switching module; The central processing module is used to analyze and process the received task processing instructions to obtain the tasks to be processed, and the task processing instructions are sent by the external device to the central processing module; The network switching module is used to send the to-be-processed task sent by the central processing module to the data processing module; The data processing module is used to process the task to be processed, obtain the processing result, and send the processing result to the external device through the network switching module; The data processing module is used to process the task to be processed and obtain the processing result, including: The data processing module acquires the to-be-processed data matching the to-be-processed task from the preset database of the external device through the network switching module; The data processing module analyzes and processes the data to be processed to obtain the processing result; The data processing device also includes a service management port and a data port. The service management port is used to forward signaling streams, and the data port is used to transmit data streams. The central processing module is connected to the external device through the service management port to realize the reception and forwarding of services. The network switching module is connected to the external device through the data port to realize the data pulling of the data processing module and the forwarding of processing results.

2. The data processing device according to claim 1, characterized in that The task to be processed includes the address of the data to be processed, and the step in which the data processing module obtains the data to be processed matching the task to be processed from the preset database of the external device through the network switching module includes: The data processing module sends a data request instruction to the external device through the network switching module, wherein the data request instruction is generated based on the task to be processed; The data processing module receives the data to be processed corresponding to the data request instruction sent by the external device through the network switching module. The data to be processed is data determined by the external device through traversal in the preset database based on the address of the data to be processed in the received data request instruction.

3. The data processing device according to claim 1, characterized in that The central processing module is used to analyze and process the received task processing instructions to obtain the steps of the task to be processed, including: The central processing module is used to determine the processing attributes of each data processing module according to the task processing instruction; The central processing module is used to determine the tasks to be processed of the target data processing module according to the processing attributes of each data processing module.

4. The data processing device according to claim 3, characterized in that The processing attribute of the data processing module represents the data processing amount of the data to be processed by the data processing module, and the central processing module is used to determine the task to be processed of the target data processing module according to the processing attribute of each data processing module, including: The central processing module is used to determine the resource data required to execute the task to be processed according to the task to be processed; The central processing module is used to determine the target data processing module from each data processing module according to the resource data required for the task to be processed and the data processing volume of each data processing module, and distribute the data to be processed of the task to be processed to each target data processing module through the network switching module to obtain the task to be processed of the target data processing module.

5. The data processing device according to claim 3, characterized in that The processing attributes of the data processing modules represent the processing classification of different types of to-be-processed data by the data processing modules. The steps of determining the to-be-processed tasks of the target data processing modules according to the processing attributes of each data processing module include: The central processing module is used to obtain the data category of the data to be processed in the task to be processed; The central processing module selects a target data processing module from each data processing module according to the data category of the data to be processed and the processing attributes of each data processing module, and transmits the corresponding task to be processed to the corresponding target data processing module through the network switching module to obtain the task to be processed of each target data processing module.

6. The data processing device according to claim 1, characterized in that The external device includes a front-end server, and the central processing module analyzes and processes the received task processing instruction to obtain the task to be processed, including: In response to the task initiation operation of the target object, the central processing module receives the task processing instruction sent by the front-end server; The central processing module analyzes and processes the received task processing instruction to obtain the task to be processed.

7. The data processing device according to claim 1, characterized in that The external device also includes a switch and a front-end server, and the switch is connected to the central processing module and the network switching module respectively; The step of the data processing module sending the processing result to the external device through the network switching module includes: The data processing module sends the processing result to the network switching module; The network switching module sends the processing result to the front-end server through the switch.

Images