Data processing method, device and system based on edge container and storage medium

Abstract

The invention provides a data processing method, device and system based on an edge container and a storage medium, and relates to the technical field of computers, the data processing method comprises the steps that at least one HTTP request of a data request end is received, and the HTTP requests respectively carry request data subjected to packet processing; in response to different HTTP requests, screening a target analysis unit from the plurality of analysis units, and analyzing the request data into original request data by using the target analysis unit; determining target response data corresponding to the original request data; and sending the target response data to the data request end. Network structure deployment of data transmission can be simplified, the operation and maintenance cost is reduced, and the processing efficiency of the operation data of the medical image equipment is ensured.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method, device, system and storage medium based on an edge container. Background Art

[0002] With the rapid increase in the number of intelligent Internet terminal devices and the advent of the fifth generation mobile communication technology (5G) and the Internet of Things era, the centralized storage and computing model of traditional cloud computing centers can no longer meet the terminal devices' needs for timeliness, capacity, and computing power. It will be an important development trend of cloud computing to sink cloud computing capabilities to the edge and conduct unified delivery, operation, maintenance, and management through the center.

[0003] At present, when processing the operating data of medical imaging equipment, data transmission is mostly achieved through the platform system docking platform system in the cloud. However, in the mobile cabin, this one-to-one platform system deployment method leads to complex network structure deployment for data transmission, which increases the operation and maintenance costs and cannot guarantee the processing efficiency of the operating data of medical imaging equipment. Summary of the invention

[0004] The present invention provides a data processing method, device, system and storage medium based on edge containers, which can simplify the network structure deployment of data transmission, reduce operation and maintenance costs, and ensure the processing efficiency of medical imaging equipment operating data.

[0005] In a first aspect, a data processing method based on an edge container is provided. The method is applied to a data processing module in an HTTP data collection system. The HTTP data collection system is deployed in an edge container. The method includes:

[0006] receiving at least one HTTP request from a data requesting end, wherein the HTTP requests respectively carry the request data after packet processing;

[0007] In response to different HTTP requests, a target parsing unit is selected from a plurality of parsing units, and the request data is parsed into original request data using the target parsing unit;

[0008] Determining target response data corresponding to the original request data;

[0009] Send the target response data to the data requester.

[0010] In a second aspect, a data processing device based on an edge container is provided, the device is applied to a data processing module in an HTTP data collection system, the HTTP data collection system is deployed in an edge container, and the device includes:

[0011] A receiving module, used for receiving at least one HTTP request from a data request end, wherein the HTTP request carries the request data after packet processing;

[0012] A parsing module, for responding to different HTTP requests, screening a target parsing unit from a plurality of parsing units, and parsing the request data into original request data using the target parsing unit;

[0013] A determination module, used to determine target response data corresponding to the original request data;

[0014] The sending module is used to send target response data to the data request end.

[0015] According to a third aspect, an electronic device is provided, comprising: a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to execute the method in the first aspect or its various implementations.

[0016] According to a fourth aspect, a computer-readable storage medium is provided for storing a computer program, wherein the computer program enables a computer to execute the method according to the first aspect or its various implementations.

[0017] Through the technical solution provided by the present invention, after receiving at least one HTTP request carrying request data, a target parsing unit can be screened from multiple parsing units, and the request data can be parsed into original request data using the target parsing unit; then the target response data corresponding to the original request data can be determined; finally, the target response data is sent to the data request end. This application can shorten the network communication distance and avoid being affected by network quality by deploying the HTTP data acquisition system in the edge container. By distributing the execution of different HTTP requests in the edge container and dynamically screening the target parsing unit from multiple parsing units, it is possible to achieve reasonable scheduling of parsing resources, which can reduce operation and maintenance costs and ensure data processing efficiency while simplifying the deployment of the data transmission network structure.

[0018] It should be understood that the above general description and the following detailed description are only exemplary and explanatory and cannot limit the present invention. Other features and advantages of the present invention will be described in detail in the following specific implementation section. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 A schematic diagram of a principle flow of data processing based on an edge container provided in an embodiment of the present application;

[0021] Figure 2 A timing diagram of a first data communication link provided in an embodiment of the present application;

[0022] Figure 3 A timing diagram of a second data communication link provided in an embodiment of the present application;

[0023] Figure 4 A schematic diagram of a flow chart of a data processing method based on an edge container provided in an embodiment of the present application;

[0024] Figure 5 A schematic diagram of a flow chart of a data processing method based on an edge container provided in an embodiment of the present application;

[0025] Figure 6 A schematic diagram of the structure of a data processing device based on an edge container provided in an embodiment of the present application;

[0026] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0029] With the rapid increase in the number of intelligent Internet terminal devices and the advent of the fifth generation mobile communication technology (5G) and the Internet of Things era, the centralized storage and computing model of traditional cloud computing centers can no longer meet the terminal devices' needs for timeliness, capacity, and computing power. It will be an important development trend of cloud computing to sink cloud computing capabilities to the edge and conduct unified delivery, operation, maintenance, and management through the center.

[0030] At present, when processing the operating data of medical imaging equipment, data transmission is mostly achieved through the platform system docking platform system in the cloud. However, in the mobile cabin, this one-to-one platform system deployment method leads to complex network structure deployment for data transmission, which increases the operation and maintenance costs and cannot guarantee the processing efficiency of the operating data of medical imaging equipment.

[0031] In order to solve the above technical problems, the inventive concept of the present invention is to establish an HTTP data acquisition system between medical equipment and the acquisition service platform, and the HTTP data acquisition system is used for data processing, forwarding and communication. By deploying the HTTP data acquisition system in the edge container, it can be moved freely with the mobile cabin, which can shorten the network communication distance and avoid being affected by the network quality. By distributing the execution of different HTTP requests in the edge container and dynamically screening the target resolution unit among multiple resolution units, it is possible to achieve reasonable scheduling of resolution resources, simplify the deployment of the data transmission network structure, reduce operation and maintenance costs, and ensure data processing efficiency.

[0032] like Figure 1 As shown, the HTTP data acquisition system includes an HTTP server module, an HTTP client module and a data processing module. The medical imaging device (i.e., edge computing device), the HTTP server module, the data processing module and the platform service deployed in the cloud are used to connect in sequence to establish a first data communication link. The platform service, the data processing module, the HTTP client module and the medical imaging device are used to connect in sequence to establish a second data communication link. The first data communication link and the second data communication link can perform parallel processing of data communication in different data processing threads. Through parallel processing of data communication, the waiting time of data communication processing can be shortened and the efficiency of data communication processing can be improved. Among them, the data processing module can be a CBUS (ClusterBUS) data bus. The CBUS (ClusterBUS) data bus can be used to provide packetization and parsing functions in the first data communication link and the second data communication link, respectively.

[0033] Wherein, in the first data communication link, if Figure 2As shown, the medical imaging device (i.e., the first medical imaging device) can send the first HTTP request carrying the first request data and the operation status information to the data processing module through the HTTP server module, and the data processing module can parse the first request data to obtain the first original request data; then the data processing module can send the first original request data after packet processing to the platform service; after the platform service responds to the first original request data corresponding to the first HTTP request, it can send the generated first target response data to the data processing module, and after the data processing module packages the first target response data, it sends the packaged first target response data to the medical imaging device through the HTTP server module. In this process, the data processing module can select the first target parsing unit from multiple parsing units in response to different first HTTP requests, and use the first target parsing unit to parse and package the first request data in different data formats.

[0034] In the second data communication link, if Figure 3 As shown, the platform service can determine the second medical imaging device from multiple medical imaging devices according to the running status information of each medical imaging device updated in real time. Then, the second HTTP request carrying the second request data can be sent to the data processing module, and the data processing module can parse the second request data to obtain the second original request data; then, the data processing module can send the second original request data after packet processing to the HTTP client module; the HTTP client module can forward the second original request data to the second edge computing device; after the medical imaging device responds to the second HTTP request, the generated second target response data can be sent to the data processing module through the HTTP client module, and the data processing module can parse the second target response data and send the second target response data after packet processing to the platform service. In this process, the data processing module can select the second target parsing unit from multiple parsing units in response to different second HTTP requests, and use the second target parsing unit to parse and package the second request data in different data formats.

[0035] After introducing the application scenarios of the embodiments of the present invention, the technical solutions of the present invention will be described in detail below:

[0036] Figure 4 A flowchart of a data processing method based on an edge container provided in an embodiment of the present invention. The method can be performed as follows: Figure 1 The data processing module shown in the figure is executed, but is not limited to this. Figure 4 As shown, the method may include the following steps:

[0037] Step 410: Receive at least one HTTP request from a data request end, wherein each HTTP request carries request data after packet processing.

[0038] Among them, the data request end may include a first edge computing device and a platform service. The first edge computing device is a hardware device designed for edge computing, which may include mobile devices (such as smart phones, tablet computers), embedded systems (such as automobile ECUs, microcontrollers for household appliances), drones, wearable devices, etc. In the following embodiment steps in the present disclosure, the medical imaging device that needs to establish a communication connection with the mobile cabin is used as an example to illustrate the technical solution in this application, but it does not constitute a specific limitation. The platform service is deployed in the cloud and is used to communicate and respond to the HTTP request issued by the first edge computing device. It can also be used to screen out a second edge computing device from multiple edge computing devices based on the operating status information of each edge computing device, and send an HTTP request to the second edge computing device.

[0039] Step 420: In response to different HTTP requests, select a target parsing unit from multiple parsing units, and use the target parsing unit to parse the request data into original request data.

[0040] For the disclosed embodiments, multiple parsing units can be set in the HTTP data acquisition system, and each parsing unit can be called to perform the parsing and packaging process of the packet data. By parsing the packet processing during the data transmission process between the edge container and the cloud, on the one hand, it can help to troubleshoot network faults, respond to network faults quickly, and ensure the stability and reliability of the network; on the other hand, it can promptly discover and respond to network security incidents, such as abnormal data traffic and attack behaviors. This capability helps to strengthen the security protection measures of the network and protect the network from malicious attacks and threats. On the other hand, it also helps to optimize network performance. By analyzing indicators such as data packet delay, packet loss, and bandwidth utilization, the network congestion and performance bottlenecks can be understood, so as to optimize network performance and allocate resources. This helps to improve the transmission efficiency and user experience of the network. By dynamically screening the target parsing unit among multiple parsing units, reasonable scheduling of parsing resources can be achieved.

[0041] Step 430: Determine target response data corresponding to the original request data.

[0042] In a specific application scenario, the data processing module can generate response data corresponding to a specific HTTP request. Therefore, after parsing the original request data, the data processing module can first determine whether it can generate the corresponding response data. If so, the data processing module can generate the corresponding target response data and feed it back to the data request end. If the response data corresponding to the original request data cannot be determined in the data processing module, the data processing module can send the original request data to the corresponding data response end, and use the data response end to generate the corresponding target response data.

[0043] Step 440: Send target response data to the data requesting end.

[0044] For the disclosed embodiment, after determining that the target response data corresponding to the original request data is obtained, the data processing module can use the corresponding data communication link to feed back the target response data to the data request end.

[0045] In summary, according to the data processing method based on the edge container provided by the present invention, after receiving at least one HTTP request carrying request data, a target parsing unit can be screened from multiple parsing units, and the request data can be parsed into original request data using the target parsing unit; then the target response data corresponding to the original request data can be determined; finally, the target response data is sent to the data request end. The present application can shorten the network communication distance and avoid being affected by the network quality by deploying the HTTP data acquisition system in the edge container. By distributing the execution of different HTTP requests in the edge container and dynamically screening the target parsing unit from multiple parsing units, it is possible to achieve reasonable scheduling of parsing resources, which can reduce operation and maintenance costs and ensure data processing efficiency while simplifying the deployment of the data transmission network structure.

[0046] based on Figure 5 The embodiment shown is a refinement and extension of the above embodiment. In order to fully illustrate the specific implementation process of the method of this embodiment, this embodiment provides the following Figure 5 The specific method shown. Figure 5 based on Figure 4 As shown in Figure 5, the method comprises the following steps:

[0047] Step 510: Receive at least one HTTP request from a data request end, wherein each HTTP request carries request data after packet processing.

[0048] For the embodiment of the present disclosure, receiving at least one HTTP request from the data requesting end in step 510 may include the following steps:

[0049] Step 510-1: Receive at least one first HTTP request from a first edge computing device sent by an HTTP server module, where the first HTTP request carries first request data after packet processing.

[0050] The first HTTP request is an HTTP request sent by the first edge computing device to the platform service, and the first request data is request data obtained after the HTTP server module performs the first packet processing on the first original request data. The first packet processing is the HTTP server module performing data format conversion on the first original request data to obtain the first request data that can be recognized and processed by the HTTP server module and the data processing module.

[0051] In a specific application scenario, the first edge computing device may send an initial HTTP request carrying first original request data to the HTTP server module, and the HTTP server module may perform a first packet processing on the first original request data to obtain first request data; the HTTP server module may further send a first HTTP request to the data processing module, and the first HTTP request may carry the first request data.

[0052] Step 510 - 2 : Receive at least one second HTTP request sent by the platform service.

[0053] The second HTTP request is an HTTP request sent by the platform service to the second edge computing device. The second HTTP request carries second request data. The second request data is request data obtained after the platform service performs second packet processing on the second original request data. The second edge computing device is an edge computing device selected by the platform service from multiple edge computing devices for executing the second HTTP request based on the running status information of the edge computing device. The second packet processing is the data format conversion performed by the platform service on the second original request data to obtain the second request data that can be recognized and processed by the platform service and the data processing module.

[0054] In a specific application scenario, after determining the second original request data, the platform service may perform a second packet processing on the second original request data to obtain the second request data. Then, the second HTTP request carrying the second request data may be sent to the data processing module. Accordingly, the data processing module may receive the second HTTP request.

[0055] Step 520: Create a first data processing thread and / or a second data processing thread for parallel processing.

[0056] In a specific application scenario, as a possible implementation method, multiple first data processing threads can be created, and the multiple first data processing threads are used to support the data parsing process of the first request data sent by the first edge computing device, so as to realize parallel and unidirectional data transmission from multiple first edge computing devices to the platform service; as a possible implementation method, multiple second data processing threads can be created, and the multiple second data processing threads are used to support the data parsing process of the second request data sent by the platform service, so as to realize parallel and unidirectional data transmission from the platform service to multiple second edge computing devices; as a possible implementation method, multiple first data processing threads and multiple second data processing threads can be created, and the multiple first data processing threads are used to support the data parsing process of the first request data sent by the first edge computing device, and the multiple second data processing threads are used to support the data parsing process of the second request data sent by the platform service, so as to realize parallel and bidirectional data transmission between multiple edge computing devices and the platform service.

[0057] Step 530a: call the first data processing thread to execute a first data parsing process, where the first data parsing process is used to select a first target parsing unit from a plurality of parsing units, and use the first target parsing unit to parse the first request data into first original request data.

[0058] Among them, the first data parsing process includes: in response to the first HTTP request, determining the first device model of the first edge computing device and the corresponding first parsing priority; screening the first target parsing unit that matches the first device model and the first parsing priority from multiple parsing units; calling the first target parsing unit to perform a first parsing process on the first request data to obtain the first original request data, and the first parsing process is the inverse process of the first packet processing.

[0059] In the disclosed embodiment, a scheduling module may be arranged in the data processing module, and the scheduling module is mainly used to implement the scheduling of different parsing units, meet the instant parsing of different types of device data, and ensure the real-time and correctness of the parsed data. Specifically, according to the device type requirements of the first edge computing device, the first parsing priority corresponding to the first device model of the first edge computing device may be customized to determine the parsing order of the multiple first request data when there are multiple first request data in the first data processing thread, so as to ensure the orderly execution of the parsing process for the first request data.

[0060] For example, the present invention defines that if the analysis result is alarm-type data, data analysis can be performed preferentially; in addition, the priority can be customized according to the actual usage requirements of the imaging device. For example, if the data of device A is required to be high in frequency, high in real time, and frequently used, the priority of device A can be set preferentially. When the data of device A is received, data processing and transmission are performed preferentially; for other imaging devices without priority settings, data analysis and transmission are performed on a first-come, first-served basis.

[0061] In embodiment step 530b, which is parallel to embodiment step 530a, a second data processing thread is called to execute a second data parsing process, where the second data parsing process is used to select a second target parsing unit from a plurality of parsing units, and parse the second request data into second original request data using the second target parsing unit.

[0062] Among them, the second data parsing process includes: in response to the second HTTP request, determining the second device model of the second edge computing device and the corresponding second parsing priority; screening the second target parsing unit that matches the second device model and the second parsing priority from multiple parsing units; calling the second target parsing unit to perform a second parsing process on the second request data to obtain the second original request data, and the second parsing process is the inverse process of the second packet processing.

[0063] In the disclosed embodiment, a scheduling module may be arranged in the data processing module, and the scheduling module is mainly used to implement the scheduling of different parsing units, meet the instant parsing of different types of device data, and ensure the real-time and correctness of the parsed data. Specifically, according to the device type requirements of the second edge computing device, the second parsing priority corresponding to the second device model of the second edge computing device may be customized to determine the parsing order of the multiple second request data when there are multiple second request data in the second data processing thread, so as to ensure the orderly execution of the parsing process for the second request data.

[0064] For example, the present invention defines that if the analysis result is alarm-type data, data analysis can be performed preferentially; in addition, the priority can be customized according to the actual usage requirements of the imaging device. For example, if the data of device B is required to be high in frequency, high in real time, and frequently used, the priority of device B can be set preferentially. When the data of device B is received, data processing and transmission are performed preferentially; for other imaging devices without priority settings, data analysis and transmission are performed on a first-come, first-served basis.

[0065] Step 540: Determine target response data corresponding to the original request data.

[0066] For the disclosed embodiment, the data processing module can obtain the first original request data by parsing the first request data, and then determine whether it can generate the response data corresponding to the first original request data. If so, it can be determined as the target response data. If the response data corresponding to the original request data cannot be determined in the data processing module, the first original request data is processed by the second packet to obtain the first original request data that can be recognized and processed by the data processing module, and the first original request data processed by the second packet is sent to the platform service so that the platform service determines the response data corresponding to the first original request data. Accordingly, as a possible implementation method, the embodiment steps may include: performing response processing on the first original request data to obtain the first target response data corresponding to the first original request data; or, sending the first original request data processed by the second packet to the platform service, receiving and parsing to obtain the first target response data sent by the platform service.

[0067] For the disclosed embodiment, the data processing module may perform a second parsing process on the second request data to obtain the second original request data that can be recognized and processed by the data processing module, and send the second original request data processed by the third packet to the second edge computing device, so that the second edge computing device determines the response data corresponding to the second original request data. As another possible implementation method, the embodiment steps may also include: sending the second original request data processed by the third packet to the HTTP client module, so that the HTTP client module forwards the second original request data to the second edge computing device; receiving and parsing to obtain the second target response data sent by the HTTP client module, the second target response data is the target response data obtained by the second edge computing device responding to the second original request data. Among them, the third packet processing is the data processing module performing data format conversion on the second original request data, and obtaining the second request data that can be recognized and processed by the data processing module and the HTTP client module.

[0068] Step 550: Send target response data to the data requesting end.

[0069] For the embodiments of the present disclosure, when the current data communication link is the first data communication link, as a possible implementation method, the steps of the embodiment may include: performing a first packet processing on the first target response data; sending the first target response data after the first packet processing to the HTTP server module, so that the HTTP server module forwards the first target response data to the first edge computing device.

[0070] For the embodiments of the present disclosure, when the current data communication link is the second data communication link, as another possible implementation method, the embodiment steps may also include: performing second packet processing on the second target response data; and sending the second target response data after the second packet processing to the platform service.

[0071] In summary, the technical solution in the present application can, after receiving at least one HTTP request carrying request data, screen the target parsing unit from multiple parsing units, and use the target parsing unit to parse the request data into original request data; then the target response data corresponding to the original request data can be determined; finally, the target response data is sent to the data request end. By deploying the HTTP data acquisition system in the edge container, the present application can shorten the network communication distance and avoid being affected by the network quality. By distributing the execution of different HTTP requests in the edge container and dynamically screening the target parsing unit from multiple parsing units, it is possible to achieve reasonable scheduling of parsing resources, which can reduce operation and maintenance costs and ensure data processing efficiency while simplifying the deployment of the data transmission network structure.

[0072] Based on the above Figure 4 , Figure 5 A detailed description of the edge container-based data processing method is provided, such as Figure 6 As shown, Figure 6 FIG. 1 is a structural block diagram of a data processing device based on an edge container according to an exemplary embodiment. Figure 6 As shown, the device comprises:

[0073] The receiving module 61 can be used to receive at least one HTTP request from the data request end, and the HTTP request carries the request data after packet processing;

[0074] The parsing module 62 may be used to select a target parsing unit from a plurality of parsing units in response to different HTTP requests, and parse the request data into original request data using the target parsing unit;

[0075] A determination module 63, which can be used to determine target response data corresponding to the original request data;

[0076] The sending module 64 may be used to send target response data to the data requesting end.

[0077] In some embodiments of the present application, the HTTP data collection system includes an HTTP server module, an HTTP client module, and a plurality of parsing units, the data request end includes a first edge computing device and a platform service, and the HTTP request includes a first HTTP request and a second HTTP request;

[0078] The receiving module 61 can be specifically used to receive at least one first HTTP request of a first edge computing device sent by an HTTP server module, the first HTTP request carrying first request data after packet processing, the first HTTP request being an HTTP request sent by the first edge computing device to the platform service, the first request data being request data obtained after the HTTP server module performs first packet processing on the first original request data; receive at least one second HTTP request sent by the platform service, the second HTTP request carrying second request data after packet processing, the second HTTP request being an HTTP request sent by the platform service to a second edge computing device, the second HTTP request carrying second request data, the second request data being request data obtained after the platform service performs second packet processing on the second original request data, the second edge computing device being an edge computing device selected by the platform service from multiple edge computing devices for executing the second HTTP request according to the operating status information of the edge computing device.

[0079] In some embodiments of the present application, the parsing module 62 can be specifically used to create a first data processing thread and / or a second data processing thread for parallel processing; call the first data processing thread to execute a first data parsing process, the first data parsing process is used to screen a first target parsing unit from multiple parsing units, and use the first target parsing unit to parse the first request data into first original request data; and / or, call the second data processing thread to execute a second data parsing process, the second data parsing process is used to screen a second target parsing unit from multiple parsing units, and use the second target parsing unit to parse the second request data into second original request data.

[0080] In some embodiments of the present application, a first data parsing process includes: in response to a first HTTP request, determining a first device model of a first edge computing device and a corresponding first parsing priority; screening a first target parsing unit that matches the first device model and the first parsing priority from a plurality of parsing units; calling the first target parsing unit to perform a first parsing process on the first request data to obtain first original request data, wherein the first parsing process is the inverse process of the first packet processing.

[0081] In some embodiments of the present application, the second data parsing process includes: in response to a second HTTP request, determining a second device model of a second edge computing device and a corresponding second parsing priority; screening a second target parsing unit that matches the second device model and the second parsing priority from multiple parsing units; calling the second target parsing unit to perform a second parsing process on the second request data to obtain second original request data, wherein the second parsing process is the inverse process of the second packet processing.

[0082] In some embodiments of the present application, the determination module 63 can be specifically used to perform response processing on the first original request data to obtain first target response data corresponding to the first original request data; or, send the first original request data after the second packet processing to the platform service, receive and parse to obtain the first target response data sent by the platform service; accordingly, the sending module 64 can be specifically used to perform the first packet processing on the first target response data; send the first target response data after the first packet processing to the HTTP server module, so that the HTTP server module forwards the first target response data to the first edge computing device.

[0083] In some embodiments of the present application, the determination module 63 can be specifically used to send the second original request data after being processed by the third packet to the HTTP client module, so that the HTTP client module forwards the second original request data to the second edge computing device; receive and parse to obtain the second target response data sent by the HTTP client module, the second target response data is the target response data obtained by the second edge computing device performing response processing on the second original request data; accordingly, the sending module 64 can be specifically used to perform a second packet processing on the second target response data; and send the second target response data after the second packet processing to the platform service.

[0084] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0085] In an embodiment of the present application, after receiving at least one HTTP request carrying request data, a target parsing unit can be screened from multiple parsing units, and the request data can be parsed into original request data using the target parsing unit; then, the target response data corresponding to the original request data can be determined; and finally, the target response data is sent to the data request end. By deploying the HTTP data acquisition system in an edge container, the present application can shorten the network communication distance and avoid being affected by network quality. By distributing the execution of different HTTP requests in the edge container and dynamically screening the target parsing unit from multiple parsing units, it is possible to achieve reasonable scheduling of parsing resources, which can reduce operation and maintenance costs and ensure data processing efficiency while simplifying the deployment of the data transmission network structure.

[0086] In the above text, the data processing device based on the edge container of the embodiment of the present invention is described from the perspective of the functional module in conjunction with the accompanying drawings. It should be understood that the functional module can be implemented in the form of hardware, can be implemented by instructions in the form of software, or can be implemented by a combination of hardware and software modules. Specifically, the steps of the data processing method based on the edge container in the embodiment of the present invention can be completed by the hardware integrated logic circuit and / or software instructions in the processor, and the steps of the data processing method based on the edge container applied in conjunction with the embodiment of the present invention can be directly embodied as a hardware decoding processor to be executed, or can be executed by a combination of hardware and software modules in the decoding processor. Optionally, the software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps in the above-mentioned data processing method based on the edge container in combination with its hardware.

[0087] Figure 7 It is a schematic block diagram of an electronic device 700 according to an embodiment of the present invention.

[0088] like Figure 7 As shown, the electronic device 700 may include:

[0089] The memory 710 and the processor 720, the memory 710 is used to store the computer program and transmit the program code to the processor 720. In other words, the processor 720 can call and run the computer program from the memory 710 to implement the method in the embodiment of the present invention.

[0090] For example, the processor 720 may be configured to execute the above method embodiments according to instructions in the computer program.

[0091] In some embodiments of the present invention, the processor 720 may include but is not limited to:

[0092] General-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.

[0093] In some embodiments of the present invention, the memory 710 includes but is not limited to:

[0094] Volatile memory and / or non-volatile memory. Among them, the non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DR RAM).

[0095] In some embodiments of the present invention, the computer program may be divided into one or more modules, which are stored in the memory 710 and executed by the processor 720 to complete the method provided by the present invention. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the controller.

[0096] like Figure 7 As shown, the electronic device 700 may further include:

[0097] The transceiver 730 may be connected to the processor 720 or the memory 710 .

[0098] The processor 720 may control the transceiver 730 to communicate with other devices, specifically, to send data to other devices or receive data sent by other devices. The transceiver 730 may include a transmitter and a receiver. The transceiver 730 may further include an antenna, and the number of antennas may be one or more.

[0099] It should be understood that the various components in the electronic device are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.

[0100] The present invention also provides a computer storage medium having a computer program stored thereon, which, when executed by a computer, enables the computer to perform the method of the above method embodiment. In other words, an embodiment of the present invention also provides a computer program product containing instructions, which, when executed by a computer, enables the computer to perform the method of the above method embodiment.

[0101] When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (Digital Subscriber Line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (Digital Video Disc, DVD)), or a semiconductor medium (e.g., a solid-state drive (Solid State Disk, SSD)), etc.

[0102] Those skilled in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments applied herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0103] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the module is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0104] The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. For example, each functional module in each embodiment of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

[0105] The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in this application, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A data processing method based on edge container, It is characterized in that The method is applied to a data processing module in an HTTP data collection system, and the HTTP data collection system is deployed in an edge container. The method includes: Receiving at least one HTTP request from a data request end, wherein the HTTP request carries the request data after packet processing; In response to different HTTP requests, selecting a target parsing unit from a plurality of parsing units, and parsing the request data into original request data using the target parsing unit; Determining target response data corresponding to the original request data; The target response data is sent to the data requesting end.

2. The method according to claim 1, It is characterized in that The HTTP data collection system includes an HTTP server module, an HTTP client module and a plurality of parsing units, the data request end includes a first edge computing device and a platform service, and the HTTP request includes a first HTTP request and a second HTTP request; The receiving device receives at least one HTTP request from a data requesting end, wherein each of the HTTP requests carries packaged request data, including: Receive at least one first HTTP request of the first edge computing device sent by the HTTP server module, the first HTTP request carrying first request data after packet processing, the first HTTP request is an HTTP request sent by the first edge computing device to the platform service, and the first request data is request data obtained after the HTTP server module performs first packet processing on the first original request data; Receive at least one second HTTP request sent by the platform service, the second HTTP request carrying second request data after packet processing, the second HTTP request is an HTTP request sent by the platform service to a second edge computing device, the second HTTP request carries second request data, the second request data is request data obtained after the platform service performs second packet processing on the second original request data, the second edge computing device is an edge computing device selected by the platform service from multiple edge computing devices to execute the second HTTP request according to the operating status information of the edge computing device.

3. The method according to claim 2, It is characterized in that The method of selecting a target parsing unit from a plurality of parsing units in response to different HTTP requests, and parsing the request data into original request data by using the target parsing unit, comprises: Creating a first data processing thread and / or a second data processing thread for parallel processing; calling the first data processing thread to execute a first data parsing process, wherein the first data parsing process is used to select a first target parsing unit from the plurality of parsing units, and to parse the first request data into first original request data using the first target parsing unit; and / or, The second data processing thread is called to execute a second data parsing process, where the second data parsing process is used to screen a second target parsing unit from the multiple parsing units, and use the second target parsing unit to parse the second request data into second original request data.

4. The method according to claim 3, It is characterized in that The first data parsing process includes: In response to the first HTTP request, determining a first device model of the first edge computing device and a corresponding first resolution priority; Selecting a first target parsing unit that matches the first device model and the first parsing priority from among a plurality of parsing units; The first target parsing unit is called to perform a first parsing process on the first request data to obtain first original request data, wherein the first parsing process is a reverse process of the first packet processing.

5. The method according to claim 3, It is characterized in that The second data parsing process includes: In response to the second HTTP request, determining a second device model of the second edge computing device and a corresponding second resolution priority; Selecting a second target parsing unit that matches the second device model and the second parsing priority from a plurality of parsing units; The second target parsing unit is called to perform a second parsing process on the second request data to obtain second original request data, wherein the second parsing process is a reverse process of the second packet processing.

6. The method according to claim 3, It is characterized in that The determining target response data corresponding to the original request data includes: Perform response processing on the first original request data to obtain first target response data corresponding to the first original request data; or, Sending the first original request data processed by the second packet to the platform service, and receiving and parsing to obtain the first target response data sent by the platform service; The sending the target response data to the data requesting end includes: Performing a first packet processing on the first target response data; Send the first target response data processed by the first packet to the HTTP server module, so that the HTTP server module forwards the first target response data to the first edge computing device.

7. The method according to claim 3, It is characterized in that The determining target response data corresponding to the original request data includes: Sending the second original request data processed by the third packet to the HTTP client module, so that the HTTP client module forwards the second original request data to the second edge computing device; Receive and parse to obtain second target response data sent by the HTTP client module, where the second target response data is target response data obtained by the second edge computing device responding to the second original request data; The sending the target response data to the data requesting end includes: performing a second packet processing on the second target response data; Sending the second target response data processed by the second packet to the platform service.

8. A data processing device based on edge container, It is characterized in that The device is applied to a data processing module in an HTTP data collection system, and the HTTP data collection system is deployed in an edge container. The device includes: A receiving module, used for receiving at least one HTTP request from a data request end, wherein the HTTP request carries the request data after packet processing; A parsing module, configured to select a target parsing unit from a plurality of parsing units in response to different HTTP requests, and parse the request data into original request data using the target parsing unit; A determination module, used to determine target response data corresponding to the original request data; A sending module is used to send the target response data to the data request end.

9. An electronic device, It is characterized in that include: A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, It is characterized in that Used to store a computer program, wherein the computer program enables a computer to execute the method according to any one of claims 1 to 7.

Images