Gateway, gateway task processing method, device and equipment

Abstract

The invention discloses a gateway, a gateway task processing method, a gateway task processing device and gateway task processing equipment, which are applied to the field of gateways. The gateway comprises a shell, a containing cavity is formed in the shell, and a sliding groove is formed in the inner wall of the shell. The placing plate is placed in the accommodating cavity through the sliding groove; a placing groove is formed in the placing plate, a component assembly is arranged in the placing groove and connected with one end of a conductive circuit arranged in the placing plate, a second connecting wire is arranged on the second side of the placing plate, and one end of the second connecting wire is connected with one end of the conductive circuit; and the other end of the second connecting wire is connected with a rear connector arranged on the shell so as to supply power to the component assembly. According to the embodiment of the invention, the component assembly is arranged in the placement groove and is directly connected with one end of the conductive circuit arranged in the placement plate, and the second connecting line is directly connected with the other end of the conductive circuit, so that the probability that the connecting line of the component assembly is externally exposed to cause winding of the connecting line is reduced, and the damage rate of the connecting line is reduced.

Description

Technical Field

[0001] This field relates to the field of gateways, and in particular, to a gateway, a method, a device, an equipment for gateway task processing. Background Art

[0002] Currently, the connecting wires of the components inside the gateway in the related art have different lengths, resulting in the long connecting wires and short connecting wires for connecting components being stacked and intertwined with each other, leading to a relatively high damage rate of the connecting wires. Summary of the Invention

[0003] Embodiments of the present invention provide a gateway, a method, a device, an equipment, a computer storage medium and a computer program product for gateway task processing, which can reduce the phenomenon of the connecting wires being intertwined with each other and reduce the damage rate of the connecting wires.

[0004] In a first aspect, an embodiment of the present invention provides a gateway, including a housing, the housing forms an accommodation cavity, and a sliding groove is provided on the inner wall of the housing; a placement board, the placement board is placed in the accommodation cavity through the sliding groove; a placement groove is provided on the placement board, a component assembly is arranged in the placement groove, one end of the component assembly is connected to a conductive circuit arranged inside the placement board, a second connecting wire is provided on the second side of the placement board, one end of the second connecting wire is connected to one end of the conductive circuit, and the other end of the second connecting wire is connected to a rear connector provided on the housing to supply power to the component assembly.

[0005] In an implementable embodiment, the number of placement boards is at least two: at least two placement boards are placed in parallel in the accommodation cavity through the sliding grooves; placement grooves are respectively provided on at least two placement boards, and component assemblies are arranged in the placement grooves; connection blocks are provided on the first sides of at least two placement boards, the connection blocks on each placement board are connected to the component assemblies through the conductive circuits arranged inside the placement boards, and the connection blocks on at least two placement boards are connected through a first connecting wire.

[0006] In an implementable embodiment, the gateway further includes a support assembly, and the support assembly is arranged between at least two placement boards.

[0007] In an implementable embodiment, protruding embedding blocks are respectively provided on the first side and the second side of the support assembly, and grooves are provided at the positions corresponding to the support assembly on at least two placement boards for placing the embedding blocks.

[0008] In an implementable embodiment, the gateway further includes a shell cover, and the shell cover is hingedly connected to the housing.

[0009] In an implementable embodiment, the housing and the shell cover of the gateway form a cuboid, the first sides of at least two placement boards are located on the side of the shell cover, and the rear connector is provided on the opposite side of the shell cover.

[0010] In an implementable embodiment, there are at least two support components.

[0011] In an implementable embodiment, at least two connection blocks are provided on each of the at least two placement boards.

[0012] In an implementable embodiment, the first connection line is plugged into the connection block.

[0013] Second, an embodiment of the present invention provides a method for gateway task processing, the method including:

[0014] Select a target task from the task queue of the gateway;

[0015] Determine the amount of resources required for the target task according to the type information and resource parameter information of the target task;

[0016] Use the transmission component in the gateway to send resource request information corresponding to the amount of resources to the central module of the gateway;

[0017] When the computing cluster in the central module receives the resource request information, send resource collection information to the resource collection component in the central module to obtain the available amount of resources corresponding to the computing cluster;

[0018] When the resource perception component in the gateway detects that the amount of resources is greater than the available amount of resources, re-enter the target task into the task queue;

[0019] When the resource perception component in the gateway detects that the amount of resources is less than or equal to the available amount of resources, perform a target operation on the target task.

[0020] In an implementable embodiment, before selecting a target task from the task queue of the gateway, the method further includes:

[0021] Obtain a task;

[0022] Enter the task into the task queue in the order of priority.

[0023] In an implementable embodiment, the central module includes at least two sub-modules. Using the transmission component in the gateway to send resource request information corresponding to the amount of resources to the central module in the gateway includes:

[0024] Use the transmission component in the gateway to send resource request information corresponding to the amount of resources to at least two sub-modules in the gateway respectively.

[0025] In an implementable embodiment, obtaining a task includes:

[0026] Obtain service data;

[0027] Divide the service data into multiple groups of data, and simultaneously modify the values of the blank data in the multiple groups of data to preset values to obtain multiple groups of first data;

[0028] Remove duplicates from the duplicate data in the multiple groups of first data to obtain multiple groups of second data;

[0029] Modify the format of the data in the multiple groups of second data to a preset format to obtain multiple groups of third data;

[0030] Screen the target data corresponding to the target field information from the multiple groups of third data as a task.

[0031] In a third aspect, an embodiment of the present invention provides a device, which includes a processor and a memory storing computer program instructions; the processor reads and executes the computer program instructions to implement the gateway task processing method according to any one of the second aspects.

[0032] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium storing computer program instructions, and when the computer program instructions are executed by a processor, the gateway task processing method according to any one of the second aspects is implemented.

[0033] In a fifth aspect, an embodiment of the present invention provides a computer program product, including a computer program, and when the computer program is executed by a processor, the gateway task processing method according to any one of the second aspects is implemented.

[0034] An embodiment of the present invention provides a gateway, a method, a device, a device, a computer storage medium, and a computer program product for gateway task processing. The gateway includes a housing, the housing forms an accommodation cavity, and a sliding groove is provided on the inner wall of the housing. A placement plate is placed in the accommodation cavity through the sliding groove; a placement groove is provided on the placement plate, and a component assembly is arranged in the placement groove. The component assembly is connected to one end of a conductive circuit arranged inside the placement plate. A second connection line is provided on the second side of the placement plate. One end of the second connection line is connected to one end of the conductive circuit, and the other end of the second connection line is connected to a rear connector provided on the housing to supply power to the component assembly. By placing the component assembly in the placement groove of the placement plate, the component assembly is directly connected to the conductive circuit inside the placement plate, then connected to the second connection line through the conductive circuit, and finally connected to the rear connector through the second connection line, reducing the probability of the connection lines of the component assembly being exposed outside and causing the connection lines to be entangled, and reducing the damage rate of the connection lines.

[0035] In addition, the embodiment of the present application further provides a method for processing gateway tasks. A target task is selected from the task queue of the gateway. The amount of resources required for the target task is determined according to the type information and resource parameter information of the target task. A resource request message corresponding to the amount of resources is sent to the central module of the gateway by using the transmission component in the gateway. When the computing cluster in the central module receives the resource request message, a resource collection message is sent to the resource collection component in the central module to obtain the available amount of resources corresponding to the computing cluster. When the resource perception component in the gateway detects that the amount of resources is greater than the available amount of resources, the target task is re-entered into the task queue. When the resource perception component in the gateway detects that the amount of resources is less than or equal to the available amount of resources, a target operation is performed on the target task. By calculating the amount of resources required for the target task obtained and comparing it with the available amount of resources of the computing cluster obtained, this method can determine whether to execute the target task according to the comparison result, reduce the probability that the target task cannot be executed due to insufficient available resources, and improve the efficiency of gateway task processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required to be used in the embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative efforts.

[0037] Figure 1 It is a schematic structural diagram of a gateway provided by an embodiment of the present invention;

[0038] Figure 2 It is a connection schematic diagram of a connection block provided by an embodiment of the present invention;

[0039] Figure 3 It is a schematic structural diagram of a placement board provided by an embodiment of the present invention;

[0040] Figure 4 It is a schematic diagram of another perspective of the gateway provided by an embodiment of the present invention;

[0041] Figure 5 It is a schematic structural diagram of a support component provided by an embodiment of the present invention;

[0042] Figure 6 It is a schematic structural diagram of another placement board provided by an embodiment of the present invention;

[0043] Figure 7 It is a schematic structural diagram of another placement board provided by an embodiment of the present invention;

[0044] Figure 8 It is a schematic flowchart of a method for processing gateway tasks provided by an embodiment of the present invention;

[0045] Figure 9 is a schematic flowchart of a method for inputting a task into a task queue provided by an embodiment of the present invention;

[0046] Figure 10 is a schematic flowchart of a method for obtaining a task provided by an embodiment of the present invention;

[0047] Figure 11 is a schematic diagram of a gateway software structure provided by an embodiment of the present invention;

[0048] Figure 12 is a schematic flowchart of another gateway task processing provided by an embodiment of the present invention;

[0049] Wherein:

[0050] 100 - gateway;

[0051] 1 - chute; 2 - connecting block;

[0052] 3 - shell cover; 4 - first placement plate; 5 - second placement plate;

[0053] 6 - first connecting wire; 7 - housing; 8 - rear connecting head; 9 - second connecting wire;

[0054] 10 - placement groove; 11 - component assembly;

[0055] 12 - support assembly; 13 - embedding block;

[0056] 14 - first groove; 15 - second groove.

[0057] In the drawings, the same components are denoted by the same reference numerals. The drawings are not drawn to actual scale. Detailed Embodiments

[0058] The features and exemplary embodiments of various aspects of the present invention will be described in detail below. For the purpose of making the objectives, technical solutions and advantages of the present invention more clear and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present invention, rather than to limit the present invention. For those skilled in the art, the present invention can be implemented without some of these specific details. The following description of the embodiments is only intended to provide a better understanding of the present invention by showing examples of the present invention.

[0059] It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprising", "including" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising..." does not exclude the presence of additional identical elements in the process, method, article or device comprising the element.

[0060] Before elaborating on the technical solutions provided by the embodiments of the present invention, for the convenience of understanding the embodiments of the present invention, the present invention specifically describes the problems existing in the related technologies:

[0061] Currently, a gateway, such as an energy computing gateway, can collect, process, analyze and manage energy data based on computer and network technologies, so as to realize the monitoring, analysis and optimization of energy consumption and help users understand the energy usage situation.

[0062] However, the connection lines of the components inside the gateway are of different lengths, resulting in the long connection lines and short connection lines for connecting the components being stacked and intertwined with each other, leading to a high damage rate of the connection lines.

[0063] In addition, when the gateway processes high-concurrency request tasks, it may be necessary to perform serialization / deserialization operations on the data. Due to the lack of an intelligent scheduling mechanism in the gateway's resource allocation, the consumption of resources such as CPU, memory and storage by the gateway during operation may be too high, resulting in low task processing efficiency.

[0064] The embodiments of the present invention provide a gateway, a method, a device, a device, a computer storage medium and a computer program product for gateway task processing, which can solve at least one of the above technical problems existing in the related technologies.

[0065] By placing the component assembly in the placement groove of the placement board, the embodiments of the present invention can shorten the length of the connection line required for connecting the component assembly to the placement board, thereby reducing the probability of connection line entanglement and lowering the damage rate of the connection line.

[0066] By calculating the amount of resources required for the target task obtained and comparing it with the available resources of the obtained computing cluster, the embodiments of the present invention can determine whether to execute the target task according to the comparison result, reduce the probability of being unable to execute the target task due to insufficient available resources, and improve the efficiency of gateway task processing.

[0067] Next, the embodiments of the present invention will be described in detail.

[0068] An embodiment of the present application provides a gateway, including:

[0069] A housing that forms a receiving cavity, and a sliding groove is provided on the inner wall of the housing;

[0070] A placement board that is placed in the receiving cavity through the sliding groove; a placement groove is provided on the placement board, a component assembly is provided in the placement groove, the component assembly is connected to one end of a conductive circuit provided inside the placement board, a second connection line is provided on the second side of the placement board, one end of the second connection line is connected to one end of the conductive circuit, and the other end of the second connection line is connected to a rear connector provided on the housing to supply power to the component assembly.

[0071] In the embodiment of the present invention, by placing the component assembly in the placement groove of the placement board, the component assembly is directly connected to the conductive circuit inside the placement board, then connected to the second connection line through the conductive circuit, and finally connected to the rear connector through the second connection line, reducing the probability of the connection lines of the component assembly being exposed outside and getting entangled, and reducing the damage rate of the connection lines.

[0072] In one embodiment, the number of placement boards is at least two: at least two placement boards are placed in parallel in the receiving cavity through the sliding groove; placement grooves are respectively provided on at least two placement boards, and component assemblies are provided in the placement grooves; connection blocks are provided on the first sides of at least two placement boards, and the connection blocks on each placement board are connected to the component assembly through a conductive circuit provided inside the placement board, and the connection blocks on at least two placement boards are connected through a first connection line.

[0073] In the embodiment of the present invention, by providing multiple placement boards, the heat generated by the component assemblies on a single-layer placement board can be reduced, thereby improving the heat dissipation efficiency of the component assemblies and extending the service life of the component assemblies.

[0074] In one embodiment, at least two placement boards may include a first placement board 4 and a second placement board 5, as Figure 1 shown. In Figure 1 , the gateway 100 further includes a housing 7 that forms a receiving cavity, and a sliding groove 1 is provided on the inner wall of the housing. The first placement board 4 and the second placement board 5 are placed in parallel in the receiving cavity through the sliding groove 1. Connection blocks 2 are provided on the first sides of the first placement board 4 and the second placement board 5. The connection blocks 2 on the first placement board 4 and the second placement board 5 are connected through a first connection line 6. The gateway further includes a housing cover 3, and the housing cover 3 is hingedly connected to the housing 7.

[0075] In the embodiment of the present invention, by providing the sliding groove 1 on the inner wall of the housing 7, the installation and disassembly of the first placement board 4 and the second placement board 5 are made more convenient.

[0076] In one embodiment, the housing and the cover of the gateway form a cuboid. The first sides of at least two placement plates are located on the side of the cover, and the rear connector is arranged on the opposite side of the cover, as Figure 1 shown.

[0077] In one embodiment, at least two connecting blocks are arranged on each of the at least two placement plates. In one example, if at least two connecting blocks are arranged on each of the at least two placement plates, two connecting blocks can be equidistantly placed on the first side of each placement plate, that is, on the side of the cover. In another example, if at least four connecting blocks are arranged on each of the at least two placement plates, four connecting blocks can be equidistantly placed on the first side of each placement plate, that is, on the side of the cover. By reducing the conductive lines required for each connecting block to be connected to the component assembly, the connection efficiency is improved.

[0078] In one embodiment, the first connecting line is plugged into the connecting block, making the installation and disassembly of the first connecting line more convenient and fast, thereby improving the convenience of using the gateway. As Figure 2 shown, the first connecting line 6 is plugged into the connecting block 2.

[0079] As Figure 3 shown, placement grooves 10 are arranged on both the first placement plate 4 and the second placement plate 5, and component assemblies 11 are arranged in the placement grooves 10. Second connecting lines 9 are arranged on the second sides of both the first placement plate 4 and the second placement plate 5, and the second connecting lines 9 are connected to the rear connectors 8 arranged on the housing 7 (as Figure 4 shown) to supply power to the component assemblies 11. In one embodiment, the gateway may further include a support component, and the support component is arranged between at least two placement plates. In one example, if the support component includes two, one support component can be arranged on one side and the opposite side of each of the at least two placement plates to improve the stability of the placement plates. In another example, if the support component includes four, two support components can be equidistantly arranged on one side and the opposite side of each of the at least two placement plates to improve the stability of the placement plates.

[0080] In the embodiment of the present invention, by arranging a support component between the placement plates, the hierarchical structure can be made more stable, the distance between the placement plates can be increased, and the heat dissipation efficiency of the component assemblies on the placement plates can be further improved, thereby prolonging the service life of the component assemblies.

[0081] In one embodiment, the gateway further includes a support component 12, as Figure 3 shown, for improving the stability of the placement plate.

[0082] In one embodiment, as Figure 5As shown in the figure, raised embedding blocks 13 are respectively arranged on the first side and the second side of the support component 12. Grooves are arranged at positions corresponding to at least two placement plates for placing the embedding blocks 13. The support component 12 is placed more stably by embedding the embedding blocks 13 into the grooves of at least two placement plates, making the partition formed between at least two placement plates more fixed, and avoiding the components on the placement slots of the placement plates from being squeezed by adjacent placement plates, resulting in damage to the components, thereby reducing the damage rate of the components.

[0083] In one embodiment, the support component includes at least two.

[0084] In one embodiment, as Figure 3 shown, the support component includes 4, and two support components are respectively arranged on two sides perpendicular to one side of the connection block, which can improve the stability of the placement plate.

[0085] Please refer to Figure 6 , another embodiment of the present invention provides a second placement plate 5. The second connection line 9 of the second placement plate 5 is arranged on the second side, that is, the opposite side of the side of the first side cover in Figure 1 . At least one first groove 14 is arranged on the side of the second placement plate 5 perpendicular to the second side, and can be embedded with Figure 5 the embedding block 13 in

[0086] Please refer to Figure 7 , another embodiment of the present invention provides a first placement plate 4. The second connection line of the first placement plate 4 is arranged on the second side, that is, the opposite side of the side of the first side cover in Figure 1 . At least one second groove 15 is arranged on the side of the first placement plate 4 perpendicular to the first side.

[0087] In one embodiment, the installation steps of the gateway 100 are as follows: Open the housing 7, pull out the first placement plate 4 and the second placement plate 5, put the component 11 into the placement slot 10, then insert the support component 12 into the support slot of the first placement plate 4 through the embedding block 13, then place the second placement plate 5 on the support component 12 and insert the embedding block 13 into the support slot inside the second placement plate 5, then align the first placement plate 4 and the second placement plate 5 with the sliding groove 1 and push them into the housing 7, insert the second connection lines of the first placement plate 4 and the second placement plate 5 into the opposite side of the cover, and insert the first connection line 6 into at least one connection block 2 of the first placement plate 4 and the second placement plate 5 for connection.

[0088] Figure 8 shows a schematic flow chart of the method for gateway task processing provided by an embodiment of the present invention. As Figure 8 shown, the method may include steps S810 - S860.

[0089] S810: Select a target task from the task queue of the gateway.

[0090] Among them, the task queue represents a queue set of tasks generated based on the collected user data information, and the target task represents the task that needs to be processed currently. The target task can be the task ranked first in the task queue.

[0091] In one embodiment, the target task can be selected from the task queue of the gateway according to a preset selection order.

[0092] In one example, the task queue of the gateway includes three tasks A, B, and C. Among them, task A is located at the first position in the task queue, then task A can be selected in the order of first in, first out.

[0093] S820: Determine the amount of resources required for the target task according to the type information and resource parameter information of the target task.

[0094] Among them, the type information represents the computing characteristic information of the target task, such as compute-intensive, memory-intensive, and input / output-intensive. The resource parameter information represents the resource demand declared by the task.

[0095] In one embodiment, after obtaining the type information and resource parameter information of the target task, the amount of resources required for the target task can be determined according to the type information and resource parameter information of the target task.

[0096] In the step process of the embodiment of the present invention, by determining the amount of resources required for the target task, it is convenient to compare with the amount of resources available inside the gateway subsequently, so as to determine whether to execute the target task, thereby improving the processing efficiency of the task.

[0097] S830: Use the transmission component in the gateway to send resource request information corresponding to the amount of resources to the central module of the gateway.

[0098] In this embodiment, after determining the amount of resources required for the target task, the transmission component in the gateway can be used to send resource request information corresponding to the amount of resources to the central module in the gateway.

[0099] In one example, the transmission component can include the Kyuubi gateway.

[0100] S840: In the case where the computing cluster in the central module receives the resource request information, send resource collection information to the resource collection component in the central module to obtain the available amount of resources corresponding to the computing cluster.

[0101] In this embodiment, if the computing cluster in the central module receives resource request information, it can send resource collection information to the resource collection component in the central module to obtain the available resource amount corresponding to the computing cluster.

[0102] In one example, the computing cluster may include a CK (Clickhouse) cluster.

[0103] S850: When the resource awareness component in the gateway detects that the resource amount is greater than the available resource amount, re-enter the target task into the task queue.

[0104] In this embodiment, after obtaining the available resource amount, the awareness detection component in the gateway can be used to detect whether the resource amount is greater than the available resource amount. When it is detected that the resource amount is greater than the available resource amount, re-enter the target task into the task queue.

[0105] S860: When the resource awareness component in the gateway detects that the resource amount is less than or equal to the available resource amount, perform the target operation on the target task.

[0106] In this embodiment, after obtaining the available resource amount, the awareness detection component in the gateway can be used to detect whether the resource amount is greater than the available resource amount. When it is detected that the resource amount is less than or equal to the available resource amount, perform the target operation on the target task.

[0107] By calculating the resource amount required for the target task obtained in the embodiment of the present invention and comparing it with the available resource amount of the obtained computing cluster, it is possible to determine whether to execute the target task according to the comparison result, reduce the probability that the target task cannot be executed due to insufficient available resources, and improve the efficiency of gateway task processing.

[0108] In one embodiment, before selecting the target task from the tasks of the gateway, as Figure 9 shown, the method for gateway task processing further includes steps S870 - S880.

[0109] S870: Obtain the task.

[0110] S880: Enter the tasks into the task queue in the order of priority.

[0111] In this embodiment, after obtaining the task, the corresponding priority information of the task can be identified, and then the task can be entered into the task queue in the preset order of priority.

[0112] In one example, there are two tasks L and K in the current task queue. Among them, the priority of task L is 5, and the priority of task K is 1. If task N re-enters the task queue because the required resource amount is less than the available resource amount, the priority of task N can be identified during the process. If the priority of task N is 3, then according to the rule that the higher the priority, the more preferentially it is executed, task N can be input to the position between L and K in the task queue.

[0113] In the embodiment of the present invention, by obtaining tasks and inputting the tasks into the task queue in the order of priority, resources are preferentially allocated to high-priority tasks, avoiding low-priority tasks from occupying resources, reducing resource waste, and improving resource utilization rate.

[0114] In one embodiment, the central module may include at least two sub-modules. Sending resource request information corresponding to the resource amount to the central module in the gateway by using the transmission component in the gateway may include step S831.

[0115] S831: Use the transmission component in the gateway to send resource request information corresponding to the resource amount to at least two sub-modules in the gateway respectively.

[0116] In this embodiment, after determining the resource amount required by the target task, the transmission component in the gateway can be used to send resource request information corresponding to the resource amount to two sub-modules in the gateway respectively.

[0117] In one embodiment, the gateway may include two sub-modules, namely the O central module and the P central module. After determining the resource amount required by the target task, the transmission component in the gateway can be used to send resource request information corresponding to the resource amount to the O central module and the P central module in the gateway respectively. After receiving the resource request information, the O central module and the P central module obtain the corresponding available resource amounts. If the available resources of the computing cluster in the O central module are insufficient and the available resources of the computing cluster in the P central module are sufficient, then the P central module can be used to perform a target operation on the target task.

[0118] In the embodiment of the present invention, by using the transmission component to send resource request information corresponding to the resource amount to at least two sub-modules in the gateway respectively, tasks can be processed in parallel, thereby improving the efficiency of the central module in processing tasks.

[0119] In one embodiment, as Figure 10 shown, obtaining tasks may include steps S871 - S875.

[0120] S871: Obtain service data.

[0121] Among them, the service data represents data related to user services collected by the gateway.

[0122] In one embodiment, the service data may be data related to user services collected by an energy calculation gateway based on sensors, meters, or device interfaces.

[0123] S872: Divide the service data into multiple groups of data, and simultaneously modify the values of the blank data in the multiple groups of data to preset values to obtain multiple groups of first data.

[0124] Among them, the size of the preset value is not fixed and can be adjusted according to user needs.

[0125] In this embodiment, after obtaining the service data, the service data can be divided into multiple groups of data, and simultaneously modify the values of the blank data in the multiple groups of data to preset values to obtain multiple groups of first data.

[0126] In the step process of the embodiment of the present invention, by simultaneously modifying the values of the blank data in the multiple groups of data to preset values, it is equivalent to processing the multiple groups of data in parallel, which can improve the data processing efficiency. And modifying the values of the blank data to preset values can reduce the probability of reading abnormal data and improve the availability of the data.

[0127] S873: Remove duplicates from the duplicate data in the multiple groups of first data to obtain multiple groups of second data.

[0128] In this embodiment, after obtaining the multiple groups of first data, duplicate data can be determined by detecting whether the values of the data in the multiple groups of first data are the same. Then, perform duplicate removal processing on the duplicate data in the multiple groups of first data, and use the data after duplicate removal as the multiple groups of second data.

[0129] In the step process of the embodiment of the present invention, by removing duplicates from the duplicate data in the multiple groups of first data, the data volume can be streamlined, the data analysis efficiency can be accelerated, and during the duplicate removal process, consistency checking of the data can improve the accuracy and reliability of the data.

[0130] S874: Modify the format of the data in the multiple groups of second data to a preset format to obtain multiple groups of third data.

[0131] In this embodiment, the format of the data in the multiple groups of second data can be compared with the preset format. If the comparison result indicates that the format of the data in the multiple groups of second data is inconsistent with the preset format, the format of the data in the multiple groups of second data can be modified to the preset format to obtain multiple groups of third data.

[0132] In the step process of the embodiment of the present invention, by modifying the format of the data in the multiple groups of second data to a preset format, the components for processing the data can quickly process the data according to unified rules, reducing the complexity and time cost during the processing.

[0133] S875: Screen the target data corresponding to the target field information from multiple groups of third data as a task.

[0134] In this embodiment, the target data corresponding to the target field information can be screened from multiple groups of third data according to the target field information as a task.

[0135] After obtaining the service data, the embodiment of the present invention can improve the data processing efficiency and the efficiency of obtaining tasks by grouping the service data and modifying the values of blank data, removing duplicates, and modifying the data format.

[0136] In one embodiment, the schematic diagram of the gateway software structure is as Figure 11As shown. Among them, the gateway system 200 includes three modules: the first module 300, the second module 400, and the third module 500. Among them, the first module 300 includes a real-time service component, a batch processing component, an interactive query component, and a report component. The real-time service component is used to obtain real-time service data. The batch processing component is used to perform batch processing on the real-time service data, such as modifying the values of blank data, removing duplicates, and modifying the data format. The interactive query component is used to perform interactive queries on the batch-processed data. The report data is used to organize the queried data into a table and use the organized data as a task. The second module 400 includes an intelligent routing component, a scheduling policy component, a task queue component, a resource awareness component, and a transmission component. Among them, the intelligent routing component is used to dynamically allocate network traffic to the most suitable path according to requirements, providing better service quality and user experience. The scheduling policy component is used to determine how to allocate and manage resources, tasks, or requests according to specific algorithms or rules. The task queue component is used to collect generated tasks. The resource awareness component is used to sense whether the available resources of the gateway computing cluster are sufficient. The transmission component is used to transmit data to the third module 500, and the transmission component may include a Kyuubi gateway. The third module 500 may be a central module, and the third module 500 includes SPRAK, Trino, CK cluster, Hive, K8s, HDFS / Yarn, and a resource collection component. Among them, Spark is a distributed computing engine that can cache data in memory, avoiding frequent disk I / O operations caused by reading data from the disk, thereby improving the speed of data processing. Trino is a distributed SQL query engine that can distribute query tasks to multiple nodes in parallel for processing, thereby achieving fast queries on large-scale data. The CK cluster is a distributed cluster architecture composed of multiple ClickHouse nodes, which can add nodes to handle the growing data volume and query requests, and distribute data on multiple nodes for parallel processing to improve query performance. Hive is a data warehouse architecture component that can map structured data to the Hadoop Distributed File System (HDFS) and can utilize the computing resources of the distributed cluster to efficiently process and analyze massive data. The resource collection component is used to collect the available resources of the CK cluster. HDFS / Yarn is the distributed file system and resource management system of the Hadoop cluster. K8s is a container orchestration component used for the automated deployment, scaling, and management of containerized applications. For example, it can transmit the collected available resource amount information to the resource awareness component in the second module 400 for sensing the available resource amount.

[0137] In one embodiment, the step flow of the method for gateway task processing is as Figure 12As shown, in step S121, the task queue acquires a task. In step S122, the scheduling algorithm component is used to determine the amount of resources required for the task. In step S123, the transmission component is used to transmit the amount of resources required for the task. In S124, the CK cluster is used to send resource collection information to the resource collection component. In step S125, the resource collection component is used to collect the available amount of resources. In step S126, the resource awareness analysis component is used to receive the available resource amount information. If the available amount of resources is less than the amount of resources required for the task, step S127 is executed to re-enter the task into the task queue. If the available amount of resources is greater than or equal to the amount of resources required for the task, step S128 is executed.

[0138] In one embodiment, the method for gateway processing can be divided into three stages. Among them, the first stage is the data collection stage, that is, using sensors, meters or device interfaces to obtain service data. The second stage is the data transmission and storage stage, and the third stage is the data processing and analysis stage.

[0139] It should be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps. That is to say, the steps can be executed in the order mentioned in the embodiments, or different from the order in the embodiments, or several steps can be executed simultaneously.

[0140] The various aspects of the present invention have been described above with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems) and computer program products according to embodiments of the present invention. It should be understood that each block in the flowchart and / or block diagram, and the combination of blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the functions / operations specified in one or more blocks of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It is also understood that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can also be implemented by dedicated hardware that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0141] The above are only specific embodiments of the present invention. Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, modules, and units described above can refer to the corresponding processes in the foregoing method embodiments, which will not be elaborated herein. It should be understood that the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of various equivalent modifications or substitutions, and these modifications or substitutions should all be covered within the protection scope of the present invention.

Claims

1. A gateway, characterized in that, Comprising: A housing that forms a receiving cavity, and a chute is provided on the inner wall of the housing; A placement board that is placed in the receiving cavity through the chute; a placement groove is provided on the placement board, and a component assembly is provided in the placement groove. One end of the component assembly is connected to a conductive circuit provided inside the placement board. A second connection line is provided on the second side of the placement board. One end of the second connection line is connected to one end of the conductive circuit, and the other end of the second connection line is connected to a rear connector provided on the housing to supply power to the component assembly.

2. The gateway according to claim 1, characterized in that The number of the placement boards is at least two: at least two placement boards are placed in parallel in the receiving cavity through the chute; placement grooves are respectively provided on the at least two placement boards, and component assemblies are provided in the placement grooves; connection blocks are provided on the first side of the at least two placement boards, and the connection blocks on each placement board are connected to the component assemblies through conductive circuits provided inside the placement board. The connection blocks on the at least two placement boards are connected through a first connection line.

3. The gateway according to claim 2, wherein The gateway further comprises: A support assembly that is provided between the at least two placement boards.

4. The gateway according to claim 3, wherein Protruding embedding blocks are respectively provided on the first side and the second side of the support assembly. Grooves are provided at positions corresponding to the support assembly on the at least two placement boards for placing the embedding blocks.

5. The gateway according to claim 1, characterized in that The gateway further comprises a shell cover that is hingedly connected to the housing.

6. The gateway according to any one of claims 1 to 5, characterized in that, The housing and the shell cover of the gateway form a cuboid. The first side of the at least two placement boards is located on the side of the shell cover, and the rear connector is provided on the opposite side of the shell cover.

7. The gateway according to claim 6, wherein The support assembly includes at least two.

8. The gateway according to claim 6, characterized in that, At least two connection blocks are provided on each of the at least two placement boards.

9. The gateway according to claim 2, wherein The first connection line is plugged on the connection block.

10. A method for gateway task processing applied to the gateway described in claim 1, characterized in that, Comprising: Selecting a target task from the task queue of the gateway; Determining the amount of resources required for the target task according to the type information and resource parameter information of the target task; Using a transmission component in the gateway to send resource request information corresponding to the amount of resources to a central module in the gateway; When a computing cluster in the central module receives the resource request information, sending resource collection information to a resource collection component in the central module to obtain the available amount of resources corresponding to the computing cluster; When a resource sensing component in the gateway detects that the amount of resources is greater than the available amount of resources, re-inputting the target task into the task queue; When a resource sensing component in the gateway detects that the amount of resources is less than or equal to the available amount of resources, performing a target operation on the target task.

11. The method according to claim 10, wherein Before selecting a target task from the task queue of the gateway, the method further comprises: Obtaining a task; Inputting the task into the task queue in the order of priority.

12. The method according to claim 10, wherein The central module includes at least two sub-modules. The using a transmission component in the gateway to send resource request information corresponding to the amount of resources to a central module in the gateway includes: Use the transmission component in the gateway to send resource request information corresponding to the resource quantity to at least two sub-modules in the gateway respectively.

13. The method according to claim 11, wherein The obtaining task includes: Obtain service data; Divide the service data into multiple groups of data, and simultaneously modify the values of the blank data in the multiple groups of data to preset values to obtain multiple groups of first data; Remove duplicates from the duplicate data in the multiple groups of first data to obtain multiple groups of second data; Modify the format of the data in the multiple groups of second data to a preset format to obtain multiple groups of third data; Screen the target data corresponding to the target field information from the multiple groups of third data as the task.

14. A device, characterized in that, The device includes: a processor and a memory storing computer program instructions; the processor reads and executes the computer program instructions to implement the method for processing gateway tasks as described in any one of claims 10-13.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the method for processing gateway tasks as described in any one of claims 10-13 is implemented.

16. A computer program product, characterized in that, Includes a computer program, and when the computer program is executed by a processor, the method for processing gateway tasks as described in any one of claims 10-13 is implemented.

Images