A radio data processing method, device, apparatus and storage medium

Abstract

The application discloses a radio data processing method, device and equipment and a storage medium. The method comprises the following steps: acquiring a radio data set to be processed; wherein the radio data set to be processed has corresponding generation time information, the radio data set to be processed comprises radio data to be processed of a to-be-processed task, and the to-be-processed task comprises a plurality of subtasks executed in a preset order; determining a target memory matched with the radio data set to be processed according to the generation time information, a total number of memories and a pre-established memory management table, and storing the radio data set to be processed in the target memory; calling a processing thread corresponding to each subtask in the plurality of subtasks in the target memory according to the preset order, and processing the radio data to be processed by using the processing thread. The technical scheme of the application improves the calculation speed of radio data.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to a radio data processing method, apparatus, device, and storage medium. Background Technology

[0002] In the field of radio astronomy, with the upgrading and development of radio astronomy equipment, the amount of data collected and the transmission speed are huge. The existing technology for processing radio astronomy data has the problem that the calculation speed is slower than the transmission speed when performing complex calculations, which eventually leads to data loss. Therefore, there is an urgent need for a new processing method to solve this problem. Summary of the Invention

[0003] This invention provides a radio data processing method, apparatus, device, and storage medium to solve the problem of data loss caused by the slower calculation speed than the data transmission speed during complex calculations in the processing of radio astronomy data in the prior art, thereby improving the calculation speed of radio data.

[0004] According to one aspect of the present invention, a radio data processing method is provided, the method comprising:

[0005] Obtain the radio data set to be processed; wherein the radio data set to be processed has corresponding generation time information, the radio data set to be processed includes radio data to be processed for the task to be processed, and the task to be processed includes multiple sub-tasks executed in a preset order;

[0006] Based on the generation time information, total memory, and pre-established memory management table, a target memory matching the radio dataset to be processed is determined, and the radio dataset to be processed is stored in the target memory.

[0007] In the target memory, the processing thread corresponding to each of the multiple subtasks is called in the preset order, and the processing thread is used to process the radio data to be processed.

[0008] According to another aspect of the present invention, a radio data processing apparatus is provided, the apparatus comprising:

[0009] A radio data set acquisition module is used to acquire radio data sets to be processed; wherein, the radio data set to be processed has corresponding generation time information, the radio data set to be processed includes radio data to be processed for a task to be processed, and the task to be processed includes multiple sub-tasks executed in a preset order;

[0010] The radio data set storage module is used to determine the target memory that matches the radio data set to be processed based on the generation time information, the total amount of memory and the pre-established memory management table, and to store the radio data set to be processed into the target memory;

[0011] The radio data processing module is used to call the processing thread corresponding to each of the multiple subtasks in the target memory in the preset order, and to process the radio data to be processed using the processing thread.

[0012] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0013] At least one processor; and

[0014] A memory communicatively connected to the at least one processor; wherein,

[0015] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the radio data processing method according to any embodiment of the present invention.

[0016] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the radio data processing method according to any embodiment of the present invention.

[0017] The technical solution of this invention involves acquiring a radio astronomy dataset to be processed. This dataset includes corresponding generation time information and comprises radio data to be processed for a task. The task includes multiple subtasks executed in a preset order. Based on the generation time information, total memory, and a pre-established memory management table, a target memory matching the dataset is determined, and the dataset is stored in the target memory. Within the target memory, processing threads corresponding to each subtask are invoked in the preset order, and these threads process the radio data. This method, where the processing threads corresponding to the subtasks process the radio data stored in the target memory, solves the problem of data loss during complex calculations in the prior art, where the calculation speed is slower than the data transmission speed, thus improving the calculation speed for radio astronomy data.

[0018] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a flowchart of a radio data processing method provided in Embodiment 1 of the present invention;

[0021] Figure 2a A flowchart of another radio data processing method provided in Embodiment 2 of the present invention;

[0022] Figure 2b This is a schematic diagram of a radio data processing method for a single radio dataset provided in Embodiment 2 of the present invention;

[0023] Figure 2c This is a schematic diagram of a radio data processing method for multiple radio datasets to be processed, provided in Embodiment 2 of the present invention;

[0024] Figure 3 This is a schematic diagram of the structure of a radio data processing device provided in Embodiment 3 of the present invention;

[0025] Figure 4 This is a schematic diagram of the structure of an electronic device that implements the radio data processing method of the present invention. Detailed Implementation

[0026] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "comprising" and "having" and any variations thereof in the specification, claims and accompanying drawings of this invention are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such processes, methods, products or devices.

[0028] Example 1

[0029] Figure 1 This is a flowchart of a radio data processing method provided in Embodiment 1 of the present invention. This embodiment is applicable to the processing of large amounts of rapidly transmitted data. The method can be executed by a radio data processing device, which can be implemented in hardware and / or software, and can be configured in a server with data processing capabilities. Figure 1 As shown, the method includes:

[0030] S110. Obtain the radio data set to be processed; wherein the radio data set to be processed has corresponding generation time information, the radio data set to be processed includes radio data to be processed for the task to be processed, and the task to be processed includes multiple sub-tasks executed in a preset order.

[0031] The radio astronomy dataset to be processed can refer to the radio astronomy dataset received by the computer network port at the current moment. The radio data to be processed contained in the dataset can be arranged in a certain order. Each piece of data in the dataset can be a unit of data. The generation time information can refer to the generation duration of the dataset; each dataset can have unique generation time information. Furthermore, since the dataset is periodically generated by an external system, the generation time information also increases periodically. The processing task can refer to the general processing procedure for the dataset. In this embodiment, the processing procedure corresponding to the dataset generally involves performing similar operations on each piece of data, meaning the processing procedures for each part of the dataset are basically the same. Subtasks can refer to the unit tasks that constitute the processing task. The preset order can refer to the processing order of multiple subtasks within the processing task.

[0032] In this embodiment, the radio data set to be processed received by the computer network port at the current moment can be obtained.

[0033] S120. Based on the generation time information, total memory, and pre-established memory management table, determine the target memory that matches the radio dataset to be processed, and store the radio dataset to be processed into the target memory.

[0034] The total memory can refer to the total amount of memory in the current computing system. The memory management table can contain the mapping between dataset identifiers and memory identifiers. A dataset identifier is the identification information used to determine the corresponding memory; it can be obtained based on the generation time information of the radio dataset to be processed. A memory identifier is the identity information used to represent each memory location. The target memory can refer to the memory space corresponding to the radio dataset to be processed; the target memory can be a target selected from multiple memory locations.

[0035] For example, a pre-built memory management table when the computing system uses 10 units of memory can be shown in Table 1:

[0036] Table 1

[0037] Dataset identifier 0 1 2 3 4 5 6 7 8 9 Memory identifier a b c d e f g h i j

[0038] In this embodiment, the target memory matching the radio dataset to be processed can be determined based on the unique generation time information corresponding to the radio dataset to be processed, the total amount of memory in the computing system, and the pre-established memory management table, so that the radio dataset to be processed can be stored in the target memory.

[0039] In an optional implementation of this embodiment, determining the target memory matching the radio dataset to be processed based on the generation time information, the total amount of memory, and a pre-established memory management table may include: determining a target dataset identifier corresponding to the radio dataset to be processed based on the generation time information and the total amount of memory; querying the pre-established memory management table based on the target dataset identifier to determine a target memory identifier matching the target dataset identifier; and using the memory corresponding to the target memory identifier as the target memory matching the radio dataset to be processed.

[0040] The target dataset identifier can refer to the dataset identifier corresponding to the radio dataset currently being processed. The target memory identifier can refer to the matching memory identifier found based on the target dataset identifier when querying a pre-established memory management table.

[0041] Continuing the previous example, the generation time of the radio dataset to be processed is 52ms. The remainder of 52 divided by the total memory of 10 is 2, which means that the dataset identifier of the radio dataset to be processed is 2. By referring to Table 1, we can determine that the memory corresponding to the radio dataset to be processed is c. Therefore, the memory corresponding to c is the target memory.

[0042] S130. In the target memory, the processing thread corresponding to each of the multiple subtasks is called in the preset order, and the processing thread is used to process the radio data to be processed.

[0043] The processing thread can be used to execute the corresponding subtask.

[0044] In this embodiment, the processing thread corresponding to each subtask can be called in the target memory according to the preset order of processing subtasks, so as to use the processing thread to process the radio data to be processed in the radio dataset.

[0045] Optionally, after all subtasks have finished processing the radio dataset to be processed, the radio dataset to be processed can be deleted from the target memory.

[0046] The technical solution of this invention involves acquiring a radio astronomy dataset to be processed. This dataset includes corresponding generation time information and comprises radio data to be processed for a task. The task includes multiple subtasks executed in a preset order. Based on the generation time information, total memory, and a pre-established memory management table, a target memory matching the dataset is determined, and the dataset is stored in the target memory. Within the target memory, processing threads corresponding to each subtask are invoked in the preset order, and these threads process the radio data. This method, where the processing threads corresponding to the subtasks process the radio data stored in the target memory, solves the problem of data loss during complex calculations in the prior art, where the calculation speed is slower than the data transmission speed, thus improving the calculation speed for radio astronomy data.

[0047] Example 2

[0048] Figure 2a This is a flowchart of another radio data processing method provided in Embodiment 2 of the present invention. Based on the above embodiments, this embodiment refines the operation of calling the processing thread corresponding to each of the plurality of subtasks in the target memory according to the preset order, and using the processing thread to process the radio data to be processed. For example... Figure 2a As shown, the method includes:

[0049] S210. Obtain the radio data set to be processed; wherein the radio data set to be processed has corresponding generation time information, the radio data set to be processed includes radio data to be processed for the task to be processed, and the task to be processed includes multiple sub-tasks executed in a preset order.

[0050] S220. Based on the generation time information, total memory, and pre-established memory management table, determine the target memory that matches the radio dataset to be processed, and store the radio dataset to be processed into the target memory.

[0051] S230. Determine the subtask that needs to be executed from the plurality of subtasks according to the preset order to obtain the target task.

[0052] The target task can refer to the currently executing subtask selected from multiple subtasks.

[0053] In this embodiment, the target task can be obtained by determining the subtask that needs to be executed from multiple subtasks according to a preset order of processing multiple subtasks.

[0054] S240. In the target memory, call the processing thread corresponding to the target task, and use the processing thread to process the radio data to be processed.

[0055] Each of the multiple subtasks has a corresponding level of complexity.

[0056] Optionally, invoking the processing thread corresponding to the target task and using the processing thread to process the radio data to be processed may include: determining whether the complexity of the target task exceeds a preset complexity threshold; if the complexity of the target task does not exceed the preset complexity threshold, invoking the processing thread corresponding to the target task and using the processing thread to process the radio data to be processed.

[0057] When the complexity of the target task exceeds the preset complexity threshold, the radio dataset to be processed is split into at least one split radio dataset; a corresponding sub-thread is created for each of the at least one split radio dataset; and the corresponding split radio dataset is processed using the sub-thread.

[0058] The preset complexity threshold can refer to the limit value of the complexity of the subtask.

[0059] In this embodiment, it can be determined whether the complexity of the target task exceeds a preset complexity threshold. If not, the processing thread corresponding to the target task can be directly called to process the radio data to be processed in the radio dataset. If so, it indicates that the target task is highly complex and may slow down the data processing speed. Therefore, the radio dataset to be processed can be split to obtain at least one split radio dataset, and a corresponding sub-thread can be created for each split radio dataset. Thus, the sub-thread can be used to process the corresponding split radio dataset to reduce the pressure on the processing thread corresponding to the target task to directly process the radio data to be processed in the radio dataset.

[0060] Optionally, the process of splitting the radio data set to be processed may include: splitting the radio data set to be processed according to the memory identifier of the radio data set to be processed in the target memory; or splitting the radio data set to be processed according to a preset number.

[0061] The memory identifier for the radio data to be processed in the target memory can be, for example, a parity identifier. The preset quantity can refer to the planned number of segments for the radio dataset to be processed, for example, two.

[0062] For example, the radio data to be processed can be split into a dataset labeled with odd numbers and a dataset labeled with even numbers based on the parity identifier of the radio data in the target memory. Alternatively, the radio data to be processed can be split into a first half dataset and a second half dataset according to two preset quantities. It should be noted that the above two splitting methods can also be used in combination, and the above two splitting methods are for illustrative purposes only and are not limiting.

[0063] For example, Figure 2b This is a schematic diagram of a radio data processing method for a single radio dataset to be processed, provided in Embodiment 2 of the present invention, taking memory-marked splitting and combining the radio dataset to be processed into two equal halves as examples. Figure 2b As shown, the processing task of the radio dataset to be processed is divided into multiple subtasks. For complex subtasks, the split radio dataset is assigned to different sub-threads for computation based on the parity of the radio data to be processed, and the split radio dataset is further divided into a first half and a second half and assigned to different processing threads.

[0064] The technical solution of this invention involves acquiring a radio astronomy dataset to be processed. The dataset includes corresponding generation time information and comprises radio data to be processed for a task. The task includes multiple subtasks executed in a preset order. Based on the generation time information, total memory, and a pre-established memory management table, a target memory matching the dataset is determined, and the dataset is stored in the target memory. The subtask to be executed is determined from the multiple subtasks according to the preset order, thus obtaining the target task. In the target memory, a processing thread corresponding to the target task is invoked, and the processing thread processes the radio data to be processed. This method, where the processing thread corresponding to the subtask processes the radio data stored in the target memory, solves the problem of data loss during complex calculations in the prior art for processing radio astronomy data due to slower calculation speeds than data transmission speeds, thereby improving the calculation speed for radio data.

[0065] In one scenario, multiple radio datasets to be processed can be acquired. The corresponding memory can be determined based on the generation time information of each dataset, thus avoiding memory contention and reducing the time spent on mutual exclusion processing during parallel computation. Based on the markings of each memory location, the radio data in the multiple datasets can be processed in a preset order according to the processing thread corresponding to each subtask within the multiple subtasks.

[0066] For example, Figure 2cThis is a schematic diagram of a radio data processing method for multiple radio datasets to be processed, provided in Embodiment 2 of the present invention, taking memory-marked splitting and combining the radio datasets to be processed into two equal halves as examples. Figure 2c As shown, after the current processing thread completes the calculation of the current radio dataset to be processed and notifies the next processing thread, the current processing thread can then perform calculations on subsequent radio datasets to be processed. Figure 2c (The dotted part in the text); when splitting complex processing threads, it can compute the split radio datasets marked as odd and even in parallel; when further splitting the split radio dataset into the first half and the second half, it can compute the first half and the second half of the split radio dataset in parallel. Figure 2c (Refer to sections 3.1.1 and 3.1.2). Properly breaking down the computation process can reduce the overall execution time after stabilization to near the execution time of the smallest subdivided unit.

[0067] Example 3

[0068] Figure 3 This is a schematic diagram of a radio data processing device provided in Embodiment 3 of the present invention. Figure 3 As shown, the device includes: a radio data acquisition module 310, a radio data storage module 320, and a radio data processing module 330. Wherein:

[0069] The radio data set acquisition module 310 is used to acquire the radio data set to be processed; wherein, the radio data set to be processed has corresponding generation time information, the radio data set to be processed includes radio data to be processed for a task to be processed, and the task to be processed includes multiple sub-tasks executed in a preset order.

[0070] The radio data set storage module 320 is used to determine the target memory that matches the radio data set to be processed based on the generation time information, the total amount of memory and the pre-established memory management table, and to store the radio data set to be processed into the target memory.

[0071] The radio data processing module 330 is used to call the processing thread corresponding to each of the multiple subtasks in the target memory in the preset order, and use the processing thread to process the radio data to be processed.

[0072] The technical solution of this invention involves acquiring a radio astronomy dataset to be processed. This dataset includes corresponding generation time information and comprises radio data to be processed for a task. The task includes multiple subtasks executed in a preset order. Based on the generation time information, total memory, and a pre-established memory management table, a target memory matching the dataset is determined, and the dataset is stored in the target memory. Within the target memory, processing threads corresponding to each subtask are invoked in the preset order, and these threads process the radio data. This method, where the processing threads corresponding to the subtasks process the radio data stored in the target memory, solves the problem of data loss during complex calculations in the prior art, where the calculation speed is slower than the data transmission speed, thus improving the calculation speed for radio astronomy data.

[0073] Optionally, the memory management table contains a mapping between dataset identifiers and memory identifiers;

[0074] Correspondingly, the radio data set storage module 320 includes:

[0075] The target dataset identifier determination subunit is used to determine the target dataset identifier corresponding to the radio dataset to be processed based on the generation time information and the total memory.

[0076] The target memory identifier determination subunit is used to query the pre-established memory management table based on the target dataset identifier to determine the target memory identifier that matches the target dataset identifier;

[0077] The target memory determination subunit is used to identify the memory corresponding to the target memory identifier as the target memory that matches the radio dataset to be processed.

[0078] Optionally, the radio data processing module 330 includes:

[0079] The target task acquisition subunit is used to determine the subtask that needs to be executed from the plurality of subtasks according to the preset order, so as to obtain the target task;

[0080] The radio data processing subunit is used to call the processing thread corresponding to the target task in the target memory and use the processing thread to process the radio data to be processed.

[0081] Optionally, each of the plurality of subtasks has a corresponding level of complexity;

[0082] Accordingly, the radio data processing subunit can be specifically used for:

[0083] Determine whether the complexity of the target task exceeds a preset complexity threshold;

[0084] When the complexity of the target task does not exceed the preset complexity threshold, the processing thread corresponding to the target task is invoked, and the processing thread is used to process the radio data to be processed.

[0085] Optionally, the radio data processing subunit can also be used for:

[0086] When the complexity of the target task exceeds the preset complexity threshold, the radio dataset to be processed is split to obtain at least one split radio dataset.

[0087] Create a corresponding sub-thread for each of the at least one shunting radio datasets; use the sub-threads to process the corresponding shunting radio datasets.

[0088] Optionally, the radio data processing subunit can also be used for:

[0089] The radio data set to be processed is split into streams based on the memory identifier of the radio data to be processed in the target memory.

[0090] Optionally, the radio data processing subunit can also be used for:

[0091] The radio data set to be processed is split into multiple streams according to a preset number.

[0092] The radio data processing apparatus provided in the embodiments of the present invention can execute the radio data processing method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of executing the method.

[0093] Example 4

[0094] Figure 4 A schematic diagram of an electronic device 400 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0095] like Figure 4As shown, the electronic device 400 includes at least one processor 401 and a memory, such as a read-only memory (ROM) 402 and a random access memory (RAM) 403, communicatively connected to the at least one processor 401. The memory stores computer programs executable by the at least one processor. The processor 401 can perform various appropriate actions and processes based on the computer program stored in the ROM 402 or loaded into the RAM 403 from storage unit 408. The RAM 403 may also store various programs and data required for the operation of the electronic device 400. The processor 401, ROM 402, and RAM 403 are interconnected via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0096] Multiple components in electronic device 400 are connected to I / O interface 405, including: input unit 406, such as keyboard, mouse, etc.; output unit 407, such as various types of displays, speakers, etc.; storage unit 408, such as disk, optical disk, etc.; and communication unit 409, such as network card, modem, wireless transceiver, etc. Communication unit 409 allows electronic device 400 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0097] Processor 401 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 401 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 401 performs the various methods and processes described above, such as radio data processing methods.

[0098] In some embodiments, the radio data processing method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 408. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 400 via ROM 402 and / or communication unit 409. When the computer program is loaded into RAM 403 and executed by processor 401, one or more steps of the radio data processing method described above may be performed. Alternatively, in other embodiments, processor 401 may be configured to perform the radio data processing method by any other suitable means (e.g., by means of firmware).

[0099] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0100] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0101] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0102] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0103] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0104] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0105] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0106] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A radio data processing method, characterized in that, include: Obtain the radio data set to be processed; wherein, the radio data set to be processed has corresponding generation time information, the radio data set to be processed includes radio data to be processed for the task to be processed, the task to be processed includes multiple sub-tasks executed in a preset order; the generation time information refers to the generation time of the radio data set to be processed, and the generation time information is unique; Based on the generation time information, total memory size, and a pre-established memory management table, a target memory matching the radio dataset to be processed is determined, and the radio dataset to be processed is stored in the target memory; the memory management table contains a fixed correspondence between dataset identifiers and memory identifiers; the dataset identifier is obtained based on the generation time of the radio dataset to be processed and the total memory size; The target task is obtained by determining the subtask to be executed from the plurality of subtasks according to the preset order; each subtask has a corresponding level of complexity. In the target memory, it is determined whether the complexity of the target task exceeds a preset complexity threshold; When the complexity of the target task does not exceed the preset complexity threshold, the processing thread corresponding to the target task is invoked, and the processing thread is used to process the radio data to be processed. When the complexity of the target task exceeds the preset complexity threshold, the radio data to be processed is split into at least one split radio data set according to the memory identifier of the radio data to be processed in the target memory; a corresponding sub-thread is created for each of the at least one split radio data set; the corresponding split radio data set is processed by the sub-thread; the memory identifier of the radio data to be processed in the target memory is an even / odd identifier.

2. The method according to claim 1, characterized in that, Based on the generation time information, total memory size, and pre-established memory management table, determine the target memory that matches the radio dataset to be processed, including: Based on the generation time information and the total memory, determine the target dataset identifier corresponding to the radio dataset to be processed; Based on the target dataset identifier, the pre-established memory management table is queried to determine the target memory identifier that matches the target dataset identifier; The memory corresponding to the target memory identifier is used as the target memory to match the radio dataset to be processed.

3. The method according to claim 1, characterized in that, The radio data set to be processed is subjected to splitting processing, including: The radio data set to be processed is split into multiple streams according to a preset number.

4. A radio data processing device, characterized in that, include: A radio data set acquisition module is used to acquire radio data sets to be processed; wherein, the radio data set to be processed has corresponding generation time information, the radio data set to be processed includes radio data to be processed for a task to be processed, the task to be processed includes multiple sub-tasks executed in a preset order; the generation time information refers to the generation duration of the radio data set to be processed, and the generation time information is unique; The radio data set storage module is used to determine the target memory that matches the radio data set to be processed based on the generation time information, the total amount of memory, and a pre-established memory management table, and to store the radio data set to be processed into the target memory; the memory management table contains a fixed correspondence between dataset identifiers and memory identifiers; the dataset identifier is obtained based on the generation time of the radio data set to be processed and the total amount of memory; A radio data processing module is used to determine the subtask to be executed from a plurality of subtasks according to a preset order to obtain a target task; each of the plurality of subtasks has a corresponding complexity level; in the target memory, it is determined whether the complexity of the target task exceeds a preset complexity threshold; if the complexity of the target task does not exceed the preset complexity threshold, the processing thread corresponding to the target task is invoked, and the processing thread is used to process the radio data to be processed; if the complexity of the target task exceeds the preset complexity threshold, the radio data to be processed is split into at least one split radio data set according to the memory identifier of the radio data to be processed in the target memory; a corresponding sub-thread is created for each of the at least one split radio data set; the sub-thread is used to process the corresponding split radio data set; the memory identifier of the radio data to be processed in the target memory is an even / odd identifier.

5. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the radio data processing method according to any one of claims 1-3.

6. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the radio data processing method according to any one of claims 1-3.

Images