A data processor and a data processing method

Abstract

A data processor and a data processing method proposed in an embodiment of the present invention map a physical memory that is in communication with the data processor by setting a first circular buffer, and then read the data in the physical memory according to the mapping relationship between the first circular buffer and the physical memory through a first data read-write module, and store the data in the physical memory in a second circular buffer. Since the data storage speed of the circular buffer is very fast, the data in the physical memory can be quickly taken out through the above scheme, avoiding the loss and damage of data caused by the data in the physical memory not being taken out in time and being overwritten by the data subsequently stored in the physical memory, and after the data in the physical memory is taken out, the physical memory can rewrite the data, thereby improving the utilization rate of the physical memory.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of data processing technology, and in particular to a data processor and a data processing method. Background Art

[0002] When using existing technology to store multi-channel data stored in the physical memory of a DSP chip (Digital Signal Processing) in a storage device such as a USB flash drive or a mobile hard disk, the data in the physical memory cannot be retrieved in time due to the slow writing speed of the storage device, resulting in the data that has not been retrieved in time being overwritten by the newly written data, thereby causing data loss.

[0003] The above description of the process of discovering the problem is only used to assist in understanding the technical solution of the present invention and does not constitute an admission that the above content is prior art. Summary of the invention

[0004] In order to solve the above technical problem or at least partially solve the above technical problem, an embodiment of the present invention provides a data processor and a data processing method.

[0005] In view of this, in a first aspect, an embodiment of the present invention provides a data processor, including:

[0006] A first circular buffer, a second circular buffer and a first data reading and writing module;

[0007] The first circular buffer is used to map a physical memory that is communicatively connected to the data processor;

[0008] The first data reading and writing module is used to read the data in the physical memory according to the mapping relationship between the first circular buffer and the physical memory, and write the read data into the second circular buffer.

[0009] In one possible implementation, the data includes a data channel number and a flag, the data flag is used to identify whether the data is readable, the first circular buffer and the second circular buffer are both composed of data blocks of preset lengths, and the header information of the data blocks includes the flag and data channel number of the data stored in the data blocks.

[0010] In a possible implementation, the data processor further includes: a second data reading and writing module and a data file creating module;

[0011] The second data reading and writing module is used to read the data in the second circular buffer;

[0012] The data file creation module is used to create a data file corresponding to the data read by the second data reading and writing module in a storage device connected to the data processor;

[0013] The second data reading and writing module writes the data read from the second circular buffer into corresponding data files respectively.

[0014] In a possible implementation, the data processor further includes: a data monitoring module and a control module;

[0015] The data monitoring module is used to monitor whether there is data transmission in the data channel corresponding to the data stored in the second circular buffer;

[0016] The control module is used to close the data file corresponding to the data when there is no data transmission in the data channel corresponding to the data for a preset period of time.

[0017] In a second aspect, an embodiment of the present application further provides a data processing method, which is applied to the data processor described in the first aspect, and the data processing method includes:

[0018] A first circular buffer maps a physical memory communicatively connected to a data processor;

[0019] A first data reading and writing module reads data in the physical memory according to a mapping relationship between the first circular buffer and the physical memory;

[0020] The first data reading and writing module writes the data read from the physical memory into the second circular buffer.

[0021] In a possible implementation manner, the first data reading and writing module reads data in the physical memory according to a mapping relationship between the first circular buffer and the physical memory, including:

[0022] The first data reading and writing module obtains header information of each data block in the first circular buffer;

[0023] Determine a data block in the first circular buffer where data can be read according to the flag bit in the header information;

[0024] Determine the physical address of the data in the data block readable by the data according to the mapping relationship between the first circular buffer and the physical memory;

[0025] The data in the physical memory is read according to the physical address.

[0026] In a possible implementation, the data processing method further includes:

[0027] The second data reading and writing module reads data from the second circular buffer;

[0028] The data file creation module creates a data file corresponding to the data read by the second data reading and writing module in a storage device connected to the data processor;

[0029] The second data reading and writing module writes the data read from the second circular buffer into corresponding data files respectively.

[0030] In a possible implementation, the data processing method further includes:

[0031] The data monitoring module monitors whether there is data transmission in the data channels respectively corresponding to the data stored in the second circular buffer;

[0032] When there is no data transmission in the data channel corresponding to the data for a preset period of time, the control module closes the data file corresponding to the data.

[0033] Compared with the prior art, a data processor proposed in an embodiment of the present invention maps the physical memory that is in communication with the data processor by setting a first circular buffer, and then reads the data in the physical memory according to the mapping relationship between the first circular buffer and the physical memory through the first data read-write module, and stores the data in the physical memory in the second circular buffer. Since the data storage speed of the circular buffer is very fast, the data in the physical memory can be quickly taken out through the above scheme, avoiding the loss and damage of data caused by the data in the physical memory not being taken out in time and being overwritten by the data subsequently stored in the physical memory, and after the data in the physical memory is taken out, the physical memory can rewrite the data, thereby improving the utilization rate of the physical memory. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0035] Figure 1 A block diagram of a data processor provided in Embodiment 1 of the present invention;

[0036] Figure 2 A block diagram of another data processor provided in Embodiment 1 of the present invention;

[0037] Figure 3 A block diagram of a data processor provided in Embodiment 2 of the present invention;

[0038] Figure 4 A flowchart of a data processing method provided in Embodiment 3 of the present invention;

[0039] Figure 5 A flowchart of another data processing method provided in Embodiment 3 of the present invention;

[0040] Figure 6 A schematic diagram of a circular buffer provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0041] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] In order to facilitate the use of data, users usually store the data stored in the physical memory of devices such as DSP to portable storage devices such as USB flash drives and mobile hard drives. However, since storage devices such as USB flash drives and mobile hard drives write data relatively slowly, the retrieval of data in the physical memory is also slow. As a result, when storing multiple data in the physical memory in the storage device, it is easy for the data in the physical memory to be overwritten by the newly written data before it can be retrieved in time, resulting in data loss.

[0043] Therefore, in order to prevent the above situation from happening, the speed of retrieving data from the physical memory should be increased.

[0044] An embodiment of the present application provides a data processor. By storing data in a physical memory in a storage device through the data processor provided by the present application, the speed of retrieving data from the physical memory can be accelerated, thereby avoiding the overwriting of data in the physical memory that cannot be retrieved in time.

[0045] Embodiment 1

[0046] Figure 1 A block diagram of a data processor is provided for an embodiment of the present invention, such as Figure 1 Said data processor comprises:

[0047] A first circular buffer, a second circular buffer and a first data reading and writing module.

[0048] The first circular buffer is used to map a physical memory that is communicatively connected to the data processor, wherein the physical memory may be a physical memory in a DSP chip that is communicatively connected to the data processor.

[0049] The first data reading and writing module is used to read the data in the physical memory according to the mapping relationship between the first circular buffer and the physical memory, and write the read data into the second circular buffer, wherein the data in the physical memory can be n-channel data captured by the DSP, n>=1, and the data can be voice data or other data, which is not limited here.

[0050] In an embodiment of the present application, the data processor is connected to the physical memory in communication, and a virtual memory is provided in the first circular buffer. The data processor maps the physical memory connected to the physical memory to the virtual memory of the first circular buffer, and then obtains a virtual address corresponding to the physical address of the data stored in the physical memory. Then, when the first data read-write module reads the data in the physical memory, it finds the physical address that has a mapping relationship with the virtual address according to the virtual address in the first circular buffer, and then reads the data from the physical memory according to the physical address. This method of accessing the physical memory through the virtual address has the following advantages:

[0051] 1. The data processor can use a series of adjacent virtual addresses to access non-adjacent memory buffers in physical memory.

[0052] 2. The data processor can use a range of virtual addresses to access memory buffers that are larger than the available physical memory. When the supply of physical memory becomes smaller, the memory manager saves physical memory pages (usually 4KB in size) to disk files, and data or code pages are moved between physical memory and disk as needed.

[0053] 3. The virtual addresses used by different processes are isolated from each other. The code in one process cannot change the physical memory being used by another process or the operating system, and other processes will not affect the data processor's process.

[0054] Through the data processor provided by the embodiment of the present application, according to the mapping relationship between the first circular buffer and the physical memory, the speed of copying the data in the physical memory to the second circular buffer is much higher than the speed of directly writing the data in the physical memory to the storage device. The data processor provided by the present application can quickly retrieve the data in the physical memory, avoiding the data being overwritten due to the slow retrieval of the physical memory.

[0055] The existing circular buffer is composed of data blocks. The length of the data block determines the amount of data that can be written into the data block. Therefore, when writing (storing) data into the circular buffer, it is necessary to first parse the length of the data block in the circular buffer to determine the length of each data block in the circular buffer, and then obtain the corresponding amount of data according to the length of the data block for writing. Since the length of the data block in the circular buffer must be parsed before the data is written into the circular buffer, it is very time-consuming, which slows down the speed of data transmission. Therefore, in order to solve this problem, in a possible embodiment, the first circular buffer and the second circular buffer provided in the present application are composed of data blocks of fixed length. The length of the data block is a preset length, and the value of the preset length can be set according to the demand. It is not limited here. Because the length of the data block is a preset fixed value, when writing data into the first circular buffer and the second circular buffer, there is no need to parse the length of the data block, which reduces the time consumption of data transmission and thereby improves the data transmission speed. The data blocks in the first circular buffer and the second circular buffer are distributed as follows: Figure 6 As shown, N represents the number of data blocks. The header of the data block contains header information, which contains a flag bit and a voice channel number. The flag bit indicates whether the data in the data block is readable. When the data in the data block is read, the data and the flag bit in the data block will be cleared to release space in time. The data channel number in the header information of the data block is used to indicate the data channel number corresponding to the data in the data block. A data block can only store data with the same data channel number. The data channel number is used to distinguish different data. The data transmitted in the same data channel belongs to the same data path, and its corresponding data channel number is the same. The flag bit and the data channel number are characteristics of the data. Each data contains its own corresponding flag bit and data channel number.

[0056] The data processor provided in the embodiment of the present application is further provided with a second data reading and writing module and a data file creating module in order to store the acquired data in the physical memory into the storage device, such as Figure 2 As shown;

[0057] The second data reading and writing module is used to read the data in the second circular buffer;

[0058] The data file creation module is used to create a data file corresponding to the data read by the second data reading and writing module in a storage device connected to the data processor;

[0059] The second data reading and writing module writes the data read from the second circular buffer into corresponding data files respectively.

[0060] In a possible embodiment, the data files correspond to the data channel numbers, and one data file corresponds to one data channel number, that is, data with the same data channel number is stored in the same data file, which facilitates data management and calling.

[0061] Embodiment 2

[0062] Figure 3 A block diagram of a data processor provided in an embodiment of the present application, such as Figure 3 As shown, the data processor includes:

[0063] A first circular buffer, a second circular buffer, a first data reading and writing module, a second data reading and writing module, a data file creating module, a data monitoring module and a control module.

[0064] The first circular buffer is used to map a physical memory that is communicatively connected to the data processor.

[0065] The first data reading and writing module is used to read the data in the physical memory according to the mapping relationship between the first circular buffer and the physical memory, and write the read data into the second circular buffer.

[0066] The second data reading and writing module is used to read the data in the second circular buffer.

[0067] The data file creation module is used to create a data file corresponding to the data read by the second data reading and writing module in a storage device connected to the data processor.

[0068] The second data reading and writing module writes the data read from the second circular buffer into corresponding data files respectively.

[0069] The data monitoring module is used to monitor whether there is data transmission in the data channel corresponding to the data stored in the second circular buffer.

[0070] The control module is used to close the data file corresponding to the data when there is no data transmission in the data channel corresponding to the data for a preset period of time.

[0071] In the prior art, when transferring data to a data file, the data file is opened as long as there is data transmission in the data channel, and the file is closed when there is no data transmission in the data channel. When transmitting incoherent data (such as voice data), this method leads to frequent opening and closing of the data file due to intermittent data, and the opening and closing of the data file takes a long time, which increases the time required for data transmission and causes low data transmission efficiency. Therefore, the present application seeks to solve this problem by setting a data monitoring module and a control module in the data processor, and the data monitoring module is used to monitor whether there is data transmission in the data channel corresponding to the data stored in the second circular buffer.

[0072] The control module is used to close the data file corresponding to the data when there is no data transmission in the data channel corresponding to the data for a preset period of time.

[0073] The specific value of the preset duration is set according to demand.

[0074] The data monitoring module monitors the data transmission in the data channel corresponding to the data stored in the second circular buffer (for example, the data channel between the second circular buffer and the data file) in real time. When it is monitored that there is no data transmission in the data channel corresponding to one or more data channels for a preset time, a control instruction is sent to the control module, and the control module closes the data file corresponding to the one or more data channels. The embodiment of the present application sets a data monitoring module, and closes the corresponding data file only when the duration of no data transmission in the data channel reaches a preset time, thereby avoiding frequent closing and opening of the data file.

[0075] Embodiment 3

[0076] Figure 4 A data processing method is provided in an embodiment of the present invention, and the data processing method is applied to the data processor described in embodiment 1 or 2, such as Figure 3 As shown, the data processing method includes the following steps:

[0077] S401. The first circular buffer maps a physical memory that is communicatively connected to the data processor;

[0078] S402. The first data reading and writing module reads the data in the physical memory according to the mapping relationship between the first circular buffer and the physical memory;

[0079] S403. The first data reading and writing module writes the data read from the physical memory into the second circular buffer.

[0080] In an embodiment of the present application, the data processor is connected to the physical memory in communication, and a virtual memory is provided in the first circular buffer. The data processor maps the physical memory connected to the physical memory to the virtual memory of the first circular buffer, and then obtains a virtual address corresponding to the physical address of the data stored in the physical memory. Then, when the first data read-write module reads the data in the physical memory, it finds the physical address that has a mapping relationship with the virtual address according to the virtual address in the first circular buffer, and then reads the data from the physical memory according to the physical address. This method of accessing the physical memory through the virtual address has the following advantages:

[0081] 1. The data processor can use a series of adjacent virtual addresses to access non-adjacent memory buffers in physical memory.

[0082] 2. The data processor can use a range of virtual addresses to access memory buffers that are larger than the available physical memory. When the supply of physical memory becomes smaller, the memory manager saves physical memory pages (usually 4KB in size) to disk files, and data or code pages are moved between physical memory and disk as needed.

[0083] 3. The virtual addresses used by different processes are isolated from each other. The code in one process cannot change the physical memory being used by another process or the operating system, and other processes will not affect the data processor's process.

[0084] Through the data processor provided by the embodiment of the present application, according to the mapping relationship between the first circular buffer and the physical memory, the speed of copying the data in the physical memory to the second circular buffer is much higher than the speed of directly writing the data in the physical memory to the storage device. The data processor provided by the present application can quickly retrieve the data in the physical memory, avoiding the data being overwritten due to the slow retrieval of the physical memory.

[0085] In a possible embodiment, the first data reading and writing module reads the data in the physical memory according to the mapping relationship between the first circular buffer and the physical memory, including:

[0086] The first data reading and writing module obtains header information of each data block in the first circular buffer.

[0087] A data block in the first circular buffer where data is readable is determined according to the flag bit in the header information, that is, the data block where the flag bit indicates data is readable.

[0088] The physical address of the data in the data-readable data block is determined according to the mapping relationship between the first circular buffer and the physical memory.

[0089] The data in the physical memory is read according to the physical address.

[0090] To facilitate data storage in storage devices such as Figure 5 As shown, the data processing method also includes:

[0091] S404. The second data reading and writing module reads data from the second circular buffer.

[0092] In a possible embodiment, the second data reading and writing module reads data from the second circular buffer, including:

[0093] The second data reading and writing module obtains header information of each data block in the second circular buffer.

[0094] A data block in the second circular buffer where data is readable is determined according to the flag bit in the header information, that is, the data block where the flag bit indicates data is readable.

[0095] Read the data stored in the data readable data block.

[0096] S405. The data file creation module creates a data file corresponding to the data read by the second data reading and writing module in a storage device connected to the data processor.

[0097] In a possible embodiment, the data file creation module creates a data file corresponding to the data channel number according to the data channel number of the data, and one data file corresponds to one data channel number.

[0098] S406. The second data reading and writing module writes the data read from the second circular buffer into corresponding data files respectively.

[0099] For example, if the data channel number of data 1 is 1, then data 1 is stored in the data file corresponding to data channel number 1.

[0100] In order to avoid frequent opening and closing of data files, the data processing method further includes:

[0101] The data monitoring module monitors whether there is data transmission in the data channels respectively corresponding to the data stored in the second circular buffer;

[0102] When there is no data transmission in the data channel corresponding to the data for a preset period of time, the control module closes the data file corresponding to the data.

[0103] For example: there are 5 data channels in the second circular buffer, and the data channel numbers corresponding to the 5 data channels are 1, 2, 3, 4, and 5 respectively. The data monitoring module monitors the data channels corresponding to the 5 data channels (for example: monitors the data channels between the second circular buffer and the data files) to see whether there is data transmission. If the duration of no data transmission in the two data channels with data channel numbers 1 and 2 reaches a preset time length, the data files corresponding to data channel numbers 1 and 2 respectively will be closed.

[0104] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0105] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0106] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0107] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for enabling an electronic device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, ROM, RAM, magnetic disks, or optical disks.

[0108] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0109] It should be noted that, in this document, relational terms such as “first” and “second” are merely used to distinguish one entity or operation from another entity or operation, but do not necessarily require or imply any actual relationship or order between these entities or operations.

[0110] Through the description of the above implementation methods, those skilled in the art can clearly understand that the methods described in the various embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the various embodiments of the present invention or the methods described in some parts of the embodiments.

[0111] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A data processor, characterized in that: include: A first circular buffer, a second circular buffer and a first data reading and writing module; The first circular buffer is used to map a physical memory that is communicatively connected to the data processor; The first data reading and writing module is used to read the data in the physical memory according to the mapping relationship between the first circular buffer and the physical memory, and write the read data into the second circular buffer; Wherein, the data processor further comprises: a second data reading and writing module and a data file creating module; The second data reading and writing module is used to read the data in the second circular buffer; The data file creation module is used to create a data file corresponding to the data read by the second data reading and writing module in a storage device connected to the data processor; The second data reading and writing module writes the data read from the second circular buffer into corresponding data files respectively; Wherein, the data processor further includes: a data monitoring module and a control module; The data monitoring module is used to monitor whether there is data transmission in the data channel corresponding to the data stored in the second circular buffer; The control module is used to close the data file corresponding to the data when there is no data transmission in the data channel corresponding to the data for a preset period of time.

2. The data processor according to claim 1, characterized in that The data includes a data channel number and a flag, the data flag is used to identify whether the data is readable, the first circular buffer and the second circular buffer are both composed of data blocks of preset lengths, and the header information of the data block includes the flag and data channel number of the data stored in the data block.

3. A data processing method, characterized in that: Applied to the data processor of any one of claims 1-2, the data processing method comprising: A first circular buffer maps a physical memory communicatively connected to a data processor; A first data reading and writing module reads data in the physical memory according to a mapping relationship between the first circular buffer and the physical memory; The first data reading and writing module writes the data read from the physical memory into a second circular buffer; Wherein, the data processing method further includes: The second data reading and writing module reads data from the second circular buffer; The data file creation module creates a data file corresponding to the data read by the second data reading and writing module in a storage device connected to the data processor; Wherein, the data processing method further includes: The data monitoring module monitors whether there is data transmission in the data channels respectively corresponding to the data stored in the second circular buffer; When there is no data transmission in the data channel corresponding to the data for a preset period of time, the control module closes the data file corresponding to the data.

4. The data processing method according to claim 3, characterized in that: The first data reading and writing module reads data in the physical memory according to a mapping relationship between the first circular buffer and the physical memory, including: The first data reading and writing module obtains header information of each data block in the first circular buffer; Determine a data block in the first circular buffer where data can be read according to the flag bit in the header information; Determine the physical address of the data in the data block readable by the data according to the mapping relationship between the first circular buffer and the physical memory; The data in the physical memory is read according to the physical address.

Images