Video data access device and method based on non-volatile memory

By using MRAM in the monitoring system for spin current storage and reading of video data, combined with cloud storage, the data loss problem of DDR SDRAM capacitor storage is solved, and data integrity and efficient storage are achieved.

CN112835522BActive Publication Date: 2024-11-26青岛海存微电子有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110141747.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-02-02
Publication Date
2024-11-26
Estimated Expiration
2041-02-02

AI Technical Summary

Technical Problem

The capacitor storage of DDR SDRAM in the monitoring system requires a timed voltage refresh. If the power is suddenly lost or the power supply is insufficient, it will lead to the loss of stored information and cause serious losses to the monitoring data.

Method used

Using a video data access device based on nonvolatile memory, using MRAM to store and read video data through spin current, combined with a cloud storage platform to ensure the integrity of data when the power is interrupted and when the storage space is insufficient Data upload.

Benefits of technology

It avoids data loss due to capacitor discharge, ensures the integrity of video data, and reduces storage time through the high read and write speed of MRAM, satisfying efficient video data writing and reading tasks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112835522B_ABST
    Figure CN112835522B_ABST
Patent Text Reader

Abstract

The present application provides a video data access device based on a non-volatile memory, comprising: an acquisition module for acquiring video data; a writing module electrically connected to the acquisition module, the writing module being used to generate a storage instruction for storing the video data; a non-volatile memory electrically connected to the writing module, the writing module being used to respond to the storage instruction and store the video data through a spin current; and a reading module electrically connected to the non-volatile memory, being used to read the video data in the non-volatile memory.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data access technology, and in particular to a video data access device and method based on a non-volatile memory. Background Art

[0002] As the monitoring system improves, its application scenarios are becoming more and more diverse. In many application scenarios, the monitoring system is required to record all dynamics within the field of view of its camera all day long, which inevitably puts higher requirements on the memory of the monitoring system. At present, the memory of the monitoring system mainly uses DDR SDRAM (Double Data Rate synchronous dynamic random-access memory). DDRSDRAM can cache data at high speed, which is conducive to the fast reading and writing of video data.

[0003] However, DDR SDRAM uses capacitor storage and needs to refresh the voltage regularly. If the monitoring system suddenly loses power or fails to supply power in time, the capacitor inside the DDR SDRAM will discharge, causing the loss of the stored information in the DDR SDRAM. Based on the monitoring properties of the monitoring system, the loss of monitoring data caused by power failure or failure to supply power in time will cause serious losses to users. Summary of the invention

[0004] The present application provides an image data access device and method based on a non-volatile memory, in order to solve or partially solve the above-mentioned problems involved in the background technology or at least one other deficiency in the prior art.

[0005] On the one hand, the present application provides such a video data access device based on a non-volatile memory, comprising: an acquisition module, a write module, a non-volatile memory, and a read module. The acquisition module is used to acquire video data. The write module is electrically connected to the acquisition module and is used to generate a storage instruction for storing video data. The non-volatile memory is electrically connected to the write module and is used to respond to the storage instruction and store the video data through a spin current. The read module is electrically connected to the non-volatile memory and is used to read the video data in the non-volatile memory.

[0006] In some embodiments, the nonvolatile memory includes: a double data rate controller and an MRAM. The double data rate controller is used to respond to the storage instruction and generate a drive storage instruction. The MRAM is electrically connected to the double data rate controller and is used to respond to the drive storage instruction and store the video data at a double rate.

[0007] In some implementations, the double data rate controller is further configured to generate a drive read instruction in response to a read instruction from the read module.

[0008] In some implementations, the MRAM is further configured to read the video data at a double rate in response to a drive read instruction.

[0009] In some implementations, a judgment module is further included, which is electrically connected to the writing module and is used to judge the storage space of the non-volatile memory.

[0010] In some embodiments, a cloud storage platform is further included, which is used to respond to the judgment result of the judgment module that the storage space of the non-volatile memory is insufficient, and receive and store the video data of the non-volatile memory.

[0011] In some embodiments, a display module is further included, which is electrically connected to the reading module and is used to receive and display the video data obtained by the reading module.

[0012] On the other hand, the present application also provides a video data access method based on a non-volatile memory, comprising: acquiring video data; generating a storage instruction for the video data by a writing module; storing the video data by a non-volatile memory through a spinning current according to the storage instruction; and reading the video data in the non-volatile memory by a reading module.

[0013] In some embodiments, the video data is stored in a non-volatile memory through a spinning current, and when the current supply to the non-volatile memory is temporarily stopped, the method includes:

[0014] The memory continues to respond to the received storage instruction and stores the video data through the spinning current; and

[0015] The nonvolatile memory generates a video data storage completion signal and stops receiving new storage instructions.

[0016] In some implementations, after the writing module generates a storage instruction for the video data, the method further includes:

[0017] Determining the storage space of the non-volatile memory; and

[0018] When the judgment result is that the storage space of the non-volatile memory is insufficient, the video data in the non-volatile memory is uploaded to the cloud storage platform.

[0019] According to the technical solution of the above-mentioned implementation mode, at least one of the following beneficial effects can be obtained.

[0020] According to an embodiment of the present application, an image data access device and method based on a non-volatile memory replaces the original SDRAM capacitor storage method with an MRAM method of writing video data through a spin current, thereby avoiding the problem of loss of data to be stored due to capacitor discharge at the moment of system power failure, thereby ensuring the integrity of the stored video data.

[0021] According to an image data access device and method based on a non-volatile memory according to an embodiment of the present application, MRAM, as a storage unit of the non-volatile memory, has a higher read and write speed, reduces the storage time, and is conducive to completing a large amount of video data writing and reading tasks. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0023] Figure 1 is a schematic structural diagram of an image data access device based on a non-volatile memory according to an exemplary embodiment of the present application;

[0024] Figure 2 is a flowchart of a method for accessing image data based on a non-volatile memory in a power-on state according to an exemplary embodiment of the present application;

[0025] Figure 3 is a schematic diagram of the working process of the MRAM when the power is on according to the image data access method based on the non-volatile memory according to the exemplary embodiment of the present application;

[0026] Figure 4 is a flowchart of a method for accessing image data based on a non-volatile memory in a power-off situation according to an exemplary embodiment of the present application; and

[0027] Figure 5 It is a schematic diagram of the working process of MRAM in a power-off state according to the image data access method based on non-volatile memory according to an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0028] In the detailed description below, many specific details of the application are set forth by example, so as to provide a thorough understanding of the relevant disclosure. However, for those of ordinary skill in the art, the application can be implemented without these details as is apparent. It should be understood that the use of "system", "device", "unit" and / or "module" terms in the application is a method for distinguishing different parts, elements, parts or assemblies of different levels in a sequential arrangement. However, if other expressions can achieve the same purpose, these terms can be replaced by other expressions.

[0029] It should be understood that when a device, unit or module is referred to as being "on," "connected to," or "coupled to" another device, unit or module, it may be directly on, connected to, coupled to, or communicating with other devices, units or modules, or there may be intermediate devices, units or modules, unless the context clearly indicates an exception. For example, the term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0030] The terms used in this application are only for describing specific embodiments and are not intended to limit the scope of this application. As shown in the specification and claims of this application, unless the context clearly indicates an exception, the words "one", "a", "a kind" and / or "the" do not specifically refer to the singular and may also include the plural. Generally speaking, the terms "include" and "comprise" only indicate the inclusion of clearly identified features, wholes, steps, operations, elements and / or components, and such expressions do not constitute an exclusive list, and other features, wholes, steps, operations, elements and / or components may also be included.

[0031] These and other features and characteristics, methods of operation, functions of related elements of the structure, combinations of parts, and economies of manufacture of the present application may be better understood with reference to the following description and drawings, which form a part of the specification. However, it is to be clearly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of protection of the present application. It is to be understood that the drawings are not drawn to scale.

[0032] Various structural diagrams are used in this application to illustrate various variations of the embodiments of this application. It should be understood that the above or below structures are not intended to limit this application. The scope of protection of this application shall be subject to the claims.

[0033] Figure 1 is a schematic structural diagram of an image data access device based on a non-volatile memory according to an exemplary embodiment of the present application.

[0034] like Figure 1 As shown, the present application discloses a video data access device based on a non-volatile memory, which may include: an acquisition module 1, a writing module 2, a non-volatile memory 3 and a reading module 4. The acquisition module is used to acquire video data. The writing module is electrically connected to the acquisition module and is used to generate a storage instruction for storing video data. The non-volatile memory is electrically connected to the writing module and is used to respond to the storage instruction and store the video data through a spinning current. And the reading module is electrically connected to the non-volatile memory and is used to read the video data in the non-volatile memory.

[0035] The acquisition module 1 can be a camera, which is used to collect all dynamics within its own field of view to obtain video data. According to different application scenarios of the video data access device based on non-volatile memory of the present application, the acquisition module 1 needs to perform continuous acquisition work within the predetermined working time. For example, in a certain monitoring scenario, the working time of the acquisition module in a week can be preset to 7d×24h, where d is the number of days and h is the number of hours. It can be foreseen that in order to meet the needs of its application scenario, the acquisition module 1 will perform long-term continuous acquisition work, and will inevitably generate a large amount of video data. The video data in this application can be dynamic video information, static picture information, or other data modes that meet the needs of users, which are not limited here.

[0036] The programmable logic device selected in the video data access device based on non-volatile memory of the present application is FPGA (Field Programmable Gate Array). Programmable logic device is a hardware carrier that implements the established functions and technical indicators of electronic application systems through electronic design automation technology. FPGA, as one of the mainstream devices to achieve this approach, has the characteristics of being directly user-oriented, extremely flexible and versatile, easy to use, and fast hardware testing and implementation. In the present application, FPGA is used as the main control chip. On the one hand, it can effectively receive the video data sent by the acquisition module 1 and generate a storage instruction containing the video data to drive the non-volatile memory 3 to store the video data; on the other hand, FPGA can effectively respond to the reading requirements of the display module 5, and then convert the reading requirements into a reading instruction that matches the non-volatile memory 3 to achieve the transmission of the video data contained in the reading instruction.

[0037] The write module 2 is a part of the FPGA responsible for generating storage instructions, and is electrically connected to the acquisition module 1 through the I2C bus. The I2C bus is a simple, bidirectional two-wire synchronous serial bus that only requires two wires to realize the information transmission between the two devices connected to it. Therefore, in this application, an I2C bus is set between the FPGA and the acquisition module 1 to realize the transmission of video data. In the transmission process of video data, the resolution can be set to the output format of RGB565, where the output format of RGB565 is 16 bits each time. In order to quickly realize the storage and real-time display of video data, the video data is divided into 2 8-bits for transmission. In this application, CH0 and CH1 are two channels for data transmission to realize the transmission of video data collected by the acquisition module 1. The data transmitted through the I2C bus is received by the first FIFO (First In First Out), and the first FIFO processes the video data to generate a storage pulse, that is, a storage instruction, and confirms the storage instruction through the write arbitration unit. Further, a storage instruction containing video data is transmitted with a lower power consumption through the AXI (Advanced eXtensibleInterface) bus protocol. Furthermore, the IP (Intellectual Property) core drives the non-volatile memory 3 to respond to the storage instruction, such as the storage operation of the video data contained in the storage instruction. The IP core selected in this application is the MIG IP core, which can provide a high-speed interface with the non-volatile memory 3, including video data transmission, initialization operation and correction operation of the non-volatile memory 3, etc.; in addition, it can also receive the storage instruction more effectively and drive the non-volatile memory 3 to execute the storage instruction.

[0038] The non-volatile memory 3 includes a double data rate controller 31 and an MRAM (Magnetoresistive Random Access Memory) 32. The double data rate controller 31 is electrically connected to the writing module 2, and can receive and respond to the storage instruction transmitted by the MIG IP core, and drive the MRAM 32 to store the video data contained in the storage instruction at a double rate.

[0039] MRAM 32 is a new type of non-volatile magnetic random access memory that uses spin current to write information. MRAM 32 uses spin current to store video data. When the power is off, the direction of the spin current will not change. MRAM 32 will still maintain the original current direction and continue to store the received video data, which is conducive to ensuring the integrity of the video storage. At the same time, MRAM 32 reduces energy consumption to a great extent by eliminating leakage, so it also has advantages such as lower dynamic energy consumption. In addition, the read and write rate of MRAM 32 is as high as 500MHZ, and the write time is less than 10ns. It can complete the storage of video data at a higher storage rate, ensuring that in certain application scenarios, such as all-day and all-time monitoring, a large amount of video data storage is required, thereby improving the user experience.

[0040] Of course, the storage space of MRAM 32 is limited. In order to avoid the situation of clearing the stored video data due to insufficient storage space of MRAM 32 during the storage process, the present application is also provided with a judgment module 6 and a cloud storage platform 7. The judgment module 6 is electrically connected to the writing module 2. After receiving the storage instruction, the storage space of MRAM 32 is first judged. If the storage space can meet the demand, no operation is performed; if the judgment result is that the storage space of MRAM 32 is insufficient, an upload instruction is sent to MRAM 32, and MRAM 32 responds to the upload instruction to upload the video data stored inside to the cloud storage platform 7, and the cloud storage platform 7 receives and stores the video data of MRAM 32. By setting up the cloud storage platform 7, the situation of insufficient storage space of MRAM 32 can be effectively solved, and the situation of clearing the stored video data due to insufficient storage space of MRAM 32 can be avoided, and the integrity of the stored video data is guaranteed. Further, the storage capacity of the video data access device based on non-volatile memory of the present application is also improved, and the needs of the scene with a large amount of video data storage are met.

[0041] In order to meet the requirements of the present application for real-time display of the collected video data, the display module 5 includes an HDMI (High Definition Multimedia Interface) display 51 and an external display 52. ​​The HDMI display is a display device that supports the high-definition multimedia interface, which can display more display information with high clarity. The external display 52 is a client operation terminal, which is used to interact with the user, specifically including displaying the real-time video dynamics collected by the collection module 1 to the user, and sending a reading request to the reading module 4. The setting of the display can meet the display requirements for the collected video data, and at the same time enhances the information interaction between the user and the video data access device based on the non-volatile memory of the present application, thereby improving the user's experience.

[0042] The read module 4 is another part of the FPGA, which is used to receive the user's read request and convert the read request into a read instruction, and transmit the read instruction to the double data rate controller 31 through the built-in MIG IP core; the double data rate controller 31 drives the MRAM 32 at a double rate to read the stored data, that is, read out the stored information by detecting its resistance.

[0043] When the stored video data is to be read, the MRAM 32 is accessed and mapped using the RBC (Row-Bank-Column) access format, that is, a memory address is converted to correspond to a physical storage unit of the MRAM 32 to obtain the video data stored in the storage unit, thereby realizing the reading of the video data.

[0044] After the reading module 4 reads the response video data, it passes the video data to the display module 5. Specifically, the reading module 4 includes a MIG IP core shared with the writing module 2, which is used to realize the transmission of the read video data and the transmission of the read instruction, which will not be repeated here. After the MIG IP core obtains the video data, it will pass it to the read arbitration unit through the AXI bus protocol to complete the confirmation of the video data. Further, the video data is passed to the second FIFO, and the second FIFO processes the video data to generate a display pulse, and the video data is passed to the display module 5 through the two channels CH1 and CH0 to complete the display demand for the video data. The reading module 4 and the writing module 2 are two modules of the FPGA, and the transmission of the two-way data generated by the two modules can be completed asynchronously, that is, the storage and reading functions can be completed independently to achieve real-time data acquisition and display.

[0045] It should be noted that in this embodiment, all modules are electrically connected to each other for information exchange.

[0046] Figure 2 The figure is a flowchart of a method for accessing image data based on a non-volatile memory in a power-on state according to an exemplary embodiment of the present application. Figure 3 1 is a schematic diagram of the working process of the MRAM when the power is on, according to the image data access method based on the non-volatile memory according to the exemplary embodiment of the present application.

[0047] like Figure 2 As shown, the present application provides a video data access method based on a non-volatile memory, comprising:

[0048] Collect video data;

[0049] The storage instruction of the video data is generated by the writing module;

[0050] According to the storage instruction, the non-volatile memory stores the video data through the spinning current; and

[0051] The video data in the non-volatile memory is read by the reading module.

[0052] Specifically, Figure 3 As shown, the MRAM of the non-volatile memory includes four mode registers, namely MR0 (Mode Register 0), MR1 (Mode Register 1), MR2 (Mode Register 2) and MR3 (Mode Register 3). The MRAM in the non-volatile memory receives a storage instruction containing video data through the AXI bus protocol and the AHB (Advanced High performance Bus) system bus, and performs storage control update characteristics, impedance, and CAS (Central Authentication Service) write length and other parameters through MR2; then controls the multi-purpose register through MR3; further, stores DLL (Delay-locked Loop, delay-locked loop), output drive length, additional length, write level enable and other parameters; further, MR0 is used to store data of different operation modes of the memory, including burst length, read burst type, CAS length, test mode, DLL reset, etc.; after calibrating the MRAM and before executing the storage instruction, MR2 is required to perform the operation of storage control update characteristics, impedance, and CAS write length and other parameters again. Further, after completing the above operations, read and write in the form of ROW-BANK-COL, while increasing the depth and width of FIFO and CAS, and finally realizing the storage of MRAM for storage data.

[0053] In some embodiments, after the writing module generates the storage instruction of the video data, the method further includes: determining the storage space of the non-volatile memory; and when the determination result is that the storage space of the non-volatile memory is insufficient, uploading the video data in the non-volatile memory to the cloud storage platform, so as to avoid the video data being cleared due to storage space limitation in some cases, and further ensure the integrity of the video data.

[0054] In some embodiments, before the entire access step, an initialization operation is also included for the device executing the method of the present application.

[0055] This embodiment is a corresponding method for implementing the image data access device based on non-volatile memory in the first embodiment. The execution mode, function and effect of any module involved therein refer to the first embodiment and will not be repeated here.

[0056] Figure 4 The figure is a flowchart of a method for accessing image data based on a non-volatile memory in a power-off situation according to an exemplary embodiment of the present application.

[0057] like Figure 4 As shown, the present application provides a video data access method based on a non-volatile memory, comprising:

[0058] Collect video data;

[0059] The storage instruction of the video data is generated by the writing module;

[0060] According to the storage instruction, the non-volatile memory stores the video data through the spinning current;

[0061] The video data in the non-volatile memory is read by the reading module;

[0062] When the current supply to the nonvolatile memory is temporarily stopped, the nonvolatile memory continues to respond to the received storage instruction and stores the video data through the spinning current; and

[0063] The nonvolatile memory generates a video data storage completion signal and stops receiving new storage instructions.

[0064] Figure 5 It is a schematic diagram of the working process of MRAM in a power-off state according to the image data access method based on non-volatile memory according to an exemplary embodiment of the present application.

[0065] like Figure 5 As shown, in the case of a sudden power outage, the MRAM will stop receiving any new commands, including storage instructions or read instructions, but will continue to execute the received commands, including storage instructions or read instructions, and store video data by means of spin current or read the stored data by detecting its resistance. After completing the storage instruction or read instruction, a storage completion signal is generated, and finally the power supply of the MRAM is turned off. This ensures that the method involved in the present application does not lose the storage or reading of video data due to power outage, and ensures the integrity of its storage and reading.

[0066] In some implementations, the method further includes resupplying current to the nonvolatile memory and repeating the above operation.

[0067] This embodiment is to implement the access method of the image data access device based on the non-volatile memory in the first embodiment under power-off condition. The execution mode, function and effect of any module involved therein are referred to the first embodiment and will not be repeated here.

[0068] According to the image data access method based on non-volatile memory of this embodiment, the original SDRAM capacitor storage method is replaced by the MRAM method of writing video data through spin current, avoiding the problem of loss of data to be stored due to capacitor discharge at the moment of system power failure, and ensuring the integrity of the stored video data. At the same time, in this embodiment, since MRAM has a higher read and write speed, the storage time is reduced, which is conducive to completing a large amount of video data writing and reading tasks.

[0069] It should be understood that the above specific embodiments of the present application are only used to illustrate or explain the principles of the present application, and do not constitute a limitation to the present application. Therefore, any modifications, equivalent substitutions, improvements, etc. made without departing from the spirit and scope of the present application should be included in the protection scope of the present application. In addition, the claims attached to the present application are intended to cover all changes and modifications that fall within the scope and boundaries of the attached claims, or the equivalent forms of such scope and boundaries.

Claims

1. A video data access device based on a non-volatile memory, characterized in that: include: An acquisition module, used for acquiring video data; A writing module, electrically connected to the acquisition module via an I2C bus, for generating a storage instruction for storing the video data, wherein the I2C bus is used to divide the video data acquired by the acquisition module into two 8-bit packets for transmission; A non-volatile memory, electrically connected to the writing module, for responding to the storage instruction and storing the video data through a spinning current; When the power is suddenly cut off, the non-volatile memory continues to respond to the received storage instruction, stores the video data through the spinning current, and generates a storage completion signal after completing the storage instruction; A reading module, electrically connected to the non-volatile memory, and used for reading the video data in the non-volatile memory; A judgment module, electrically connected to the writing module, and used for judging the storage space of the non-volatile memory; as well as The cloud storage platform is used to respond to the judgment result of the judgment module that the storage space of the non-volatile memory is insufficient, and receive and store the video data of the non-volatile memory.

2. The video data access device based on non-volatile memory according to claim 1, characterized in that: The non-volatile memory comprises: a double data rate controller, configured to generate a drive storage instruction in response to the storage instruction; and The MRAM is electrically connected to the double data rate controller and is used to respond to the drive storage instruction to store the video data at a double rate.

3. The video data access device based on non-volatile memory according to claim 2, characterized in that: The double data rate controller is further used to respond to the read instruction of the read module and generate a drive read instruction.

4. The video data access device based on non-volatile memory according to claim 3, characterized in that: The MRAM is also used to respond to the drive read instruction and read the video data at a double rate.

5. The video data access device based on non-volatile memory according to claim 1, characterized in that: It also includes a display module, which is electrically connected to the reading module and is used to receive and display the video data obtained by the reading module.

6. A video data access method based on non-volatile memory, characterized in that: include: Collect video data; The writing module generates a storage instruction for the video data, wherein the video data is divided into two 8-bit packets for transmission via an I2C bus; Determining the storage space of the non-volatile memory; When the judgment result is that the storage space of the non-volatile memory is insufficient, uploading the video data in the non-volatile memory to the cloud storage platform; According to the storage instruction, the video data is stored by the non-volatile memory through the spinning current, and when the power is suddenly cut off, the method includes: The nonvolatile memory continues to respond to the received storage instruction to store the video data through the spinning current, and The nonvolatile memory generates a storage completion signal of the video data and stops receiving new storage instructions; and The video data in the non-volatile memory is read by a reading module.