A multimedia data processing method, device, equipment and readable storage medium

By configuring secure memory access permissions for the multimedia data processing module in the terminal device, the development difficulty and system load issues of processing multimedia data in secure mode of the terminal device are solved, and more efficient multimedia data processing is achieved.

CN115618356BActive Publication Date: 2025-11-04HUNAN GOKE MICROELECTRONICS CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202211302512.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-24
Publication Date
2025-11-04
Estimated Expiration
2042-10-24

AI Technical Summary

Technical Problem

When terminal devices process encrypted multimedia data, existing technologies require functional modules to run in a secure mode, which increases development difficulty, system load, power consumption, and reduces system operating efficiency.

Method used

By receiving multimedia data processing requests, the current data processing module is identified, and secure memory access permissions are configured for it when the CPU is in secure mode. The module is then switched to non-secure mode to process multimedia data, thus reducing the frequency of CPU mode switching.

Benefits of technology

It reduces CPU load, decreases overall device power consumption, improves system efficiency, and simplifies system development.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115618356B_ABST
    Figure CN115618356B_ABST
Patent Text Reader

Abstract

The application discloses a multimedia data processing method and device, equipment and a readable storage medium. After receiving a data processing request of multimedia data, the application determines a current data processing module from a plurality of data processing modules according to the data processing request, and then makes a CPU of a multimedia processing device in a safe mode, configures a safe memory access permission for the current data processing module, and then switches the CPU to a non-safe mode, and calls the current data processing module to process the multimedia data according to the safe memory access permission. The scheme can adapt the safe mode and the non-safe mode of the equipment for each module, does not need to develop corresponding components in the safe mode for the module, can reduce the CPU load and the system power consumption of the equipment, improves the system operation efficiency and the efficiency of processing the multimedia data of each module.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a multimedia data processing method and device, equipment and readable storage medium. BACKGROUND

[0002] At present, a terminal device can be provided with a secure CPU and a non-secure CPU, when the secure CPU is used, the device works in a secure mode; when the non-secure CPU is used, the device works in a non-secure mode. If the terminal device has only one CPU, the CPU has two states of secure mode and non-secure mode, and the mode can be switched according to the needs of the device.

[0003] When the terminal device processes encrypted multimedia data such as audio and video, multiple function modules (such as decryption modules, decoding modules, etc.) need to be called. Since the multimedia data is secure data in an encrypted state, these function modules need to run in the secure mode of the device. Generally, a function component compatible with the secure mode of the device is developed to make the function modules process encrypted multimedia data in the secure mode of the device, but this increases the development difficulty. Moreover, running the function modules in the secure mode of the device increases the switching frequency of the CPU from the non-secure CPU to the secure CPU, thereby increasing the system load and power consumption and reducing the system running efficiency.

[0004] Therefore, how to adapt to the secure mode and the non-secure mode of the device and improve the efficiency of the function modules in processing multimedia data is a problem to be solved by those skilled in the art. SUMMARY

[0005] Therefore, how to adapt to the secure mode and the non-secure mode of the device and improve the efficiency of the function modules in processing multimedia data is a problem to be solved by those skilled in the art.

[0006] In the current aspect, the present application provides a multimedia data processing method, which is applied to a multimedia processing device including multiple data processing modules, and the method comprises:

[0007] receiving a data processing request of multimedia data, determining a current data processing module from the multiple data processing modules according to the data processing request;

[0008] making a CPU of the multimedia processing device in a secure mode, and configuring a secure memory access permission for the current data processing module;

[0009] switching the CPU to a non-secure mode, and calling the current data processing module to process the multimedia data according to the secure memory access permission.

[0010] Optionally, the step of determining the current data processing module from the plurality of data processing modules according to the data processing request comprises:

[0011] determining a data processing flow according to the data processing request;

[0012] determining the current data processing module from the plurality of data processing modules according to the data processing flow.

[0013] Optionally, the step of configuring the secure memory access permission for the current data processing module comprises:

[0014] setting the memory access address register corresponding to the current data processing module to a secure mode, and configuring the memory access address of the current data processing module to the memory access address register.

[0015] Optionally, the step of configuring the memory access address of the current data processing module to the memory access address register comprises:

[0016] obtaining the memory address of the current to-be-processed data, and configuring the memory address of the current to-be-processed data to the read memory address register corresponding to the current data processing module;

[0017] obtaining a writable memory region, and configuring the memory address of the writable memory region to the write memory address register corresponding to the current data processing module.

[0018] Optionally, after the step of configuring the secure memory access permission for the current data processing module, the method further comprises:

[0019] setting a bus address controller to a secure mode;

[0020] configuring the secure memory access permission of the current data processing module to the bus address controller.

[0021] Optionally, the step of invoking the current data processing module to process the multimedia data according to the secure memory access permission comprises:

[0022] receiving a data processing bus request of the current data processing module;

[0023] judging whether the data processing bus request conforms to the secure memory access permission;

[0024] if yes, executing the step of invoking the current data processing module to process the multimedia data according to the secure memory access permission.

[0025] Optionally, the calling the current data processing module to process the multimedia data according to the secure memory access permission comprises:

[0026] obtaining a readable memory region and a writable memory region corresponding to the current data processing module based on the ID of the current data processing module;

[0027] reading the multimedia data from the readable memory region as to-be-processed data;

[0028] calling the current data processing module to process the to-be-processed data, and obtaining a processing result;

[0029] writing the processing result into the writable memory region.

[0030] In a second aspect, the present application provides a multimedia data processing apparatus, which is applied to a multimedia processing device including a plurality of data processing modules, and the apparatus comprises:

[0031] a receiving module, configured to receive a data processing request of multimedia data, and determine a current data processing module from the plurality of data processing modules according to the data processing request;

[0032] a configuration module, configured to make a CPU of the multimedia processing device in a secure mode, and configure a secure memory access permission for the current data processing module;

[0033] a calling module, configured to switch the CPU to a non-secure mode, and call the current data processing module to process the multimedia data according to the secure memory access permission.

[0034] In a third aspect, the present application provides an electronic device, which comprises:

[0035] a memory, configured to store a computer program;

[0036] a processor, configured to execute the computer program to implement the multimedia data processing method disclosed above.

[0037] In a fourth aspect, the present application provides a readable storage medium, configured to save a computer program, wherein the computer program is executed by a processor to implement the multimedia data processing method disclosed above.

[0038] It can be seen that the application provides a multimedia data processing method, which is applied to a multimedia processing device including a plurality of data processing modules, and the method includes: receiving a data processing request of multimedia data, determining a current data processing module from the plurality of data processing modules according to the data processing request; making a CPU of the multimedia processing device in a secure mode, configuring a secure memory access permission for the current data processing module; switching the CPU to a non-secure mode, and calling the current data processing module to process the multimedia data according to the secure memory access permission.

[0039] It can be seen that after receiving the data processing request of the multimedia data, the application determines the current data processing module from the plurality of data processing modules according to the data processing request, then makes the CPU of the multimedia processing device in the secure mode, configures the secure memory access permission for the current data processing module, and then switches the CPU to the non-secure mode, and calls the current data processing module to process the multimedia data according to the secure memory access permission. It can be seen that the method of the embodiment of the application can make each multimedia data processing module run in the non-secure mode of the device CPU, so that it is not necessary to develop the corresponding components in the secure mode for each multimedia data processing module, the difficulty of developing the device system is reduced, and the multimedia processing device can process the multimedia data without switching the entire device or the entire multimedia data processing module to the secure mode, but only needs to make the CPU in the secure mode when configuring the secure memory access permission for the data processing module, and controls the current data processing module to safely read or write a part of space of the DDR by configuring the secure memory access permission of the module, thereby improving the security of data processing, because only the secure permission of the corresponding address register of the current data processing module needs to be configured, the switching frequency of the CPU between the secure mode and the non-secure mode is reduced, thereby reducing the running load of the CPU, reducing the overall power consumption of the device, and improving the system running efficiency.

[0040] Correspondingly, the multimedia data processing device, the device and the readable storage medium provided by the application also have the above technical effects. BRIEF DESCRIPTION OF DRAWINGS

[0041] In order to more clearly illustrate the technical solutions of the embodiments of the application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only embodiments of the application, and those skilled in the art can also obtain other drawings according to the provided drawings without creative labor.

[0042] Figure 1 A flowchart of a multimedia data processing method disclosed by the application;

[0043] Figure 2 A corresponding diagram of a functional module and a memory region disclosed in the present application;

[0044] Figure 3 A corresponding diagram of another functional module and a memory region disclosed in the present application;

[0045] Figure 4 A schematic diagram of a multimedia data processing device disclosed in the present application;

[0046] Figure 5 A schematic diagram of an electronic device disclosed in the present application. DETAILED DESCRIPTION

[0047] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0048] At present, when a terminal device processes encrypted multimedia data such as audio and video, multiple functional modules (such as decryption modules and decoding modules) need to be called. Since the multimedia data is secure data in an encrypted state, these functional modules need to run in a device security mode. Generally, a functional component compatible with the device security mode is developed to enable the functional modules to process encrypted multimedia data in the device security mode, which increases the development difficulty. Moreover, running the functional modules in the device security mode increases system power consumption and device CPU load, and reduces system running efficiency. Therefore, the present application provides a multimedia data processing scheme, which can adapt to the security mode and the non-security mode of a device, and improve the efficiency of processing multimedia data by each functional module.

[0049] Referring to Figure 1 The present embodiment discloses a multimedia data processing method, which is applied to a multimedia processing device including multiple data processing modules. The method comprises the following steps:

[0050] S101, receiving a data processing request of multimedia data, and determining a current data processing module from the multiple data processing modules according to the data processing request.

[0051] In the embodiment, the multimedia processing device can be any terminal device capable of processing multimedia data, such as a smart phone, a television set-top box, etc. The multimedia data can be audio, video, image, document, etc. The data processing module is a functional module in the device for processing multimedia data. Taking the television set-top box as an example, the multimedia data processed by the television set-top box is mostly video, and the video generally arrives at the television set-top box in the form of encrypted video stream. At this time, the television set-top box needs to perform decryption, decoding, post-processing, output display, etc. on the encrypted video stream. Therefore, the corresponding decryption module, decoding module, post-processing module, and output display module need to be called to complete the entire processing flow.

[0052] The multimedia processing device comprises a plurality of data processing modules. When receiving a data processing request of multimedia data, a current data processing module is determined from the plurality of data processing modules according to the data processing request, so as to subsequently configure a secure memory access permission for the current data processing module.

[0053] In a specific embodiment, the step of determining the current data processing module from the plurality of data processing modules according to the data processing request comprises: determining a data processing flow according to the data processing request; and determining the current data processing module from the plurality of data processing modules in sequence according to the data processing flow.

[0054] Specifically, when the multimedia receives a data processing request, the complete data processing flow can be determined according to the data processing request. For example, when receiving an encrypted video data output display processing request, the complete data processing flow comprises a decryption flow, a decoding flow, a post-processing flow, and an output display flow. According to the data processing flow, the decryption module, the decoding module, the post-processing module, and the output display module can be determined in sequence as the current data processing module, and corresponding data processing is performed.

[0055] S102, making the CPU of the multimedia processing device in a secure mode, and configuring a secure memory access permission for the current data processing module.

[0056] The multimedia data processing device has independent secure CPU and non-secure CPU, or the CPU includes secure state and non-secure state, and the state can be switched in real time during work. When the secure CPU or the CPU works in the secure state, the device CPU works in the secure mode; when the non-secure CPU or the CPU works in the non-secure state, the device CPU works in the non-secure mode. In the actual application scenario, the device runs, and the CPU runs in the non-secure mode by default. When a data processing request is received, the non-secure mode CPU sends a CPU switching command. After the CPU switching request command is received, the CPU is switched from the non-secure state to the secure state, or from the non-secure CPU to the secure CPU, so that the device CPU runs in the secure mode. When the device CPU is in the secure mode, the secure memory access permission is configured for the current data processing module. After the configuration is completed, the device CPU is switched to the non-secure mode, so that the subsequent current data processing module processes the multimedia data according to the secure memory access permission.

[0057] In specific embodiments, configuring the secure memory access permission for the current data processing module includes setting the memory access address register corresponding to the current data processing module to the secure mode, and configuring the memory access address of the current data processing module to the memory access address register.

[0058] The memory of the device can be DDR, etc. When the secure memory access permission is configured for the current data processing module, the readable memory area and the writable memory area are also configured. The memory access address can be the memory access address of the readable memory area, or the memory access address of the writable memory area.

[0059] In specific embodiments, the step of configuring the memory access address of the current data processing module to the memory access address register includes: obtaining the memory address of the current data to be processed, and configuring the memory address of the current data to be processed to the read memory address register corresponding to the current data processing module; obtaining the writable memory area, and configuring the memory address of the writable memory area to the write memory address register corresponding to the current data processing module.

[0060] The readable memory region and the writable memory region corresponding to the current data processing module can be different regions or the same region in the device memory. The readable memory region corresponding to the current data processing module is the region in which the current to-be-processed data is stored in the device memory. The memory address of the current to-be-processed data is configured in the read memory address register corresponding to the current data processing module, so that the current data processing module subsequently reads the to-be-processed data according to the memory address in the read memory address register to perform corresponding data processing. After the data processing of the current data processing module is completed, the processed data result needs to be stored in the device memory for extraction by the next data processing module. Therefore, a corresponding writable memory region is applied, and the memory address of the writable memory region is configured in the write memory address register corresponding to the current data processing module, so that the current data processing module obtains the memory address in the write memory address register after the data processing is completed, and stores the processed data result in the corresponding memory. The writable memory region corresponding to the data processing module is a blank memory region or a memory region occupied by deletable dirty data, and therefore can be applied according to a predetermined rule. The size of the memory applied each time can be set according to the size of the multimedia data.

[0061] Generally, a memory region can be determined by a memory start address and a memory end address, or by a memory start address and a total size of the memory region, and therefore when the readable memory region and the writable memory region are configured for a certain data processing module, the memory start address, the memory end address, and the total size of the memory region are configured in the corresponding registers according to this principle.

[0062] In a specific embodiment, the read memory address register includes a read start register and a read size register, and correspondingly, the memory address of the current to-be-processed data is configured in the read memory address register corresponding to the current data processing module, including writing the memory start address in which the current to-be-processed data is stored into the read start register, and writing the size of the memory region in which the current to-be-processed data is stored into the read size register. In another specific embodiment, the read memory address register includes a read start register and a read end register, and correspondingly, the memory address of the current to-be-processed data is configured in the read memory address register corresponding to the current data processing module, including writing the memory start address in which the current to-be-processed data is stored into the read start register, and writing the memory end address in which the current to-be-processed data is stored into the read end register. It can be seen that one data processing module corresponds to one read start register and one read size register, or one read start register and one read end register. These registers can be used to record the readable memory region corresponding to the data processing module.

[0063] In one embodiment, the write memory address register comprises a write start register and a write size register; and correspondingly, the configuration of the memory address of the writable memory region to the write memory address register corresponding to the current data processing module comprises writing the memory start address of the writable memory region into the write start register and writing the size of the writable memory region into the write size register. In another embodiment, the write memory address register comprises a write start register and a write end register; and correspondingly, the configuration of the memory address of the writable memory region to the write memory address register corresponding to the current data processing module comprises writing the memory start address of the writable memory region into the write start register and writing the memory end address of the writable memory region into the write end register. It can be seen that one data processing module corresponds to one write start register and one write size register, or one write start register and one write end register. The registers can be used to record the writable memory region corresponding to the current data processing module.

[0064] S103, switching the CPU to a non-secure mode and calling the current data processing module to process the multimedia data according to the secure memory access permission.

[0065] After the configuration of the corresponding secure memory access permission is completed, the CPU of the device can be switched back to the non-secure mode, and in the non-secure mode, the current data processing module can be called to process the multimedia data according to the secure memory access permission.

[0066] In one embodiment, after the configuration of the secure memory access permission of the current data processing module is completed, the method further comprises: setting the bus address controller to a secure mode; and configuring the secure memory access permission of the current data processing module to the bus address controller. In order to subsequently judge whether the data processing bus request conforms to the secure memory access permission according to the secure memory access permission. Specifically, the current data processing module in the secure mode can be configured with an ID, the ID of the data processing module and the memory access address are mapped, and the mapping relationship is sent to the bus address controller.

[0067] The step of calling the current data processing module to process the multimedia data according to the secure memory access permission comprises: receiving a data processing bus request of the current data processing module; judging whether the data processing bus request conforms to the secure memory access permission; and if so, calling the current data processing module to process the multimedia data according to the secure memory access permission.

[0068] Specifically, according to the multimedia data processing flow, when it is the turn of the current data processing module to process data, and after the secure memory access permissions of the current data processing module have been configured, the current data processing module initiates a data processing bus request. The bus address controller determines whether the data processing bus request complies with the secure memory access permissions. If it does, the current data processing module is called to process the multimedia data according to the secure memory access permissions. If it does not, the process returns directly.

[0069] In a specific implementation, the bus address controller determines whether the memory region requested by the current processing module and its access attributes (read or write) conform to the aforementioned corresponding configuration based on the ID of the current processing module. If they conform, access is allowed; otherwise, access is not allowed.

[0070] In some embodiments, invoking the current data processing module to process the multimedia data according to the secure memory access permissions includes: querying the readable memory area corresponding to the current data processing module based on the ID of the current data processing module, reading the multimedia data from the readable memory area; invoking the current data processing module to process the multimedia data and obtaining the processing result; and querying the writable memory area corresponding to the current data processing module based on the ID of the current data processing module and writing the processing result into the writable memory area.

[0071] For example, a set-top box's CPU has a secure mode and a non-secure mode, and the CPU usually runs in the non-secure mode, only switching to secure mode when secure memory access permissions are configured for the current data processing module. Figure 2 As shown, the set-top box's CPU is currently in insecure mode. When the encrypted video stream arrives at the set-top box, the CPU writes the video stream data into buffer1 in the device's memory. Based on the application layer request corresponding to the current encrypted data stream, it determines that decryption processing is required first, and this decryption process must be securely protected. Therefore, the decryption module is first designated as the current data processing module, allowing only the decryption module to read the video stream data in buffer1. Specifically, the set-top box's CPU is switched to secure mode, and read permissions are granted to buffer1 for the decryption module in secure mode. Simultaneously, write permissions are granted to buffer2 for the decryption module. Then, the set-top box's CPU is switched to insecure mode, and the decryption module is called to read the video stream data from buffer1 as the current data to be processed for decryption. After decryption, the decryption result is written to buffer2.

[0072] Then, the decoding module is determined as the current data processing module according to the multimedia data processing procedure, the CPU of the television set-top box is switched to the safe mode again, and the reading permission of buffer2 is configured for the decoding module in the safe mode, and the writing permission of buffer3 is configured for the decoding module, then the CPU of the television set-top box is switched back to the non-safe mode. In the non-safe mode, the decoding module is called to read the decryption result in buffer2 for decoding operation, and the decoding result is written into buffer3 after the decoding is completed. The post-processing module and the output display module are sequentially taken as the current data processing module for similar operation until the target display data is obtained.

[0073] The multimedia data processing method provided by the embodiment of the application comprises the following steps: determining a current data processing module from a plurality of data processing modules according to a data processing request; making a CPU of a multimedia processing device in a safe mode, and configuring a safe memory access permission for the current data processing module; switching the CPU to a non-safe mode, and calling the current data processing module to process the multimedia data according to the safe memory access permission. The embodiment method can make each multimedia data processing module run in the non-safe mode of the device CPU, thus it is not necessary to develop corresponding components in the safe mode for each multimedia data processing module, the difficulty of developing the device system is reduced, the multimedia processing device can process the multimedia data without switching the whole device or the whole multimedia data processing module to the safe mode, the security of data processing is improved by configuring the safe memory access permission of the module to control the current data processing module to safely read or write a part of space of the DDR, because it is only necessary to configure the safe permission of the address register of the current data processing module, the switching frequency of the CPU between the safe mode and the non-safe mode is reduced, thus the running load of the CPU is reduced, the overall power consumption of the device is reduced, and the system running efficiency is improved.

[0074] In some embodiments, the size of the memory access region can be set according to the average size of each processing segment in the video stream, for example, when a video stream segment is 3MB-4MB, the sizes of buffer1, buffer2 and buffer2 can be set to be not less than 4MB, and when the next video stream segment is processed, it is not necessary to configure the safe memory access permission for each module. That is, when the second video segment arrives at the television set-top box, the second video segment is also written into buffer1, at this time, it can be found that the decryption module has the access permission of buffer1, then the decryption module directly reads the second video segment in buffer1 for decryption, and it is not necessary to configure the safe memory access permission, and then the decryption result of the second video segment is written into buffer2. Correspondingly, for the subsequent decoding, display and other modules, it is not necessary to configure the safe memory access permission, but the corresponding module is directly called for data processing.

[0075] Therefore, in one embodiment, the multimedia data processing method further comprises: judging whether the current data processing module has the secure memory access permission; if yes, executing the step of invoking the current data processing module to process the multimedia data according to the secure memory access permission in the non-secure mode. If the current data processing module does not have the secure memory access permission, executing the step of making the CPU of the multimedia processing device in the secure mode and configuring the secure memory access permission for the current data processing module. That is, if the device CPU runs in the non-secure mode and the current data processing module has the access permission of the multimedia data, the current data processing module is directly invoked to process the multimedia data according to the secure memory access permission in the non-secure mode. The running load of the CPU is further reduced and the system efficiency is improved.

[0076] Of course, if the size of the secure access region configured by the secure memory access permission is too small, the configuration of the secure memory access permission of each module needs to be updated next time when the multimedia data is processed. For example, when the second video segment arrives at the television set-top box, it is found by judging the size of buffer 1 and the size of the second video segment that buffer 1 cannot accommodate the second video segment. At this time, the memory region configured for each module in the previous time cannot be reused, and the secure memory access permission needs to be reconfigured for the second video segment. The process of updating the configuration of the secure memory access permission of each module can refer to the above related content, and the core is to modify the information recorded in the corresponding register.

[0077] Please refer to Figure 3 The embodiment can control the memory access address corresponding to the module. When each module accesses the DDR, the secure CPU core in the device controls the memory access address interval that the corresponding module can access, so as to realize the protection of the multimedia data in the DDR.

[0078] The system of the device runs in a non-secure state (i.e. non-secure mode) by default. After obtaining the encrypted stream from the server, the encrypted stream is written into a DDR buffer 1, at which time module 1 needs to be called, and a state switching command is sent to the secure CPU core to make the device switch to a secure state, and also make the bus address controller enter a secure mode. At this time, the output of module 1 is configured in the secure state to correspond to a memory access address register (which records the start address of buffer 2) and a size register (which records the size of buffer 2). At the same time, the read permission of buffer 1 is configured for module 1, that is, the memory access address register of the input of module 1 records the start address of buffer 1, and the size register of the input of module 1 records the size of buffer 1. After the configuration is completed, the device is switched to a non-secure state, at which time module 1 is enabled and started, and module 1 can read the encrypted stream from buffer 1, process the data, and output the processing result to buffer 2. Correspondingly, the memory access addresses corresponding to other modules are also configured and processed accordingly.

[0079] A multimedia data processing device provided by an embodiment of the present application is described below. The multimedia data processing device described below can be referred to the multimedia data processing method described above.

[0080] Referring to Figure 4 As shown in the figure, the embodiment of the present application discloses a multimedia data processing device, which is applied to a multimedia processing device including a plurality of data processing modules, and the device includes:

[0081] A receiving module 401 is configured to receive a data processing request of multimedia data, and determine a current data processing module from the plurality of data processing modules according to the data processing request.

[0082] A configuration module 402 is configured to make a CPU of the multimedia processing device in a secure mode, and configure a secure memory access permission for the current data processing module.

[0083] A calling module 403 is configured to switch the CPU to a non-secure mode, and call the current data processing module to process the multimedia data according to the secure memory access permission.

[0084] In a specific implementation, the receiving module is specifically configured to:

[0085] Determine a data processing flow according to the data processing request;

[0086] Determine the current data processing module from the plurality of data processing modules according to the data processing flow.

[0087] In a specific implementation, the configuration module is specifically configured to:

[0088] setting the memory access address register corresponding to the current data processing module to a safe mode, and configuring the memory access address of the current data processing module to the memory access address register.

[0089] In one embodiment, the configuration module is specifically configured to:

[0090] obtain a memory address of the current data to be processed, and configure the memory address of the current data to be processed to a read memory address register corresponding to the current data processing module;

[0091] obtain a writable memory region, and configure a memory address of the writable memory region to a write memory address register corresponding to the current data processing module.

[0092] In one embodiment, the configuration module further comprises:

[0093] a bus configuration module, configured to set a bus address controller to a safe mode, and configure the safe memory access permission of the current data processing module to the bus address controller.

[0094] In one embodiment, the configuration module further comprises:

[0095] a bus request processing module, configured to receive a data processing bus request of the current data processing module, judge whether the data processing bus request conforms to the safe memory access permission, and if so, execute a step of calling the current data processing module to process the multimedia data according to the safe memory access permission.

[0096] In one embodiment, the calling module is specifically configured to:

[0097] obtain a readable memory region and a writable memory region corresponding to the current data processing module based on an ID of the current data processing module;

[0098] read multimedia data from the readable memory region as the data to be processed;

[0099] call the current data processing module to process the data to be processed, and obtain a processing result;

[0100] write the processing result to the writable memory region.

[0101] The more specific working processes of the modules and units in the embodiment can refer to the corresponding content disclosed in the foregoing embodiments, and will not be described here in detail.

[0102] It can be seen that the embodiment provides a multimedia data processing apparatus. The apparatus can enable each multimedia data processing module to run in a non-secure mode of a CPU of a device, so that a corresponding component in a secure mode does not need to be developed for each multimedia data processing module, the difficulty of developing the device system is reduced, and the multimedia processing device can process multimedia data without switching the entire device or the entire multimedia data processing module to the secure mode, but only needs to configure a secure memory access permission for the data processing module to enable the CPU to be in the secure mode, and control the secure reading or writing of a certain space of the DDR by the current data processing module by configuring the secure memory access permission of the module, so as to improve the security of data processing. Because only the secure permission of the corresponding address register of the current data processing module needs to be configured, the frequency of switching the CPU between the secure mode and the non-secure mode is reduced, so that the running load of the CPU is reduced, the overall power consumption of the device is reduced, and the system running efficiency is improved.

[0103] Next, an electronic device provided by the embodiment of the application is introduced. The electronic device described below can be referred to in conjunction with the multimedia data processing method and the apparatus described above.

[0104] Referring to Figure 5 As shown in the figure, the embodiment of the application discloses an electronic device, which comprises:

[0105] The memory 501 is configured to save a computer program.

[0106] The processor 502 is configured to execute the computer program to implement the method disclosed in any of the above embodiments.

[0107] Next, a readable storage medium provided by the embodiment of the application is introduced. The readable storage medium described below can be referred to in conjunction with the multimedia data processing method, the apparatus and the device described above.

[0108] A readable storage medium is configured to save a computer program. When the computer program is executed by a processor, the multimedia data processing method disclosed in the above embodiment is implemented. For specific steps of the method, refer to the corresponding content disclosed in the above embodiment, which will not be described here.

[0109] The terms "current", "second", "third", "fourth" and the like, if any, used in the present application are used for distinguishing between similar objects, and are not necessarily intended to denote a particular order or sequence among the objects. It is to be understood that the data used in this description is for purpose of explanation only, and is not intended to limit the embodiments described herein to a particular example. Further, the term "comprises" and variations thereof, do not exclude the presence of elements or steps other than those listed in a process, method, system, product, apparatus, or device, for example. The term "comprising" and variations thereof, as used herein, are intended to be open-ended, for example, to encompass the presence of steps, elements, or features other than those listed in a process, method, system, product, apparatus, or device, for example.

[0110] It should be noted that the description in the present application involving "current", "second", and the like is only for the purpose of description, and should not be understood as indicating or implying the relative importance of the indicated technical features, or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "current", "second" can explicitly or implicitly include at least one of the features. In addition, the technical solutions of various embodiments can be combined with each other, but it must be based on the realization of a person skilled in the art, when the combination of technical solutions appears contradictory or unachievable, it should be considered that the combination of technical solutions does not exist, nor within the protection scope claimed in the present application.

[0111] The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between various embodiments can be referred to each other.

[0112] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, software modules executed by a processor, or a combination of the two. The software modules can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or any other form of readable storage medium known in the art.

[0113] The principles and implementation modes of the present application are described by using specific examples in the present application. The above description of the embodiments is only to help understand the method and its core idea of the present application; at the same time, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range will be changed; in view of the above, the content of the specification should not be understood as limiting the present application.

Claims

1. A multimedia data processing method, characterized in that, The method is applied to a multimedia processing device, the multimedia processing device including multiple data processing modules, and the method includes: Receive a data processing request for multimedia data, determine a data processing flow based on the data processing request, and determine the current data processing module from the plurality of data processing modules according to the data processing flow. When the current data processing module is determined, the CPU of the multimedia processing device is put into safe mode, and safe memory access permissions, readable memory area and writable memory area are configured for the current data processing module. Switch the CPU to non-secure mode, call the current data processing module to process the multimedia data read from the readable memory area according to the secure memory access permissions, obtain the processing result, and write the processing result into the writable memory area; The next current data processing module is determined from the plurality of data processing modules according to the data processing flow, until the last current data processing module is called, and the target display data is obtained.

2. The method according to claim 1, characterized in that, Configuring secure memory access permissions for the current data processing module includes: Set the memory access address register corresponding to the current data processing module to safe mode, and configure the memory access address of the current data processing module to the memory access address register. The memory access address includes the memory access address of the readable memory region and the memory access address of the writable memory region.

3. The method according to claim 2, characterized in that, The step of configuring the memory access address of the current data processing module to the memory access address register includes: Obtain the memory address of the current data to be processed, and configure the memory address of the current data to be processed in the read memory address register corresponding to the current data processing module. The current data to be processed is the multimedia data to be processed by the current data processing module, and the read memory address register records the readable memory area of ​​the current data processing module. Obtain a writable memory region, and configure the memory address of the writable memory region in the write memory address register corresponding to the current data processing module. The write memory address register records the writable memory region of the current data processing module.

4. The method according to claim 1, characterized in that, After configuring secure memory access permissions for the current data processing module, the method further includes: Set the bus address controller to secure mode; Configure the secure memory access permissions of the current data processing module to the bus address controller.

5. The method according to claim 1, characterized in that, The step of invoking the current data processing module to process the multimedia data read from the readable memory area according to the secure memory access permissions includes: Receive the data processing bus request from the current data processing module; Determine whether the data processing bus request complies with the secure memory access permissions; If the conditions are met, then the step of calling the current data processing module to process the multimedia data read from the readable memory area according to the secure memory access permissions is executed.

6. The method according to any one of claims 1 to 5, characterized in that, The step of invoking the current data processing module to process the multimedia data read from the readable memory area according to the secure memory access permissions includes: Based on the ID of the current data processing module, obtain the readable memory area and the writable memory area corresponding to the current data processing module; Read the multimedia data from the readable memory area as data to be processed; The current data processing module is invoked to process the data to be processed, and the processing result is obtained. The processing result is written to the writable memory area.

7. A multimedia data processing device, characterized in that, The device is applied to a multimedia processing equipment, the multimedia processing equipment including multiple data processing modules, and the device includes: A receiving module is used to receive data processing requests for multimedia data, determine a data processing flow based on the data processing requests, and sequentially determine the current data processing module from the plurality of data processing modules according to the data processing flow. The configuration module is used to put the CPU of the multimedia processing device into a safe mode whenever the current data processing module is determined, and to configure safe memory access permissions, readable memory area and writable memory area for the current data processing module. The calling module is used to switch the CPU to a non-secure mode, call the current data processing module to process the multimedia data read from the readable memory area according to the secure memory access permissions, obtain the processing result, write the processing result to the writable memory area, and continue to determine the next current data processing module from the multiple data processing modules according to the data processing flow, until the last current data processing module is called, and obtain the target display data.

8. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the method as claimed in any one of claims 1 to 6.

9. A readable storage medium, characterized in that, Used to store a computer program, wherein the computer program, when executed by a processor, implements the method as described in any one of claims 1 to 6.

Citation Information

Patent Citations

  • Data transmission method and device, electronic equipment and computer readable storage medium

    CN114297696A