Data processing method and data processing equipment

Abstract

The embodiment of the invention provides a data processing method which comprises the following steps that a first driver sends a synchronization event to a first processor, and the first processor is awakened from a power saving mode after receiving the synchronization event. The first processor decodes first data for a first function and transmits the decoded first data to a first buffer. The first processor enters a power saving mode after transmitting the decoded first data to the first buffer. Wherein the synchronization event is used for indicating that the second processor needs to be awakened to process the second data for the second function.

Description

[Technical field]

[0001] The present invention relates to data processing technology, in particular to a data processing method and a data processing device. [Background technology]

[0002] Typically, in the mobile phone field, different modules may need to use the same system resources. However, when multiple modules need to operate independently of each other without a proper synchronization mechanism, these modules may compete for these resources and use them independently, thereby increasing system power consumption. Therefore, how to reduce system power consumption has become an important issue. [Summary of the invention]

[0003] The present invention provides a data processing method and a data processing device, thereby improving the utilization efficiency of system resources, increasing the idle time of the system (such as the data processing device), and reducing the power consumption of the system.

[0004] An embodiment of the present invention provides a data processing method, the method comprising the following steps: a first processor receives a synchronization event from a first driver. The first processor wakes up from a power saving mode after receiving the synchronization event. The first processor decodes first data for a first function. The first processor transmits the decoded first data to a first buffer. The first processor enters a power saving mode after transmitting the decoded first data to the first buffer. The synchronization event is used to indicate that a second processor needs to wake up to process second data for a second function.

[0005] Another embodiment of the present invention provides a data processing device, the device comprising a first buffer, a first driver and a first processor. The first driver is configured to send a synchronization event to the first processor. The first processor is configured to wake up from a power saving mode after receiving the synchronization event, decode first data for a first function, transfer the decoded first data to the first buffer, and enter the power saving mode after transferring the decoded first data to the first buffer. The synchronization event is used to indicate that the second processor needs to wake up to process second data for a second function.

[0006] According to the data processing method and data processing device of the present invention, the first processor wakes up from the power saving mode after receiving the synchronization event, decodes the first data for the first function, transmits the decoded first data to the first buffer, and enters the power saving mode after transmitting the decoded first data to the first buffer, wherein the synchronization event is used to indicate that the second processor needs to wake up to process the second data for the second function. Therefore, the present invention provides a synchronization mechanism for processing the first data and the second data, thereby effectively improving the efficiency of resource use, increasing the idle time of the system (such as the data processing device), and reducing the power consumption of the system.

Brief Description of the Drawings

[0007] The present invention can be more fully understood by reading the following detailed description and referring to the accompanying drawings, in which:

[0008] Figure 1 is a schematic diagram of a data processing device according to an embodiment of the present invention;

[0009] Figure 2 is a schematic diagram of a data processing device according to an embodiment of the present invention;

[0010] Figure 3 is a schematic diagram of an audio processor according to an embodiment of the present invention;

[0011] Figure 4 is a flow chart of a data processing method according to an embodiment of the present invention;

[0012] Figure 5 is a flow chart of a data processing method according to an embodiment of the present invention;

[0013] Figure 6 is a flow chart of a data processing method according to an embodiment of the present invention;

[0014] Figure 7 is a flow chart of a data processing method according to an embodiment of the present invention. [Specific implementation method]

[0015] The technical terms of the present invention are based on the general definitions of the technical field of the present invention. If the present invention describes or explains one or some terms, the definition of the terms is based on the description or explanation of the present invention. Each embodiment has one or more technical features. In possible embodiments, technicians can selectively implement all or part of the technical features of any embodiment of the present invention, or selectively combine all or part of the technical features of the embodiments of the present invention.

[0016] In each of the following embodiments, the same reference numerals represent the same or similar elements or components.

[0017] Figure 1 is a schematic diagram of a data processing device according to an embodiment of the present invention. Figure 1 The data processing device 100 includes a first driver 110, a first processor 120, and a first buffer 130. The data processing device 100 may also include a second driver 140, a second processor 150, a second buffer 160, and a front end 170. The first driver 110 and the second driver 140 may run on a host processor, such as a CPU. The first driver 110 and the second driver 140 may run on one host processor, or the first driver 110 and the second driver 140 may run on different host processors.

[0018] The first driver 110 may receive a notification from the second driver 140, and send a synchronization event to the first processor 120 based on the notification. The notification is used to indicate that the second processor 150 needs to wake up to process the second data for the second function. The synchronization event is used to indicate that the second processor 150 needs to wake up to process the second data for the second function. The first processor 120 may wake up from the power saving mode after receiving the synchronization event, decode the first data for the first function, transfer the decoded first data to the first buffer 130, and enter the power saving mode after transferring the decoded first data to the first buffer 130.

[0019] In some embodiments, the second driver 140 may periodically send a notification to the first driver 110, and the notification indicates that the second processor 150 needs to wake up to process the second data for the second function. The first driver 110 may periodically receive the notification and send a synchronization event to the first processor 120. Then, the first processor 120 may periodically wake up after receiving the synchronization event.

[0020] In some embodiments, the first driver 110 may be an audio driver, the second driver 140 may be a display driver, the first data may be audio data, and the second data may be image data, but the present invention is not limited thereto. In some embodiments, the first processor 120 may be an audio processor, such as an audio digital signal processor (ADSP), and the second processor 150 may be an image processor, but the present invention is not limited thereto. In some embodiments, the front end 170 may be an audio front end (AFE), but the present invention is not limited thereto. The first function may play audio data, and the second function may display an image. The second driver 140 may periodically send a notification to the first driver 110 when an image needs to be played.

[0021] In some embodiments, the second driver 140 may periodically generate a notification event when an image needs to be played, wherein the notification event is used to indicate that the second processor 150 needs to process the image data for playback. The second driver 140 may periodically send the notification event to the second processor 150. Then, the second processor 150 may periodically wake up from the power saving mode after receiving the notification event, decode the image data, transfer the decoded image data to the second buffer, and enter the power saving mode after transferring the decoded image data to the second buffer 160.

[0022] Therefore, the present invention provides a synchronization mechanism for waking up the first processor 120 and the second processor 150, so that the first processor 120 and the second processor 150 can be woken up substantially synchronously. Because the first processor 120 and the second processor 150 can be woken up substantially synchronously and use some resources synchronously, the resource utilization efficiency is improved. Because the first processor 120 and the second processor 150 can be woken up substantially synchronously, the idle time of the system (such as the data processing device 100) is increased, and the system power consumption is reduced.

[0023] In some embodiments, the first processor 120 may determine that there is audio data that needs to be played, and may notify the front end 170 to disable the transmission of the interrupt request, wherein the audio data matches the image. The audio data may be audio data in a video, and the image may be an image in a video. Specifically, the first processor 120 may receive a first notification message from a main processor and receive audio data from a processor (e.g., a main processor), wherein the first notification message is used to notify the first processor 120 to play the audio data that matches the image. The first processor 120 may determine that there is audio data that needs to be played based on the first notification message.

[0024] In some embodiments, the first processor 120 may determine that there is no audio data matching the image that needs to be played, and notify the front end 170 to enable the transmission of the interrupt request. Specifically, the first processor 120 may receive a second notification message from the main processor, wherein the second notification message is used to notify the first processor 120 of the end of playing the audio data matching the image. The first processor 120 may determine that there is no audio data matching the image that needs to be played based on the second notification message.

[0025] Figure 2 is a schematic diagram of a data processing device according to an embodiment of the present invention. Figure 2 The data processing device 200 may include an audio driver 210, an audio processor 220, a display driver 240, and an image processor 250. The data processing device 200 may also include a first buffer 230, a second buffer 260, and a front end 270. In some embodiments, the audio driver 210, the audio processor 220, the display driver 240, the image processor 250, the first buffer 230, the second buffer 260, and the front end 270 may be the same as or similar to the first driver 110, the first processor 120, the second driver 140, the second processor 150, the first buffer 130, the second buffer 160, and the front end 170.

[0026] The data processing device 200 may be applied to a scenario in which an image is displayed while audio data is played, such as a scenario in which a video is played.

[0027] The main processor in the data processing device 200 may send a first notification message to notify the audio processor 220 that the audio data corresponding to the image needs to be played, and the audio data is sent to the audio processor 220. The audio processor 220 generates an offload task based on the first notification message, wherein the offload task includes a parameter for indicating that the audio data matching the image needs to be played. The audio processor 220 stores the audio data in its internal buffer. The audio processor 220 notifies the front end 270 to disable the transmission of the interrupt request (IRQ). Then, the audio processor 220 enters a sleep mode. In some embodiments, the front end 270 may be an audio front end (AFE). The main processor in the data processing device 200 may send a third notification message to notify the image processor 250 that the image needs to be played, and the image is sent to the image processor 250. The image processor 250 stores the image in its internal buffer and enters a sleep mode. The sleep mode is a power saving mode.

[0028] When an image needs to be played, the display driver 240 generates a notification and sends the notification to the audio driver 210. In some embodiments, images need to be played periodically, for example, 60 images per second, and 60 notifications can be generated per second. Therefore, the display driver 240 can generate notifications periodically and send the notifications to the audio driver 210.

[0029] The audio driver 210 may periodically receive notifications from the display driver 240 and periodically send synchronization events to the audio processor 220, wherein the synchronization events are used to indicate that the image processor 250 needs to wake up to process images for playback. The display driver 240 and the audio driver 210 may be software running on one host processor or on different host processors. The display driver 240 and the audio driver 210 may run on a kernel.

[0030] The audio processor 220 is coupled to the first buffer 230. After receiving the synchronization event from the audio driver 210, the audio processor 220 wakes up from the power saving mode to perform subsequent operations. The audio processor 220 decodes the audio data in its buffer and then transmits the decoded audio data to the first buffer 230. Then, the audio processor 220 enters the power saving mode after transmitting the decoded audio data to the first buffer 230. The front end 270 obtains the decoded audio data from the first buffer 230 and sends it to the speaker to play the decoded audio data. The audio processor 220 can be an audio digital signal processor (ADSP).

[0031] The display driver 240 also sends a notification event to the image processor 250 to wake it up when it is necessary to play the image. In this embodiment, it is necessary to play the image periodically, for example, 60 images per second, and 60 notification events are sent per second. The image processor 250 is coupled to the second buffer 260. The image processor 250 periodically wakes up from the power saving mode after receiving the notification event from the display driver 240 to perform subsequent operations. The image processor 250 processes the image and transmits the processed image to the second buffer 260. Among them, the processing may include a decoding operation. Then, the image processor 250 enters the power saving mode after transmitting the processed image to the second buffer 260. The front end (not shown) can obtain the image from the second buffer 260 and send it to the display for displaying the image. The front end can be integrated with the front end 270.

[0032] Therefore, the present invention provides a synchronization mechanism for waking up the audio processor 220 and the image processor 250, so that the audio processor 220 and the image processor 250 can be woken up synchronously (for example, but not limited to, woken up substantially at the same time). Because the audio processor 220 and the image processor 250 can be woken up synchronously (for example, woken up substantially at the same time) and can use some resources (for example, the same resources) at the same time, the resource utilization efficiency is improved. Because the audio processor 220 and the image processor 250 can be woken up synchronously (for example, woken up substantially at the same time), the idle time of the system (such as the data processing device 200) is increased and the system power consumption is reduced.

[0033] The main processor in the data processing device 200 may send a second notification message to notify the audio processor 220 that the audio data matching the image data has finished playing. The audio processor 220 ends the offloading task and notifies the front end 270 to enable the transmission of the interrupt request (IRQ). Then, the audio processor 220 enters the sleep mode.

[0034] In addition to the scene of displaying an image while playing audio data, there are also some scenes that only need to play audio data. In these scenes, the front end 270 can periodically send an interrupt request to the audio processor 220 to trigger the audio processor 220 to periodically send audio data to the first buffer 230. Then, the front end 270 obtains the audio data from the first buffer 230 and sends it to the speaker for playing. Therefore, the audio processor 220 can determine which scene will be executed. If it is a scene of displaying an image while playing audio data, the audio processor 220 notifies the front end 270 to disable the transmission of the interrupt request (IRQ). If it is a scene of only playing audio data, the audio processor 220 will not notify the front end 270 to disable the transmission of the IRQ.

[0035] Figure 3is a schematic diagram of an audio processor according to an embodiment of the present invention. Figure 3 The audio processor 220 includes a task utility unit 310 , an image event handler 320 , a storage unit 330 , a decoder 340 , an audio hardware abstraction layer (HAL) 350 , and an audio front end (AFE) interrupt request (IRQ) handler 360 .

[0036] The audio processor 220 receives a first notification message to notify the audio processor 220 that it needs to play audio data corresponding to an image, and receives the audio data. The audio data is stored in the storage unit 330. The audio processor 220 generates an offload task based on the first notification message, wherein the offload task includes a parameter for indicating the playing of audio data corresponding to the image. The task utility unit 310 generates an enable notification or a disable notification according to the task generated by the audio processor 220. For example, when the task utility unit 310 detects that the task is an offload task and the offload task includes a parameter for indicating the playing of audio data corresponding to the image, the task utility unit 310 generates a disable notification to notify the front end 270 to disable the transmission of the IRQ so that the front end 270 does not send an interrupt request. When the task utility unit 310 detects that the task is not an offload task, the task utility unit 310 does not generate a disable notification. Then, the audio processor 220 enters a sleep mode.

[0037] The audio processor 220 wakes up after receiving the sync event from the audio driver 210. The image event processing unit 320 in the audio processor 220 receives the sync event from the audio driver 210 and generates a sync event notification.

[0038] The audio HAL 350 is connected to the image event processing unit 320, the decoder 340, the first buffer (e.g., audio buffer) 230, and the front end 270. The audio HAL 350 receives the synchronization event notification generated by the image event processing unit 320. The audio HAL 350 notifies the decoder 340 to decode the audio data. Specifically, the audio HAL 350 may notify the decoder 340 to decode the audio data based on the usage of the first buffer (e.g., audio buffer) 230. For example, based on the remaining size of the first buffer (e.g., audio buffer) 230, the audio HAL 350 indicates the number of decoded audio data to the decoder 340. The decoder 340 is connected to the storage unit 330. The decoder 340 decodes the audio data stored in the storage unit 330 and transmits the decoded audio data to the audio HAL 350. The audio HAL 350 transmits the decoded audio data to the first buffer (e.g., audio buffer) 230. After the audio HAL 350 transmits the decoded audio data to the first buffer (e.g., audio buffer) 230, the audio processor 220 enters a power saving mode. In some embodiments, the audio processor 220 requires some resources during the awake state, such as an external memory interface (EMI) or a clock resource, but the present invention is not limited thereto.

[0039] The audio processor 220 may receive a second notification message, and the second notification message is used to notify the audio processor 220 that the audio data playback is finished. The audio processor 220 finishes the unloading task. Specifically, the task utility unit 310 in the audio processor 220 detects the end of the unloading task and notifies the front end 270 to enable the transmission of the interrupt request so that the front end 270 can send (periodically send) the interrupt request. Then, the audio processor 220 enters the sleep mode.

[0040] In some scenarios where only audio data needs to be played, the front end 270 may periodically send an interrupt request to the audio processor 220 to trigger the audio processor 220 to periodically send the audio data to the first buffer (e.g., audio buffer) 230. Therefore, the AFE IRQ processing unit (AFE IRQ handler) 360 in the audio processor 220 may be connected to the audio HAL 350 and the front end 270. The AFE IRQ processing unit 360 receives the interrupt request sent by the front end 270, and sends the interrupt request to the audio HAL 350, so that the audio HAL 350 performs a corresponding operation.

[0041] In some embodiments, the storage unit 330 may be a dynamic random access memory (DRAM).

[0042] Figure 4 is a flow chart of a data processing method according to an embodiment of the present invention. In step S402, the method involves a first processor receiving a synchronization event from a first driver, wherein the first driver is used to drive the first processor. In step S404, the method involves the first processor waking up from a power saving mode after receiving the synchronization event. In step S406, the method involves the first processor decoding first data for a first function.

[0043] In step S408, the method involves the first processor transmitting the decoded first data to the first buffer. In step S410, the method involves the first processor entering a power saving mode after transmitting the decoded first data to the first buffer. In this embodiment, the synchronization event is used to indicate that the second processor needs to wake up to process the second data for the second function.

[0044] In some embodiments, step S402 may include the first driver periodically sending a synchronization event to the first processor. The first driver may be an audio driver, the first data may be audio data, and the second data may be image data. The audio data may be audio data in a video, and the image data may be image data in a video.

[0045] Figure 5 is a flow chart of a data processing method according to an embodiment of the present invention.

[0046] In step S502, the method involves the first driver periodically receiving a notification from the second driver, wherein the notification indicates that the second processor needs to wake up to process second data for a second function. In step S504, the method involves the first driver periodically sending a synchronization event to the first processor based on the notification. In step S506, the method involves the first processor periodically waking up from a power saving mode after receiving the synchronization event. In this embodiment, Figure 5 Steps S508 to S510 in Figure 4 The steps S408 to S410 in are the same or similar. Therefore, Figure 5 Steps S508 to S510 in Figure 4 The description of the embodiment is not repeated here. The first driver is an audio driver, the second driver is a display driver, the first data is audio data, and the second data is image data. The first processor is an audio processor, and the second processor is an image processor. When an image needs to be played, the display driver generates a notification and sends the notification to the audio driver. Because the video needs to play multiple images (for example, 60 images per second), notifications are generated periodically.

[0047] Figure 6 is a flow chart of a data processing method according to an embodiment of the present invention. In this embodiment, Figure 6 Steps S502' to S510' in Figure 5 In the embodiment, the first driver is an audio driver, the second driver is a display driver, the first data is audio data, and the second data is image data. The first processor is an audio processor, and the second processor is an image processor. In some embodiments, the audio data may be audio data in a video, and the image data may be image data in a video.

[0048] In step S602, the method involves the display driver periodically generating a notification when image data needs to be played and periodically sending the notification to the audio driver, wherein the notification is used to indicate that the image processor needs to be awakened to process the image data for playback. The method also involves periodically sending a notification event to the image processor to wake it up when the image data needs to be played, wherein the notification event is used to indicate that the image processor needs to process the image data for playback.

[0049] In step S604 , the method involves the image processor periodically waking up from the power saving mode after receiving a notification event.

[0050] In step S606, the method involves the image processor decoding the image data. In step S608, the method involves the image processor transferring the decoded image data to the second buffer. In step S610, the method involves the image processor entering a power saving mode after transferring the decoded image data to the second buffer.

[0051] Figure 7 is a flow chart of a data processing method according to an embodiment of the present invention. In this embodiment, Figure 7 Steps S502' to S510' in Figure 5 In this embodiment, the first driver is an audio driver, the second driver is a display driver, the first data is audio data, and the second data is image data. The first processor is an audio processor, and the second processor is an image processor.

[0052] In step S702, the method involves the audio processor determining that there is audio data that needs to be played, wherein the audio data matches the image. In step S704, the method involves the audio processor notifying the front end to disable the transmission of the interrupt request. In step S706, the method involves the audio processor determining that there is no audio data that needs to be played that matches the image. In step S708, the method involves the audio processor notifying the front end to enable the transmission of the interrupt request when there is no audio data that needs to be played that matches the image.

[0053] In some embodiments, step S702 may include the audio processor receiving a first notification message from the main processor, wherein the first notification message is used to notify the audio processor to play the audio data matching the image; and the audio processor receiving the audio data from the main processor. In some embodiments, step S706 may include the audio processor receiving a second notification message from the main processor, wherein the second notification message is used to notify the audio processor to end playing the audio data matching the image.

[0054] The present invention provides a synchronization mechanism for waking up an audio processor and an image processor, so that the audio processor and the image processor can be woken up substantially synchronously. Because the audio processor and the image processor can be woken up substantially synchronously and use some resources synchronously, the efficiency of resource use is improved. Because the audio processor and the image processor can be woken up substantially synchronously, the idle time of the system (such as the data processing device 100) is increased and the power consumption of the system is reduced.

[0055] Although the present invention has been described by way of example, it should be understood that the present invention is not limited to the disclosed embodiments. On the contrary, it is intended to cover various modifications and similar arrangements (which will be obvious to those skilled in the art). Therefore, the appended claims should be given the broadest interpretation to cover all such modifications and similar arrangements.

Claims

1. A data processing method, characterized in that: include: The first processor receives a synchronization event from the first driver, wherein the synchronization event is used to indicate that the second processor needs to wake up to process second data for a second function; The first processor wakes up from the power saving mode after receiving the synchronization event; The first processor decodes first data for a first function; The first processor transmits the decoded first data to the first buffer; as well as The first processor enters the power saving mode after transmitting the decoded first data to the first buffer.

2. The data processing method according to claim 1, characterized in that: Further including: The first driver periodically receives a notification from the second driver, wherein the notification is used to indicate that the second processor needs to be awakened to process second data for a second function; as well as The first driver periodically sends a synchronization event to the first processor based on the notification; The first processor wakes up periodically after receiving the synchronization event.

3. The data processing method according to claim 2, characterized in that: The first driver is an audio driver, the first data is audio data matching the image data, the second data is image data, and when the image data needs to be played, the first driver receives the notification from the second driver.

4. The data processing method according to claim 3, characterized in that: Further including: The second driver periodically generates a notification event when the image data needs to be played, wherein the notification event is used to indicate that the second processor needs to process the image data for the second function; The second driver periodically sends the notification event to the second processor; The second processor periodically wakes up from the power saving mode after receiving the notification event; The second processor decodes the second data; The second processor transmits the decoded second data to the second buffer; as well as The second processor enters the power saving mode after transmitting the decoded second data to the second buffer.

5. The data processing method according to claim 3, characterized in that: Further including: The first processor determines that there is audio data that needs to be played, wherein the audio data matches the image data; and The first processor notifies the front end to disable transmission of interrupt requests.

6. The data processing method according to claim 5, characterized in that: The step of the first processor determining that there is audio data that needs to be played includes: The first processor receives a first notification message from the main processor, wherein the first notification message is used to notify the first processor to play the audio data matching the image data; and The first processor receives the audio data.

7. The data processing method according to claim 5, characterized in that: Further including: The first processor determines that there is no audio data that needs to be played to match the image data; and The first processor notifies the front end to enable transmission of the interrupt request.

8. The data processing method according to claim 7, characterized in that: The step of the first processor determining that there is no audio data that needs to be played that matches the image data comprises: The first processor receives a second notification message from the main processor, wherein the second notification message is used to notify the first processor of an end of playing the audio data matching the image data.

9. A data processing device, characterized in that: include: First buffer; A first driver is configured to send a synchronization event; as well as a first processor configured to wake up from a power saving mode after receiving the synchronization event, decode first data for a first function, transfer the decoded first data to the first buffer, and enter the power saving mode after transferring the decoded first data to the first buffer; The synchronization event is used to indicate that the second processor needs to wake up to process second data for a second function.

10. The data processing device according to claim 9, characterized in that Further including: A second driver, a second buffer and the second processor, wherein the first driver is configured to periodically receive a notification from the second driver, and the notification is used to indicate that the second processor needs to wake up to process the second data for the second function; The first driver is further configured to periodically send the synchronization event to the first processor; and the first processor is configured to periodically wake up after receiving the synchronization event.

11. The data processing device according to claim 10, characterized in that The first driver is an audio driver, the first data is audio data matched with image data, the second data is image data, and the notification is received by the first driver from the second driver when the image data needs to be played.

12. The data processing device according to claim 11, characterized in that The second driver is configured to periodically generate a notification event when image data needs to be played, wherein the notification event is used to indicate that the second processor needs to process the image data for a second function; wherein the second driver is further configured to periodically send the notification event to the second processor; wherein the second processor is further configured to periodically wake up from a power saving mode after receiving the notification event, decode the second data, transfer the decoded second data to the second buffer, and enter the power saving mode after transferring the decoded second data to the second buffer.

13. The data processing device according to claim 11, characterized in that Further comprising a front end, wherein the first processor is further configured to determine that there is audio data that needs to be played, and to notify the front end to disable transmission of the interrupt request, wherein the audio data matches the image data.

14. The data processing device according to claim 13, characterized in that The first processor is further configured to receive a first notification message from the main processor and receive audio data, wherein the first notification message is used to notify the first processor to play audio data matching the image data.

15. The data processing device according to claim 11, characterized in that The first processor is configured to determine that there is no audio data that needs to be played and matches the image data, and to notify the front end to enable transmission of the interrupt request.

16. The data processing device according to claim 15, characterized in that The first processor is further configured to receive a second notification message from the main processor, wherein the second notification message is used to notify the first processor of the end of playing the audio data matching the image data.

Images