Method for configuring memory arrangement in computing device

Through the graphical user interface system, the memory arrangement of the computing device is optimized, the cumbersome and time-consuming problems in the prior art are solved, flexible and fast memory arrangement is realized, and processor performance and MIPS utilization are improved.

CN119032345APending Publication Date: 2024-11-26HARMAN INT IND INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380031136.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-06
Filing Date
2023-04-06
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The prior art is cumbersome and time-consuming to optimize the memory arrangement of computing device, and lacks flexibility, resulting in underutilization of processing resources.

Method used

A graphical user interface system is provided that allows users to generate and allocate memory layouts by configuring data, optimize memory layouts based on the memory location of the processing module and the memory capacity of the computing device, avoiding hard-coded and multiple code changes.

Benefits of technology

Achieve flexible and fast memory layout optimization, improve processor performance and MIPS utilization, reduce memory latency competition, and simplify engineer workflow.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119032345A_ABST
    Figure CN119032345A_ABST
Patent Text Reader

Abstract

A system and method for allocating memory locations for a number of processing modules on a computing device having a predefined memory layout, the method implemented by a processor of a graphical user interface in communication with the computing device, and comprising the steps of: receiving, at the graphical user interface, the predefined memory layout of the computing device; displaying, at the graphical user interface, the configuration of the predefined memory layout of the computing device; receiving a user input memory placement request for allocation of data to memory locations; generating configuration data for the allocation of data to memory locations in the predefined memory layout of the computing device; and displaying a consumption guide at the graphical user interface, the consumption guide showing an estimated consumption level determined by the configuration data for the allocation of data to a memory location.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross-references

[0002] This application claims priority to provisional application 202241020656 filed in India on April 6, 2022, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to memory arrangements in computing devices, and more particularly, to configuring computing device memory latency. Background Art

[0004] A computing device such as a digital signal processor (DSP) is a processor that runs algorithms to mathematically manipulate digitized signals such as, but not limited to, voice, audio, video, sonar, radar, etc. Signal processing is performed using one or more processors or microprocessors including one or more data storage systems. For example, internal memory, cache memory, external memory, etc.

[0005] Computing device performance is measured in many ways, but the most common metric is the time it takes a processor to complete a task, which is determined by the arrangement of data in memory to achieve the fastest access time, thereby reducing processing time. Processors have multiple memory types. Lower-level memory types (i.e., level 1) are smaller in size and have shorter access times, so they are "faster." Higher-level memory types (i.e., levels 2 to 16) are larger in size and have longer access times, so they are "slower." The hierarchy from fastest to slowest is level 1 (L1) being the fastest and level 16 (L16) being the slowest. Different systems have different numbers of memory types. Memory latency is related to the duration required from initiating a request to access memory to reading and writing data at the requested memory.

[0006] Typically, arranging data in memory requires: 1) calculating how much memory a processing pipeline will need, 2) understanding how and how often each type of memory is used, 3) arranging the memory blocks in such a way that the fastest memory is allocated to the part of the process that will benefit most from faster access, 4) compiling the code after the memory arrangement is complete, and 5) flashing the file onto a flash-based memory storage device.

[0007] To optimize processor performance, the above code changes are performed iteratively. After each code change, the code is compiled and flashed, and its impact on the processor can be measured. In practice, multiple code changes are required because there are multiple blocks competing for the lowest latency / fastest memory. The downside of this current approach is that it is a tedious and time-consuming task and does not provide engineers with much flexibility. This approach is complex, time-consuming, and often results in underutilization of processing resources. Summary of the invention

[0008] The subject matter of the present invention includes one or more embodiments of an interface system for configuring a memory layout in a computing device having a plurality of processing modules, each of the plurality of processing modules having data to be stored in a plurality of memory locations of the computing device for access and transmission to the system for execution. The interface system includes: a communication protocol for receiving a memory layout from the computing device; a graphical user interface for displaying a configuration of each of the plurality of processing modules to memory locations within the memory layout; a memory layout request for modifying the configuration, the memory layout request being input by a user at the graphical user interface and associating a processing module with a latency level of a memory location in the plurality of memory locations. Configuration data is generated at the graphical user interface, the configuration data representing the layout of the data to be stored in the plurality of memory locations based on the memory layout request for each processing module and the memory capacity of the computing device.

[0009] In one or more embodiments, the graphical user interface includes a plurality of options for a user to select memory placement requests, wherein one or more user-selected placement requests are used to generate the configuration data.

[0010] In one or more embodiments, a consumption guide is displayed that illustrates a consumption level of the configuration data.

[0011] In one or more embodiments, an allocator on the computing device allocates the memory layout according to the configuration data.

[0012] In one or more embodiments, a result configuration file is displayed indicating the configuration results of the memory layout modified according to the configuration data.

[0013] The subject matter of the present invention includes one or more embodiments of a method for allocating memory locations for a predetermined number of processing modules, the memory locations being located on a computing device having a predefined memory layout, the processing modules having instructions to be stored in the memory locations according to a configuration, wherein the instructions are accessible and executable by the computing device, the method being implemented by a processor of a graphical user interface in communication with the computing device. The method includes the steps of: receiving a predefined memory layout of the computing device at a graphical user interface; displaying a configuration of the predefined memory layout of the computing device at the graphical user interface; receiving a user-input memory layout request for allocation of data to the memory locations, the user-input memory layout request being input at the graphical user interface; generating configuration data in the processor of the graphical user interface for allocation of data to the memory locations in the predefined memory layout of the computing device, the configuration data being based on the user-input memory layout request for memory allocation and the computing device memory capacity; and displaying a consumption guide at the graphical user interface, the consumption guide showing an estimated consumption level for allocation of data to the memory locations as determined by the configuration data.

[0014] In one or more embodiments, the method further includes the steps of presenting a plurality of options for user selection for the memory allocation request, and generating configuration data based on the user selection.

[0015] In one or more embodiments, the method further includes sending configuration data to a computing device, wherein the configuration data is assigned to memory locations according to the configuration data.

[0016] In one or more embodiments, the method further includes displaying, at a graphical user interface, a result configuration file showing memory allocations made according to the configuration data.

[0017] In one or more embodiments, the method further includes the step of prioritizing user-input storage placement requests based on the estimated consumption levels and the result profile. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 is a block diagram of an example computing device;

[0019] Figure 2 is a flow chart of one or more embodiments of a method for configuring memory latency in an example computing device;

[0020] Figure 3 is an example flow chart of a method for configuring memory delay in an audio system;

[0021] Figure 4is a screenshot of a layout view displayed at a graphical user interface (GUI);

[0022] Figure 5 is a screenshot of the consumption level displayed at the GUI; and

[0023] Figure 6 is a screenshot of the resulting profile displayed at the GUI.

[0024] The elements and steps in the drawings are shown for simplicity and clarity, and are not necessarily provided in any order. For example, the drawings show steps that can be performed simultaneously or in different orders to help improve understanding of the embodiments of the present disclosure. DETAILED DESCRIPTION

[0025] Although the reference Figures 1 to 5 Various aspects of the present disclosure have been described, but the present disclosure is not limited to such embodiments, and additional modifications, applications, and embodiments may be implemented without departing from the present disclosure. In the accompanying drawings, the same reference numerals will be used to illustrate the same components. Those skilled in the art will recognize that the various components set forth herein may be modified without departing from the scope of the present disclosure.

[0026] Figure 1 1 is a block diagram of a system 100 for configuring a memory arrangement on a computing device 102. The computing device 102 has at least one processor, a program for executing instructions and calculations, and a memory for storing programs and data. The computing device 102 has a program memory 104 that stores programs used by the computing device 102 to process data. The data memory 106 stores information (data) to be processed. The computing engine 108 (CPU) accesses the programs from the program memory 104 and the information from the data memory 106 to perform mathematical manipulations.

[0027] The CPU 108 has internal memory 110, which is divided into levels, L1 112, L2 114 to Ln 116, (where n depends on the processor architecture), which are intended to be used in a manner that minimizes memory access time. This is called local memory, and as mentioned above, the levels are differentiated according to size and access speed. The memory on the CPU 108 is generally faster to access than external memory (such as program memory 104 and data memory 106). Level L1 112 may be considered the fastest, while level Ln 116 may be considered the slowest. Level L2 114 is slower than level L1 112, but faster than level Ln 116. Data is supplied to and from the computing device 102 by means of an input / output (I / O) block 118.

[0028] Each type of memory, program memory 104, data memory 106, and internal memory levels 112, 114, 116, each has its own fetch time. Depending on the placement or configuration of data in the memory layout, CPU 108 can fetch data faster and perform operations at a higher rate. In one or more embodiments, a graphical user interface (GUI) 120 receives user input 122 indicating the configuration of the memory layout to accommodate signal flow in computing device 102. GUI 120 provides the user with the ability to input modifications to the memory layout. From GUI 120, the user can select specific levels in memory for placement of programs and data to test and preview the effects of the selection on computing device 102.

[0029] The GUI 120 generates configuration data 124, which is transmitted to the computing device 102 via the general communication port 126, and the modification of the configuration of the memory arrangement is reflected in the memory layout of the computing device according to the user request. The general communication port 126 is used to send and receive all configuration and feedback data between the GUI and the computing device 102. Once generated, the configuration data 124 can be sent to the computing device 102 via the communication protocol 123, where it is stored by the computing device 102 in the persistent memory 105 of the program memory 104 and / or the data memory 106. No hard coding is required. No compilation and flashing are required, and the allocator 128 in the computing device 102 configures the memory arrangement according to the configuration data 124.

[0030] The framework 107 is connected to the GUI 120 by means of a communication protocol 123 to provide information about the memory capacity of the computing device 102. The computing device memory capacity is presented to the user and used by the GUI when generating configuration data 124. The GUI 120 provides the user with options to select as user input 122. The selection is used to generate the configuration data 124. For example, an object such as an audio module in a multi-channel audio system has a memory type and size. The user selects by means of the GUI 120 to request a delay assigned to the module.

[0031] Configuration data 124 is generated at the GUI and transmitted back to computing device 102, where allocator 128 will determine whether the computing device can satisfy the requested allocation based on computing device memory capacity. Allocator 128 will maximize the computing device memory capacity to accommodate configuration data 124.

[0032] If the allocator 128 is unable to accommodate the latency allocation as detailed in the user request and configuration data 124, default settings will be applied at the computing device 102. The allocator 128 will provide detailed information about the allocation made and send the profiling results to the GUI, which are then displayed to the user in the form of a result profile. The result profile shows the user how the configuration data allocates data to memory locations and how it will affect the memory capacity of the computing device and its processing performance. The profiling results and configuration of the memory layout can be used to allocate memory with the fastest extraction time to objects that the user considers to be most critical.

[0033] Figure 2 2 is a flow chart of one or more embodiments of a method 200 for allocating memory for placement of data in one or more memory locations of a memory layout stored on a computing device. A user configures 202 a placement of data to be stored in memory on a computing device at a GUI. To configure the memory placement, the user inputs one or more requests for memory data placement by selecting latency levels of memory blocks. When configuration data is generated at the GUI, transmitted to the computing device, and implemented at the computing device, the latency levels of the memory blocks determine where data allocation should occur.

[0034] Configuration data is generated 204 at the GUI and contains all such memory placement requests that the user wants to be "tested" to indicate how the memory placement requests affect the performance of the computing device. The configuration data is sent 206 to the computing device by means of a communication protocol, where it is allocated 208 to the computing device memory by an allocator. The allocator allocates memory based on the memory capacity of the computing device. Whether the computing device can complete the requested allocation is reported 210 back to the GUI for display to the user. The user's goal is to optimize the performance of the computing device, so the user can evaluate the results to determine whether it is necessary to request modifications to the memory placement.

[0035] Configuration data is transferred to the computing device and tested without compiling and flashing code changes before measuring their impact on the computing device. This scenario allows the user to flexibly test computing device performance through the GUI and its connection to the computing device to effectively and quickly optimize performance through memory arrangements without time-consuming hard-coded memory arrangements.

[0036] As an example, the system and method are described as a tuning tool for an audio system. Figure 31 is a flow chart of one or more embodiments of a method 300 for configuring a memory arrangement of data in a computing device of an audio system. The audio system has a frame populated with audio modules. Each audio module contains a different piece of audio processing logic to instruct an amplifier in the audio system to perform a certain function. In the example described below, the computing device can be a digital signal processor (DSP) in the audio system. However, it should be noted that the description of the DSP is for exemplary purposes only, and the subject matter of the present invention can be applied to other types of computing devices and other types of systems that can benefit from memory allocation to enhance performance capabilities. In the description below, the terms "computing device and DSP" can be used interchangeably.

[0037] According to the method 300, a tuning tool is connected to an audio system via a communication protocol 302, and upon connection, the audio system sends the layout of its core and memory configuration to a graphical user interface (GUI). The GUI displays 304 the configuration and current layout of the core in the audio system's computing device. The audio system has a signal flow associated therewith, which can be viewed at the GUI.

[0038] Figure 4 4 is a screenshot of a GUI that displays the signal flow as a layout view 400, where a user can view an overview of the configuration of the memory layout and signal flow 402 of the connected audio system. The layout view is also where the user enters a memory placement request 404. Figure 4 In the screenshot of , only a portion of the memory configuration of the audio system is visible. In this example, a first core 406 and a second core 408 of the memory configuration are shown.

[0039] refer to Figure 3 In the method 300 shown in FIG. 1 , a user enters or adds 306 an instance of an audio framework (which may be, for example, data or programming instructions) and the instance is populated 308 with audio modules according to the user's memory placement request (based on, for example, memory latency). The user's request for memory placement is entered by selecting the user's request at each memory block from a drop-down menu. This is done in Figure 4 4. The first core 402 has a first audio module 406 and a second audio module 408. The first audio module has three memory blocks 414a, 414b, and 414c. Each audio module may have multiple memory blocks, and each memory block may have a configurable memory delay. The user selects a memory delay 416 in a drop-down menu. Each memory block 414a, 414b, 414c defines a memory area that needs to be allocated to the audio module 406.

[0040] Reference again Figure 3, the user describes 310 each audio module to the tuning tool, and the tuning tool displays 312 the memory layout with parameter descriptions, such as ID number, label, memory type, file size, etc. The user also enters 314 their memory layout request for each memory block in the audio module to generate configuration data. Figure 4 , the GUI displays an overview of the signal flow 402 of the current memory placement configuration, and the user can decide which modifications to make to the memory latency level 416 of the memory block 414c. In this step, the user combines the knowledge of the current resource consumption with the performance metrics displayed at the GUI to modify the latency of the memory block to optimize the system, e.g., to operate as fast as possible.

[0041] Back to reference Figure 3 , once generated, the configuration data is sent 316 to the audio system via a communication protocol, thereby changing the allocation strategy without having to modify code and / or re-flash the audio system.

[0042] like Figure 5 As shown in FIG. 5 , performance metrics of a consumption guide 500 are displayed at a GUI. The consumption level of each audio module 502 is shown in the form of average MIPS 504 and maximum MIPS 506. When a user sends a memory placement request to a computing device, the information presented in the consumption guide 500 provides the user with valuable feedback and information about DSP resource consumption.

[0043] An allocator on the computing device of the audio system allocates 322 a memory arrangement according to the configuration data and checks the memory capacity of the DSP and the system performance at the computing device. The result is displayed at the GUI in the form of a result profile of CPU consumption data (per audio module) and actual memory allocation (depending on the audio system). The memory arrangement allocated by the allocator is then visible 324 on the GUI, where the user can see a visual representation of the individual memory blocks and their delays.

[0044] Figure 6 is a screen shot of an example of a result configuration file 600. The result configuration file 600 includes a list of audio modules 602 and a memory block ID 604 for each audio module. Once the configuration data generated by the GUI is assigned to the DSP, the information presented in the result configuration file 600 provides the user with valuable feedback and information about DSP performance metrics, thereby allowing the user to modify the latency of the memory blocks in a manner that optimizes system performance.

[0045] In the foregoing description, the present disclosure has been described with reference to specific exemplary embodiments. The description and drawings are illustrative rather than restrictive, and modifications are intended to be included within the scope of the present disclosure. Therefore, the scope of the present disclosure should be determined by the claims and their equivalents, rather than by the examples described alone.

[0046] For example, the steps recited in any method or process claim may be performed in any order, may be repeated, and are not limited to the specific order presented in the claim. In addition, the components and / or elements recited in any device claim may be assembled or otherwise operatively configured in a variety of arrangements and are therefore not limited to the specific configuration recited in the claim. For example, the delays of multiple memory blocks may be modified simultaneously in an Excel file and imported into a tuning tool at the GUI.

[0047] According to the inventive subject matter, memory placement is no longer hard-coded, and DSP engineers can easily and quickly improve MIPS utilization. Instead of modifying code, recompiling, and re-flashing to modify memory placement, the user can modify the memory placement simply by entering selections at the GUI to generate a configuration file. The configuration file is sent to the DSP via xTP, resulting in a more flexible and fast method to optimize processor performance and memory placement.

[0048] Any methods or processes described may be implemented by executing instructions with one or more devices, such as a processor or controller, memory (including non-transitory memory), sensor, network interface, antenna, switch, actuator, to name a few.

[0049] Benefits, other advantages, and solutions to problems have been described above with respect to specific embodiments; however, any benefit, advantage, solution to problems, or any element that may cause any particular benefit, advantage, or solution to occur or become more significant should not be construed as a critical, required, or essential feature or component of any or all the claims.

[0050] The terms "comprise," "comprises," "comprising," "having," "including," "includes," or any variations thereof, are intended to represent a non-exclusive inclusion, such that a process, method, article, composition, or apparatus that includes a list of elements includes not only those elements recited but may also include other elements not expressly listed or inherent to such process, method, article, composition, or apparatus. In addition to combinations and / or modifications not specifically recited, other combinations and / or modifications of the above-described structures, arrangements, applications, proportions, elements, materials, or components used in the practice of the present disclosure may be varied or otherwise specially adapted to a particular environment, manufacturing specifications, design parameters, or other operating requirements without departing from the general principles of the present disclosure.

Claims

1. An interface system for configuring a memory arrangement in a computing device having a plurality of processing modules, each of the plurality of processing modules having data to be stored in a plurality of memory locations of the computing device for access and transfer to a system for execution, the interface system include: a communication protocol for receiving a memory layout from the computing device; a graphical user interface for displaying a configuration of each of the plurality of processing modules to a memory location within the memory layout; a memory placement request for modifying the configuration, the memory placement request being input by a user at the graphical user interface and associating a processing module with a latency level of a memory location in the plurality of memory locations; as well as Configuration data generated at the graphical user interface, the configuration data representing an arrangement of data to be stored in the plurality of memory locations based on the memory arrangement request of each processing module and a memory capacity of the computing device.

2. The interface system of claim 1, wherein the graphical user interface further comprises a plurality of options for the user to select the memory placement requests, wherein one or more user-selected memory placement requests are used to generate the configuration data.

3. The interface system of claim 2, further comprising a consumption guide that displays, at the graphical user interface, consumption levels of one or more user-selected storage placement requests.

4. The interface system of claim 3, wherein the consumption level is presented to the user so that the user can input a memory placement request, wherein the processing module with the highest priority can be assigned to the memory location with the fastest extraction time among all the memory locations.

5. The interface system of claim 1, wherein the graphical user interface sends the configuration data to the computing device via the communication protocol, and the computing device further include: An allocator is configured to allocate the data to the memory layout according to the configuration data.

6. The interface system of claim 5, further comprising a result configuration file displayed at the graphical user interface, the result configuration file indicating a profiling result of the configuration of the memory layout modified according to the configuration data, the profiling result being sent to the graphical user interface via the communication protocol.

7. A method for allocating memory locations for a predetermined number of processing modules, the memory locations being located on a computing device having a predefined memory layout, the processing modules having instructions to be stored in the memory locations according to a configuration, wherein the instructions are accessible and executable by the computing device, the method being implemented by a processor of a graphical user interface in communication with the computing device, the method The following steps are involved: receiving, at the graphical user interface, the predefined memory layout of the computing device; displaying, at the graphical user interface, the configuration of the predefined memory layout of the computing device; receiving a user-input memory placement request for allocation of data to memory locations, the user-input memory placement request being input at the graphical user interface; generating, in the processor of the graphical user interface, configuration data for the allocation of data to memory locations in the predefined memory layout of the computing device, the configuration data being based on the user-input memory placement request for memory allocation and a memory capacity of the computing device; as well as A consumption guide is displayed at the graphical user interface, the consumption guide illustrating an estimated consumption level for the allocation of data to memory locations as determined by the configuration data.

8. The method of claim 7, further comprising: The following steps are involved: presenting, at the graphical user interface, a plurality of options for user selection for a user-input memory allocation request; as well as The configuration data is generated based on one or more user selections.

9. The method of claim 7, further comprising: The following steps are involved: sending the configuration data to the computing device; and The data is allocated to memory locations in the predefined memory layout according to the configuration data.

10. The method of claim 8, further comprising the step of displaying at the graphical user interface a result profile of the assignment of data to memory locations according to the configuration data, the result being sent to the graphical user interface as a layout of the data in each of the memory locations in the predefined memory layout.

11. The method of claim 7, further comprising: The following steps are involved: The user-input storage placement requests are prioritized based on the estimated consumption level and the result profile.

12. A tuning tool for an audio system having a digital signal processor (DSP) and a plurality of audio modules controlled by the DSP, the tuning tool include: a communication protocol, the communication protocol being used for communication between the tuning tool and the audio system; a graphical user interface, the graphical user interface receiving the memory layout of the DSP sent from the audio system, the graphical user interface displaying a configuration of the memory layout; a memory placement request input by a user at the graphical user interface, the memory placement request modifying the configuration of the memory layout; as well as Configuration data generated by the graphical user interface, the configuration data representing a modification of an allocation of the audio modules in memory locations of the memory configuration based on the memory placement request and a memory capacity of the DSP, the configuration data being displayed at the graphical user interface.

13. The tuning tool of claim 12, wherein the graphical user interface further comprises a plurality of options for user selection, one or more selections of user options from the plurality of options being used to generate the configuration data.

14. The tuning tool of claim 13, further comprising a consumption guide that displays, at the graphical user interface, estimated consumption levels of one or more user-selected memory placement requests.

15. The tuning tool of claim 12, wherein the DSP further comprises a distributor, the graphical user interface sends the configuration data to the DSP via the communication protocol, and the distributor in the DSP distributes the audio modules to be stored in the memory layout at corresponding memory locations according to the configuration data.

16. The tuning tool of claim 15 , further comprising a result configuration file displayed at the graphical user interface, the result configuration file indicating a profiling result of the configuration of the memory layout modified according to the configuration data, the profiling result being sent to the graphical user interface via the communication protocol and displayed as the result configuration file at the graphical user interface.