Instruction set ecological testing method, device, equipment and readable storage medium

Abstract

The embodiment of the present invention provides an instruction set ecological testing method, device, equipment and readable storage medium, the method comprising: determining at least one application object associated with the instruction set; the instruction set comprises an instruction set to be tested and a reference instruction set; the application object is used to run based on the instruction set to be tested or the reference instruction set; obtaining a first operating parameter when the application object runs based on the instruction set to be tested, and a second operating parameter when the application object runs based on the reference instruction set; determining a parameter result of the application object based on the first operating parameter and the second operating parameter; the parameter result is used to represent the size relationship between the first operating parameter and the second operating parameter; determining the ecological maturity of the instruction set to be tested based on the parameter result of each application object. The present invention can determine the applicability of the instruction set to be tested.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to an instruction set ecosystem testing method, device, electronic device and computer-readable storage medium. Background Art

[0002] The instruction set is the basic language of the computer. The instruction set specifies the operations and commands that the processor can perform, thereby defining the tasks and operations that the processor can perform. Different instruction set architectures have different ecological maturity. Ecological maturity refers to the ecosystem built around the instruction set and its degree of perfection. Instruction sets with high ecological maturity can be widely used in various fields, so it is necessary to clarify the ecological maturity of the instruction set.

[0003] However, there is currently no relevant plan to determine the ecological maturity of the instruction set, resulting in the inability to determine the applicability of the instruction set. Summary of the invention

[0004] The embodiments of the present invention provide an instruction set ecological testing method, device, electronic device and readable storage medium, which can solve the problem that the applicability of the instruction set cannot be determined in the related art.

[0005] In order to solve the above problems, an embodiment of the present invention discloses an instruction set ecosystem testing method, the method comprising:

[0006] Determine at least one application object associated with an instruction set; the instruction set includes an instruction set to be tested and a reference instruction set; the application object is used to run based on the instruction set to be tested or the reference instruction set;

[0007] Acquire a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set;

[0008] Determine a parameter result of the application object based on the first operating parameter and the second operating parameter; the parameter result is used to indicate a magnitude relationship between the first operating parameter and the second operating parameter;

[0009] Based on the parameter results of each application object, the ecological maturity of the instruction set to be tested is determined.

[0010] Optionally, there are multiple application objects;

[0011] After the step of determining at least one application object associated with the instruction set, the method further comprises:

[0012] According to the type of each application object, the plurality of application objects are classified to obtain at least one type of object combination;

[0013] According to at least one type of object combination, construct an ecological structure of the instruction set; the ecological structure includes at least one application layer, and different application layers correspond to different types of object combinations;

[0014] The ecological structure is used to indicate the order of application objects used when obtaining the first operating parameter and the second operating parameter of at least one application object.

[0015] Optionally, the step of determining the parameter result of the application object based on the first operating parameter and the second operating parameter includes:

[0016] Determine at least one first sub-parameter in the first operating parameter and at least one second sub-parameter in the second operating parameter; different first sub-parameters are used to describe different types of operating conditions when the application object is running based on the instruction set to be tested; different second sub-parameters are used to describe different types of operating conditions when the application object is running based on the reference instruction set;

[0017] Determining at least one sub-parameter result based on each first sub-parameter and its corresponding second sub-parameter;

[0018] Based on at least one sub-parameter result and a corresponding preset first weight combination, a parameter result of the application object is determined; different sub-parameter results correspond to different weights in the preset first weight combination.

[0019] Optionally, the method further includes:

[0020] For each object combination corresponding to each application layer, obtaining a parameter result of each application object in the object combination to obtain a parameter result combination of the application layer;

[0021] Based on at least one parameter result in the parameter result combination, determine the ecological maturity corresponding to the application level.

[0022] Optionally, the step of determining the ecological maturity of the instruction set to be tested based on the parameter result of each application object includes:

[0023] For each application layer, determining the ecological maturity of the application layer based on the parameter results of the application objects in the application layer;

[0024] The ecological maturity of the instruction set is determined according to the ecological maturity corresponding to each application level and the corresponding preset second weight combination; different application levels correspond to different weights in the preset second weight combination.

[0025] Optionally, the step of obtaining a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set, includes:

[0026] When the application object is running based on the reference instruction set, obtaining a first support parameter corresponding to the application object after executing a preset test case set; the first support parameter represents the execution success rate corresponding to the instruction set to be tested;

[0027] When the application object runs based on the instruction set to be tested, a second support parameter corresponding to the application object after executing the test case set is obtained; the second support parameter represents the execution success rate corresponding to the reference instruction set.

[0028] Optionally, the step of obtaining a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set, includes:

[0029] When the application object is running based on the instruction set to be tested, obtaining a first execution time of the application object to execute a preset test task; the first execution time indicates the time required for the task corresponding to the instruction set to be tested to be completed;

[0030] When the application object runs based on the reference instruction set, a second execution duration of the application object to execute a preset test task is obtained; the second execution duration represents the duration required to complete the execution of the task corresponding to the reference instruction set.

[0031] On the other hand, an embodiment of the present invention discloses an instruction set ecosystem testing device, the device comprising:

[0032] An application object module, configured to determine at least one application object associated with an instruction set; the instruction set includes an instruction set to be tested and a reference instruction set; the application object is configured to run based on the instruction set to be tested or the reference instruction set;

[0033] An operation parameter module, used to obtain a first operation parameter when the application object is running based on the instruction set to be tested, and a second operation parameter when the application object is running based on the reference instruction set;

[0034] A parameter result module, used to determine a parameter result of the application object based on the first operation parameter and the second operation parameter; the parameter result is used to indicate a magnitude relationship between the first operation parameter and the second operation parameter;

[0035] The ecological determination module is used to determine the ecological maturity of the instruction set to be tested based on the parameter results of each application object.

[0036] Optionally, there are multiple application objects;

[0037] The device also includes:

[0038] An object combination module, used for classifying a plurality of application objects according to the type of each application object to obtain at least one type of object combination;

[0039] An ecological structure module, used to construct an ecological structure of the instruction set according to at least one type of object combination; the ecological structure includes at least one application layer, and different application layers correspond to different types of object combinations;

[0040] The ecological structure is used to indicate the order of application objects used when obtaining the first operating parameter and the second operating parameter of at least one application object.

[0041] Optional, parameter result module, including:

[0042] a sub-parameter submodule, used to determine at least one first sub-parameter in the first operating parameters, and at least one second sub-parameter in the second operating parameters; different first sub-parameters are used to describe different types of operating conditions when the application object is running based on the instruction set to be tested; different second sub-parameters are used to describe different types of operating conditions when the application object is running based on the reference instruction set;

[0043] A sub-result submodule, configured to determine at least one sub-parameter result based on each first sub-parameter and its corresponding second sub-parameter;

[0044] The result weight submodule is used to determine the parameter result of the application object based on at least one sub-parameter result and a corresponding preset first weight combination; different sub-parameter results correspond to different weights in the preset first weight combination.

[0045] Optionally, the device further comprises:

[0046] A hierarchical object module, for obtaining, for each object combination corresponding to each application level, a parameter result of each application object in the object combination, so as to obtain a parameter result combination of the application level;

[0047] The hierarchical ecological module is used to determine the ecological maturity corresponding to the application level based on at least one parameter result in the parameter result combination.

[0048] Optional, ecological determination module, including:

[0049] A hierarchical ecology submodule, for determining, for each application layer, the ecological maturity of the application layer based on the parameter results of the application objects in the application layer;

[0050] The instruction set ecological submodule is used to determine the ecological maturity of the instruction set according to the ecological maturity corresponding to each application level and the corresponding preset second weight combination; different application levels correspond to different weights in the preset second weight combination.

[0051] Optionally, run the parameter module, including:

[0052] A first use case support submodule is used to obtain a first support parameter corresponding to the application object after executing a preset test case set when the application object is running based on the reference instruction set; the first support parameter represents the execution success rate corresponding to the instruction set to be tested;

[0053] The second use case support submodule is used to obtain the second support parameter corresponding to the application object after executing the test case set when the application object runs based on the instruction set to be tested; the second support parameter represents the execution success rate corresponding to the reference instruction set.

[0054] Optionally, run the parameter module, including:

[0055] A first duration submodule is used to obtain a first execution duration of the application object to execute a preset test task when the application object is running based on the instruction set to be tested; the first execution duration indicates the duration required for the task corresponding to the instruction set to be tested to be completed;

[0056] The second duration submodule is used to obtain the second execution duration of the application object to execute a preset test task when the application object runs based on the reference instruction set; the second execution duration represents the duration required to complete the execution of the task corresponding to the reference instruction set.

[0057] On the other hand, an embodiment of the present invention further discloses an electronic device, which includes a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store executable instructions, and the executable instructions enable the processor to execute the aforementioned instruction set ecological testing method.

[0058] An embodiment of the present invention further discloses a readable storage medium. When instructions in the readable storage medium are executed by a processor of an electronic device, the electronic device can execute the aforementioned instruction set ecosystem testing method.

[0059] The embodiment of the present invention includes the following advantages: by determining at least one application object associated with an instruction set, the instruction set includes a reference instruction set and an instruction set to be tested, and the application object is used to run based on the reference instruction set or the instruction set to be tested, and obtain the first operating parameter of the application object when it runs based on the instruction set to be tested, and the second operating parameter of the application object when it runs based on the reference instruction set; based on the first operating parameter and the second operating parameter, determine the parameter result of the application object, the parameter result is used to represent the size relationship between the first operating parameter and the second operating parameter, and determine the ecological maturity of the instruction set to be tested based on the parameter result of each application object. The first operating parameter when the application object runs based on the instruction set to be tested and the second operating parameter when the application object runs based on the reference instruction set can be used to jointly determine the parameter result, and then the ecological maturity of the instruction set can be obtained based on the parameter result of each application object, and the applicability of the instruction set to be tested can be accurately determined. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0061] Figure 1 It is a flow chart of steps of an instruction set ecological testing method of the present invention;

[0062] Figure 2 is a flow chart of steps of another instruction set ecological testing method of the present invention;

[0063] Figure 3 is a structural block diagram of an instruction set ecological testing device provided by an example of the present invention;

[0064] Figure 4 It is a structural block diagram of an electronic device for instruction set ecological testing provided by an example of the present invention. DETAILED DESCRIPTION

[0065] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0066] The terms "first", "second", etc. in the specification and claims of the present invention are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable when appropriate, so that the embodiments of the present invention can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, the term "and / or" in the specification and claims is used to describe the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In the embodiments of the present invention, the term "multiple" refers to two or more, and other quantifiers are similar.

[0067] The instruction sets that are currently widely used are the X86 architecture and the Advanced RISC Machine (ARM) architecture. With the development of technology, the fifth generation of Reduced Instruction Set Computing (RISC), namely RISC-V, is gradually being used.

[0068] RISC-V, X86 and ARM are three different architectures. From the perspective of instruction set, X86 is a complex instruction set computing (CISC) architecture with a relatively complex instruction set, supporting a large number of instructions, rich functions, and high complexity of instruction decoding. ARM is a reduced instruction set computing (RISC) architecture with a simpler instruction set than X86, a fixed instruction length, and simplified instruction decoding and execution. RISC-V is an open source RISC instruction set architecture with a concise instruction set that is easy to understand and implement. It supports modular design and can select different instruction subsets according to specific needs. From the perspective of ecosystem maturity, X86 has the most mature ecosystem, with extensive hardware support, and is widely used in desktop computers, servers, and supercomputing fields, with a large amount of software and driver support. ARM is mostly used in the field of mobile devices and is widely used in smartphones and tablet computers. The ARM architecture has low power consumption characteristics, and RISC-V has a short development time and can be applied to embedded systems, the Internet of Things, edge computing and other fields.

[0069] Method Embodiment

[0070] Reference Figure 1, shows a flowchart of an instruction set ecological testing method embodiment of the present invention, the method may specifically include the following steps:

[0071] Step 101, determining at least one application object associated with an instruction set; the instruction set includes an instruction set to be tested and a reference instruction set; the application object is used to run based on the instruction set to be tested or the reference instruction set.

[0072] In the embodiments of the present disclosure, it is necessary to first understand that the instruction set ecosystem refers to a comprehensive system built around a specific instruction set architecture, including hardware, tools, operating systems, development environments, applications, services, community support, and developer groups, including micro-architecture designs directly related to instruction set hardware, as well as compilers, library function libraries, operating systems, development tool chains, debuggers, performance analyzers, middleware, application programming interfaces, standards, security frameworks, and community contributions and education and training. These elements together constitute an environment of interdependence and coordinated development. The health and activity of the instruction set ecosystem directly affects the adoption rate, developer acceptance, and ultimate application level of the architecture.

[0073] Instruction Set Ecosystem Maturity is a quantitative or qualitative parameter that describes the level of development of the instruction set ecosystem. It is used to determine the comprehensive performance of the instruction set in terms of technology maturity, market application, richness of supporting resources, community activity, compatibility, sustainable development capabilities, and technological innovation.

[0074] Application objects may be applications, firmware, compilation tool chains and development tool sets, deep learning frameworks, deep learning computing platforms, and other objects, without limitation. Application objects associated with an instruction set may refer to application objects that can be run on hardware based on the instruction set architecture.

[0075] The instruction set may include a reference instruction set and an instruction set to be tested. The reference instruction set may be an instruction set with a higher ecological maturity, such as X86 or ARM. The instruction set to be tested may be an instruction set with an unclear ecological maturity, such as RISC-V or other instruction sets newly generated with the development of technology. The reference instruction set and the instruction set to be tested are not specifically limited here.

[0076] Step 102: Obtain a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set.

[0077] In the embodiment of the present disclosure, the operation of the application object based on the instruction set to be tested may refer to the operation of the hardware based on the architecture of the instruction set to be tested, and the first operation parameter corresponding to the instruction set to be tested is obtained, and the first operation parameter represents the operation status of the application object when it is executed based on the instruction set to be tested.

[0078] Similarly, the running of the application object based on the reference instruction set may refer to the running of the hardware based on the reference instruction set architecture, obtaining a second running parameter corresponding to the reference instruction set, the second running parameter representing the running status of the application object when it runs based on the reference instruction set.

[0079] The first operating parameter and the second operating parameter may be one parameter or a group of parameters, and the specific content and quantity of the operating parameters are not limited here.

[0080] Step 103: Determine a parameter result of the application object based on the first operating parameter and the second operating parameter; the parameter result is used to represent the magnitude relationship between the first operating parameter and the second operating parameter.

[0081] In the embodiment of the present disclosure, a parameter result is determined based on a first operating parameter and a second operating parameter of an application object. The first operating parameter and the second operating parameter may be subtracted, divided, or other operations may be performed. The parameter result may represent the magnitude relationship between the first operating parameter and the second operating parameter.

[0082] There can be one or more application objects, so corresponding parameter results can be determined for each application object. It can be understood that the parameter results can also be used as the ecological maturity of the application object. The parameter results of the application object can represent the relative relationship between the operation of the application object based on the instruction set to be tested and the operation based on the reference instruction set.

[0083] Step 104: Determine the ecological maturity of the instruction set to be tested based on the parameter results of each application object.

[0084] In the embodiments of the present disclosure, the parameter results of each application object may be comprehensively counted, such as adding or averaging the parameter results of each application object, and performing other more complex operations to obtain the ecological maturity of the instruction set to be tested, which is not limited here.

[0085] In summary, the embodiments of the present invention include the following advantages: by determining at least one application object associated with an instruction set, the instruction set includes a reference instruction set and an instruction set to be tested, and the application object is used to run based on the reference instruction set or the instruction set to be tested, and obtain the first operating parameter of the application object when it runs based on the instruction set to be tested, and the second operating parameter of the application object when it runs based on the reference instruction set; based on the first operating parameter and the second operating parameter, determine the parameter result of the application object, the parameter result is used to represent the size relationship between the first operating parameter and the second operating parameter, and determine the ecological maturity of the instruction set to be tested based on the parameter result of each application object. The first operating parameter of the application object when it runs based on the instruction set to be tested and the second operating parameter of the application object when it runs based on the reference instruction set can be used to jointly determine the parameter result, and then the ecological maturity of the instruction set can be obtained based on the parameter result of each application object, and the applicability of the instruction set to be tested can be accurately determined.

[0086] Reference Figure 2 , shows a flowchart of another instruction set ecological testing method embodiment of the present invention, the method may specifically include the following steps:

[0087] Step 201, determining at least one application object associated with an instruction set; the instruction set includes an instruction set to be tested and a reference instruction set; the application object is used to run based on the instruction set to be tested or the reference instruction set;

[0088] Step 202, obtaining a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set;

[0089] Step 203: determining a parameter result of the application object based on the first operating parameter and the second operating parameter; the parameter result is used to indicate a magnitude relationship between the first operating parameter and the second operating parameter;

[0090] Step 204: Determine the ecological maturity of the instruction set to be tested based on the parameter results of each application object.

[0091] The contents of the above steps 201-204 can refer to the above Figure 1 The embodiments are not described in detail here.

[0092] Optionally, there are multiple application objects;

[0093] After the step of determining at least one application object associated with the instruction set, the method further comprises:

[0094] Step A1, classifying multiple application objects according to the type of each application object to obtain at least one type of object combination;

[0095] Step A2, constructing an ecological structure of the instruction set according to at least one type of object combination; the ecological structure includes at least one application layer, and different application layers correspond to different types of object combinations;

[0096] The ecological structure is used to indicate the order of application objects used when obtaining the first operating parameter and the second operating parameter of at least one application object.

[0097] In the embodiment of the present disclosure, when determining multiple application objects associated with the instruction set, the multiple application objects may be classified based on the functional use of the application objects. For example, the classification may be as follows:

[0098] For cloud computing / cloud native ecology, it can include analysis and visualization platform Grafana, container orchestration platform Kubernetes, package manager Helm, grid service platform Istio, system monitoring and alarm toolkit Prometheus;

[0099] Open source projects, machine learning platforms, deep learning frameworks, and deep learning libraries for video encoding and decoding and AI computing, including PyTorch, MXNet, Caffe, Tensorflow, OpenCV, OpenBLAS, MNN, Ffmpeg, scikit-learn, Apache Spark Mllib, CNTK, Deeplearning4j, Apache Mahout, and ONNX;

[0100] Distributed system infrastructure, relational database management systems, distributed relational databases, and others for big data processing ecosystems, including: Hadoop, Spark, Flink, MySQL, GaussDB, Redis, MariaDB;

[0101] Virtual machines, virtualization management platforms, container runtime daemons, application container engines, and others for virtualization and containerization, including kernel-based virtual machines (KVM), StartoVirt, iSulaD, and docker;

[0102] Language runtime related ones may include OpenJDK (an open source implementation of the Java language), Python (a computer programming language);

[0103] The compilation tool chain and development tool set may include the GNU compiler (GCC, GNU Compiler Collection), the low-level virtual machine (LLVM, Low Level Virtual Machine), the quick simulator (QEMU, Quick Emulator), and the GNU symbolic debugger (GDB, GNU symbolic debugger); among them, GNU is an operating system.

[0104] The operating system and basic libraries may include OpenEuler (open source Linux operating system distribution), Linux kernel (Linux Kernel), open source encryption library (OpenSSL, Open Secure Sockets Layer), C standard library implementation (musl libc), open source implementation of SSH (Secure Shell) protocol (OpenSSH), C standard library (Glibc, GNU CLibrary);

[0105] The system firmware layer can include the Unified Extensible Firmware Interface (UEFI), the open source secure boot implementation (OpenSBI), and the open source baseboard management controller (OpenBMC).

[0106] Hardware support and acceleration related may include machine learning unit (MLU, Machine Learning Unit), tensor processing unit (TPU, Tensor Processing Unit) and others.

[0107] The above are multiple application objects and categories listed in the present disclosure. Different numbers of categories and different numbers of application objects can be set as needed.

[0108] Each classification object combination can be used as a level, and a level includes one or more application objects. The application objects of different levels are further combined to obtain the ecological structure used to describe the entire instruction set. Each application object in the ecological structure can be used to determine the ecological maturity of the instruction set to be tested.

[0109] The ecological structure of the entire instruction set is as follows:

[0110]

[0111] Among them, L 1 , L2 and others represent different application layers, L 1.1 , L 1.2 …… indicates application layer L 1 The application objects in the same level are similar to those in other application levels, so I will not go into details here. Based on the ecological structure, the operation parameters can be obtained for each application object in an orderly manner.

[0112] In implementing the embodiments of the present disclosure, multiple application objects are classified according to the type of each application object to obtain at least one type of object combination; based on the at least one type of object combination, the ecological structure of the instruction set is constructed, which can clearly define the functions of different application objects when determining the ecological maturity of the instruction set, and then based on the ecological structure, the operating parameters can be obtained for each application object in an orderly manner, which is conducive to clearly and accurately measuring the ecological maturity of the instruction set to be tested.

[0113] Optionally, the step of determining the parameter result of the application object based on the first operating parameter and the second operating parameter includes:

[0114] Determine at least one first sub-parameter in the first operating parameter and at least one second sub-parameter in the second operating parameter; different first sub-parameters are used to describe different types of operating conditions when the application object is running based on the instruction set to be tested; different second sub-parameters are used to describe different types of operating conditions when the application object is running based on the reference instruction set;

[0115] Determining at least one sub-parameter result based on each first sub-parameter and its corresponding second sub-parameter;

[0116] Based on at least one sub-parameter result and a corresponding preset first weight combination, a parameter result of the application object is determined; different sub-parameter results correspond to different weights in the preset first weight combination.

[0117] In the embodiment of the present disclosure, the first operating parameter may be a group of parameters, and the first operating parameter may include at least one first sub-parameter, and different first sub-parameters are used to describe different types of operating conditions when the application object is running based on the reference instruction set. For example, the first sub-parameter may be used to describe the running time, the number of instructions, the read cache condition, and other types of operating conditions when the application object is running based on the instruction set to be tested.

[0118] Since the first operating parameter and the second operating parameter differ only in the corresponding instruction sets, the second operating parameter and the second sub-parameter are also similar and will not be described in detail here.

[0119] It is understandable that different sub-parameters are used to describe different types of operating conditions, and each sub-parameter itself can also be a group of sub-parameters, that is, the description of a specific type of operating condition is achieved through a group of parameters.

[0120] For example, when testing the deep learning framework PyTorch to obtain corresponding operating parameters, the operating parameters of PyTorch may include multiple sub-parameters.

[0121] PyTorch can include development projects that can compare the number of instructions executed by the reference instruction set and the instruction set to be tested, as shown below:

[0122]

[0123] Among them, N K,RISC-V is the number of instructions representing a single item in the first subparameter (based on the RISC-V instruction set), N K,ARM Indicates the number of instructions for a single item in the second sub-parameter (based on the ARM instruction set), RatioN K It is the speedup ratio of the number of instructions between the two.

[0124] However, PyTorch can include multiple items to be tested (different items can be used in different fields and applications), that is, each sub-parameter itself can also be a group of sub-parameters, then each item to be tested can be tested to obtain the number of instructions executed, as shown in the following formula:

[0125]

[0126] Among them, S N Sub-parameter results when multiple items are represented, q represents the number of items, RatioN K It is the instruction number speedup ratio. The above formula can be used to find the average value of the instruction number speedup ratios corresponding to multiple projects to obtain the final sub-parameter result. This sub-parameter result is used to indicate the number of instructions of the instruction set to be tested (RISC-V) relative to the reference instruction set (ARM) in the case of multiple projects. The number of instructions has a corresponding relationship with the compilation quality. For example, the fewer the number of instructions, the higher the compilation quality. It can reflect the difference in compilation quality (CQ, CompilationQuality) between the instruction set to be tested and the reference instruction set.

[0127] For each project, you can also test the number of cache read misses (L1-dcache-load-misses). The number of cache read misses is an indicator used to measure the number of times the processor fails to find the required data from the cache and must read the data from the slower main memory. Similarly, there is the following formula:

[0128]

[0129] Among them, M K,RISC-V is the number of cache read misses for a single item in the first subparameter (based on the RISC-V instruction set), M K,ARM Indicates the number of cache read misses for a single item in the second subparameter (based on the ARM instruction set), RatioM K is the speedup ratio of the number of cache read misses. In the case of multiple items, similarly, the following formula is used:

[0130]

[0131] Among them, S M Sub-parameter results when multiple items are represented, q represents the number of items, RatioM K is the speedup ratio of the number of cache read misses. The above formula can be used to average the speedup ratios of the number of cache read misses corresponding to multiple projects to obtain the final sub-parameter result. This sub-parameter result is used to indicate the number of cache read misses of the instruction set to be tested (RISC-V) relative to the reference instruction set (ARM) in the case of multiple projects. S M It can indicate the difference in memory system performance (MP) between the instruction set to be tested and the reference instruction set.

[0132] The sub-parameter results obtained based on the above formula include, for example, S N , S M , each sub-parameter result can be combined with different weights in the preset first weight combination to determine the parameter result of the application object, that is, the ecological maturity of the application object.

[0133] The embodiments of the present disclosure are implemented by determining at least one first sub-parameter in the first operating parameter and at least one second sub-parameter in the second operating parameter; determining at least one sub-parameter result based on each first sub-parameter and its corresponding second sub-parameter; and determining the parameter result of the application object based on the at least one sub-parameter result and the corresponding preset first weight combination. The parameter result of the application object can be determined based on different aspects corresponding to different sub-parameters, thereby improving the accuracy of the parameter result of the application object.

[0134] Optionally, the step of obtaining a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set, includes:

[0135] When the application object is running based on the instruction set to be tested, obtaining a first support parameter corresponding to the application object after executing a preset test case set; the first support parameter indicates an execution success rate corresponding to the instruction set to be tested;

[0136] In the case where the application object runs based on the reference instruction set, a second support parameter corresponding to the application object after executing the test case set is obtained; the second support parameter represents the execution success rate corresponding to the reference instruction set.

[0137] In the embodiment of the present disclosure, the operating parameter may be a parameter indicating support of the instruction set for the test case, and the support parameter indicates the execution success rate of the test case.

[0138] When the application object runs based on the instruction set to be tested, the application object can execute a preset set of test cases, and then determine the first support rate based on the number of successfully executed test cases in the test case set. Among them, the successful execution of the test case can mean that the function or feature being tested achieves the expected result after execution. For example, if it is a test case for a calculation function, the calculation result obtained by inputting specific data is accurate. It can also mean that during the execution of the test case, there is no system crash, error message, unexpected interruption, etc., and it can also mean that there is no data loss, data corruption, or data is incorrectly modified, etc., as well as other situations.

[0139] Similarly, when the application object runs based on the reference instruction set, the second support parameter corresponding to the application object after executing the test case set is obtained.

[0140] Optionally, the step of obtaining a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set, includes:

[0141] When the application object is running based on the instruction set to be tested, obtaining a first execution time of the application object to execute a preset test task; the first execution time indicates the time required for the task corresponding to the instruction set to be tested to be completed;

[0142] When the application object runs based on the reference instruction set, a second execution duration of the application object to execute a preset test task is obtained; the second execution duration represents the duration required to complete the execution of the task corresponding to the reference instruction set.

[0143] In the embodiment of the present disclosure, the operating parameter may be used to indicate the execution time of a preset test task. PyTorch may include a development project, and the development project may correspond to a test task. The execution time (wall time) corresponding to the reference instruction set and the instruction set to be tested may be compared, as shown in the following formula:

[0144]

[0145] Among them, T K,RISC-V Indicates the first execution time of a single item in the first sub-parameter (based on the RISC-V instruction set), T K,ARM Indicates the second execution time of a single item in the second sub-parameter (based on the ARM instruction set), RatioT K It is the execution time acceleration ratio of the two, corresponding to the sub-parameter result of a single project.

[0146] The corresponding sub-parameters can be determined based on the execution time of multiple items to be tested. In the case of multiple items, the formula is as follows:

[0147]

[0148] Among them, S T Sub-parameter results when multiple items are represented, q represents the number of items, RatioT K is the execution time acceleration ratio. The above formula can be used to calculate the average execution time acceleration ratio corresponding to multiple projects to obtain the final sub-parameter result. This sub-parameter result is used to indicate the execution time of the instruction set to be tested (RISC-V) relative to the reference instruction set (ARM) in the case of multiple projects. S T It can represent the difference in overall machine performance between the instruction set to be tested and the reference instruction set, that is, the difference in performance advancement (PA).

[0149] In addition to the S T , S about the number of cache read misses MIn addition to the test case support rate, other types of operating conditions may also be included, such as the number of patches submitted by software developers of different instruction sets, the support rate of different instruction set architecture versions of the same software for heterogeneous computing units, and the support rate of different instruction sets for business items in specific industry fields. Among them, heterogeneous computing units may include central processing units (CPU), neural network processing units (NPU), machine learning units (MLU), TPU, single instruction multiple data (SIMD) extended instruction sets NEO, RISC-V extensions (RVV), and others. The above different types of operating conditions can be understood as operating conditions detected from different dimensions and angles.

[0150] Different weights are allocated for different types of operation, and the following formula can be used:

[0151]

[0152] in, It is the result of the sub-parameter about the execution time The weight of

[0153]

[0154] Is the result of the sub-parameter about the number of instructions The weight of

[0155]

[0156] is the result of the sub-parameter about the number of cache read misses The weight of

[0157]

[0158] is the weight of the sub-parameter result about the test case support rate. / Can express the difference in functional integrity (FI), is the test case support rate of the instruction set to be tested, is the test case support rate of the reference instruction set.

[0159]

[0160] is the weight of the sub-parameter result about the number of patches submitted by software development. It can indicate the difference in ecological prosperity between the instruction set to be tested and the reference instruction set, namely the open source development activity level (ODAL). is the number of patches submitted by software developers for the instruction set to be tested, is the number of patches submitted by software developers for the reference instruction set.

[0161]

[0162] is the weight of the sub-parameter result about the support rate of heterogeneous computing units. / It can represent the difference in heterogeneous computing support level (HCSL). is the support rate of the heterogeneous computing units of the instruction set to be tested, is the support rate of heterogeneous computing units of the reference instruction set.

[0163]

[0164] is the weight of the sub-parameter result of the business item support rate for a specific industry. / It can indicate the difference in Industry Application Support Level (IASL). is the business item support rate of the specific industry of the instruction set to be tested, It is the business item support rate for a specific industry of the reference instruction set.

[0165] In general, for a specific application object, the overall parameter result of the application object, i.e., the ecological maturity, can be expressed by the following formula:

[0166]

[0167] in, is the ecological maturity of the application object. For different types of operation conditions, there is a maturity performance vector of the instruction set to be tested α = (S T , S N , S M , a1 , b 1 , c 1 , d 1 ), the maturity performance vector of the reference instruction set β = (1,1, 1, a 2 , b 2 , c 2 , d 2 ), dimension weight vector = (w 1 , w 2 , w 3 , w 4 , w 5 , w 6 , w 7 ) .

[0168] Optionally, the method further includes:

[0169] Step B1, for each object combination corresponding to the application layer, obtaining the parameter result of each application object in the object combination to obtain the parameter result combination of the application layer;

[0170] Step B2: determining the ecological maturity corresponding to the application level based on at least one parameter result in the parameter result combination.

[0171] In the embodiment of the present disclosure, the ecological structure is composed of each level, and each level is also composed of at least one application object. Therefore, each application level actually corresponds to an object combination. Based on the parameter results of each application object in the object combination, a parameter result combination of the application level can be obtained.

[0172] The ecological maturity of the application layer can then be determined based on the combination of parameter results. For example, the parameter results in the parameter result combination can be added together, or the addition can be divided by the number of parameter results in the parameter result combination to obtain an average value, or other more complex calculation processes can be used.

[0173] For example, the ecosystem maturity at the application level can be determined by the following formula:

[0174]

[0175] in, represents the ecological maturity of the i-th application layer, n represents the number of application objects in the i-th application layer, Indicates the ecological maturity of application objects in the i-th application layer.

[0176] In the implementation of the embodiments of the present disclosure, the parameter results of each application object in the object combination corresponding to each application layer are obtained to obtain the parameter result combination of the application layer; based on at least one parameter result in the parameter result combination, the ecological maturity corresponding to the application layer is determined. The ecological maturity of the application layer can be determined separately, so that the availability of the instruction set to be tested for a specific purpose or function can be known, further improving the granularity of ecological testing.

[0177] Optionally, the step of determining the ecological maturity of the instruction set to be tested based on the parameter result of each application object includes:

[0178] For each application layer, determining the ecological maturity of the application layer based on the parameter results of the application objects in the application layer;

[0179] The ecological maturity of the instruction set is determined according to the ecological maturity corresponding to each application level and the corresponding preset second weight combination; different application levels correspond to different weights in the preset second weight combination.

[0180] In the embodiment of the present disclosure, the ecological maturity of the application layer can be determined according to the ecological maturity of the parameter result set of each application object in each application layer.

[0181] Since the instruction set to be tested corresponds to the entire ecological structure, the ecological maturity of the instruction set to be tested can be determined according to the ecological maturity of each application layer in the ecological structure, and each application layer can also correspond to different preset weights. The ecological maturity of the instruction set to be tested can be determined by the following formula:

[0182]

[0183]

[0184] in, is the weight of the i-th layer in the ecological structure, m is the number of application layers, and the sum of the preset weights (i.e., the preset second weight combination) corresponding to all application layers is 1; L represents the ecological maturity of the overall ecological structure corresponding to the instruction set to be tested, Indicates the ecological maturity of the i-th application layer.

[0185] The embodiment of the present invention includes the following advantages: by determining at least one application object associated with an instruction set, the instruction set includes a reference instruction set and an instruction set to be tested, and the application object is used to run based on the reference instruction set or the instruction set to be tested, and obtain the first operating parameter of the application object when it runs based on the instruction set to be tested, and the second operating parameter of the application object when it runs based on the reference instruction set; based on the first operating parameter and the second operating parameter, determine the parameter result of the application object, the parameter result is used to represent the size relationship between the first operating parameter and the second operating parameter, and determine the ecological maturity of the instruction set to be tested based on the parameter result of each application object. The first operating parameter when the application object runs based on the instruction set to be tested and the second operating parameter when the application object runs based on the reference instruction set can be used to jointly determine the parameter result, and then the ecological maturity of the instruction set can be obtained based on the parameter result of each application object, and the applicability of the instruction set to be tested can be accurately determined.

[0186] It is understandable that the various operating parameters used to determine the ecological maturity mentioned above can be updated regularly, the operating parameters can be automatically collected, and parameters such as preset weights can be updated in real time as needed.

[0187] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0188] Device Embodiment

[0189] Reference Figure 3 , shows a structural block diagram of an instruction set ecological testing device of the present invention, the device 30 comprises:

[0190] The application object module 301 is used to determine at least one application object associated with an instruction set; the instruction set includes an instruction set to be tested and a reference instruction set; the application object is used to run based on the instruction set to be tested or the reference instruction set;

[0191] An operation parameter module 302 is used to obtain a first operation parameter when the application object is running based on the instruction set to be tested, and a second operation parameter when the application object is running based on the reference instruction set;

[0192] A parameter result module 303 is used to determine a parameter result of the application object based on the first operation parameter and the second operation parameter; the parameter result is used to indicate a magnitude relationship between the first operation parameter and the second operation parameter;

[0193] The ecological determination module 304 is used to determine the ecological maturity of the instruction set to be tested based on the parameter results of each application object.

[0194] Optionally, there are multiple application objects; the device further includes:

[0195] An object combination module, used for classifying a plurality of application objects according to the type of each application object to obtain at least one type of object combination;

[0196] An ecological structure module, used to construct an ecological structure of the instruction set according to at least one type of object combination; the ecological structure includes at least one application layer, and different application layers correspond to different types of object combinations;

[0197] The ecological structure is used to indicate the order of application objects used when obtaining the first operating parameter and the second operating parameter of at least one application object.

[0198] Optional, parameter result module, including:

[0199] a sub-parameter submodule, used to determine at least one first sub-parameter in the first operating parameters, and at least one second sub-parameter in the second operating parameters; different first sub-parameters are used to describe different types of operating conditions when the application object is running based on the instruction set to be tested; different second sub-parameters are used to describe different types of operating conditions when the application object is running based on the reference instruction set;

[0200] A sub-result submodule, configured to determine at least one sub-parameter result based on each first sub-parameter and its corresponding second sub-parameter;

[0201] The result weight submodule is used to determine the parameter result of the application object based on at least one sub-parameter result and a corresponding preset first weight combination; different sub-parameter results correspond to different weights in the preset first weight combination.

[0202] Optionally, the device further comprises:

[0203] A hierarchical object module, for obtaining, for each object combination corresponding to each application level, a parameter result of each application object in the object combination, so as to obtain a parameter result combination of the application level;

[0204] The hierarchical ecological module is used to determine the ecological maturity corresponding to the application level based on at least one parameter result in the parameter result combination.

[0205] Optional, ecological determination module, including:

[0206] A hierarchical ecology submodule, for determining, for each application layer, the ecological maturity of the application layer based on the parameter results of the application objects in the application layer;

[0207] The instruction set ecological submodule is used to determine the ecological maturity of the instruction set according to the ecological maturity corresponding to each application level and the corresponding preset second weight combination; different application levels correspond to different weights in the preset second weight combination.

[0208] Optionally, run the parameter module, including:

[0209] A first use case support submodule is used to obtain a first support parameter corresponding to the application object after executing a preset test case set when the application object is running based on the reference instruction set; the first support parameter represents the execution success rate corresponding to the instruction set to be tested;

[0210] The second use case support submodule is used to obtain the second support parameter corresponding to the application object after executing the test case set when the application object runs based on the instruction set to be tested; the second support parameter represents the execution success rate corresponding to the reference instruction set.

[0211] Optionally, run the parameter module, including:

[0212] A first duration submodule is used to obtain a first execution duration of the application object to execute a preset test task when the application object is running based on the instruction set to be tested; the first execution duration indicates the duration required for the task corresponding to the instruction set to be tested to be completed;

[0213] The second duration submodule is used to obtain the second execution duration of the application object to execute a preset test task when the application object runs based on the reference instruction set; the second execution duration represents the duration required to complete the execution of the task corresponding to the reference instruction set.

[0214] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0215] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0216] Regarding the processor in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0217] Reference Figure 4, is a structural block diagram of an electronic device for instruction set ecological testing provided by an embodiment of the present invention. Figure 4 As shown, the electronic device includes: a processor, a memory, a communication interface and a communication bus, and the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store executable instructions, and the executable instructions enable the processor to execute the instruction set ecological testing method of the aforementioned embodiment.

[0218] The processor may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other editable devices, transistor logic devices, hardware components or any combination thereof. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor.

[0219] The communication bus may include a path for transmitting information between the memory and the communication interface. The communication bus may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The communication bus may be divided into an address bus, a data bus, and a control bus. For ease of representation, Figure 4 The fact that only one line is used in the diagram does not mean that there is only one bus or only one type of bus.

[0220] The memory can be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or it can be an EEPROM (Electrically ErasableProgrammable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory), a magnetic tape, a floppy disk, and an optical data storage device.

[0221] The embodiment of the present invention also provides a non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor of an electronic device (server or terminal), the processor can execute Figure 2 The instruction set ecological testing method shown.

[0222] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0223] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (which may include disk storage, CD-ROM, optical storage) containing computer-usable program code.

[0224] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0225] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal device to operate in a predictable manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0226] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 Functional steps of one or more boxes.

[0227] Although the preferred embodiments of the present invention are described, those skilled in the art will recognize the basic creative concept and may make other changes and modifications to these embodiments. The appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0228] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0229] The above is a detailed introduction to an instruction set ecological testing method, device, electronic device and readable storage medium provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for testing an instruction set ecosystem, characterized in that: The method comprises: Determine at least one application object associated with an instruction set; the instruction set includes an instruction set to be tested and a reference instruction set; the application object is used to run based on the instruction set to be tested or the reference instruction set; Acquire a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set; Determine a parameter result of the application object based on the first operating parameter and the second operating parameter; the parameter result is used to indicate a magnitude relationship between the first operating parameter and the second operating parameter; Determining the ecological maturity of the instruction set to be tested based on the parameter results of each application object; There are multiple application objects; after the step of determining at least one application object associated with the instruction set, the method further includes: According to the type of each application object, the plurality of application objects are classified to obtain at least one type of object combination; According to at least one type of object combination, construct an ecological structure of the instruction set; the ecological structure includes at least one application layer, and different application layers correspond to different types of object combinations; The ecological structure is used to indicate the order of application objects used when obtaining the first operating parameter and the second operating parameter of at least one application object.

2. The method according to claim 1, characterized in that The step of determining the parameter result of the application object based on the first operating parameter and the second operating parameter includes: Determine at least one first sub-parameter in the first operating parameter and at least one second sub-parameter in the second operating parameter; different first sub-parameters are used to describe different types of operating conditions when the application object is running based on the instruction set to be tested; different second sub-parameters are used to describe different types of operating conditions when the application object is running based on the reference instruction set; Determining at least one sub-parameter result based on each first sub-parameter and its corresponding second sub-parameter; Based on at least one sub-parameter result and a corresponding preset first weight combination, a parameter result of the application object is determined; different sub-parameter results correspond to different weights in the preset first weight combination.

3. The method according to claim 1, characterized in that The method further comprises: For each object combination corresponding to each application layer, obtaining a parameter result of each application object in the object combination to obtain a parameter result combination of the application layer; Based on at least one parameter result in the parameter result combination, determine the ecological maturity corresponding to the application level.

4. The method according to claim 1, characterized in that: The step of determining the ecological maturity of the instruction set to be tested based on the parameter results of each application object includes: For each application layer, determining the ecological maturity of the application layer based on the parameter results of the application objects in the application layer; The ecological maturity of the instruction set is determined according to the ecological maturity corresponding to each application level and the corresponding preset second weight combination; different application levels correspond to different weights in the preset second weight combination.

5. The method according to claim 1, characterized in that The step of obtaining a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set, comprises: When the application object is running based on the instruction set to be tested, obtaining a first support parameter corresponding to the application object after executing a preset test case set; the first support parameter indicates an execution success rate corresponding to the instruction set to be tested; In the case where the application object runs based on the reference instruction set, a second support parameter corresponding to the application object after executing the test case set is obtained; the second support parameter represents the execution success rate corresponding to the reference instruction set.

6. The method according to claim 1, characterized in that The step of obtaining a first operating parameter of the application object when it is running based on the instruction set to be tested, and a second operating parameter of the application object when it is running based on the reference instruction set, comprises: When the application object is running based on the instruction set to be tested, obtaining a first execution time of the application object to execute a preset test task; the first execution time indicates the time required for the task corresponding to the instruction set to be tested to be completed; When the application object runs based on the reference instruction set, a second execution duration of the application object to execute a preset test task is obtained; the second execution duration represents the duration required to complete the execution of the task corresponding to the reference instruction set.

7. An instruction set ecological testing device, characterized in that: The device comprises: An application object module, configured to determine at least one application object associated with an instruction set; the instruction set includes an instruction set to be tested and a reference instruction set; the application object is configured to run based on the instruction set to be tested or the reference instruction set; An operation parameter module, used to obtain a first operation parameter when the application object is running based on the instruction set to be tested, and a second operation parameter when the application object is running based on the reference instruction set; A parameter result module, used to determine a parameter result of the application object based on the first operation parameter and the second operation parameter; the parameter result is used to indicate a magnitude relationship between the first operation parameter and the second operation parameter; An ecological determination module, used to determine the ecological maturity of the instruction set to be tested based on the parameter results of each application object; There are multiple application objects; the device also includes: An object combination module, used for classifying a plurality of application objects according to the type of each application object to obtain at least one type of object combination; An ecological structure module, used to construct an ecological structure of the instruction set according to at least one type of object combination; the ecological structure includes at least one application layer, and different application layers correspond to different types of object combinations; The ecological structure is used to indicate the order of application objects used when obtaining the first operating parameter and the second operating parameter of at least one application object.

8. An electronic device, characterized in that: The electronic device includes a processor, a memory, a communication interface and a communication bus, and the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store executable instructions, and the executable instructions enable the processor to execute the instruction set ecological testing method as described in any one of claims 1 to 6.

9. A readable storage medium, characterized in that: When the instructions in the readable storage medium are executed by a processor of an electronic device, the processor is enabled to execute the instruction set ecological testing method as described in any one of claims 1 to 6.

Images