670results about "Software metrics" patented technology

An example operation may include one or more of receiving a first code base and a second code base from a software repository, wherein each of the first and second code bases comprise source code of a plurality of different software programs, identifying a source code within the first code base that is interdependent with a source code within the second code base based on execution of a generative artificial intelligence (GenAI) model on the first and second code bases, determining a software component to connect the source code within the first code base to the source code within the second code base, and displaying an identifier of the software component via a user interface.

Systems and methods for integrating generative artificial intelligence (AI) capabilities within Software as a Service (SaaS) platforms. One of the computer-implemented methods are for querying a generative AI model about structured data in a SaaS environment, enabling users to interact with and manipulate data through AI-assisted interfaces. One of the systems maintains a generative AI agent configured to interact with SaaS platform data as a virtual team member, capable of understanding context and nuances of project data. Also described are methods for color-context aware data analysis, generation of interactive elements in messaging sessions, and cross-application generative AI agent interactions triggered by user mentions. Also described is facilitating the creation of custom SaaS platform products by combining functionalities from existing products using generative AI. The systems and methods represent advancement in AI-driven SaaS customization and data analysis.

The invention relates to methods and systems for integrating generative artificial intelligence (AI) capabilities into Software as a Service (SaaS) platforms. It comprises maintaining AI agents with varying credentials, enabling their interaction with alphanumeric data in table structures, and implementing a hierarchical access control scheme. The system displays table structures, provides interfaces for user inputs, and allows AI agents to be added as platform users. The generative AI agents can analyze data, identify actions, and perform tasks autonomously. The invention also includes methods for proactive information gathering, interactive analysis of AI outputs, and management of AI resources as limited assets. This approach enhances SaaS functionality by enabling AI-driven task completion, data analysis, and decision-making while maintaining data security and user-specific access controls.

The systems and methods provide a model deployment criterion. The model deployment criterion indicates a difference in a value against which the proxy model may be measured to determine when, if ever, the proxy model should be deployed to replace the existing rule engine. The model deployment criterion may be keyed to the proxy model (e.g., based on a difference in its size, throughput speed, number of changes, etc.), the existing rule engine (e.g., based on a difference in its age, update occurrences to its rule base, etc.), and / or comparisons between models (e.g., based on differences in results, throughput speed, efficiency, etc.).

Systems and methods for generating code for artificial intelligence models without requiring training data that is specific to model components and objectives. For example, the system may receive an original version of a rule engine. The system may input the original version, using a first input condition, into a regeneration model to generate a first regenerated version of the rule engine. The system may determine whether the first regenerated version includes a first hallucination based on comparing the first regenerated version to alternative versions of the rule engine, wherein each of the alternative versions were generated using a respective alternative input condition. The system may, in response to determining that the first regenerated version includes the first hallucination, determining whether the first hallucination comprises a positive mutation.

Methods and systems for assessing a software bill of materials (SBOM) include building a knowledge graph from repositories, using function fingerprints of software packages in the repositories. Dependencies of an application are identified using function fingerprints of the application and comparing to function fingerprints of the software packages. A quality score for an SBOM of the application is generated based on a comparison of the identified dependencies to claimed dependencies of the SBOM. An action is performed responsive to the quality score.

Disclosed herein are computer-implemented systems and methods for code value assessment. For example, in one aspect, the system comprises, an input module configured to receive program code submissions from developers, a processing unit equipped with Text-Based Models with Contextual Understanding (TBM-CUs) configured to evaluate the functional meaning, purpose, and value of submitted code segments and distinguish between code contributions from human programmers and machine learning systems, a visualization module configured to present the assessed value of the analyzed code over various time periods and dimensions, offering insights into trends, patterns, and comparative performance, a communication module configured to translate programming code meaning or function into plain language summaries for non-technical stakeholders, and an AI peer review module configured to automatically review, accept or reject code contributions.

The invention provides a business module source code generation method and system based on large model business reasoning, and belongs to the technical field of code generation. The business module source code generation method comprises the steps that semantic analysis is conducted on business requirements, and a business association graph with weights is constructed; performing module division, and decomposing a complete task into a plurality of sub-tasks; calling a coordination agent, distributing a corresponding module code generation agent based on a large model for each decomposed subtask, and injecting context information to generate a corresponding module code; wherein the module code generation agent learns a corresponding relationship between tasks and injected context information and codes in advance based on field self-adaptive staged training; and calling the verification agent to perform code quality verification. The method has the beneficial effects that the module division is performed based on the business association graph with the weight, the multi-agent collaborative code generation is constructed by adopting the field-adaptive staged training, and the quality of the generated code is verified, so that the code generation efficiency and quality are improved.

Systems and methods for detecting anomalies in generative outputs are disclosed herein. The system receives a user prompt indicating a request for data over a time period. The system inputs, into a model, the user prompt to cause the model to generate an output based on the user prompt. The system then generates the first tokens based on the output. To generate the second tokens, the system retrieves, based on the user prompt, sources relating to the data requested by the user prompt. The system then generates queries to request, from the sources, the data over the time period and generates the second tokens based on the retrieved data. The system then performs a comparison of the first tokens and the second tokens and accepts or rejects the output of the model based on the comparison.

A system and method for automatically generating a change history of source code using a generative artificial intelligence (“AI”) system. In examples, a generative AI system receives a request inquiring about one or more changes made to software code of a software service or application. In response to receiving the request, the generative AI system navigates one or more information sources to collect code change context relevant to history of the code change(s). The generative AI system generates an instruction corresponding to the received request, where the instruction and the code change context are provided as input to a language model (LM) (e.g., a generative AI model). Based on the inquiry of the request, the LM processes the input, generates, and provides a corresponding output. The generative AI system then uses the output to generates and provide an explanation about the code change(s) to a requestor of the request.

Systems and methods described herein enable adaptive, threshold-based modification of node maps representing ontologies, knowledge graphs, or code development pipelines using generative artificial intelligence. The disclosed platform can retrieve a node map and generate one or more candidate perturbations that modify nodes or relationships within the node map. The disclosed platform can evaluate the effect of the perturbations by comparing respective outputs against ground-truth data. Perturbations can be automatically determined based on changes in external datasets, compliance policies, or operational requirements. The perturbations can be implemented when a computed perturbation quality value satisfies a threshold quality criterion. As such, the system enables efficient, policy-compliant evolution of relational system architectures in dynamic environments.

Methods and systems for assessing a software bill of materials (SBOM) include extracting package names from code of an application to identify first dependencies of the application. Package names are extracted from accesses by the application to identify second dependencies of the application. A quality score is generated for an SBOM of the application based on a comparison of the contents of the SBOM to the first dependencies and the second dependencies. An action is performed responsive to the quality score.

The systems and methods provide a model deployment criterion. The model deployment criterion indicates a difference in a value against which the proxy model may be measured to determine when, if ever, the proxy model should be deployed to replace the existing rule engine. The model deployment criterion may be keyed to the proxy model (e.g., based on a difference in its size, throughput speed, number of changes, etc.), the existing rule engine (e.g., based on a difference in its age, update occurrences to its rule base, etc.), and / or comparisons between models (e.g., based on differences in results, throughput speed, efficiency, etc.).

Systems, methods, and devices that relate to assessing uncertainty associated with entities are disclosed. In one example aspect, the method receives artifacts relating to an entity and categories for assessing uncertainty. For each category, a generative model retrieves and standardizes data points from the artifacts. A rule-based model inputs the standardized data points to output a rating. The generative model then generates an assessment of the rating and data points according to a predefined structure. The method outputs a summary, rating, and standardized data points for each category. These outputs can be used by other systems for assessing the uncertainty of the entity and taking action based on the assessment.

A system for automated code modification improves application performance in cloud environments by integrating telemetry analysis with large language model (LLM)-driven reasoning. The system collects contextual information about a target application, including metadata, source code, and configuration files, and correlates it with real-time telemetry data related to application performance. Based on this data, the system constructs a structured LLM prompt using a predefined schema, which is transmitted to an LLM. The prompt instructs the LLM to recommend modifications to source or configuration files that may enhance performance, along with natural language explanations for those recommendations. In response to receiving the LLM's response, the system extracts the proposed code or configuration changes and associated rationale, and presents them to a user via a client device interface.

A method by a computing system to determine a resource configuration for a function as a service application. The method includes generating, for each of one or more functions of the application, a performance profile of the function that indicates performance characteristics of the function with respect to an amount of resources allocated to the function, determining a resource configuration for the application based on an optimization objective and the performance profiles of the one or more functions, and deploying the application using the resource configuration determined for the application.

The invention discloses a code generation method, which comprises the following steps that: a code development platform receives input information of a user in a first code file in a project, acquires a context in the file and a first cross-file context according to a static structure of the project, and acquires a second cross-file context according to behavior characteristics of the user in a development project, obtaining a third cross-file context according to the evolution coupling degree of at least one second code file in a code warehouse of the project and the first code file, and generating prompt information according to the input information, the context in the file, the first cross-file context, the second cross-file context and the third cross-file context, and inputting the prompt information into the code generation model for reasoning to obtain at least one group of generation codes, and displaying the at least one group of generation codes to the user. According to the method, the multi-dimensional item-level context and the user input serve as the input of the code generation model, the capability of the code generation model for utilizing the cross-file context in the code generation process is improved, and the code generation effect is improved.

Disclosed herein are system, method, and computer program product embodiments for detecting anomalies during software testing. The methods include generating a plurality of test reports for the software program by executing one or more test cases on a plurality of versions of the software program, generating a control chart based on the plurality of test reports, generating an alert when at least one testing characteristic includes an anomaly over the plurality of versions of the software program as determined based on the control chart. The control chart includes a plot associated with at least one testing characteristic of the software program, and a historical context associated with execution of the one or more test cases on the plurality of versions of the software program.

Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for evaluating an energy efficiency of a computer code snippet. A computer-implemented system obtains code data characterizing a computer code snippet and rule data characterizing one or more energy efficiency rules, and processes the code data and rule data using machine-learning models to detect energy efficiency defects in the computer code snippet that negatively impact a dynamic energy efficiency of the computer code snippet upon execution by the computing device.

Large language model code translation error detection include receiving a code portion of a first programming language, and converting the code portion to a second programming language. A first accuracy of the converting of the code portion to the second programming language is calculated. A difference between the first accuracy and an historical accuracy of a conversion from the first programming language to the second programming language is determined. A potential error in the code portion of the first programming language is indicated based on the difference between the first accuracy and the historical accuracy being greater than a predetermined value is indicated.

Aspects of the present disclosure provide systems, methods, and computer-readable storage media that support automated source code review using sentiment analysis with magnitude of entities. Known compliant and non-compliant source code may be used to generate dictionaries for evaluating lines of code using AI and ML techniques, such as by clustering data entities (lines of software code) and performing sentiment analysis on the data entities (lines of software code) which accounts for a magnitude of the data entities in the software code. The dictionaries enable automated review and correction of non-compliant code, such as vulnerable or insecure code, during the coding process. For example, sentiment analysis may be performed using the dictionaries on in-development code to determine a polarity and magnitude score for each line of code. The scores for each line can be compared to one or more conditions to determine a remediation action for individual lines of code.

Using complexity metrics to assess code generated using artificial intelligence includes generating, by an artificial intelligence (AI) language model, output source code based on input source code; identifying respective complexity scores for the input source code and the output source code using one or more complexity metrics; and generating, based on an evaluation of the respective complexity scores, a validation score for the output source code.

Methods, systems, and apparatus for automatic detection of software bugs are disclosed. An example apparatus includes a comparator to compare reference code to input code to detect a source code error in the input code; a graph generator to generate a graphical representation of the reference code or the input code, the graphical representation to identify non-overlapping code regions; and a root cause determiner to determine a root cause of the source code error in the input code, the root cause based on the non-overlapping code regions.

The systems and methods provide a model deployment criterion. The model deployment criterion indicates a difference in a value against which the proxy model may be measured to determine when, if ever, the proxy model should be deployed to replace the existing rule engine. The model deployment criterion may be keyed to the proxy model (e.g., based on a difference in its size, throughput speed, number of changes, etc.), the existing rule engine (e.g., based on a difference in its age, update occurrences to its rule base, etc.), and / or comparisons between models (e.g., based on differences in results, throughput speed, efficiency, etc.).

To support the evaluation of the impact of vulnerabilities in an information processing system composed of sub systems built in different environments on each sub system.SOLUTION: A vulnerability impact evaluation support device 40 comprises: a memory device that stores software component information, the software component information being information about software that constitutes each of a plurality of subsystems constructed in different environments that constitute an information processing system; and a control device that creates extended software component information including information about a second subsystem that is affected by a processing impact caused by a vulnerability in software of a first subsystem within the information processing system, identifies other subsystems that are affected by a processing impact caused by a vulnerability in software of a selected subsystem based on the extended software component information, and outputs information about the identified subsystems based on the software component information.SELECTED DRAWING: Figure 1

Disclosed herein are computer-implemented systems and methods for code value assessment. For example, in one aspect, the system comprises, an input module configured to receive program code submissions from developers, a processing unit equipped with Text-Based Models with Contextual Understanding (TBM-CUs) configured to evaluate the functional meaning, purpose, and value of submitted code segments and distinguish between code contributions from human programmers and machine learning systems, a visualization module configured to present the assessed value of the analyzed code over various time periods and dimensions, offering insights into trends, patterns, and comparative performance, a communication module configured to translate programming code meaning or function into plain language summaries for non-technical stakeholders, and an AI peer review module configured to automatically review, accept or reject code contributions.

Disclosed in the present application is a code generation method. The method comprises: a code development platform receiving input information from a user for a first code file in a project; acquiring in-file context and first cross-file context on the basis of a static structure of the project; acquiring second cross-file context on the basis of behavior characteristics of the user when developing the project; acquiring third cross-file context on the basis of the degree of evolution coupling between at least one second code file in a code warehouse of the project and the first code file; generating prompt information on the basis of the input information, the in-file context, the first cross-file context, the second cross-file context and the third cross-file context; inputting the prompt information into a code generation model for reasoning, so as to obtain at least one group of generated codes; and presenting to the user the at least one group of generated codes in parallel. The method takes multi-dimensional project-level context and a user input as inputs of a code generation model, thereby improving the capability of the code generation model using cross-file context during code generation, and improving the code generation performance.

The invention provides an intelligent analysis method, system, equipment and program product for automatic code review, which are applied to the field of computer software engineering and development tools, and the method comprises the following steps: obtaining code difference data, preprocessing to generate a semantic code unit, constructing a structured cue word and inputting the structured cue word into a large language model, according to the scheme, the problems that in existing code review, semantic understanding is insufficient, and efficiency is low can be solved, automatic risk identification and analysis of code changes are achieved, and review efficiency and accuracy are improved.

Systems are provided for generating, modifying and using SBOMs for facilitating risk assessment and threat mitigation for corresponding programs, and particularly for large programming builds. The creation and modification of the SBOMs includes processes for omitting declarations referenced in chunk SBOMs of program chunks incorporated into a final programming build associated with a build SBOM, but which are not actually utilized by the final programming build, as well as processes for adding new declarations for code segments that are not declared in the related chunk SBOMs, even though the code segments are utilized by the final programming build. Systems are also configured to use SBOMs in combination with configuration restriction records to assess and resolve threat events in a manner that can prevent unnecessary remedial actions for threat events that appear to be relevant to one or more files or dependencies incorporated into a program.

A retrieval-augmented neural transformer model with chunk cross-attention predicts a code review given a proposed source code change, represented as a code diff hunk, and a set of historical code review comments. The code diff hunk represents proposed edits to a source code snippet with its surrounding context that has not been changed. The historical code review comments are associated with code edits that are semantically similar to the proposed source code changes. The code diff hunk is partitioned into chunks which are used to find semantically similar historical code review comments. The set of historical code review comments is aggregated and used to guide the model in makings its predictions.