255 results about "Injection attacks" patented technology

A method and system for generating a privilege based segmented instruction prompt has been developed. Trusted instructions defining the trusted instructions as having a first privilege level, program instructions as having a second privilege level, and data instructions as having a third privilege level are received. The program instructions to implement tasks associated with the data instructions are received. The data instructions are received. The generated privilege based segmented instruction prompt includes the trusted instructions, the program instructions, and the data instructions. The privilege based segmented instruction prompt enables a generative LLM to determine whether the privilege based segmented instruction prompt is an instruction injection attack based on whether there is a conflict between the trusted instructions, the program instructions, and the data instructions in violation of the first, second, and third privilege levels.

A computing system receives a prompt to be provided as input to a large language model. The computing system generates generating an input string to the large language model by appending a plurality of contexts to the prompt. The plurality of contexts defines rules for the large language model to follow when generating the prompt. The plurality of contexts includes a negative context. Based on the prompt and the plurality of contexts, the computing system generates an attention matrix representing relationships between the prompt and the plurality of contexts. The computing system provides the attention matrix to a trained neural network to determine a likelihood that the prompt is malicious. Responsive to determining that the prompt is likely a malicious prompt, the computing system initiates a remedial action.

The embodiment of the invention discloses a prompt injection defense method and system, electronic equipment and a storage medium, and the method comprises the steps: carrying out the preliminary detection of an input text, and obtaining a preliminary detection result; performing semantic analysis on the input text to generate a semantic understanding analysis report; obtaining current operation parameters of the target large language model; according to the current operation parameters, obtaining a behavior pattern analysis result of the target large language model; obtaining a current defense strategy of the target large language model according to the preliminary detection result, the semantic comprehension analysis report and the behavior pattern analysis result; according to the method, the input text and the running state of the large language model are closely combined, so that the prompt injection attack suffered by the large model can be accurately detected, the large model can be efficiently prevented from being hostile attacked, and the corresponding defense strategy can be formulated in a complex attack scene; more effective defense is realized, and the robustness of the whole defense system is improved.

Systems and methods for detecting and mitigating prompt injection attacks on a generative LLM are disclosed. A deployment scenario is considered, in which the generative LLM supports a task automation function. Prompts are received and interpreted by the generative LLM, and outputs from the generative LLM are used to trigger automation actions. The prompts are constructed based on a combination of user input and external data and are, therefore, vulnerable to prompt injection attacks though manipulation of the external data. To mitigate this risk, a separate discriminative classification, decoupled from the generative LLM, engine is configured to identify malicious prompts, and filter out any malicious prompts before they reach the generative LLM.

The invention discloses a power system false data injection attack detection method and system. Measurement data of a power distribution system are acquired; constructing an attack sequence, and injecting the constructed attack sequence into the obtained measurement data to simulate a false data attack; constructing a false data injection attack detection model based on the expansion causal convolution and the recurrent neural network to analyze the state change of the power distribution system; and judging an attack behavior according to the analyzed state of the power distribution system. According to the method, time sequence data can be processed, the long-term dependency relationship and the complex mode can be captured, and the response capability to the complex attack mode can be improved, so that the false data injection attack can be effectively detected and prevented, and the safety and reliability of the power distribution system can be maintained.

This disclosure describes utilizing an attack defense system to improve the defense robustness of a targeted large generative model (LGM) by generating a set of variant prompt injection attacks that are successful against the targeted LGM, where the set of variants is based on a prompt injection attack (e.g., jailbreak) against the targeted LGM or another LGM. For example, the attack defense system utilizes a two-phase framework to generate variant prompt injection attacks and evaluate their attack effectiveness against a targeted LGM. The attack defense system achieves improved variant prompt injection attacks by repeating the two-phase framework and gaining insights from the effectiveness scores of previously generated variants. In addition to generating enhanced variants, the attack defense system generates diverse variants to safeguard the targeted LGM against a broader range of prompt injection attacks that employ more creative and complex styles.

The invention relates to a method for obtaining a hint injection attack test case for a large language model, which combines a conditional variation auto-encoder cVAE and a Markov chain, and obtains a large language model test case through data generation and context modeling, gradual exposure of malicious instructions and simulation of multiple rounds of dialogue attacks in reality. Realizing multiple rounds of dialogue attacks on the large language model, and challenging the defense capability of the large language model; the design scheme introduces a concealment technology, role play attack, state transition and other technologies, improves the complexity and concealment of attacks, has the core advantages of automation, higher concealment, wide coverage, batch testing and the like, can evaluate the security defense capability of the large language model more truly and comprehensively, and improves the security defense capability of the large language model. The defects of an existing defense mechanism are found, and research on multi-round prompt injection attacks and improvement of a security defense mechanism are promoted.

The invention relates to the field of artificial intelligence and natural language processing, in particular to a method, a model and equipment for identifying a prompt injection attack for a large language model. The method comprises the following steps: acquiring a cue word to be input into an LLM; performing semantic analysis on the cue word to obtain a semantic analysis result; performing prompt injection word detection on the prompt word to obtain a prompt injection word detection result; and according to a semantic analysis result and a prompt injection word detection result, analyzing whether the prompt word relates to a prompt injection attack. The invention provides a fusion recognition mechanism combining semantic analysis and prompt injection word detection, and the fusion recognition mechanism is specially used for recognizing the prompt injection attack aiming at the LLM, so that the defense capability for the LLM prompt injection attack is improved.

Disclosed is a training data generation system for generating training data used to train machine learning models to inspect GenAI traffic to identify security and privacy concerns related to GenAI use. The training data generation system is seeded with initial prompts. The initial prompts include benign prompts, prompt injection attacks, and uploaded files. Each initial prompt is submitted to multiple GenAI applications to obtain responses. The corresponding prompts and responses are stored in a training data repository. Variations of the initial prompts are generated using, for example, one of the GenAI applications. Each variation is submitted to each of the GenAI applications as well, and the corresponding prompts and responses are stored. Another machine learning model, regex patterns, a combination, or the like may be used to label the prompts and responses in the training data repository to generate a large training data set quickly and efficiently.

The embodiment of the invention relates to the field of artificial intelligence, and provides a model context protocol injection attack protection method and device based on dynamic semantic analysis, computer equipment and a storage medium, and the method comprises the steps: obtaining request data corresponding to a call request initiated by a user through a model context protocol, carrying out the preprocessing of the request data, obtaining the preprocessed request data; performing semantic vectorization on request text and context historical information in the request data through a lightweight bidirectional encoder representation model to output an initial risk score; correcting the initial risk score according to context historical information carried in a model context protocol to obtain a corrected final risk score; and performing hierarchical defense decision according to the final risk score, and determining risk grading information corresponding to each piece of request data so as to execute a protection action corresponding to each piece of risk grading information. By adopting the method, the accuracy of identifying the protocol injection attack can be improved.

A system and method for multiple fraud type detection includes anti-injection attack system that has a layered architectural approach that uses a includes combination of different specific models to detect the attacks in combination with image processing techniques, device signals and liveness checks to detect the variety of different types of fraud attacks or repeat fraud attacks. The anti-injection attack system applies the analysis of the tools used to create deepfake, face morph and face swap attacks to define the elements of its layered architecture that can these various types of attacks.

A computer-implemented method is provided that prevents prompt injection attacks against generative models. Input data is received, and a first prompt section is generated from the input data. First, second and third instructions are received, which respectively instruct the generative model to carry out a task based on the first prompt section, inform the generative model of a boundary of the first prompt section, and instruct the generative model to ignore any instructions in present in the first prompt section. A prompt for the generative model is generated from the first prompt section and the first instructions, second instructions and third instructions.

The invention discloses a multi-modal attack identification method fusing BMama and difference to guide trans-attention, which comprises the following steps: simulating a false data injection attack, a denial of service attack, an address resolution protocol spoofing attack and a domain name system spoofing attack, collecting physical layer sensor data and network layer flow data, and preprocessing multi-modal data; bMama is constructed to perform dynamic time modeling on multi-modal data, a graph neural network is combined to adversariate a variational auto-encoder, features of a power grid system topology and a communication topology structure are fused, and robustness of potential representation is enhanced through adversarial training; the method comprises the following steps of: guiding feature complementary fusion by using modal difference through a difference guide iteration cross-attention fusion mechanism, improving the capability of distinguishing complex attacks, finally carrying out attack detection and classification on fused modals, and executing end-to-end optimization according to a weighted combination of loss of each part. The method can effectively detect and classify the multi-modal attack in the smart power grid, and enhances the safety and reliability of a complex system.

The invention discloses a power network attack chain dynamic deduction and intelligent response process method, system and device based on deep reinforcement learning and a medium, and belongs to the technical field of network security and power system protection. Multi-modal data is aligned and normalized, an event view cache is constructed, and the generalization detection capability on process camouflage and memory injection attacks is improved through a federated learning collaborative detection mechanism; based on the event view cache and historical threat intelligence, generating a dynamic attack knowledge graph, constructing a deep reinforcement learning model taking the attack knowledge graph as an environment, calculating an attack influence index by using a Bayesian network, and generating a differentiated security response instruction; and realizing attack path backtracking and attack source positioning based on the attack knowledge graph. According to the method, multi-modal data fusion analysis and strategy adaptive updating are realized, and the attack chain identification accuracy and evidence chain construction integrity are remarkably improved.

Techniques for liveness detection using a motion, face, and context cues. The techniques can be implemented to prevent against successful presentation attacks, video injection attacks, and deepfake attacks. In some examples, the techniques encompass receiving a set of video frames from a personal computing device. A first liveness determination can be made using a motion-based model based on the received video frames. A second liveness determination can be made using a face-based model based on the received video frames. A third liveness determination can be made using a context-based model based on the received video frames. A final liveness determination can be made based on the first, second and third liveness determinations.

The invention provides a direct current micro-grid false data injection attack detection method based on deep learning, and aims to improve the safety and stability of a direct current micro-grid when the direct current micro-grid encounters hostile attacks. According to the method, a parallel double-branch model in which Transform and GRU are combined is adopted, the advantages of the Transform and the GRU are brought into full play, and efficient identification of the false data injection attack (FDIA) is achieved. Through multi-level feature fusion and a decision-making mechanism, the model can accurately identify various false data injection attacks in a complex attack scene, and relatively high detection accuracy is kept. Experimental results show that the method shows excellent performance in a direct current micro-grid environment, has a wide application prospect, and particularly has a remarkable application value in engineering practice.

The invention discloses a false data injection attack detection method and system based on elastic energy prediction. The method comprises the steps that a distributed node network is constructed, nodes are deployed to collect real-time energy output data, each node generates a state estimation value according to a Kalman consensus filtering model, an innovation vector is calculated, and a monitoring threshold is adjusted by combining an association weight of a network topology; inputting a state estimation value, an innovation vector and real-time energy output data, calculating an accumulated deviation trend by using a time sequence analysis method, identifying a slow penetration attack in combination with a sliding window, and judging whether a false data injection attack exists or not; when it is judged that the false data injection attack exists, operation parameters of the energy equipment are adjusted, attacked nodes are isolated, non-attacked nodes are redistributed, and state change information is recorded; and according to the attack frequency, the node association weight and the operation cost, the detection parameters are adjusted in the dual-time scale, the resource allocation weight is optimized based on the feedback data, and the detection probability, the response time and the resource allocation strategy are dynamically updated.

In an embodiment, a method includes receiving a prompt provided to a large language model (LLM), generating a semantic fingerprint for the prompt based on semantic and syntactic features associated with the prompt, generating a vector representation incorporating the semantic fingerprint for the prompt, calculating semantic distances between the vector representation and multiple vector representations associated with multiple malicious intents, determining an intent associated with the prompt based on the semantic distances, and determining a defense action on the prompt based on the intent and multiple policies to mitigate a security risk associated with the prompt.

The embodiment of the invention provides a coupling network asynchronous dynamic intermittent safety control method and system, and the method comprises the steps: obtaining multiple attack signals comprising an injection attack signal and a replacement attack signal after building a dynamic model of a following network, a target network and a state error variable; and setting an intermittent controller according to the dynamic network model and the multiple attack signals, and setting a dynamic mechanism based on an exponential function to convert a state error variable into an interval control function. Wherein the interval control function is used for realizing security mean square synchronization control between the following network model and the target network model. According to the method, the asynchronous anti-attack intermittent dynamic cooperative control strategy oriented to the complex coupled network can be constructed based on an average intermittent control rate and dynamic event trigger threshold coupling method by utilizing a node self-adaptive dual spoofing attack probability model, and the problems of difficulty in multi-attack modeling and insufficient control strategy collaboration can be relieved.

A malicious instructions detection model (“detector”) intercepts augmented prompts destined for a large language model (“LLM”). Each augmented prompt was augmented with data from potentially compromised data sources susceptible to indirect prompt injection attacks. The detector tokenizes / preprocesses sentences in the augmented prompts and is invoked on the tokenized / preprocessed sentences to obtain confidence scores that each sentence comprises malicious instructions. If one or more of the confidence scores is above a threshold, the detector blocks the augmented prompt and generates an alert indicating the blocking and the malicious instructions. Otherwise, the detector communicates the augmented prompt to its intended LLM.

Prompt injection attack detection in responses from large language models includes receiving, at a server from a user device, a user prompt segment to an LLM, generating a LLM prompt from the user prompt segment, sending the LLM prompt to the LLM, and receiving a response from the LLM. Prompt injection attack detection further includes comparing the response to a structured data schema for the response to validate the response, and sending, responsive to validating the response, the response to the user device.

One commonality among most vehicular security attacks reported to date is that they ultimately require write access to the CAN bus. In order to cause targeted and intentional changes in the vehicle behavior, malicious CAN injection attacks require knowledge of the CAN message format. However, since this format is proprietary to OEMs and can differ even among different models of a single make of vehicle, one must manually reverse-engineer the CAN message format of each vehicle they target. To mitigate this difficulty, an automated CAN message translator is presented.

The invention provides a cue word injection protection method and device, equipment and a storage medium, and the method comprises the steps: obtaining input information of a target AI application, detecting the input information, determining whether the input information accords with an input protection strategy of the target AI application or not, and obtaining the input protection strategy based on the configuration information of the target AI application through learning, and determining whether the input information has the risk of cue word injection, and if the input information of the target AI application conforms to the input protection strategy, processing the input information by using the large model of the target AI application to obtain an output result. By the adoption of the technical scheme, after the input information of the target AI application is obtained, the input information is detected through the input protection strategy obtained through learning based on the configuration information of the target AI application so as to determine whether the input information has the risk of cue word injection or not, and therefore cue word injection attacks of the target AI application are effectively prevented.

Systems and methods for ransomware protection in advanced injection-based attacks. Events from a driver are analyzed to identify a potentially malicious actor. A confidence level is calculated for the potentially malicious actor identification to weigh the probability that the actor is malware or a source of malware. Behavior associated with the potentially malicious actor can be collected, if it is likely that the potentially malicious actor is associated with malware, such as if the confidence level is over a predetermined threshold. Subsequently, one or more virtual honeypots are generated for the suspicious processes and the response to the virtual honeypots is included in anti-ransomware heuristic analysis.

The invention discloses a false data injection attack detection method based on federal learning and comparative learning, and relates to the technical field of power system security, and the method comprises the steps: collecting voltage, phase, frequency and equipment state power data from a power station, carrying out the denoising through employing a wavelet transformation method, filling a missing value through employing KNN interpolation, converting the data into a JSON format, and carrying out the detection of a false data injection attack. Generating a hash value by using SHA-256, and uploading the data in the JSON format and the hash value to a block chain; according to the method, a false data injection attack detection method is combined with federal learning, each power station can locally train model parameters, so that uploading of original data is avoided, the risk of data leakage is reduced, the model parameters and power data are managed through the block chain technology, the integrity and security of the data are ensured, and the method is suitable for popularization and application. Therefore, the data reliability and the safety protection capability of the power system are improved.

A system, a method, and a computer program product for identification of command injection attacks. The system comprises processors, devices connected to a network, a memory, and an execution platform connected to the devices via the network and capable of executing executable products of execution commands provided thereto by the devices. At least one of the processors is configured to analyze execution commands provided to the execution platform to identify input provisioning or execution events, and determine whether they correlate to the suspicious record event, to perform a remedial action prior to attempting to execute them. When determining that the input includes a command separator and an executable product, the processor records a suspicious event. In response to identifying a potential execution event, determine that an execution command configured to be executed thereby correlates to the suspicious event, and flag the execution command as a command injection attack.

The invention relates to the field of resistance of a micro-grid to a false data injection attack, and particularly discloses a micro-grid control method for resisting the false data injection attack, so as to quickly improve the influence caused by the false data injection attack. Due to the fact that the fault-tolerant rate of switching control is low, a self-adaptive control method based on frequency-voltage errors is combined, recovery of frequency and voltage operation states and adjustment of compensation accuracy are achieved, the frequency and voltage operation states and the self-adaptive control method are combined for use, and a dual-safety control framework with attack and fault defense capacity is established. Compared with a traditional switching control method, the method can keep the running state stable when the micro-grid is attacked by false data injection. According to the mechanism, the stability and the function of the system are maintained by dynamically responding to the existence of false data, the micro-grid can be ensured to continuously, safely and effectively run even if the micro-grid is in the face of network physical threats, and reasonable distribution and stable running of the power of the micro-grid are realized.

The invention discloses a false data injection attack detection method for an electric power information physical system, relates to the technical field of attack detection, and solves the problem that in the prior art, only the damage of FDIA to a measurement data time mode is considered, and the spatial correlation between measurement data is affected even if the FDIA is not considered. According to the method, an FDIA detection model structure based on correlation difference is designed, and the attention action range is constrained by embedding position information and introducing a correction factor. Besides, in combination with fine granularity and multi-scale characteristics of a measurement data sequence, topological correlation is introduced, correlation differences are defined, a correlation difference-based antagonism discriminant criterion reasoning method is designed, and the distinguishability of normal and attack measurement data is amplified through adversarial training, so that a discriminant criterion is obtained. Complete embodiments show that compared with an existing detection model, the provided model has higher detection accuracy and robustness, and is excellent in performance when facing injection attacks with different amplitudes.

The invention discloses an SQL injection detection method and device, equipment and a storage medium, and relates to the technical field of safety protection, and the method comprises the steps: obtaining an initial SQL statement input by a target user through a target Web application, and carrying out the preprocessing of the initial SQL statement, so as to obtain a corresponding target SQL statement; generating a corresponding token sequence based on the target SQL statement, and constructing a target abstract syntax tree corresponding to the target SQL statement; wherein the token sequence is a sequence generated based on each SQL element in the target SQL statement; and extracting a target feature corresponding to the target SQL statement based on the token sequence and the target abstract syntax tree, and detecting whether the target SQL statement has an injection attack behavior based on the target feature by using a pre-trained target graph neural network model. According to the method, high-accuracy, high-adaptability and low-delay SQL injection real-time detection can be realized.

The invention relates to the field of power grids, in particular to a safe constant-power control method for a micro-grid under false information injection attack. The method comprises the following steps: firstly, establishing a micro-grid distributed power supply model, and establishing a dynamic model for describing a distributed power supply inverter in a constant power control mode according to the power supply model; and then, analyzing false information injection attacks, modeling damage of the false information injection attacks to the micro-grid distributed power supply model, and designing an extended state observer to observe damaged information. Finally, designing a sliding mode controller and setting controller parameters; and enabling the micro-grid distributed power supply to stably track the reference power of the energy management system based on the controller. According to the invention, by providing an innovative false information injection attack protection scheme, the constant power control of the micro-grid is optimized, the safety and stability of the system are remarkably improved, and the method is of great significance to the construction, operation and maintenance of an intelligent power grid.