8229 results about "Contextual information" patented technology

In addition to an original prompt that is manually provided by a user, contextual information is sent to a generative AI to elicit a higher quality response. Sensors collect audio, video, physiological, cognitive, environmental, and digital data from the user. Machine-learning models evaluate the sensor data to infer the emotional state of the user. The emotional state is used to augment the original prompt with contextual information. The augmented prompt is fed into the generative AI to make it context-aware. Accordingly, the generative AI can automatically pick up on non-verbal cues that the user did not manually articulate in the original prompt. Just as a human-to-human conversation involves a combination of verbal and non-verbal communications, the present concepts enable the generative AI to also leverage non-verbal communication when interacting with human users.

The invention discloses a multi-round knowledge-guided question-answering method and system fusing a large language model and a knowledge graph. The method comprises the following steps: S1, constructing the knowledge graph; s2, performing retrieval and clarification; s3, extracting labels and classifying questions; s4, performing scene guidance and dynamic retrieval; and S5, answer generation and formatting output. The method aims at solving the fuzzy problem in complex policy and regulation questions and answers, and the accuracy of user demand analysis and the comprehensiveness of answers are improved. According to the method, a knowledge graph is taken as a core, and multi-path semantic analysis and problem guidance capabilities are provided by constructing a hierarchical structure covering first-level items, second-level items, scene categories and keyword nodes. In combination with strong semantic comprehension and generation capabilities of the pre-trained large language model, the system can dynamically track context information in user input, iteratively access related nodes along different paths of the knowledge graph, and gradually clarify user intentions.

A video localization system localizes actions in videos based on a classification model and an actionness model. The classification model is trained to make predictions of which segments of a video depict an action and to classify the actions in the segments. The actionness model predicts whether any action is occurring in each segment, rather than predicting a particular type of action. This reduces the likelihood that the video localization system over-relies on contextual information in localizing actions in video. Furthermore, the classification model and the actionness model are trained based on weakly-labeled data, thereby reducing the cost and time required to generate training data for the video localization system.

There are disclosed herein systems and methods for human agency support and facilitation through an integrated use of context information, historical work product, biosensors, explicit user input and a generative AI or generalist agent. The system comprises input means, tokenization, a generative AI or generalist agent and an output stage capable of enacting agency on a user's behalf using output tokens from the language model.

The invention provides a unit test case generation system based on a large language model, and the system comprises a function dependency analysis engine module which is used for preprocessing a target project, extracting a function dependency relationship, and generating an abstract syntax tree and a source code file; the large model module is used for automatically generating a test case through the code context information and the optimized cue word; and the verification and optimization module is used for verifying whether the test cases can be successfully executed or not by compiling and running the test cases, marking part of the test cases needing to be further processed, automatically analyzing error reasons, optimizing cue words and realizing automatic repair of the part of the test cases. According to the unit test case generation system based on the large language model, the function dependency analysis and the large language model are combined, the high-quality test case can be automatically generated, dependence on manpower or existing test cases is not needed, manual intervention is reduced, and the test efficiency and comprehensiveness are improved.

The disclosure presents a multi-agent AI system utilizing specialized Large Language Models (LLMs) to automate and enhance software development workflows. This system integrates a memory-augmented generative pre-trained transformer (MemGPT) agent for dynamic context management, a Critic Agent for semi-adversarial quality feedback, and other specialized agents for task delegation and execution. The MemGPT agent interacts with an embedding storage to manage extended contextual information, enabling the system to handle complex software projects with enhanced accuracy and efficiency. This innovative approach significantly reduces manual intervention, streamlines the development process, and improves software quality, offering a robust solution to the challenges of modern software development environments.

The invention discloses an unmanned aerial vehicle autonomous routing inspection conductor detection method and system based on Bezier curve modeling. The method comprises the steps that a binocular image sequence, GPS positioning and IMU attitude data are collected through an unmanned aerial vehicle, synchronous alignment processing is carried out on multi-source data, a scene dynamic evaluation value is calculated, adaptive image enhancement is executed, and space-time features are extracted and fused. Constructing a multi-scale feature pyramid, extracting wire topological features, and generating enhanced features in combination with environment context information; and generating a control point candidate set based on the enhanced features, optimizing Bezier curve parameters, and performing time sequence consistency optimization. According to the invention, high-precision lead detection and robust tracking in a complex scene are realized, and the reliability of autonomous inspection of the unmanned aerial vehicle is improved; the key technical problems of scale change, feature matching, dynamic modeling, data fusion, parameter optimization and the like in the wire detection process can be solved.

A video localization system localizes actions in videos based on a classification model and an actionness model. The classification model is trained to make predictions of which segments of a video depict an action and to classify the actions in the segments. The actionness model predicts whether any action is occurring in each segment, rather than predicting a particular type of action. This reduces the likelihood that the video localization system over-relies on contextual information in localizing actions in video. Furthermore, the classification model and the actionness model are trained based on weakly-labeled data, thereby reducing the cost and time required to generate training data for the video localization system.

An artificial intelligence system that conducts dialogs with one or more participants to achieve an educational outcome, such as teaching material with a Socratic question-and-answer method, reviewing material to reinforce ideas or to prepare a participant for future tests or events, or evaluating a participant's knowledge or communication skills. The system may use an artificial intelligence engine that can understand and generate natural language, such as a large-language model like ChatGPT. Text-to-speech and speech-to-text converters may be coupled to the AI engine to enable the system to communicate directly with participants using spoken language. The system may provide an interface for entry of contextual information for a dialog, such as background information on topics for discussion. It may provide an interface for moderation of a dialog, for example by a teacher, lawyer, thesis advisor, etc. System may evaluate the performance of the participants at the end of a dialog.

An example operation may include one or more of receiving context of a user during an inquiry of a feature via a software application, executing a waiting period via the software application, during the waiting period, selecting an animation to display via the software application based on the context of the user and the feature inquiry wherein the animation provides contextual data associated with the feature, wherein the contextual data is based on a determined need of the user, displaying the animation via the software application during the waiting period, and determining if the user has accepted the feature via the software application. At least one portion of the example operation: integrates with an artificial intelligence (AI) chatbot, interacts with the AI chatbot, is performed by the AI chatbot, and / or is associated with an AI model.

One or more data streams may be used for controlling multi-system interaction. For example, a data stream may be received, and a surgical option associated with a surgical instrument may be selected based on the data stream. A control signal associated with the surgical instrument may be generated based on the selected surgical option. A surgical device may receive an external data stream from a source external to the surgical system. The device may derive, based at least on the external data stream, decision contextual information. The device may select a surgical option associated with a surgical instrument based on the decision context information. The device may generate a visual indication of the decision context information associated with selecting the surgical option. The device may generate a control signal associated with the surgical instrument based on the selected surgical option.

The invention provides an intelligent vulnerability mining platform construction method and system based on a large model. The intelligent vulnerability mining platform systematically identifies and analyzes potential security risks, collects and identifies code snippets with the security risks, arranges the code snippets into risk code paragraphs, identifies target code paragraphs, determines known vulnerabilities, generates context information, captures key events in actual operation, and records real execution paths and state changes. The method comprises the steps of generating a dynamic execution track, simulating different paths, generating an attack vector path, predicting unknown vulnerabilities and credibility scores of the unknown vulnerabilities, testing prediction results of high-credibility scores, confirming and generating real vulnerability information, recording the information to a vulnerability knowledge base, and generating a security report containing vulnerability description, influence ranges, risk levels and repair suggestions. According to the technical scheme provided by the embodiment of the invention, the detection accuracy and efficiency of the security vulnerabilities in the software system are improved.

An Applicant Assistant System may receive, from a user device, a user input indicating a query or task associated with information displayed in a user interface. The device may determine one or more components associated with the user interface and access component metadata of the determined one or more components, the component metadata for each of the one or more components indicating one or more of a fact, a data link, or an action. A prompt comprising at least some of the component metadata, at least some context information, and an indication of one or more available response elements may be provided to a large language model (LLM). The LLM may response with one or more response elements that may be processed by the System, such as to cause updates to the user interface on the user device.

The invention discloses an intelligent question answering system construction method and system based on an LLM large language model, and the method comprises the steps: carrying out the corpus aggregation from a plurality of heterogeneous data sources, and dynamically capturing the text data related to a target domain; preliminarily screening the text data, and based on semantic similarity and a text quality scoring rule, removing redundant and low-quality text data or text data irrelevant to a target field; performing diversity analysis on the text data, and generating diversified text data with high similarity with real data through an adversarial generation technology; performing multi-level semantic annotation on the text data, and generating a training sample by analyzing context information in the annotated corpus; and converting the training sample into a standard format sample, and training an LLM large language model by using the standard format sample to serve as an intelligent question-answering system of a target domain. By utilizing the embodiment of the invention, the intelligent level of the intelligent question-answering system in various application scenes can be effectively improved, and further development of the intelligent question-answering technology is promoted.

Systems and methods are described herein for detecting and reducing hallucinations and improving the reliability of an LLM-based QA system. Particularly, the disclosure provides a set of hallucination detection and handling approaches that address different types of hallucinations of the QA system. The hallucination detection approaches described herein include comparing a natural language answer with context information by way of sentence similarity estimation and keyword matching. The hallucination handling approaches described herein include removing hallucinated sentences from the natural language answer or regenerating the natural language answer using better context information, depending on a level of hallucination detected in the natural language answer. A hybrid framework is also provided that systematically combines the hallucination detection approaches and hallucination handling approaches into one system to achieve an optimal hallucination-reduction performance for the QA system.

Automatically investigating security incidents and generating security incident reports using a Large Language Model (LLM). A computerized system receives an incoming Security Alert Message pertaining to a possible security-related incident. The system automatically feeds into the LLM at least: the content of the Security Alert Message; the metadata of the Security Alert Message; context information describing a security domain; and organization context information pertaining to users and machines of that organization. The system automatically prompts the LLM to automatically investigate the Security Alert Message and to automatically generate a detailed Incident Report pertaining to the Security Alert Message.

The embodiment of the invention provides a method for constructing a large language model knowledge management system. The method comprises a knowledge construction step, a knowledge retrieval step and an answer production step. According to the scheme, the artificial intelligence large language model technology can be utilized. External knowledge is obtained from multiple data sources, a search technology and a cue word function of a large language model are combined, RAG proposes a problem to the large model, knowledge obtained by searching the problem in the multiple data sources is used as a background context, and information of the problem and the background context is integrated into cue words of the large language model. And therefore, the large language model can make a final accurate answer.

The invention provides a service data security protection method and system for digital enterprise management, and the method comprises the steps: obtaining an access request sequence initiated by a target user at a service operation terminal, generating a dynamic access control strategy vector according to a historical behavior track associated with an access operation identifier, and carrying out the dynamic access control strategy vector; analyzing the dynamic access control strategy vector through a strategy decoder, and generating a real-time access permission instruction; based on the real-time access permission instruction, performing homomorphic encryption mapping on a sensitive data segment in the request context information to generate a ciphertext transmission channel, and performing security parameter synchronization on the ciphertext transmission channel and the cross-department conjoint analysis model; and calling a federated learning framework to carry out multi-modal feature fusion on the real-time operation flow of the service operation terminal, generating an abnormal operation confidence score, triggering a cross-level interception protocol when the abnormal operation confidence score exceeds a dynamic threshold, and rolling back the current session state to a security baseline version. According to the invention, the accuracy and response timeliness of anomaly detection can be improved.

Methods, systems, and computer storage media for providing security posture management using an artificial intelligence security engine in a security management system. Security posture management supports security management of a computing environment based on contextual information associated with artificial-intelligence-supported applications. The security management system provides an artificial intelligence security graph associated with the artificial-intelligence-supported applications. The artificial intelligence engine uses the artificial intelligence security graph to correlate artificial intelligence attack monitoring data with operational data of the artificial-intelligence-supported applications. In operation, artificial intelligence attack monitoring data is accessed. An artificial intelligence security graph associated with a plurality of artificial-intelligence-supported applications is accessed. Based on the artificial intelligence attack monitoring data and the artificial intelligence security graph, operational data of an artificial-intelligence-supported application is accessed. The artificial intelligence attack monitoring data and the operational data are analyzed to identify an artificial intelligence security alert. The artificial intelligence security alert is communicated.

The invention relates to the technical field of medical image diagnosis, and discloses a medical image automatic diagnosis method and system based on deep learning. According to the method, multi-modal medical image data of a target object is acquired and standardized, a two-channel convolutional neural network is utilized to extract features, the features are processed through cross-modal feature fusion, adaptive attention weight distribution and other technologies, a cascaded two-way long-short-term memory network is adopted for modeling, abnormity is detected based on a probabilistic graph model, and the target object is identified. And the nidus is segmented by a multi-scale context information enhancement module, and finally a diagnosis suggestion is generated by a diagnosis inference engine driven by a knowledge graph. The system comprises a multi-modal image acquisition interface module, a distributed feature calculation cluster, a visual interaction terminal and a security audit module. According to the method, the accuracy and efficiency of medical image diagnosis can be improved, comprehensive diagnosis reference is provided for doctors, and meanwhile data safety and privacy are guaranteed.

Techniques for generating a prompt for a language model to determine an action responsive to a user input, are described. In some embodiments, the system receives a user input, determines one or more application programming interfaces (APIs) configured to perform actions that are relevant to the user input and exemplars representing examples of using the APIs with respect to user inputs similar to the current user input. The system further determines device states of devices that are determined to be related to the user input and also determines other contextual information (e.g., weather information, time of day, geographic location, etc.). The system generates a prompt including the user input, the APIs, the exemplars, the device states, and the other contextual information. A language model processes the prompt to determine an action responsive to the user input and the system causes performance of the action.

A method for electronic processing of user queries maintaining factual consistency during processing includes receiving a user query, executing a hybrid retrieval operation, generating a context information space that includes a set of paragraph output from the paragraph retrieval operation, a set of triplet output from the triplet retrieval operation, and a set of graphs output from the graph retrieval operation. Furthermore, generating a first prompt instruction to generate an intermediate rationale as explanation output and performing an automatic fact-checking operation to verify the explanation output and re-feeding the user query along with the generated explanation output to the generative language model to derive an answer output that is succinct in one or more language parameters as compared to the generated explanation output. The answer output includes a verified and evidence-supported answer and at least one fact reference from first set of factual information with reduced hallucinations and factual inconsistencies.

A three-dimensional point cloud semantic segmentation method based on graph convolution and a grouping vector attention mechanism adopts a network structure of a U-Net style, feature extraction and propagation are performed on point cloud through multi-level feature coding and decoding, each level firstly centralizes and standardizes local neighborhood features through a geometric affine module, and then the local neighborhood features are subjected to feature extraction and propagation; the capturing capability of the model on the diversity of the local region is enhanced; secondly, constructing a local neighborhood graph, and designing an asymmetric edge feature learning function to extract local topological information; deep edge features are further extracted in combination with a residual network; and finally, selectively fusing local features and global context information under the condition of low parameter quantity by using a grouping vector attention mechanism, and performing cross-level feature interpolation up-sampling to an original scale to complete point cloud segmentation. The method can significantly improve the point cloud segmentation precision, and is suitable for the perception of a mobile robot and other devices carrying a three-dimensional sensor on a complex scene.

Conducting user research with human users is time consuming and expensive. Provided with quality training data that represents human users having different personae, models can be trained to offer responses that can emulate different human users. The models may offer synthetic users that can extract information from and respond to inputs to the models. The inputs can include prompts and responses can include answers to the prompts. In some cases, data about human users can be used to build different synthetic user memories, which may be used to generate different prompt chains corresponding to different users. The prompt chain can be used to prompt a model to respond based on the contextual information in the synthetic user memory.

The present disclosure relates to systems, methods, and non-transitory computer-readable media that edit digital images using combinations of speech input and gesture interactions. For instance, in some embodiments, the disclosed systems receive speech input from a client device displaying a digital image within a graphical user interface, the digital image portraying an object. Additionally, the disclosed systems detect, via the graphical user interface, one or more gesture interactions with respect to the object of the digital image. Based on the speech input, the disclosed systems determine an edit for the object of the digital image indicated by the one or more gesture interactions. Further, the disclosed systems modify the object within the digital image using the edit indicated by the one or more gesture interactions.

The invention discloses an advertisement marketing recommendation method based on deep reinforcement learning, and relates to the technical field of computer data processing, and the method comprises the steps: integrating and processing user behavior data, context information and advertisement features, and forming a multi-modal feature vector; performing feature fusion on the multi-modal feature vector to obtain a fused user comprehensive feature vector; dynamically updating the user portrait by using an online learning algorithm according to the comprehensive feature vector of the user; according to the user portrait and the context information, designing an intelligent agent based on deep reinforcement learning, and formulating an advertisement recommendation strategy; collecting new data generated when the user interacts with the recommended advertisement, and optimizing an advertisement recommendation strategy; by dynamically updating the user portrait and optimizing the advertisement recommendation strategy, the click rate and the conversion rate of the advertisement are improved, a higher rate of return on investment is provided for an advertiser, and the method has advantages in the market with intense competition.

Approaches presented herein are directed to generating synthetic images with one or more augmentations realistically added to objects in the images, while ensuring the preservation and integrity of semantic or contextual information within the image. A synthetic augmentation system may identify and extract foreground image data (e.g., text), and a version of the image with the foreground image data removed can be processed by a generative diffusion model. One or more inputs can be provided to specify aspects such as a type or strength of augmentation to be performed. After an augmented image is generated using the generative diffusion model, the previously removed text can be blended back into the image. A synthetic augmentation system may use one or more blending weights for the text, such as a defect blending weight and a letter blending weight. The final result is a synthetic image with added realistic augmentations that preserves the semantic content.

The invention discloses a Transform-CNN medical image segmentation method and system based on multi-scale fusion semantic enhancement, and relates to the technical field of image segmentation, and the method comprises the steps: collecting medical image data, and constructing a medical image data set; constructing a medical image segmentation network model; training the medical image segmentation network model through the medical image data set; and inputting real-time acquired data into the trained medical image segmentation network model to obtain a medical image segmentation result. According to the invention, double encoders, LGDA modules and the like are adopted to capture multi-scale global features of kidney tumors and enhance representation, and the LGDA module is used for adapting to size and form changes of the kidney tumors; the MLCF module is used for supplementing information of the main encoder; the PSE module captures multi-scale global semantic information and integrates local context information, local features are fused through the SAM module, and kidney tumor positioning in an endoscope image is achieved.

The invention relates to a knowledge base question answering method and device and a computer readable storage medium, and belongs to the technical field of artificial intelligence. A query question input by a user is received; the query problem is analyzed, and keywords in the query problem are extracted; retrieving slice data matched with the query problem from a retrieval enhancement generation system on the basis of the text correlation between the keyword and the slice data; wherein a plurality of slice data are pre-stored in the retrieval enhancement generation system, the slice data comprise text slices and image-text slices, and the image-text slices comprise storage paths of images and image descriptions with text context information of the images; and inputting the retrieved slice data into a multi-modal large model, generating an answer related to the query question and an image matched with the answer, and outputting the question answer with the image. According to the method, the capability of an original retrieval enhancement generation system is remarkably improved, and the information requirement of a user in an image-text environment is more comprehensively met.

The invention discloses a cockpit active recommendation system and method based on a knowledge graph and semantic reasoning, and relates to the technical field of intelligent cockpits. The system receives natural language voice input of a user, executes voice recognition and semantic analysis, extracts user intention, keywords and slot entities, generates structured semantic information, constructs or calls a knowledge graph structure with semantic relation edges in combination with environment context information, and obtains the knowledge graph structure with the semantic relation edges. Semantic path reasoning is carried out based on the path dependence weight and the semantic similarity, a semantic edge label guided graph attention mechanism is introduced to calculate a path consistency score, a candidate recommendation set is generated, the semantic fitting degree and the path score are fused to sort and output recommendation content, and the graph edge weight and the user portrait are updated based on user feedback. According to the method, semantic understanding precision, recommendation path interpretability and system adaptive capacity are improved, and the method is suitable for personalized voice recommendation, man-machine interaction and scene linkage control tasks in an intelligent cockpit.