8016 results about "Speech model" patented technology

Embodiments described herein relate to systems and methods for automatically generating content, generating API requests and / or request bodies, structuring user-generated content, and / or generating structured content in collaboration platforms, such as documentation systems, issue tracking systems, project management platforms, and other platforms. The systems and methods described use a network architecture that includes a prompt generation service and a set of one or more purpose-configured large language model instances (LLMs) and / or other trained classifiers or natural language processors used to provide generative responses for content collaboration platforms.

The invention discloses a big language model reasoning optimization method and system based on dynamic video memory compression and memory isomerism, and intelligent management of video memory resources is realized by integrating a dynamic compression strategy of KV Cache and a memory parallel architecture. The method comprises the following steps: 1) analyzing the spatial-temporal characteristics of the KV Cache in real time, adaptively selecting a quantization compression algorithm, a rarefaction algorithm or a low-rank decomposition algorithm, performing hierarchical storage based on attention head importance scores, keeping high precision of a core head, and implementing low-bit quantization on a secondary head; (2) the compressed inactive data are divided into a plurality of data blocks to be stored in a system memory, a parallel data channel group is established according to the number of physical channels, the compressed blocks are concurrently read through multiple channels during loading, and parallel decompression of a sparse matrix is accelerated through a GPU tensor core; and 3) constructing a KV Cache multiplexing mechanism and a parallel channel, and parallelizing a compression / decompression process and model calculation by adopting a hardware acceleration compression and asynchronous pipeline mechanism.

The invention belongs to the technical field of artificial intelligence and big data, and discloses a customer data processing and insight system based on a big language model. The system is composed of a multi-source data access module, a data preprocessing and label fusion module, a large language model semantic understanding module, a knowledge enhancement and semantic linkage module, an insight generation and visualization module, an intelligent strategy output module and a feedback learning and self-optimization module. According to the method, multi-source heterogeneous data such as texts, voices and structured behaviors are integrated, and the deep semantic analysis capability of a large language model is combined, so that global modeling of customer behaviors and intentions is realized; a multi-modal synchronous acquisition and standardization mechanism eliminates data format barriers, and a dynamic label mechanism adapts to context changes, so that the system can capture deep semantic association in customer expression, and compared with a traditional keyword matching method, the semantic understanding accuracy is improved by more than 40%, and a more complete data base is provided for insight generation.

Large language models (LLMs) are versatile in responding to user questions on a wide variety of topics. However, LLMs suffer from several drawbacks, such as hallucinations, incomplete information, and inability to cite original sources of information. Disclosed herein are systems and methods for using an LLM in a restricted manner to respond to queries regarding document corpora, e.g., documents related to a set of products, such that the impact of these drawbacks is minimized. Information retrieval is coupled with LLMs to build a question and answer (Q&A) system on the text corpora. Complex retrieved information, incorporating human feedback, and recommendations in the Q&A system are provided.

Disclosed herein are systems and methods for graph-based dynamic information retrieval and synthesis, particularly for enhancing the response generation of chatbot applications using large language models (LLMs). The methods involve receiving a user query, generating a query embedding, and accessing a knowledge graph comprising nodes representing documents with associated document embeddings. A set of documents is retrieved based on similarity scores, and a distance matrix is constructed to calculate shortest-path distances between nodes. Documents are clustered to identify a largest cluster from which content is retrieved to formulate a response. The disclosed embodiments improve upon retrieval augmented generation (RAG) by leveraging the hierarchical relationships of a knowledge graph and node interconnectedness to provide contextually coherent information and mitigate the inclusion of information from irrelevant or superficially related documents in LLM responses.

The invention relates to the technical field of voice semantics, can be applied to business scenes of financial science and technology, medical health, poster design and the like, and discloses a visual sense generation method and device based on semantic association modeling, equipment and a medium. Generating a demand text containing theme and style parameters; semantic features in the demand text are extracted, semantic association weights are constructed, and element layout coordinates are optimized in combination with spatial distribution constraints; and encoding the layout information into a control matrix, fusing the control matrix with the initial noise, adjusting a noise reduction process through an encoding and decoding network, and generating target visual content highly matched with the semantic meaning of the user instruction. According to the method, the layout optimization function is constructed, the diffusion model is guided to focus the semantic salient region in space, language model output and the visual generation process are closely combined, structured response and space mapping of user semantic requirements are achieved, and the expression consistency and personalized adaptation capacity of visual content generation are improved.

The invention relates to the technical field of artificial intelligence, and discloses a bidding document generation method based on retrieval enhancement generation and a large language model, and the method comprises the steps: analyzing technical parameters, legal terms and score weights in a bidding demand document; retrieving matched historical bidding document fragments and technical specifications from the industry knowledge base, and generating a retrieval enhanced data set; fusing the data through a dynamic weight distribution algorithm and generating an initial bidding document draft; checking conflict terms based on the legal semantic knowledge graph and marking correction suggestions; and optimizing the bidding document structure and the key content according to the score weight. According to the method, an online learning mechanism driven by sentence vector matching, timeliness weight calculation and user feedback is adopted, so that the problems of inaccurate technical parameter extraction, low legal conflict detection efficiency and non-optimized scoring rules in the bidding document generation process are solved.

The invention discloses an archive knowledge base construction and retrieval method and system based on multi-modal data fusion. The method comprises the steps that heterogeneous archive data are cleaned, image features are extracted through CNN, text features are extracted through Transform, audio is converted into text and then subjected to similarity, a unified feature vector is generated, and metadata is constructed according to archive code association; creating a graph database instance, defining nodes and relationship types, importing entities and relationships, and storing feature vectors and metadata; the features are mapped to a high-dimensional shared semantic space, positive and negative sample pairs are constructed to update embedded layer parameters, self-attention is used in modalities, a shared attention mechanism is used between modalities, weights are adjusted according to archive features, and unified knowledge representation is generated; segmenting the steering quantity of the multi-modal data, storing the steering quantity into a database, and adopting hierarchical indexing and optimizing as required; related document fragments are retrieved through RAG technology vectors, answers are generated with the help of a large language model, and session feedback is provided. The file retrieval efficiency and accuracy are improved.

The invention discloses a power grid equipment intelligent operation and maintenance method based on a large language model and a knowledge graph, and relates to the technical field of intelligent power grid operation and maintenance, and the method comprises the steps: carrying out the operation and maintenance of power grid equipment through a power grid operation and maintenance knowledge graph constructed through a large language model and a knowledge federation technology, the power grid equipment operation and maintenance comprises one or more of health state evaluation, fault risk prediction and early warning, intelligent operation and maintenance strategy generation and health degree dialogue query of the power grid equipment. According to the invention, a power grid operation and maintenance mode can be effectively promoted to be transformed and upgraded from a traditional manual experience type and a passive maintenance type to a data-driven, intelligent and active preventive maintenance mode. Key intelligent operation and maintenance technical support is provided for building a novel electric power system with new energy as a main body, the novel electric power system is assisted to achieve the development goals of being safer, more efficient, cleaner and lower in carbon, and important industry strategic significance and social contribution are achieved.

The present invention provides a large language model-based system and method for data processing in application developed by codeless platform. The invention includes identification of intent of a user to process procurement, supply chain, application integration, application restructuring or development scenarios.

The invention relates to the technical field of intelligent operation and maintenance and artificial intelligence crossing of a power system, in particular to an intelligent power work order processing method of an RPA fused multi-modal large model, which analyzes multi-modal work order data such as texts, voices, images and the like through a domain adaptation large language model, and realizes fault key information extraction and conflict resolution in combination with a dynamic knowledge graph; performing work order priority scoring and resource allocation by using space-time constraint reinforcement learning; an analysis result is converted into an automatic execution script through an RPA engine, and a whole-process closed loop of order sending, processing and feedback is achieved; meanwhile, a feedback optimization and conflict resolution cooperation mechanism is constructed, and the knowledge graph and the model precision are continuously iterated. The method improves work order processing efficiency and analysis precision, enhances decision scientificity, and is suitable for an intelligent operation and maintenance scene of a power system.

The invention discloses a robot control method and device based on multi-modal data fusion, and the method comprises the steps: responding to a control instruction inputted by a user, receiving and preprocessing sensing information fed back by a plurality of types of sensors preset on a robot, and obtaining multi-modal data; dynamically adjusting the weight of each modal data, and extracting the feature vector of each modal data; according to the dynamically adjusted weight of each modal data, fusing the extracted feature vectors of each modal data to generate a comprehensive feature vector for representing the comprehensive state of the current environment; according to the comprehensive feature vector, the control instruction is analyzed through a preset large language model, and a final decision result of the robot is obtained; and according to the final decision result, calling and executing an instruction set required to be executed by the robot so as to drive the robot to complete related actions. Therefore, by adopting the embodiment of the invention, the robot can effectively process and utilize information from different modes to the maximum extent, and better decision and performance of the robot are realized.

The invention relates to the technical field of intelligent conference processing, and relates to a conference summary processing method and system using AI, and the method comprises the steps: carrying out the real-time noise suppression of a collected conference audio stream and associated text data through a noise suppression algorithm, and carrying out the cross-modal alignment of the denoised data through a cross-modal alignment algorithm; a domain-specific attention head is inserted into an attention layer of the pre-trained Transform model, a domain-enhanced speech recognition model is constructed, and audio is converted into a text sequence with a speaker tag; adopting a heterogeneous graph neural network to construct a structured topic evolution graph; key decision nodes in the structured topic evolution graph are extracted based on a reinforcement learning strategy, and a final conference summary document is generated. In the decoding stage, the fusion proportion of the acoustic model and the language model is dynamically adjusted based on the real-time acoustic confidence coefficient, the recognition rate of the vocabularies in the professional field is increased, and the problems of frequent term transcription errors and poor semantic coherence in the professional conference are effectively solved.

The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating personal responses through retrieval-augmented generation. In particular, the disclosed systems can generate a query embedding from a query generated by an entity and determine data context specific to the entity by comparing the query embedding with a plurality of vectorized segments of content items associated with the entity. The disclosed systems can provide the data context to a large language model and generate a personalized response informed by the data context. Subsequently, the disclosed systems can provide the personalized response for display on a client device associated with the entity.

The embodiment of the invention provides a method for constructing a large language model knowledge management system. The method comprises a knowledge construction step, a knowledge retrieval step and an answer production step. According to the scheme, the artificial intelligence large language model technology can be utilized. External knowledge is obtained from multiple data sources, a search technology and a cue word function of a large language model are combined, RAG proposes a problem to the large model, knowledge obtained by searching the problem in the multiple data sources is used as a background context, and information of the problem and the background context is integrated into cue words of the large language model. And therefore, the large language model can make a final accurate answer.

The invention discloses a multi-modal interview automatic quality analysis and evaluation method and system based on a large model, and the method comprises the steps: collecting and storing multi-modal data, such as texts, audios, videos and behavior interaction, and carrying out the preprocessing of the multi-modal data to form a standardized data set; utilizing a preset interview structure and a large model to dynamically guide the process, adjusting the topic rhythm according to real-time feedback, and recording stage conversion information to form logic trajectory data for process coherence management; automatically coding text data through a large language model, extracting features such as keywords and performing topic clustering, performing cross validation and semantic fusion in combination with data analysis results of each modal, and generating deep analysis results such as psychological states; and generating a comprehensive assessment report containing qualitative description, quantitative score and psychological abnormality or cognitive disorder risk prompts based on a deep analysis result, thereby providing a basis for psychological health assessment and cognitive competence evaluation. According to the method, automatic analysis of multi-modal data is realized, and evaluation scientificity and efficiency are improved.

Device, system, and method for automatically detecting and classifying personally identifiable information (PII) in documents and files. A method includes performing a deterministic rule-based search, in a plurality of stored documents, for PII data-items. If the deterministic rule-based search indicates that a particular document is more likely than not to contain a PII data-items then the method includes: extracting a textual snippet from the particular document, wherein the textual snippets surrounds the PII data-item; adding the textual snippet and the particular document to one or more training datasets utilized for training a Large Language Model (LLM) configured to find PII data-items in documents for Named Entity Recognition (NER) in those documents.

The present invention is a Large Language Model-Based AI-powered interactive doll that provides personalized content, education, companionship, entertainment and emotional support to children. The doll connects to a large language model (LLM) and uses a microphone, video camera, touch screen and speaker to interact with the child. The integrated LLM provides real-time video analysis capabilities. The accompanying app provides a full suite of customization options for parents to tailor the doll's interactions to their child's needs and preferences. The doll provides a wide range of content, including educational content, homework assistance, entertainment, AI art, video and music generation, companionship and emotional support, and can suggest activities, tell personalized interactive stories, assisting with language learning, play games, and interact with the child in various other ways. The doll can also be used as a monitor, allowing parents to listen in on the child's interactions, and in another embodiment, to livestream video via an internal camera.

The invention relates to the technical field of large language models, and discloses a voice data interaction feedback control processing method based on a large language model. The method comprises the following steps: acquiring an industrial voice instruction through an AMR main controller, and obtaining a standardized vector through industrial lexicon matching and intention classification; inputting an industrial large language model for reasoning processing, and generating an AMR execution scheme; carrying out distributed coordination and task allocation on the AMR cluster to form a control instruction sequence; and the motion controller executes monitoring, processes exceptions and outputs a feedback strategy. Accurate classification and semantic understanding of complex industrial instructions are achieved, the processing capacity of professional knowledge in the industrial field is improved, and meanwhile high-precision real-time state monitoring is achieved.

The present disclosure relates to systems, non-transitory computer-readable media, and methods for utilizing a context transformer engine, a smart topic agent, and a large language model to generate a smart topic output. In particular, in one or more embodiments, the disclosed systems generate a smart topic output from a transcript of a video call. In some embodiments, the disclosed systems provide a smart topic interface that provides the smart topic output on a client device and receives selections of smart topic elements. In one or more embodiments, the disclosed systems generate a combined smart topic from transcripts of video calls in which client devices that participated are associated with a collaborating user account group.

The invention relates to the technical field of data processing, in particular to a method and system for processing data based on a large language model.The method comprises the following steps that based on inter-sentence punctuation positioning and part-of-speech tagging, sentence blocks are divided to generate functional partitions, themes and relational words are extracted to judge semantic chain starting points, a trigger index sequence is constructed, and logic jump points and breakpoint positions are recognized; and mapping the label structure to the language model output analysis deviation, and generating a label mapping combination list. According to the method, semantic turning nodes can be captured by analyzing the semantic direction change trend, the relation between the semantic turning nodes and verb and noun combinations is judged, the position of a trigger point of an actual information transfer effect is extracted, and the break point area of a semantic path is recognized through the positioning of key word starting and stopping blocks and the logical judgment of noun group cross combination; the path integrity has a clear fracture identifier, a traceable semantic mapping structure path is established in a language model, and the accuracy, coherence and hierarchy clearness of semantic reconstruction are enhanced.

The embodiment of the invention provides a multi-agent-based equipment analysis method and system, equipment and a storage medium, and belongs to the technical field of artificial intelligence. The method comprises the following steps: firstly, acquiring a user question text about equipment analysis, and performing task splitting and planning on the user question text through a large language model of a supervisor agent to determine a target sub-task and a task agent corresponding to the target sub-task; and calling an application program interface of the task agent through the supervisor agent to execute the target subtask to obtain task feedback, and generating an equipment analysis result by the large language model according to the task feedback and feeding back the equipment analysis result to a user. Various equipment analysis tasks are completed through cooperation of multiple agents, the equipment analysis tasks can be conveniently expanded through the supervisor agent-task agent architecture, and the equipment analysis requirements of a user are flexibly processed.

A real-time system for the multimodal generation of virtual reality scenes based on artificial intelligence for the creation of immersive three-dimensional environments from natural language narratives, consisting of: a speech capture module configured to continuously record a user's spoken narrative via one or more directional microphones, preprocesses the captured signal by noise reduction and temporal alignment, and outputs a digital speech stream; A speech-to-text processing unit that is operationally coupled to the speech capture module and configured for real-time speech recognition using a continuous neural transformer model. The unit is trained to transcribe natural language utterances into structured text data while maintaining contextual continuity throughout the evolving narrative. a semantic interpretation processing unit that is communicatively linked to the speech recognition unit and configured to perform natural language understanding techniques to extract contextual entities, spatial references, temporal relationships, and object attributes from the transcribed narrative; the engine includes a large language model that is fine-tuned for spatial reasoning tasks; a scene graph generation module configured to transform the interpreted semantic data into a structured, hierarchical representation that defines nodes for identified entities and edges for corresponding relationships, with each node associated with metadata describing geometry, position, orientation, texture, and linking attributes between objects; a multimodal image-language model processor coupled with the scene graph generation module, wherein the processor is configured to retrieve, adapt, or synthesize appropriate three-dimensional elements from a pre-trained visual-lexical embedding space and align these elements with their semantic and spatial definitions derived from the scene graph; a scene assembly and rendering controller configured to create a cohesive virtual scene from the aligned assets, perform real-time rendering using a GPU-accelerated ray tracing pipeline, and produce a stereoscopic visual output that corresponds to the evolving narrative; A head-mounted virtual reality visualization device connected to the rendering engine and configured to display the generated immersive environment to the user in real time. The device features motion sensors and inside-out tracking cameras to detect head and body movements, dynamically updating viewing angles and perspective within the rendered scene; and a bidirectional feedback module integrated into the head-mounted device and connected to the semantic interpretation processing unit; the module is configured to interpret corrective commands, gestures, or supplementary comments from the user to refine or modify specific scene elements without interrupting the real-time visualization; The system continuously updates the virtual scene as the narrative develops, ensuring temporal synchronization between speech input and rendered output below a defined latency threshold, thus enabling a natural, dialogic construction of complex three-dimensional virtual environments.

A method for evaluating textual output of one or more machine-learned language models is presented. The method includes receiving, from a user of a client device, a first prompt for input to one or more machine-learned language models, providing the first prompt to the one or more models for execution, and receiving a set of generated responses to the first prompt from the one or more models. The method further includes generating a user interface (UI) on the client device displaying the first prompt and generated responses as a table user interface element. The method applies a selected evaluation function to the generated response to evaluate the response with respect to an evaluation objective and identifies words that influence the evaluation. The method generates one or more UI elements on the UI to display the results of the evaluation for the generated responses.

The invention provides an industrial agent decision-making method and device, electronic equipment and a storage medium. The method comprises the following steps: loading multi-source industrial data to a knowledge graph, and constructing a domain ontology and an MCP ontology; performing parameter fine tuning on a preset base large language model; receiving an industrial process planning demand input by a user, and performing semantic analysis on the industrial process planning demand; processing the query result by utilizing an MCP context strategy to generate a prompt context; inputting the prompt context and the industrial process planning demand into a fine tuning large language model to generate a first process planning scheme; performing rule verification on the first process planning scheme based on the knowledge graph, and judging whether the first process planning scheme meets a preset rule or not according to a verification result; and converting the final process planning scheme into a control script or an interface calling sequence which can be analyzed by an industrial execution system, and outputting the control script or the interface calling sequence. According to the method, the cross-software system compliance process planning with unified knowledge, automatic generation and rule verification can be realized.

The invention discloses a sign language translation method and device based on vision and word feature pre-training alignment, and belongs to the technical field of sign language translation.The sign language translation method comprises the steps that vision features of sign language videos are extracted through a vision encoder, and word text features are extracted through a text encoder; performing comparative learning based on vision and word text features to obtain a pre-trained vision encoder; performing word text mask prediction pre-training on the text decoder; constructing the pre-trained visual encoder and the pre-trained text decoder into a sign language recognition model so as to recognize a word text sequence from the sign language video; and accessing the pre-trained large language model in the domain into a sign language recognition model to construct a sign language translation model, and performing combined fine tuning so as to translate the word text sequence into a natural language text. The sign language recognition and translation method can realize more efficient, accurate and reliable sign language recognition and translation, is applied to the fields of intelligent sign language translation, barrier-free communication, sign language education and the like, and provides more accurate and natural language interaction experience for hearing-impaired groups.

A computer-implemented method for jailbreaking Large Language Models (LLMs) requiring only black-box access-Branch-and-Prune. LLMs are powerful tools displaying many capabilities. However, despite safety training, LLMs can generate harmful, biased, and toxic content-demonstrated by the prevalence of human-designed “jailbreaks” that override LLM's safety “guardrails.” At the core, the method engages an “attacker” LLM into conversations where it generates variations of the original prompt that may jailbreak the target LLM. Compared to prior methods, the disclosed Branch-and-Prune adaptively decides which conversations to engage in (pursuing conversations with a high-likelihood of success while abandoning less-promising ones), and “mixes” the different conversations (increasing the success rate of the method). This enables jailbreaks for state-of-the-art LLMs for over 80% of the existing harmful prompts while requiring fewer queries to the target LLM.

The invention discloses a city updating intelligent expert system architecture and method based on a large language model, and relates to the technical field of city planning and construction. The knowledge base management module supports efficient retrieval and application of professional domain knowledge; the expert agent group comprises a user-defined core expert and a system dynamic supplement expert; the expert team collaborative decision-making module is used for executing multiple rounds of hierarchical collaborative decision-making processes; the meta-agent module is responsible for project feature analysis and expert team dynamic configuration; the auxiliary agent module comprises a host agent which is responsible for guiding the decision making process; the recorder agent generates a decision summary report; the verification agent is responsible for verifying and evaluating the professional ability of the expert agent; and the scoring agent evaluates the decision quality. According to the method, the problems of dispersed professional knowledge, low cross-domain expert cooperation efficiency, high decision-making cost and the like in the existing city updating decision-making process are solved, and the decision-making efficiency and quality of city updating early-stage planning are comprehensively improved.

The invention relates to a code generation method and system based on heterogeneous multi-agent collaboration and electronic equipment. According to the method, a special commentator agent instantiated by a heterogeneous large language model is added into a multi-agent collaboration process; according to the method, consistency and feasibility verification is carried out on a demand document given by an analyst agent by adopting a commentator agent, a modification suggestion is proposed in an early stage, deviation and problems are found in time in the early stage of a task, the cost and complexity of later correction are reduced, the robustness and reliability of codes are improved, and the method is suitable for large-scale popularization and application. And the generated result can still maintain high-level correctness under extreme conditions or specific boundary conditions. And the method has practical significance in improving software development efficiency, reducing project risks and improving the quality of an intelligent automatic solution.

Apparatus and methods are disclosed for implementing a copilot as a network of microservices including specialized large language models (LLMs) or other trained machine learning (ML) tools. The microservice network architecture supports flexible, customizable, or dynamically determinable dataflow. Compared to much larger competing LLMs, comparable or superior performance is achieved for certain tasks, while significantly reducing hardware requirements and computation time. Disclosed examples incorporate microservices for expansion, retrieval, embedding, and evaluation, in addition to one or more core microservices. Optionally, intermodal I / O, multiple data repositories, competency qualification, or human feedback can be supported. Multiple core microservices can support varying client authorizations or cognitive functions. The disclosed architecture supports any major LLM use case and can be deployed on a single compute node with a single GPU. Techniques are disclosed for multi-recursive retrieval, expansion ML tool training, input / output translation at data producers, and qualification of input / output data against copilot competency.