892results about "Multimedia data indexing" patented technology

A web-based interface enables medical personnel to remotely monitor medical devices. A monitoring system records operational data and alarms from the medical devices in a file. However, since network connections between the medical devices and the monitoring system are intermittent, the file does not contain a contiguous stream of data for each medical device. The file pauses recording during gaps in network connectivity. The system displays current data, as well as a list of alarms. If medical personnel wish to view more detail about an earlier time or one of the alarms, the system calculates where in the file the medical device data was recorded. This calculation accounts for the discontiguous nature of the data. The system uses times the network connection is made and broken to calculate an index into the file that corresponds to the time of the user-selected alarm.

The invention discloses an enterprise-level knowledge management system based on a large language model. The enterprise-level knowledge management system comprises a knowledge storage module, a knowledge analysis module and a knowledge application module, the knowledge storage module is responsible for managing and storing knowledge from different sources, supporting uploading, updating, deleting and sharing of electronic documents and multimedia documents, and is provided with authority control; the knowledge analysis module is used for carrying out deep understanding and structured processing on text and multimedia contents through a special analyzer by utilizing an advanced large language model technology; the knowledge application module provides intelligent retrieval and intelligent question and answer functions and supports advanced applications such as behavior portrait analysis and standard process supervision. According to the method and the system, the acquisition, understanding and application efficiency of enterprise knowledge is remarkably improved by fusing a large language model technology and a traditional knowledge management method, an intelligent, automatic and safe knowledge management solution is provided for an enterprise, and value mining and innovative application of enterprise knowledge assets are effectively promoted.

The invention discloses a visual scene method, system and equipment based on digital twinning and a medium, and relates to the technical field of digital twinning and visual modeling, and the method comprises the steps: collecting multi-format source data, carrying out the field standard mapping, and carrying out the consistency verification of the multi-format source data after the field standard mapping; writing the multi-format source data after consistency verification into a to-be-fused buffer area, selecting model component data in the to-be-fused buffer area to execute coordinate reference conversion, and performing association binding on the converted model component data and the structured graphic and text information by constructing an identification field; and synchronously loading the associated and bound model component data and the structured graphic and text information to a predefined template container, generating a scene configuration file according to a container structure, and calling a release engine to register to a multi-terminal rendering service channel. According to the method, accurate alignment of multi-format model components in a unified space coordinate system is realized by constructing an affine transformation coordinate reference conversion scheme.

The invention discloses a multi-modal enhanced retrieval method and system, and the method comprises the steps: obtaining heterogeneous data, and executing data processing to obtain a meta-information set; encoding the meta-information set into a high-dimensional meta-information vector, and constructing a vector index; receiving a query statement of a user, calculating the similarity between the query statement and the meta-information vector, and obtaining a meta-information query result; and calling a large language model based on the obtained meta-information to generate a summary result, and merging and outputting the summary result and heterogeneous data corresponding to the meta-information. According to the method, multi-modal data is processed into unified semantic vector representation, efficient vectorization indexing and semantic generation and expansion capacity of a large-scale language model are combined, high-value information can be rapidly extracted from multi-source heterogeneous data, and real-time, cross-modal and high-precision retrieval requirements are supported. A reordering and traceability mechanism introduced in the scheme further enhances the correlation and reliability of the information, and provides comprehensive and accurate knowledge support for the generation of query results.

The invention provides an AI-based multi-user data storage docking and secure transmission method, which comprises the following steps of: acquiring a propagation path of a hot topic according to a multi-modal content association graph, performing fragmentation storage on the propagation path by adopting a clustering algorithm, and generating a fragmentation storage index table; when the relevance of different modal contents is higher than a preset threshold value, determining that the sensitivity grading result is consistent with the multi-modal relevance, performing dynamic rule adjustment by adopting a deep learning model, generating a dynamic auditing rule set, and obtaining boundary judgment parameters of the rule set; and distributing the dynamic auditing rule set and the decision transparency index to each service line by adopting a cross-platform data synchronization protocol according to the auditing decision log, generating a cross-platform consistency auditing standard, and obtaining a synchronization log of standard execution.

The invention relates to a multi-modal large model-based low-slow small flight target identification and classification method and system, and aims at solving the problem of monitoring and identification of low-slow small flight targets in a complex scene. According to the method, various sensor data including visible light images, infrared images, radar signals, sound features and radio signals are fused, the multi-mode large model is used for processing and fusing data of different modes, combined features are extracted, efficient detection and classification of low-speed small targets are achieved, and the method has an automatic early warning function. The method has the advantages of real-time response, automatic processing and high recognition precision, and is suitable for low, slow and small flight target defense scenes such as airports, military bases and urban safety.

The invention relates to an intelligent dialogue system and method based on an AI multi-mode large model. The method comprises the following steps: collecting biological characteristic data of a user in real time; cloning a personalized expression mode of the user by using the generative adversarial network; driving the audio avatar to perform multi-round dialogue interaction with the user, capturing a real-time physiological signal of the user through an expression recognition module, and generating a dynamic response content suggestion in combination with a dialogue context; and analyzing the interaction process based on the reinforcement learning model. The multi-modal deep fusion of the voice rhythm features, the language structure features and the facial dynamic features is realized, so that the limitation of single-modal or simple feature splicing in the prior art is broken through, the emotional state of the user can be accurately and comprehensively captured, the intention is expressed and the fine physiological reaction is expressed, and the user experience is improved. And a solid foundation is laid for constructing high-fidelity user representation.

The embodiment of the invention provides a metadata generation method, a metadata identification method and electronic equipment. The method comprises the following steps: firstly, acquiring media content; next, metadata of the media content is generated, the metadata of the media content comprises an AIGC (Artificial Intelligence Generation Content) identifier, and the AIGC identifier indicates whether the media content is the AIGC or not; further, subsequently, whether the media content is the AIGC or not can be identified according to the AIGC identifier in the metadata of the media content; therefore, the user can be helped to judge the authenticity of the media content to a certain extent, and the vigilance of the user in using (such as forwarding) the media content is improved to a certain extent.

The embodiment of the invention belongs to the field of data processing, and relates to a data retrieval method and device, computer equipment and a storage medium, and the method comprises the following steps: obtaining standard data information; performing feature extraction and semantic representation on the standard data information to obtain semantic vector representation, and constructing a semantic index according to the semantic vector representation; obtaining input retrieval information, and performing semantic understanding and expansion on the input retrieval information to obtain retrieval information representation; converting the retrieval information representation into a retrieval semantic vector, calculating the similarity between the retrieval semantic vector and the semantic index, and screening the standard data information according to the similarity to obtain a candidate data set; and performing priority ranking on the candidate data set to obtain a retrieval result data set, and returning the retrieval result data set to the display interface for display. According to the method and the device, the retrieval result data set with high content correlation and high retrieval accuracy can be effectively obtained according to the input retrieval information.

The invention relates to the technical field of data processing, and discloses a remote sensing monitoring classification system for seawall ecological features and a sample library construction method. The method comprises the following steps: fusing and processing a multi-source remote sensing image to obtain a standardized data set; extracting seawall section characteristic parameters, and generating preliminary type distribution data; fusing geographic and ecological information to form feature element data; calculating vegetation coverage and material characteristics to obtain quantitative indexes; establishing a three-level sample library structure; and updating the sample through similarity matching, and constructing a classification system. According to the invention, remote sensing monitoring standardized expression and intelligent classification of seawall ecological features are realized.

The invention discloses an archive management system based on artificial intelligence, and the system comprises a data preprocessing module which is used for obtaining and preprocessing original archive data, a missing region detection module which is used for carrying out the missing region detection and feature extraction of the preprocessed archive data, and generating missing region description information; the global search optimization module is used for carrying out global search by adopting a variable-scale Levy flight algorithm based on the missing region description information; the local optimization module is used for carrying out detail optimization on a local missing region by utilizing an improved grey wolf optimization algorithm based on the global search candidate data; the data fusion and consistency matching module is used for fusing the locally optimized filling data and the preprocessed archive data; and the filling quality evaluation and optimization module is used for performing error feedback evaluation on the filled archive data and finally filing the corrected archive data. According to the invention, the overall consistency and rationality of archive filling in the archive management process are improved.

The invention discloses a digital collection full-life-cycle traceability tracking system based on a block chain, and the system comprises a digital identification module, a verification module, a packaging transfer module, a verification module, an integration module, and a system construction module, and achieves the full-life-cycle traceability tracking of a digital collection through the technologies of multi-dimensional feature extraction, watermark embedding, distributed storage, and zero-knowledge proof. And tracking and verification of the whole process from creation to transaction of the digital collections are realized. According to the system, the transaction authorization model is encapsulated by adopting the intelligent contract, so that safe transfer of ownership is ensured; a tamper-proof verification mechanism is constructed through multi-level integrity verification; different platform data are integrated by using a cross-chain technology to form a comprehensive traceability graph, so that key problems of authenticity verification, copyright protection, value evaluation and the like faced by a digital collection market are effectively solved. In addition, the system also establishes a scientific authenticity evaluation and value dynamic evaluation system, provides an objective basis for market pricing, and significantly improves the credibility and safety of the digital collections.

The invention relates to an image-text search database construction method and device, a database and a storage medium. The method comprises the following steps: analyzing an obtained document, and extracting to obtain image information and text information of the document; based on the image information and the text information, constructing at least one image-text pair of the literature, the image-text pair comprising an image and a corresponding image annotation text; generating an image feature vector of the image based on the image and the image annotation text; key text information of the literature is extracted from the text information, and a text feature vector of the literature is generated based on the key text information; and based on the image feature vector and the text feature vector of each document, constructing an image-text search database. By adopting the method, literature feature extraction of multi-modal data such as fusion texts and images is realized, deep professional association among literatures is mined, and the accuracy of carrying out image-text search on related literatures in the astronomical field can be improved.

The invention discloses a multi-modal information identifier generation method and system based on semantic hash. The method comprises the following steps: carrying out data preprocessing and multi-modal feature extraction on multi-modal data to obtain a unified representation containing rich semantic information; mapping the features to a shared semantic space by adopting an independent alignment projection network of each mode, and introducing cross-mode contrast learning and label supervision to realize semantic alignment among different modes; compressing the high-dimensional features after multi-modal data alignment to generate a Hash code with a fixed length; generating a unified semantic hash code containing semantic information of at least two modals; searching the number of times that the Hash code appears in a database through the unified semantic Hash code, generating a redundant code, and splicing the redundant code with the unified semantic Hash code to form an identifier of the sample; on the basis of the unified semantic hash codes, the hash codes related to the to-be-queried category in the test set are queried in the training set, and unified identification and efficient retrieval of different modes are achieved.

The invention discloses a media file query and retrieval method and system based on an AI dialogue scene, the method combines a mixed mode of vector retrieval and keyword retrieval, realizes accurate retrieval of cross-modal data, and can process various media files including texts, pictures, videos, PPT and the like. According to the method, a double-round scoring mechanism of a large language model (LLM) is combined, firstly, the relevancy of file content is scored, then secondary scoring is carried out according to the matching degree of a file title and user query, and it is ensured that the file most relevant to query is called. In addition, the system can further utilize a user feedback mechanism to continuously optimize the retrieval precision, and the user experience is improved. Compared with the prior art, the method has the advantages that the accuracy and the efficiency of multi-modal data retrieval are remarkably improved, the limitation of a traditional AI dialogue system during multimedia file processing is solved, and the method is suitable for intelligent dialogue application scenes needing to quickly and accurately obtain various types of media files.

Generative media content (e.g., generative audio) can be dynamically generated based on various inputs, which can include blockchain data. A playback device accesses blockchain data stored via a distributed ledger and generates media content based at least in part on the blockchain data. The playback device can access a library of pre-existing media segments and arrange a selection of pre-existing media segments from the library for playback according to a generative media content model and based at least in part on the blockchain data. The generated media content can then be played back via the playback device.

Generative media content (e.g., generative audio) can be dynamically generated based on various inputs, which can include blockchain data. A playback device accesses blockchain data stored via a distributed ledger and generates media content based at least in part on the blockchain data. The playback device can access a library of pre-existing media segments and arrange a selection of pre-existing media segments from the library for playback according to a generative media content model and based at least in part on the blockchain data. The generated media content can then be played back via the playback device.

Generative media content (e.g., generative audio) can be dynamically generated based on various inputs, which can include blockchain data. A playback device accesses blockchain data stored via a distributed ledger and generates media content based at least in part on the blockchain data. The playback device can access a library of pre-existing media segments and arrange a selection of pre-existing media segments from the library for playback according to a generative media content model and based at least in part on the blockchain data. The generated media content can then be played back via the playback device.

Generative media content (e.g., generative audio) can be dynamically generated based on various inputs, which can include blockchain data. A playback device accesses blockchain data stored via a distributed ledger and generates media content based at least in part on the blockchain data. The playback device can access a library of pre-existing media segments and arrange a selection of pre-existing media segments from the library for playback according to a generative media content model and based at least in part on the blockchain data. The generated media content can then be played back via the playback device.

Systems, methods, and computer-readable storage media for indexing a catalog of training content, and more specifically to indexing the catalog of training content using Artificial Intelligence (AI) to improve responses to queries. A system can execute a search of training course content stored in a database, identifying at least one of new training course content or updated training course content. Based on the media type of the each piece of content, the system can execute one or more data extraction algorithms, resulting in extracted data for each piece of new or updated content. The system can then add the extracted data to a semantic search index.

A computer-implemented apparatus, system, and method is disclosed for protecting sensitive data. A cognoscible computing engine is multi-layered and multi-pathed. It includes features for handling different data formats, including structured, semi-structured, and unstructured data. Features are included to support near real-time processing at scale with high accuracy. Applications include redacting or masking sensitive data to comply with data privacy and security standards.

Generative media content (e.g., generative audio) can be dynamically generated based on various inputs, which can include blockchain data. A playback device accesses blockchain data stored via a distributed ledger and generates media content based at least in part on the blockchain data. The playback device can access a library of pre-existing media segments and arrange a selection of pre-existing media segments from the library for playback according to a generative media content model and based at least in part on the blockchain data. The generated media content can then be played back via the playback device.

A method of encapsulating media data into a media file, the method comprising: obtaining a time boundary in a time interval corresponding to the presentation duration of an original sample of the media data; duplicating the original sample into two consecutive duplicated samples separated by the time boundary, the two duplicated samples having a same data part corresponding to the data part of the original sample; generating a time adjustment indication indicating for each duplicated sample the relationship between the time interval corresponding to the presentation duration of the duplicated sample and the time interval corresponding to the presentation duration of the original sample; and encapsulating the media data comprising the duplicated samples and the time adjustment indication in the media file, the time adjustment indication being located in metadata describing the media data.

Generative media content (e.g., generative audio) can be dynamically generated based on various inputs, which can include blockchain data. A playback device accesses blockchain data stored via a distributed ledger and generates media content based at least in part on the blockchain data. The playback device can access a library of pre-existing media segments and arrange a selection of pre-existing media segments from the library for playback according to a generative media content model and based at least in part on the blockchain data. The generated media content can then be played back via the playback device.

The invention discloses a conference content intelligent generation processing method and system based on a multi-modal large model, and the method comprises the steps: collecting the original data of a conference, and completing the standardization preprocessing; inputting a multi-modal large model, extracting multi-modal features and carrying out semantic alignment; executing cross-modal hash coding, generating binary codes and establishing an index database; performing hash retrieval on the related fragments, and constructing a conference content directed graph; based on a conference content directed graph structure, searching an optimized path by adopting a Monte Carlo tree; and generating structured conference content, and outputting a summary, an abstract and an action item. According to the method, efficient extraction, accurate retrieval and structured intelligent generation of the conference content are realized by fusing a multi-modal large model, cross-modal Hash coding and Monte Carlo tree search.

The invention discloses a multi-modality-based minority non-abandoned pattern knowledge graph construction method and system, and relates to the technical field of cultural heritage digital protection. Deep association of multi-modality knowledge is realized through a double-path entity relationship extraction mechanism, context semantics are coded by a text path by utilizing a pre-training language model, and a multi-modality knowledge graph is constructed; the method comprises the following steps: accurately extracting entities such as a pattern and an inheritor, a semantic relationship and a visual path, analyzing a pattern topological structure through a graph convolutional network, converting visual features such as lines and contours into structured relationship data, calculating cosine similarity of a text and a visual feature vector through comparative learning, establishing cross-modal mapping of the visual features and culture description, and obtaining a visual feature model; according to the mechanism, the knowledge graph simultaneously contains semantic logic and visual feature association, and construction of a complete knowledge chain from a pattern form to cultural connotation is realized.

The embodiment of the invention discloses a content template generation method and device, a storage medium and electronic device.The method comprises the steps that a demonstration theme template selected by a client side is determined, and a single-page content template sample selected by the client side for the demonstration theme template is obtained, based on the demonstration theme template and the single-page content template sample, a demonstration template processing large model is adopted to extract theme single-page attribute characteristics, single-page content template amplification processing is carried out on the demonstration theme template based on the theme single-page attribute characteristics, and a single-page content template set corresponding to the demonstration theme template is obtained, and displaying the single-page content template set to the client.

The invention discloses a Lake and Hunan wood carving image generation method, device and equipment based on a LoRA model and a storage medium, and relates to the technical field of process digitization and image generation, and the method comprises the steps: constructing a Lake and Hunan wood carving manufacturing process feature library based on a material object scanning graph, wood texture data and a manufacturing process video of the Lake and Hunan wood carving; according to the feature library, performing hierarchical training on the initial LoRA model according to a texture layer-cutter layer-pattern layer hierarchical logic to obtain a hierarchical LoRA model, and performing hierarchical fusion on the hierarchical LoRA model and a potential diffusion model to form a lake and Hunan woodcarving image generation model; and analyzing text cue words input by a user by using a keyword system in the feature library, extracting wood carving types, timber texture parameters, folk pattern requirements and scene adaptation features, and inputting the features into the lake and Hunan wood carving image generation model to obtain a target lake and Hunan wood carving image. According to the method, the lake and Hunan woodcarving image with the process reduction degree and the scene adaptability can be generated.

Generative media content (e.g., generative audio) can be dynamically generated based on various inputs, which can include blockchain data. A playback device accesses blockchain data stored via a distributed ledger and generates media content based at least in part on the blockchain data. The playback device can access a library of pre-existing media segments and arrange a selection of pre-existing media segments from the library for playback according to a generative media content model and based at least in part on the blockchain data. The generated media content can then be played back via the playback device.

Methods and systems are disclosed herein to address the problems discussed above and in particular to provide coordination for uncoordinated content. Beyond simply archiving and / or organizing available content, the methods and systems generate composite media assets that provide enriched details and supplemental data that extends beyond any given source content. The methods and systems achieve this through a novel data filtration and synchronization process.