505 results about "Object storage" patented technology

The invention relates to the technical field of research and development management, can be applied to business scenes of financial science and technology, medical health and the like, and discloses an anomaly analysis method, device, equipment and medium based on a variation test. Generating a test case through the semantic perception model; selecting a variation strategy by using a state-driven model according to the service state, and generating a variation test case based on the access control strategy; executing the variation test case in a distributed environment, and collecting system resource index data and request execution monitoring data; and inputting the collected data into the abnormal prediction model, and outputting an abnormal behavior prediction result. Through combination of semantic perception generation, state-driven selection and anomaly prediction, coverage of a test case on protocol dependence and a service state is improved, and the accuracy of anomaly detection of the object storage system is remarkably improved.

The invention relates to the technical field of big data storage, and discloses a multi-level data storage and mixed query method and system, a storage medium and equipment, and the method comprises the steps: collecting original buried point data, carrying out real-time stream processing, storing the processed real-time data in a hot storage layer, carrying out timing offline batch processing on historical buried point data, and storing the processed real-time data in a hot storage layer; converting into an optimized storage format and storing in an object storage system; an extended metadata management system is constructed, and structure information, partition information and access frequency information of data in the object storage system are automatically extracted and managed; executing query, and reducing the data scanning amount through a query optimization strategy; automatically migrating data among different storage layers through a dynamic cold and hot data layering mechanism; a unified query interface is provided, a query request is distributed to a corresponding real-time processing system or an offline query system based on an intelligent routing strategy, and a query result is cached and returned, so that high-performance and low-cost storage and second-level query of data are realized.

The invention discloses a distributed file management system and method, and belongs to the technical field of computer software, the system adopts a tree hierarchical structure to organize files, and the system comprises an application layer used for receiving file operation requests from a plurality of independent clients, and each request carries a unique application identifier; the file system layer comprises a configuration module, an operation module, a metadata management module, a day module, a timed task module and a gateway module, and the request is routed to a corresponding logic storage partition in the data layer according to an application identifier; the data layer comprises a database cluster and an object storage cluster, and performs persistent storage and management of logic isolation on metadata and file data according to application identifiers; and the infrastructure layer provides an extensible server and network resources. Based on a distributed architecture, load balancing and efficient access are realized through data storage partitioning, a metadata management and index technology and a client load balancing technology, and the expandability, fault tolerance and performance of the system are improved.

The invention provides a server-free document processing and real-time reporting method and system, relates to the technical field of data processing, and starts from responding to the operation that a user uploads a source document to an object storage server, and routing an event to a pre-subscribed document processing server-free function. And after the function is triggered, obtaining a source document, performing analysis and data extraction on the source document to generate structured data, and storing the structured data in a database. The event bus then routes the event to a pre-subscribed report-generating server-less function. And automatically generating a notice containing an access link and pushing the notice to a specified user or terminal. According to the method, automation, real-time performance and flexibility of the whole process from document uploading to report generation are achieved, and through tight combination of event driving and a server-free architecture, the processing efficiency, the resource utilization rate and the system response speed are improved.

The invention provides a multi-type storage cluster dynamic nano-management method based on a cloud platform, and belongs to the technical field of cloud platform storage resource management, a storage pool is used as a minimum management unit, a configuration center provides a unified nano-management entrance and is associated with a platform initialization process, and initialization of standardized parameters such as a storage cluster IP, an account and the like is automatically completed; after management, block storage, file storage or object storage types and exclusive parameters thereof are configured for the storage pool according to business requirements, and available storage pools are screened according to binding relations when storage services are created, so that resource mismatching is avoided. Bidirectional synchronization is carried out between the operation and maintenance resource management module and the storage module through a full life cycle by using an equipment SN number, so that state consistency and traceability are realized; expansion of newly added storage pools, unbinding of the storage pools and resource recovery are supported, and the resource utilization rate and the operation and maintenance efficiency are improved.

The invention relates to the technical field of aviation field multi-source heterogeneous data retrieval, and discloses an aviation field multi-source heterogeneous data deep retrieval engine based on a large model, which comprises a front end and API gateway, a LangGraph agent, a retrieval layer, a data access and treatment layer, an object storage module and a monitoring and operation layer, according to the aviation field multi-source heterogeneous data deep retrieval engine based on the large model, unified retrieval can be conducted on multi-source heterogeneous data such as patents, standards and literatures, a user does not need to conduct respective retrieval in different data sources, the retrieval efficiency is greatly improved, and through unified data access and cooperative work of a governance layer and a retrieval layer, the retrieval efficiency is greatly improved. The barriers among different data sources are broken through, and keywords and evaluation strategies conforming to industry characteristics are generated in combination with the thesaurus, the technical system and the knowledge graph in the aviation field. During retrieval sorting, factors such as industry priorities are considered, so that the retrieval result better meets the actual requirements of the aviation field, and the retrieval accuracy is improved.

The invention provides a file data migration method and device, equipment, a storage medium and a program. The method comprises the following steps: receiving object storage access information, wherein the object storage access information is used for requesting migration of target file data; according to the object storage access information, constructing mapping information between a file local directory of the file storage system and an object storage bucket of an object storage cluster; according to the file path under the local directory of the file, generating a target object identifier in the object storage cluster, the target object identifier being generated by converting a hierarchical structure of the file path; and migrating the target file data from the file storage system to an object storage cluster based on the mapping information and the target object identifier. According to the method, the file storage flexibility can be improved.

Techniques are provided for a data format for efficient management of checkpoint support. The data format corresponds to a base metafile and a set of instance metafiles used to track storage operations such as a directory restore operation. The base metafile and the set of instance metafiles can be used to resume the storage operation from where the storage operation left off in the event of a failure. The base metafile and the set of instance metafiles can be used to track progress of the storage operation processing objects stored within an object store of a cloud storage environment.

The invention provides a PDF (Portable Document Format) document content identification method and device, equipment and a storage medium. The method comprises the following steps: acquiring an access link of an unanalyzed document; downloading the target PDF document from the object storage service according to the access link; when the content region corresponding to the page type in the target PDF document is a text region, dividing the content region into a text region, a table region and an image region according to the page type corresponding to each content region; and when the content region is a text region, extracting a native text character sequence from the text region, and performing similarity calculation on the native text character sequence to generate a semantic coherent paragraph text. According to the method, the sentences with similar semantics in the text region are automatically divided into the same text block based on the cosine similarity, so that the text content with coherent and complete semantics is analyzed from the document, the problem that text paragraphs are broken after document recognition is solved, and the semantic coherence of the document content is effectively improved.

This invention discloses a cache adjustment method, apparatus, device, and computer-readable storage medium, comprising: collecting access characteristic data from the client layer, object storage daemon layer, and device layer respectively; determining the object access mode of the system based on the access characteristic data; and adjusting the cache priority of each access task, the cache capacity ratio between the client layer and the object storage daemon layer, and the data residence time in the cache layer according to the object access mode; wherein the cache layer includes the client layer and the object storage daemon layer. This invention improves cache hit rate and overall read / write throughput performance, and reduces access latency.

The embodiment of the invention provides a big data analysis system, and relates to the technical field of big data, and the system comprises a container meta-management platform which is used for constructing and managing a plurality of container cloud clusters, and creating a tenant corresponding to each user so as to configure each tenant to the required container cloud cluster; the plurality of big data clusters are used for calculating the submitted corresponding data query tasks; according to the multi-tenant platform, a service layer is used for transmitting a data query task to a calculation engine layer under the condition that the data query task submitted by a user is acquired; the calculation engine layer is used for submitting the data query task to a corresponding big data cluster for calculation; the distributed file system is used for storing the read-write permission of each tenant so as to establish connection with the corresponding object storage cluster according to the read-write permission of the tenant corresponding to the data query task; and the object storage system comprises a plurality of object storage clusters for storing read-write data required by the corresponding tenants.

The invention provides a home group PG recovery method and storage device.The method comprises the steps that when a target PG is recovered, the first utilization rate of a target object storage device OSD scheduled by the target PG is obtained; the first utilization rate is compared with a first threshold value, and the recovery data flow direction of the target OSD is obtained; and determining whether to perform recovery operation on the target OSD or not according to the comparison result and the recovery data flow direction. Through the method, the problems of expansion process interruption failure and service interruption caused by the fact that the OSD is fully written in advance in the recovery process can be effectively prevented.

The invention relates to the technical field of cloud storage, can be applied to business system platforms of financial science and technology, medical health and the like, and discloses a migration method, device and equipment of a storage placement group and a medium, and the migration method comprises the following steps: obtaining a distributed storage cluster, and collecting multi-dimensional load data of object storage equipment nodes in the distributed storage cluster; calculating a load score of the object storage device node according to the multi-dimensional load data, and constructing a device capability matrix of the object storage device node by using the load score; identifying a storage cluster mapping graph in the distributed storage cluster, and mapping the equipment capability matrix into a soft weight of the storage cluster mapping graph; soft weight parameter configuration operation is carried out on the storage cluster mapping graph by using the soft weight, and a storage placement group of the distributed storage cluster is constructed according to the configured storage cluster mapping graph; and generating a batch migration scheme of the storage placement group, and executing migration operation on the storage placement group according to the batch migration scheme. The accuracy of migration of the storage placement group can be improved.

Provided herein are systems and methods for configuring automatic evolution of dynamic tables. An example method includes parsing, by at least one hardware processor, a query associated with a dynamic table to determine a current base object dependency of the dynamic table on at least a first base object. A prior base object dependency of the dynamic table on at least a second base object is retrieved. A delta between data stored by the at least first base object and data stored by the at least second base object is determined. The dynamic table is updated based on the delta.

The application provides a wall object splicing method and device and electronic equipment. The method comprises the following steps: obtaining M first wall objects in a straight wall form associated with a starting point of a target wall object in a straight wall form; classifying the M first wall objects into left and right wall objects, storing the first wall objects on the left side of the starting point of the target wall object in a first array, and storing the first wall objects on the right side of the starting point of the target wall object in a second array; determining a first target wall edge contour line closest to the left wall edge on the starting point side of the target wall object in the first array, and determining a second target wall edge contour line closest to the right wall edge on the starting point side of the target wall object in the second array; and determining a first group of splicing points associated with the starting point according to the left and right wall edges on the starting point side of the target wall object and the two target wall edge contour lines. The application can automatically process complex multi-wall joint conditions, ensure the splicing of walls with different thicknesses, and meet the splicing requirements under different complex conditions.

In accordance with an embodiment, described herein are systems and methods for use of an in-memory data grid as a vector database, with linearly-scalable data ingestion, for use in generative artificial intelligence (AI), data visualization, or other applications that include the use of a large language model (LLM) or a retrieval-augmented generation (RAG) process. In accordance with an embodiment, the in-memory data grid provides functionality to represent content as document chunks containing text, embedding, and metadata, which allows the system to support a variety of RAG framework integrations in a consistent manner. To further support the use of RAG processes, the system can support document ingestion via various types of document sources, such as the use of HTTP URLs that allow retrieval of documents using HTTP GET calls; or, for example in cloud environments, the use of object storage and / or other cloud provider storage services as appropriate.

The present application provides a system that integrates BIM and IoT datasets into a digital twin platform, enabling real-time spatial monitoring, semantic referencing, and lifecycle management of building assets. The system includes a BIM interface module, an IFC conversion module, a preprocessing module, and a data linking module. The BIM interface module receives external data to generate or update a BIM model. The IFC conversion module converts the BIM model into an IFC-compatible format with a globally unique identifier. The preprocessing module performs model federation and data normalization, and includes subcomponents for performing geometric conversion to WebGL, semantic structuring, IoT spatial tagging, and floor tagging. The data linking module serializes the output information, uploads it to an object storage area, and registers access URLs and property mappings in the platform database.

Embodiments of the present application provide a structured data context isolation addressing and multi-layer cache analysis method, device and electronic equipment for large language model Agent tool invocation, which relates to the field of artificial intelligence data processing. The method comprises: calling a data acquisition tool to obtain a structured data set of an analysis object and a data set index Key thereof; based on the data set index Key, concurrently starting multiple independent analysis tracks, and after completion of analysis, storing analysis result data to a persistent index layer and an object storage layer, and generating an analysis result identification Key; and based on the analysis result identification Key of each track, the server autonomously reads each dimension analysis result data from the persistent index layer and the object storage layer, and after merging and processing, generates a structured comprehensive analysis report. The technical solution solves problems such as context window pollution, cross-tool data transmission redundancy, lack of efficient cache mechanism for LLM analysis results, and lack of fault tolerance and breakpoint resume capability for analysis pipeline.

A method and system to provide annotation-based domain mapping are disclosed. The method includes receiving a plurality of source domain objects and destination domain objects from a user. Further, the method includes storing the plurality of source domain objects and destination domain objects. Further, the method includes analyzing the destination domain objects to extract predefined annotations. Further, the method includes parsing the predefined annotations to extract mapping details and conditional details. Further, the method includes traversing a metadata graph generated based on the predefined annotations to identify a matching path in a source domain that correlates with a class path present in the metadata graph, and evaluating at least one condition associated with the matching path using at least one source attribute value. Further, the method includes mapping the source attribute value to at least one destination attribute value, upon satisfying the at least one condition.

The present application relates to a big data hybrid storage system and method, and a readable storage medium. The big data hybrid storage system comprises: a first file system, which is used for storing active data; a second file system based on object storage, which is used for storing inactive data; a hybrid storage protocol endpoint, which is used for performing automatic data routing and reading / writing on the first file system and the second file system; and a data synchronization server, which is used for parsing an audit log of the first file system to obtain file usage statistical information, starting a timing task to scan the first file system and the second file system to obtain a corresponding first file list and second file list, and determining, on the basis of the file usage statistical information and the difference between the first file list and the second file list, whether to mirror and synchronize data in the first file system to the second file system. Thus, data storage costs are reduced, and object storage access pressure is alleviated.

The invention discloses a control method and device of storage equipment and the storage equipment, and belongs to the field of storage equipment. The control method of the storage equipment comprises the following steps: acquiring time information of storing each storage object in a target chamber in at least one chamber to the storage equipment and position information of the storage object in the target chamber; generating a first image corresponding to the target chamber based on the time information, the position information and the storage capacity information corresponding to the target chamber; and generating and displaying a second image based on the first image. According to the control method of the storage equipment, the second image used for representing the storage condition of each chamber is generated according to the time information of each storage object stored in the storage equipment in the chamber and the position information of the storage object in the chamber, the number of the storage objects stored in each chamber, the storage duration and other conditions can be visually displayed, and the storage efficiency of the storage equipment is improved. And the real-time performance is high, and the user can conveniently manage the storage equipment, so that the use experience of the user is improved.

The invention provides an intelligent processing system for hospital medical record informatization management, and the system comprises a data storage module which is used for carrying out the butt joint with an existing information system of a hospital through an API gateway, constructing an original database through cloud object storage, and carrying out the centralized storage of structured medical record data and unstructured medical record data; and the term standardization module is used for mapping the medical terms in the medical record to a national standard medical term set. According to the method, automatic analysis, recognition and relation extraction are performed on the text information in the medical record through the medical natural language processing engine, and the text information is filled into the structured data model, so that the medical record information is standardized, and a good basis is provided for clinical scientific research and hospital management. By integrating patient information, historical medical records and medical knowledge maps, diagnosis suggestions and safe medication early warning are provided for doctors in the diagnosis and treatment process, the scientificity of clinical decision making is enhanced, medical risks are reduced, and patient safety is improved.

A system and method for reconciling data from a local database streamed to a Cloud storage service is disclosed. A data transaction is received from a structured query language (SQL) database service operated by a server. The transaction includes log sequence numbers and corresponding data records. The log sequence numbers are stored in a change data capture (CDC) table. The sent data transaction is streamed via a data integration service. A storage object service stores the sent data into an object storage service bucket. A data reconciliation service deploys a cloud trail target to generate a log file of log sequence numbers from the sent data stored in the object storage service bucket. The log file of log sequence numbers is compared with the log sequence numbers in the CDC table. A missing data record is flagged to an exception table based on the comparison. An alert is issued for the missing data record.

This invention discloses a method for processing multimodal data acquisition in intelligent manufacturing systems, relating to the field of industrial data governance technology. The method includes: acquiring multimodal data streams; segmenting raw data blocks and standardizing and encapsulating them to generate metadata records; establishing time indexes, batch indexes, and process indexes; hashing the metadata records to generate content addresses and writing them to object storage; recalculating the hash and comparing the content addresses to complete consistency verification and writing the results to a commit log table; generating operator records for successfully committed data blocks and hashing them to obtain operator addresses; registering lineage edges to form directed acyclic lineage relationships; generating leaf lists according to a preset range and aggregating them to obtain root digests; verifying content addresses object by object based on the leaf lists and root digests; replaying and recalculating to generate replay-derived data blocks; comparing them to generate audit records and storing them. This invention ensures continuous monitoring of data quality during big data acquisition through the replay and recalculation processing of directed acyclic lineage relationships.

The invention provides an object storage volume management method, device and equipment and a readable storage medium, and the method comprises the steps: responding to a write-in request associated with a clone volume, and obtaining a data state of a data object in the clone volume associated with the write-in request; writing data associated with the write-in request in a data area associated with the write-in request in a data object according to an acquisition result that the data state of the data object in the clone volume associated with the write-in request is unready; and marking or keeping marking the data object as a clone object. Through the technical scheme of the specification, the state of the data object is dynamically identified, and local writing and marking are carried out when necessary, so that the overhead of reading and copying full data in copy-on-write is avoided, the writing delay of the clone object is remarkably reduced, the writing operation performance is improved, and meanwhile, the data independence and the space efficiency of the clone volume are kept.

The invention relates to the technical field of Web development, and discloses a three-dimensional visualization processing method and system based on object pool access and a storage medium, and the method comprises the steps: creating a scene object, a matched object pool and a pool manager, and defining a pool capacity and an object creation function; a three-dimensional object storage pool is pre-created, a reset state object in the pool is preferentially reused when an object is requested, and a merging pool is created if no available object exists; object use data, object conditions and interaction requirements are monitored in real time, and the pool capacity, the object creation number, attribute modification parameters and the refresh frequency are dynamically adjusted. According to the method, the problems of performance bottleneck and resource waste caused by frequently creating / destroying objects in traditional three-dimensional rendering are solved, the rendering efficiency and the interaction response speed can be improved, the resource utilization rate is optimized, the system stability is guaranteed, and the method is adaptive to large-scale dynamic three-dimensional visual scenes such as digital twinning and Internet of Things monitoring.

This application discloses a network switching method, apparatus, electronic device, storage medium, and program, relating to the field of distributed storage technology. The method includes: collecting detection data from different layers in a distributed storage system, wherein the different layers include at least one of the following: physical layer, transport layer, and application layer; and the detection data includes at least one of the following: physical layer signal data, transport layer liveness detection data, and application layer verification data; determining the real-time operating status of the storage network based on the detection data; and determining whether to call a virtual network interface to switch the storage traffic of the storage network application to the front-end network based on the real-time operating status. This solves the problem in related technologies where data synchronization between different object storage units is impossible when the storage network is completely interrupted.

The application discloses a container image security detection method and system based on self-defined features, and belongs to the technical field of container image security detection, and aims to solve the technical problem of how to conduct targeted security protection on image security in a multi-element security scene mode. The method comprises the following steps: constructing an image feature object and storing the image feature object in a database in the form of a registry, wherein the image feature object is a set of self-defined rules, and the rules are used to define detection behaviors for security evaluation of image features; for an image package pulled from an image warehouse, a scanner is used to analyze the metadata of the image to obtain an analysis result, and the analysis result is stored in a feature database; and the analysis result is evaluated based on the self-defined rules in the image feature object, and a security alarm is generated if the analysis result matches unsafe behaviors defined in the rules.

A data access method includes that a cloud management platform receives, through an upload interface, first data uploaded by a first client located in a first geographical region, stores the first data in a first object storage bucket in a site located in the first geographical region, and sets a first access domain name for the first data. When the cloud management platform receives a data access request from a second client located in a second geographical region for the first access domain name, the cloud management platform pulls the first data stored in the first object storage bucket to a second object storage bucket in a site located in the second geographical region for access by the second client.

The invention provides a picture loading method and device, electronic equipment and a storage medium, and relates to the technical field of picture loading. The method comprises the steps of obtaining picture addresses of all first target pictures of a current page; converting the first target picture into an optimal compression rate format supported by the terminal equipment by using an object storage service to obtain a second target picture; determining a single-screen height based on the screen size and the picture rendering magnification, and traversing whether the height of the second target picture is greater than the single-screen height; if yes, cutting the second target picture into a plurality of block pictures based on the single-screen height; creating a picture element, storing the picture address of the block picture and / or the second target picture which does not need to be clipped to the self-defined attribute of the picture element, and rendering the picture element to the current page; determining a target picture element based on the page rolling speed of the current page; and reading the picture address in the user-defined attribute of the target picture element to load and display the picture, thereby realizing quick loading of long picture blocks and reducing flow consumption.