575 results about "Big data management" patented technology

A method, a system and a computer program of synchronizing data between a data management system and an external system are disclosed. The method includes creating a first database instance and a second database instance using an integration data model. The method further includes synchronizing data between the second database instance and the external system. A services framework is created and the first database instance and the second database instance are interfaced using the services framework which includes an entity definition repository, a change tracking repository, and a data export element. Also disclosed are a system and a computer program for synchronizing data between a data management system and an external system.

A distributed data management system has multiple virtual machine nodes operating on multiple computers that are in communication with each other over a computer network. Each virtual machine node includes at least one data store or “bucket” for receiving data. A digital hash map data structure is stored in a computer readable medium of at least one of the multiple computers to configure the multiple virtual machine nodes and buckets to provide concurrent, non-blocking access to data in the buckets, the digital hash map data structure including a mapping between the virtual machine nodes and the buckets. The distributed data management system employing dynamic scalability in which one or more buckets from a virtual machine node reaching a memory capacity threshold are transferred to another virtual machine node that is below its memory capacity threshold.

The invention provides a medical big data management system and frame based on a block chain and belongs to the technical field of a smart contract. The invention mainly comprises an integrated frame structure of the system, a registration contract part, a digest contract part and a relation contract part of users and medical record data providers. The whole medical big data management system takes the block chain as the technology base. The users can directly, effectively, rapidly and selectively manage own medical record privacy. The block chain has two characteristics: decentration and tamper resistance, so the truest and most convenient service is provided for the users, comprising patients, hospitals and data warehouses, and the data processing pressure of the data warehouses due to big data centralization is mitigated.

A system for big data aggregation in a sensor network is provided, and the system includes a sensor network which comprises two or more sensor nodes connected to each other over a wired/wireless network and is configured to transfer sensor data generated by each of the two or more sensor nodes to a big data management unit by setting a destination address in the sensor data as an address of a big data management unit; and the big data management unit configured to distribute and dispersedly store the sensor data based on the set destination address of the sensor data.

The invention discloses an Internet-based logistic combination system capable of achieving real-time cargo tracking and having shared public information and the implementation method thereof. The logistic combination system comprises a server, a client and an enterprise terminal, which are connected with each other through the Internet, wherein, a C/S architecture capable of communicating with hardware equipment conveniently and achieving strong data management function is arranged at the enterprise terminal connected with the server; and a B/S architecture for enquiring the state information of cargos through the server is arranged between the client and the server. In the entire process from consignment to reception, all information are uploaded and updated to the server to achieve integral operation of order management, logistic management and inventory management, thereby constructing a network for achieving high logistic efficiency, information safety and resource sharing. The system has wider application range and facilitates development of various services, thereby constructing solid foundation for further development of the logistic system.

A data management system respectively computes first hash values while sliding a window a prescribed amount at a time with respect to a prescribed range from a start location of a data block to a prescribed size. The system extracts, from among the first hash values, a first hash value, which is equivalent to a characteristic value, and partitions the data block into a first chunk of data at a location corresponding to this first hash value. The system determines coincidence between a first chunk of data and a stored second chunk of data, and prevents duplicate data from being stored twice.

The invention provides a large legal data management system based on fuzzy inference. The system comprises a data collection module, a data preprocessing module, a database module, a central server, an information push module and a mobile terminal; the data collection module is used for collecting laws and regulations, cases, monitoring, legal practitioners and social data, storing the same in corresponding databases, and storing the data in the database module after being processed by the data preprocessing module to be trimmed and classified, a fuzzy inference module of a central database carries out large data analysis on the legal provisions and case data and generates accurate case analysis and relevant legal analysis reports, and finally, the information push module pushes the reports to the mobile terminal to provide accurate legal services for users. According to the large legal data management system based on fuzzy inference provided by the invention, internal data relations in related legal laws and regulations systems, case systems, monitoring systems, legal practitioner systems and social systems in law management are mined in depth by the fuzzy mathematics algorithm to provide accurate and efficient quantitative tool support for judicial works.

The invention discloses a log management system based on a block chain. In order to solve the problems that in an information system, the log data size is large, traditional file storage is not enoughto meet the requirement, and meanwhile, the high value of logs needs to achieve safe storage of the files, log documents are stored through a distributed system architecture, and the confidentialityof data is guaranteed through data encryption; However, in a distributed storage process, a user generally cannot control a data storage server being used, which means that there is a risk of data confidentiality, data integrity and data availability. The appearance of the block chain technology provides a feasible technical path for log big data management, the block chain has the characteristicsof decentralization, detrust, difficulty in information tampering and the like, and integrity proving of the data can be effectively realized.

The invention relates to the field of smart city and big data and discloses an event driven based smart city big data system and a processing method. The big data system comprises a big data acquisition layer, a big data transmission layer, a big data storage management layer, a big data computational analysis layer and a big data application service layer. The big data acquisition layer realizes data acquisition by means of the Internet of Things technology; the big data transmission layer transmits data to the big data storage management layer; the big data storage management layer realizes storage of big data in the smart city; the big data computational analysis layer realizes processing and analysis of the big data in the smart city; the big data application service layer provides big data services for users and city managers and provides processing and analysis results obtained by a big data processing layer for the users in real time in a service manner. By the event driven based smart city big data system and the processing method, big data management and utilization modes can be improved effectively, service and decision making capacity of the smart city can be improved through big data, and smart city management and services are realized.

The invention discloses an engineering construction multi-dimensional dynamic information fusion and cooperation interactive system, comprising a professional system, a data management system, a progress management system, a positioning system, a monitoring system, a BIMVR system, a communication system and a construction system. The professional system, the data management system and the BIMVR system are combined to built a simulation engineering model and actual construction site scenes and the simulation engineering three-dimensional model are combined to achieve data interaction, thus, real-time data acquisition and interaction between software and hardware equipment under control of the software are both achieved. A non-linear management mode is utilized to manage construction progress, last-minute changes of progresses can be adjusted in any time, and progress management is much flexible and convenient. A block chain technique is utilized for data management, particularly, multi-point mesh block structure is built through the block chain technique, all terminals participates recording of a database, and thus, safety and flexibility in use of the whole system is guaranteed effectively.

The invention relates to a well site data integration cooperative work platform that comprises a data acquisition module, a central database and an engineering technology cooperative work platform. The engineering technology cooperative work platform comprises a query display module, a geological comprehensive research module, a while-drilling dynamic tracking and analysis module, a knowledge base management module, a mobile monitoring module and a remote decision support module. The well site data integration cooperative work platform builds a standardized and unified big data management platform, achieves production site information comprehensive application, achieves well site and base field data synchronization analysis application, eliminates information isolated island, provides an integrated cooperative work platform for drilling engineers, geologists, reservoir engineers and managers, fully shares information, makes decisions more intuitively and rapidly, guides field operation in real time, improves the efficiency and quality of well site operation management, and brings the reformation of production management modes.

The invention provides a smart city big data management system, and relates to the technical field of smart cities, and the system comprises: a big data center station which is used for collecting city big data provided by city infrastructures, carrying out the preprocessing of the city big data to obtain preprocessed big data, and storing the preprocessed big data to form a city brain database; acollaborative sharing platform which is used for carrying out capacity encapsulation and protocol adaptation on the capacity components, abstracting the capacity components into atomic energy, and providing services to the outside through an open communication interface so as to support business applications of different technical systems to call and interact with the preprocessed big data; and an auxiliary decision application which is used for carrying out artificial intelligence analysis according to a pre-generated adaptive decision analysis engine set and the preprocessed big data, and displaying an analysis result to an urban manager through an urban instrument panel so as to monitor an urban operation state in real time and provide technical support for decision making of the urbanmanager. According to the invention, the city can self-discover problems to the greatest extent and assist in solving the problems.

The invention provides a large data management system which adopts a distribution type framework. The system comprises a local data server and a principal data server, wherein the local data server provides a local clustered database which constitutes a high-availability cluster by means of two machines and a disk array; the principal data server provides cluster proxy service which is data access proxy service of the local clustered database. Preferably, the large data management system further comprises one or more clients which are suitable for determining whether the one or more clients have the authority to have access to a target data point by having access to the cluster proxy service, obtaining position information of the local clustered database where the target data point belongs to, and directly having access to the local clustered database corresponding to the position information. The large data management system solves the problem of super-large-scale data management capacity of a system by means of the distribution type high-availability cluster framework, and solves the problem of high-frequency data sampling and processing capacity by the adoption of a local real-time database.

The invention provides a shared bicycle controlled site map and location and service big data system comprising a shared bicycle cloud service platform. The shared bicycle cloud service platform comprises a preset parking site big data management module, a no-parking big data management module, a preset parking site optimization route big data management module, a cloud computing analysis module, a third-party professional organization oriented warning module, a popularity big data management module, a high-credit user management module, a credit big data management module, and a cloud service platform two-way transmission module. A user mobile terminal system comprises a user mobile terminal two-way transmission module, a surrounding check module, a start module, a navigation positioning location information acquisition module, a customer credit query module, a hotspot demand display module, and a specified location area type display module. The system can overcome the problem that precise demand popularity guidance and restriction cannot be realized due to low precision of shared bicycle parking sites and routes.

The invention discloses a park-oriented internet of things big data management and application platform, and relates to the technical field of internet of things. The park-oriented internet of thingsbig data management and application platform comprises a park sensor unit, an internet of things unit, a real-time computing unit, a data transfer unit, a storage unit and an offline computing unit. According to the park-oriented internet of things big data management and application platform, a park level big data platform is established, big data within a park range are collected by using the park sensor unit via the internet of things, and analysis and customized services are provided on the basis of the big data; for each unit in a park, the overall influence degree of the unit on a traffic, an energy consumption and an environment of the park is computed, thereby realizing intelligent management for a large-scale industrial science and technology park; the management working efficiency is high, the time and the labor are saved, and the management cost is relatively low.

A system may retrieve a pattern from a pattern database with the pattern identifying a type of sensitive data. The system may also retrieve data identified by a variable from a big data management system. The system may then match the data to the pattern to detect the type of sensitive data in the data. An output may be generated in response to the data matching the pattern. A variable access permission may be retrieved for the variable from a permissions repository, a sensitive data permission may be retrieved for the type of sensitive data from the permissions repository, and the variable access permission may be compared to the sensitive data permission to detect a discrepancy.

The invention relates to a data management service system based on large data. The data management service system comprises a heterogeneous data normalized-description module, a data semantization module, a data storage performance module, a data logic-management module, a data scenarization and service matching module and a data display module. The data management service system based on scenes solves the problems as follows: first, the data volumes are large at present, the data variety is large, the data is from various data sources, and the data categories and formats are rich; as a result, the problem of difficult storage is formed; second, the description of data heterogeneity: the data with multi-source large data forms data islands; different data structures exit in each data source, and at the same time, different designation systems also exist in each data source; the homogeneous data can also not interoperate; third, the data matching problem: the data matching problem is formed as the structures of data categories are different, the precision ratio and the recall rate are low, and the query cost is high.

The invention discloses a cloud platform auditing system based on big data management analysis, and relates to a cloud auditing system, in particular to a cloud platform auditing system based on big data management analysis. The cloud platform auditing system based on big data management analysis comprises a cloud platform, an equipment management module, a data auditing module, a statistic analysis module, a data storage module, an application control module and a safety protection module; the equipment management module includes network mode setting, management port setting, monitoring port setting, system time setting, equipment debugging and equipment maintenance; the network mode setting includes a network, a bypass and a gateway; the system time setting includes network synchronization and manual setting; the equipment debugging includes network sniffing, network routing and network communication; and the equipment maintenance includes system upgrade, configuration storage and factory setting restoration. The cloud platform auditing system is a networking information auditing system which has various network access modes and is comprehensive in audit contents and safe in data, so as to solve various problems caused by leakage of current enterprise and personal information.

The invention provides a test system and a test method for detecting and maintaining a rail transit braking system. The test system comprises a test subsystem, a data management subsystem and a query application subsystem, wherein the test subsystem is used for acquiring, comparing and outputting data; the data management subsystem stores a result to a server and analyzes the result through big data management; and the query application subsystem uses terminal application software and equipment to enable a user to instantly, dynamically and historically know and monitor a detection state and a maintenance state. The test method comprises steps: the test subsystem is used for carrying out detection operation on a train braking system; the data management subsystem is used for carrying out data management on the detection result; and the query application subsystem is used for providing query service for the user. Thus, automation and standardization of detection on the rail transit train braking system can be realized, digitization of the test result can be realized, various types of reports can be directly outputted from the server, direct storage and remote query are realized, and a data basis is provided for preventive maintenance.

The invention relates to an interactive query method suitable for multiple big data management systems. The method comprises the steps of 1) building an associated document model, which comprises a document set and an association set, wherein the association set is a set composed of associations among documents; 2) converting different original data models into associated document models, and connecting different data sources integrally through the associated document models; 3) based on the associated document models, establishing a unified query language suitable for multivariate data; and 4) by utilizing the unified query language suitable for the multivariate data, realizing unified query of a relational database, a graph database and a file system. According to the method, the unified query language suitable for the multivariate data management system is proposed for the first time, so that the unified query of the relational database, the graph database and the file system can be realized.