576 results about "Big data management" patented technology

A method, a system and a computer program of synchronizing data between a data management system and an external system are disclosed. The method includes creating a first database instance and a second database instance using an integration data model. The method further includes synchronizing data between the second database instance and the external system. A services framework is created and the first database instance and the second database instance are interfaced using the services framework which includes an entity definition repository, a change tracking repository, and a data export element. Also disclosed are a system and a computer program for synchronizing data between a data management system and an external system.

The invention discloses a planning big data management and control system of a smart power distribution network and a method. The system comprises that a data layer constructs a global power network planning model; a basic data dictionary containing power network devices, graph standards and power network operation information is built; an application layer carries out statistic analysis and real time load actual measurement analysis to the power network devices and power network operation states in a set region; automatic filling of power network load data graphs, intelligent operation of planning data, intelligent verification of the planning data and intelligent statistics and summary of the planning data are realized; a service layer selects planning power network schemes; a display layer carries out centralized display, share and information issue to the planning and design achievement. According to the system and the method of the invention, through taking multi-source massive data such as basic geographic information, power network space and attribute thematic information and power network operation real time information as cores, planning and design data resources in the system are effectively integrated, a power network planning and design integrated information platform is built, and power network planning and design information-based foundation is tamped.

A distributed data management system has multiple virtual machine nodes operating on multiple computers that are in communication with each other over a computer network. Each virtual machine node includes at least one data store or “bucket” for receiving data. A digital hash map data structure is stored in a computer readable medium of at least one of the multiple computers to configure the multiple virtual machine nodes and buckets to provide concurrent, non-blocking access to data in the buckets, the digital hash map data structure including a mapping between the virtual machine nodes and the buckets. The distributed data management system employing dynamic scalability in which one or more buckets from a virtual machine node reaching a memory capacity threshold are transferred to another virtual machine node that is below its memory capacity threshold.

The invention provides a medical big data management system and frame based on a block chain and belongs to the technical field of a smart contract. The invention mainly comprises an integrated frame structure of the system, a registration contract part, a digest contract part and a relation contract part of users and medical record data providers. The whole medical big data management system takes the block chain as the technology base. The users can directly, effectively, rapidly and selectively manage own medical record privacy. The block chain has two characteristics: decentration and tamper resistance, so the truest and most convenient service is provided for the users, comprising patients, hospitals and data warehouses, and the data processing pressure of the data warehouses due to big data centralization is mitigated.

The invention provides a method and a device for automatic installation and deployment of a hadoop platform. The method comprises the following steps of storing installation packages in different release versions and in different version numbers in a yum installation server according to directory hierarchy; allowing hadoop version configuration files in different release versions and in different version numbers to form configuration list information according to the directory hierarchy, storing the configuration list information on a big data management platform, and storing repo installation source files and a hadoop service directory list under a version number directory layer; running the big data management platform and uploading the configuration list information; creating a cluster and selecting a hadoop release version and a version number; allowing hosts to join the cluster, and distributing the repo installation source files to the hosts; selecting a hadoop service; configuring necessary parameters of the hadoop service; generating installation and start task information by using the big data management platform, and sending the installation starting task information to each host by using the big data management platform; allowing each host to acquire a software installation package of the corresponding hadoop service and automatically install and start each service according to the installation and start task information. The method and the device solve the problem of differentiation and are universally applied to installation of various open source editions.

A system for big data aggregation in a sensor network is provided, and the system includes a sensor network which comprises two or more sensor nodes connected to each other over a wired / wireless network and is configured to transfer sensor data generated by each of the two or more sensor nodes to a big data management unit by setting a destination address in the sensor data as an address of a big data management unit; and the big data management unit configured to distribute and dispersedly store the sensor data based on the set destination address of the sensor data.

The invention proposes an intelligent video analysis method. The method comprises the following steps of S1, creating a training sample according to an obtained video image; S2, extracting a characteristic according to the training sample; S3, establishing a training classification model according to the extracted characteristic; and S4, detecting a target according to the training classification model. The method has a capability of intelligently analyzing, acquiring, storing and transmitting large-scale diversified basic videos, an image big data management capability, and integrative capabilities of interconnection with other business systems and the like. Characteristic description information can be stored to form an index, and a video of a concerned event can be quickly located and played from massive video files by effectively utilizing and managing stored video file resources, so that the video record reverse query efficiency is improved and intelligent management of video data is realized.

The invention discloses an Internet-based logistic combination system capable of achieving real-time cargo tracking and having shared public information and the implementation method thereof. The logistic combination system comprises a server, a client and an enterprise terminal, which are connected with each other through the Internet, wherein, a C / S architecture capable of communicating with hardware equipment conveniently and achieving strong data management function is arranged at the enterprise terminal connected with the server; and a B / S architecture for enquiring the state information of cargos through the server is arranged between the client and the server. In the entire process from consignment to reception, all information are uploaded and updated to the server to achieve integral operation of order management, logistic management and inventory management, thereby constructing a network for achieving high logistic efficiency, information safety and resource sharing. The system has wider application range and facilitates development of various services, thereby constructing solid foundation for further development of the logistic system.

A data management system respectively computes first hash values while sliding a window a prescribed amount at a time with respect to a prescribed range from a start location of a data block to a prescribed size. The system extracts, from among the first hash values, a first hash value, which is equivalent to a characteristic value, and partitions the data block into a first chunk of data at a location corresponding to this first hash value. The system determines coincidence between a first chunk of data and a stored second chunk of data, and prevents duplicate data from being stored twice.

The invention provides a large legal data management system based on fuzzy inference. The system comprises a data collection module, a data preprocessing module, a database module, a central server, an information push module and a mobile terminal; the data collection module is used for collecting laws and regulations, cases, monitoring, legal practitioners and social data, storing the same in corresponding databases, and storing the data in the database module after being processed by the data preprocessing module to be trimmed and classified, a fuzzy inference module of a central database carries out large data analysis on the legal provisions and case data and generates accurate case analysis and relevant legal analysis reports, and finally, the information push module pushes the reports to the mobile terminal to provide accurate legal services for users. According to the large legal data management system based on fuzzy inference provided by the invention, internal data relations in related legal laws and regulations systems, case systems, monitoring systems, legal practitioner systems and social systems in law management are mined in depth by the fuzzy mathematics algorithm to provide accurate and efficient quantitative tool support for judicial works.

The invention discloses a log management system based on a block chain. In order to solve the problems that in an information system, the log data size is large, traditional file storage is not enoughto meet the requirement, and meanwhile, the high value of logs needs to achieve safe storage of the files, log documents are stored through a distributed system architecture, and the confidentialityof data is guaranteed through data encryption; However, in a distributed storage process, a user generally cannot control a data storage server being used, which means that there is a risk of data confidentiality, data integrity and data availability. The appearance of the block chain technology provides a feasible technical path for log big data management, the block chain has the characteristicsof decentralization, detrust, difficulty in information tampering and the like, and integrity proving of the data can be effectively realized.

The invention relates to the field of smart city and big data and discloses an event driven based smart city big data system and a processing method. The big data system comprises a big data acquisition layer, a big data transmission layer, a big data storage management layer, a big data computational analysis layer and a big data application service layer. The big data acquisition layer realizes data acquisition by means of the Internet of Things technology; the big data transmission layer transmits data to the big data storage management layer; the big data storage management layer realizes storage of big data in the smart city; the big data computational analysis layer realizes processing and analysis of the big data in the smart city; the big data application service layer provides big data services for users and city managers and provides processing and analysis results obtained by a big data processing layer for the users in real time in a service manner. By the event driven based smart city big data system and the processing method, big data management and utilization modes can be improved effectively, service and decision making capacity of the smart city can be improved through big data, and smart city management and services are realized.

The invention discloses an engineering construction multi-dimensional dynamic information fusion and cooperation interactive system, comprising a professional system, a data management system, a progress management system, a positioning system, a monitoring system, a BIMVR system, a communication system and a construction system. The professional system, the data management system and the BIMVR system are combined to built a simulation engineering model and actual construction site scenes and the simulation engineering three-dimensional model are combined to achieve data interaction, thus, real-time data acquisition and interaction between software and hardware equipment under control of the software are both achieved. A non-linear management mode is utilized to manage construction progress, last-minute changes of progresses can be adjusted in any time, and progress management is much flexible and convenient. A block chain technique is utilized for data management, particularly, multi-point mesh block structure is built through the block chain technique, all terminals participates recording of a database, and thus, safety and flexibility in use of the whole system is guaranteed effectively.

The invention relates to a well site data integration cooperative work platform that comprises a data acquisition module, a central database and an engineering technology cooperative work platform. The engineering technology cooperative work platform comprises a query display module, a geological comprehensive research module, a while-drilling dynamic tracking and analysis module, a knowledge base management module, a mobile monitoring module and a remote decision support module. The well site data integration cooperative work platform builds a standardized and unified big data management platform, achieves production site information comprehensive application, achieves well site and base field data synchronization analysis application, eliminates information isolated island, provides an integrated cooperative work platform for drilling engineers, geologists, reservoir engineers and managers, fully shares information, makes decisions more intuitively and rapidly, guides field operation in real time, improves the efficiency and quality of well site operation management, and brings the reformation of production management modes.

The invention provides a public service platform for industrial energy management. The public service platform comprises an application layer, a data center and a communication layer. The application layer mainly comprises parts of energy consumption online monitoring, economic operation analysis, electronic energy-saving supervision and enterprise service. The data center comprises a data storage module and a data analysis module. The communication layer is a data collection and data unification and normalization processing part. The system is based on enterprise CIM, and a unified data model is established via unified and normalized processing of enterprise information and energy consumption information, and a double engine mass big data management platform; according to the system provided by the invention, data sent by monitoring apparatuses of existing industrial enterprises can be encoded uniformly and a unified model parameter service is provided; and a standard real-time data service is provided for online monitoring of energy consumption and an energy-saving diagnostic decision, thereby solving the problems that existing enterprise energy consumption online monitoring systems are imperfect, the overall energy consumption trends and economic operating situations of the industrial enterprises cannot be comprehensively and timely grasped by government agencies, and the like.

A virtual stored data management system is provided. In one embodiment, the management system includes one or more hosts and a plurality of data storage elements functionally coupled to the hosts. Each data storage element includes a host network attachment, data transfer means, a storage controller, and permanent data storage media. The permanent data storage media is organized with management information uniquely associated with units of the data such that the management information may be manipulated in several different locations within the management system substantially simultaneously. Thus, the organization of the management processes allows for the management information to be processed, used, changed, or modified in several different locations within the management system at any particular instance. Provision is made for the internal processes to discover the current location of the processing, for the location to be changed as directed, and for the processing to be kept consistent when done in more than one place simultaneously.

The invention provides a smart city big data management system, and relates to the technical field of smart cities, and the system comprises: a big data center station which is used for collecting city big data provided by city infrastructures, carrying out the preprocessing of the city big data to obtain preprocessed big data, and storing the preprocessed big data to form a city brain database; acollaborative sharing platform which is used for carrying out capacity encapsulation and protocol adaptation on the capacity components, abstracting the capacity components into atomic energy, and providing services to the outside through an open communication interface so as to support business applications of different technical systems to call and interact with the preprocessed big data; and an auxiliary decision application which is used for carrying out artificial intelligence analysis according to a pre-generated adaptive decision analysis engine set and the preprocessed big data, and displaying an analysis result to an urban manager through an urban instrument panel so as to monitor an urban operation state in real time and provide technical support for decision making of the urbanmanager. According to the invention, the city can self-discover problems to the greatest extent and assist in solving the problems.

The invention provides a large data management system which adopts a distribution type framework. The system comprises a local data server and a principal data server, wherein the local data server provides a local clustered database which constitutes a high-availability cluster by means of two machines and a disk array; the principal data server provides cluster proxy service which is data access proxy service of the local clustered database. Preferably, the large data management system further comprises one or more clients which are suitable for determining whether the one or more clients have the authority to have access to a target data point by having access to the cluster proxy service, obtaining position information of the local clustered database where the target data point belongs to, and directly having access to the local clustered database corresponding to the position information. The large data management system solves the problem of super-large-scale data management capacity of a system by means of the distribution type high-availability cluster framework, and solves the problem of high-frequency data sampling and processing capacity by the adoption of a local real-time database.

The invention provides a shared bicycle controlled site map and location and service big data system comprising a shared bicycle cloud service platform. The shared bicycle cloud service platform comprises a preset parking site big data management module, a no-parking big data management module, a preset parking site optimization route big data management module, a cloud computing analysis module, a third-party professional organization oriented warning module, a popularity big data management module, a high-credit user management module, a credit big data management module, and a cloud service platform two-way transmission module. A user mobile terminal system comprises a user mobile terminal two-way transmission module, a surrounding check module, a start module, a navigation positioning location information acquisition module, a customer credit query module, a hotspot demand display module, and a specified location area type display module. The system can overcome the problem that precise demand popularity guidance and restriction cannot be realized due to low precision of shared bicycle parking sites and routes.

The invention discloses a park-oriented internet of things big data management and application platform, and relates to the technical field of internet of things. The park-oriented internet of thingsbig data management and application platform comprises a park sensor unit, an internet of things unit, a real-time computing unit, a data transfer unit, a storage unit and an offline computing unit. According to the park-oriented internet of things big data management and application platform, a park level big data platform is established, big data within a park range are collected by using the park sensor unit via the internet of things, and analysis and customized services are provided on the basis of the big data; for each unit in a park, the overall influence degree of the unit on a traffic, an energy consumption and an environment of the park is computed, thereby realizing intelligent management for a large-scale industrial science and technology park; the management working efficiency is high, the time and the labor are saved, and the management cost is relatively low.

In a data management system in which a data server cooperates with other data servers connected thereto via a network, each data server has a data management section in which one or more data items are stored in correspondence to globally unique data identifiers, a request processor section that searches the data management section for data item requested from a client, provides the requested data item to the client when the requested data item is found, and transmits a data inquiry to other data server on the network to detect a data server storing the requested data item when the requested data item is not found; and a response section that searches, when receiving a data inquiry transmitted from another data server, the data management section for the requested data item and transmits to the another data server a result of the search.

A system may retrieve a pattern from a pattern database with the pattern identifying a type of sensitive data. The system may also retrieve data identified by a variable from a big data management system. The system may then match the data to the pattern to detect the type of sensitive data in the data. An output may be generated in response to the data matching the pattern. A variable access permission may be retrieved for the variable from a permissions repository, a sensitive data permission may be retrieved for the type of sensitive data from the permissions repository, and the variable access permission may be compared to the sensitive data permission to detect a discrepancy.

A distributed data management system has multiple virtual machine nodes operating on multiple computers that are in communication with each other over a computer network. Each virtual machine node includes at least one data store or “bucket” for receiving data. A digital hash map data structure is stored in a computer readable medium of at least one of the multiple computers to configure the multiple virtual machine nodes and buckets to provide concurrent, non-blocking access to data in the buckets, the digital hash map data structure including a mapping between the virtual machine nodes and the buckets. The distributed data management system employing dynamic scalability in which one or more buckets from a virtual machine node reaching a memory capacity threshold are transferred to another virtual machine node that is below its memory capacity threshold.

The invention relates to a data management service system based on large data. The data management service system comprises a heterogeneous data normalized-description module, a data semantization module, a data storage performance module, a data logic-management module, a data scenarization and service matching module and a data display module. The data management service system based on scenes solves the problems as follows: first, the data volumes are large at present, the data variety is large, the data is from various data sources, and the data categories and formats are rich; as a result, the problem of difficult storage is formed; second, the description of data heterogeneity: the data with multi-source large data forms data islands; different data structures exit in each data source, and at the same time, different designation systems also exist in each data source; the homogeneous data can also not interoperate; third, the data matching problem: the data matching problem is formed as the structures of data categories are different, the precision ratio and the recall rate are low, and the query cost is high.

The invention belongs to the technical field of Internet of Things, also belongs to the technical field of medical instrument management, and in particular to a surgical instrument. The surgical instrument comprises a body and an ultrahigh frequency RFID (Radio Frequency Identification Device) tag; and the ultrahigh frequency RFID tag is fixed on a preset position of the body through an adhesive or a plastic package buckle. The invention also discloses a management system of the surgical instrument. The surgical instrument is provided with the ultrahigh frequency RFID tag; the management system comprises a local server, an RFID reader-writer and a cloud server; the local server is connected with the cloud server for data sharing; the local server is connected with the RFID reader-writer for data transmission; and the RFID reader-writer is used for reading the ultrahigh frequency RFID tag. The ultrahigh frequency RFID tag is fixed on a position of the surgical instrument body and does not affect the normal use of the surgical instrument; the ultrahigh frequency RFID tag endows a traceable function to the surgical instrument; the corresponding numerical information can be managed in real time; big data management is realized so that the surgical instrument is intelligent.

The invention provides a doctor and patient data management system and method. The system comprises a patient main index module, a department main index module, a staff main index module and a main data management module, wherein the patient main index module generates patient main index information according to patient information and provides query and subscription services of the patient main index information; the department main index module generates department main index information according to department information and provides query and subscription services of the department main index information; the staff main index module generates staff main index information according to medical personnel information and provides query and subscription services of the staff main index information; and the main data management module obtains and stores standard business terms and standard business dictionaries, and provides query and subscription services of the standard business terms and the standard business dictionaries. According to the system and the method, unique patient main index, department main index and staff main index are realized among medical information systems, so that unique business terms and business dictionaries among the systems are ensured, and system connection and information sharing can be realized.

The invention discloses a cloud platform auditing system based on big data management analysis, and relates to a cloud auditing system, in particular to a cloud platform auditing system based on big data management analysis. The cloud platform auditing system based on big data management analysis comprises a cloud platform, an equipment management module, a data auditing module, a statistic analysis module, a data storage module, an application control module and a safety protection module; the equipment management module includes network mode setting, management port setting, monitoring port setting, system time setting, equipment debugging and equipment maintenance; the network mode setting includes a network, a bypass and a gateway; the system time setting includes network synchronization and manual setting; the equipment debugging includes network sniffing, network routing and network communication; and the equipment maintenance includes system upgrade, configuration storage and factory setting restoration. The cloud platform auditing system is a networking information auditing system which has various network access modes and is comprehensive in audit contents and safe in data, so as to solve various problems caused by leakage of current enterprise and personal information.

The invention provides a test system and a test method for detecting and maintaining a rail transit braking system. The test system comprises a test subsystem, a data management subsystem and a query application subsystem, wherein the test subsystem is used for acquiring, comparing and outputting data; the data management subsystem stores a result to a server and analyzes the result through big data management; and the query application subsystem uses terminal application software and equipment to enable a user to instantly, dynamically and historically know and monitor a detection state and a maintenance state. The test method comprises steps: the test subsystem is used for carrying out detection operation on a train braking system; the data management subsystem is used for carrying out data management on the detection result; and the query application subsystem is used for providing query service for the user. Thus, automation and standardization of detection on the rail transit train braking system can be realized, digitization of the test result can be realized, various types of reports can be directly outputted from the server, direct storage and remote query are realized, and a data basis is provided for preventive maintenance.

The invention discloses a road slope three-dimensional visualization modeling method, and particularly relates to the technical field of road slope modeling, and the method comprises the following modeling steps: S1, constructing a roadbed slope three-dimensional visualization model; S2, constructing a slope structure model and displaying vector data information. According to the invention, technologies such as geographic information, virtual reality, big data management, roadbed slope engineering and the like are comprehensively applied; the construction of a roadbed slope three-dimensional visual live-action model and a navigation technology are researched. a three-dimensional visualization scheme of the slope is constructed and the technical problem of compatible display of the model ona 'cloud eye' system platform is solved; meanwhile, structure vector data on the side slope body is subjected to integrated processing; the structure three-dimensional visualization model is constructed, roadbed slope basic information, a protection and reinforcement structure, a construction process and safety monitoring and maintenance information are fused and visually, clearly and selectivelydisplayed through the three-dimensional model, the loading speed during browsing is high, and the user experience is good.

The invention relates to an interactive query method suitable for multiple big data management systems. The method comprises the steps of 1) building an associated document model, which comprises a document set and an association set, wherein the association set is a set composed of associations among documents; 2) converting different original data models into associated document models, and connecting different data sources integrally through the associated document models; 3) based on the associated document models, establishing a unified query language suitable for multivariate data; and 4) by utilizing the unified query language suitable for the multivariate data, realizing unified query of a relational database, a graph database and a file system. According to the method, the unified query language suitable for the multivariate data management system is proposed for the first time, so that the unified query of the relational database, the graph database and the file system can be realized.