64 results about "User-defined function" patented technology

The invention relates to a data processing method and device of a distributed computing engine and electronic equipment. The method comprises the steps that under the condition that a structured query statement of a client side is received, the structured query statement is analyzed, a first task and a target task are obtained, the structured query statement comprises a user-defined function, the target task is a task corresponding to the user-defined function, and the first task is a task corresponding to statements except the user-defined function; calling an interface of the target custom function server to enable the target custom function server to execute the target task; target data generated by the target self-defined function server and first data generated by the working node of the distributed computing engine serve as execution results of the structured query statement and are returned to the client side, and the first data are data obtained when the working node of the distributed computing engine executes the first task. According to the method and the device, the technical problem of low processing efficiency of the structured query statement comprising the custom function is solved.

The invention belongs to the technical field of artificial intelligence, is applied to the field of financial science and technology and the field of medical health, and discloses a rule engine configuration method, device and equipment based on machine learning and a storage medium. The method comprises the steps that historical calculation data and performance indexes in historical calculation tasks are collected, and a training data set is constructed; a machine learning model is trained, and algorithm parameters of the rule engine are dynamically optimized through the training data set; configuring an expression and a user-defined function of a rule engine, and realizing analysis and execution of scripts through JEXL (JavaScript Exchange Library); establishing a dynamic mapping relationship between the algorithm configuration library and the business variables, mapping algorithm variable names and business variable names, and generating configurable algorithm rules; and analyzing task load and resource requirements based on a pre-trained machine learning model, distributing system resources, and repairing abnormal behaviors in a calculation process. According to the invention, the problems of low processing efficiency, high maintenance cost, unreasonable resource allocation and poor expandability in the prior art are solved.

The present application discloses a data transmission method and device. The method comprises: receiving a query request sent from a target account, wherein the query request at least comprises a target data set requested to be accessed by the target account; when there is sensitive data in the target data set, selecting a target function from among pre-registered custom functions, and performing a desensitization operation on the target data set by means of the target function to obtain a desensitized target data set, wherein the custom functions are deployed in a plurality of versions of distributed engines; and sending the desensitized target data set to the target account. The present application solves the technical problem in the related art of low adaptability of data desensitization methods.

Systems and methods for compressing and querying data for real-time analytics. The system can receive log data and generate an intermediate representation by parsing a log template and variables from the log data into a columnar format. The method includes generating a compressed intermediate representation associated with an index type and storing the compressed intermediate representation in the columnar format based on the index type. The method includes receiving a search query and analyzing the search query to identify a user defined function. The method includes parsing the search query to convert the search query into one or more predicates that satisfy the search query. The method includes filtering the compressed log data based on the one or more predicates and providing a query result.

The invention discloses a data simulation method based on a database function and a timed task. The method comprises the following steps: S1, acquiring source data based on a multi-modal lightweight intelligent acquisition strategy; s2, performing data cleaning and standardization so as to ensure engineering processing of simulation data quality and consistency; s3, creating a user-defined function in the database to package intelligent logic of data simulation; according to a time condition and a data mode in the timed task, intelligently performing simulation trigger judgment and simulation data generation through the user-defined function; s4, performing efficient data injection based on a buffer and batch optimization mechanism of the intermediate table; and S5, performing timed task period regulation and control. The invention further discloses a corresponding system, electronic equipment and a computer readable storage medium.

A data platform for managing an application as a first-class database object. The data platform includes at least one processor and a memory storing instructions that cause the at least one processor to perform operations including detecting a data request from a browser for a data object located on the data platform, executing a stored procedure, the stored procedure containing instructions that cause the at least one processor to perform additional operations including instantiating a User Defined Function (UDF) server, an application engine, and the application within a security context of the data platform based on a security policy determined by an owner of the data object. The data platform then communicates with the browser using the application engine as a proxy server.

The invention relates to the technical field of network security, and discloses a program-level code similarity analysis method and device based on semantic slicing, and the method comprises the steps: constructing a program-level target function call graph based on a target source code; matching the target function call graph with a standard function call graph to obtain a plurality of isomorphic sub-graphs; performing semantic slicing on each function node in the first sub-graph and the second sub-graph to obtain a first slicing result of the first sub-graph and a second slicing result of the second sub-graph; and evaluating the slice similarity between each function in the first slice result and each function in the second slice result, and determining the similarity of the target source code according to the slice similarity. According to the method, the user-defined function call graph for eliminating system function interference is constructed, an isomorphic sub-graph matching algorithm is combined, multi-dimensional features are comprehensively considered, the accuracy of similarity calculation is improved, effective support is provided for practical application scenes such as code reconstruction and security audit, and the guarantee of code quality and security is improved.

The present invention relates to a method for converting a Simulink-StateFlow model into a NuSMV model, which includes the following steps: conducting a requirements analysis on the system to be evaluated and constructing a Simulink-StateFlow model; extracting program statements, custom function statements, and logical sequence relationships in the model, and respectively constructing a program statement data table, a custom function data table, and a logical sequence data table; integrating the model program and sequence to generate a model information table; analyzing the Matlab programming language and constructing Matlab syntax rules; processing the program statements in the model information table according to the syntax rules and parsing them into an abstract syntax tree; processing the abstract syntax tree to determine an algorithm for converting it into NuSMV statements; and processing the model information table according to the conversion algorithm to generate a NuSMV model. The present invention greatly improves the efficiency and accuracy of the NuSMV tool for model checking of the Simulink-StateFlow model, and realizes the safety verification of the Simulink requirements model of the control system.

The present application discloses a method, device and medium for calculating performance indicators in a network management system, which relates to the field of network management. In order to reduce resource usage when calculating indicators, the present application automatically calls the custom function corresponding to the indicator to obtain the calculation result of the performance indicator by calling the custom function and the grammatical parsing tree through the query command after receiving the query request. By using database function calculation, the database CPU resources can be fully utilized and the consumption of application server CPU resources can be reduced. There is no need to perform complex indicator calculation logic at the network management application layer, which greatly simplifies the performance indicator calculation process in the network management system. In the scenario of large data volume, there is no need to increase the application server CPU resources, which effectively solves the problem of computing efficiency bottleneck.

Using custom functions to access a cloud-based data warehouse including: receiving, by a workbook manager from a client computing system, a call to a first user-defined function input to an element of a workbook, wherein the workbook presents a dataset from a cloud-based data warehouse, wherein the first user-defined function is defined in the workbook manager; and executing, by the workbook manager and in the cloud-based data warehouse, based on the call to the first user-defined function, a second user-defined function defined in the cloud-based data warehouse.

This invention discloses a pallet rental data management method, system, intelligent device, and storage medium. The method includes: obtaining the user identifier of the current user and the database identifier of the currently accessed database; obtaining a customer number list string based on the user identifier and database identifier; saving the customer number list string to a session variable; establishing a custom function to obtain the customer number list string; splitting the customer number list string into a row-based list view; establishing a data view for the relevant data tables in the currently accessed database; associating the list view with the data view to obtain the associated view; setting the relevant data tables to write-only; obtaining the query information input by the current user; retrieving result data from the associated view based on the query information; and providing the result data back to the current user. This invention ensures effective isolation of data in the shared pallet rental system and guarantees the confidentiality of user data.

The present invention discloses a global UDF query method and system based on Spark SQL, and relates to the field of function configuration. The steps of the method include: registering the required UDF under the default library, and querying the UDF under the default library when receiving a UDF query request including a function name issued by a user. Before the UDF query, the present invention pre-registers the required UDF under the default library and uses it as a global function. If the user does not query the UDF under the current library, the user can query under the default library. Therefore, the user only needs to register a custom function under the default library, and it can be used under other databases. The user does not need to enter the database name when querying, and the query process is relatively simple.

The present invention discloses a method and system for generating and testing user-defined functions in a database. The method comprises the following steps: building a retrieval corpus containing function semantic fragments based on official documents of a database system; adopting a hierarchical strategy to build multi-layer prompt information based on the function semantic fragments, structured requirement information and example guidance templates; a function creation model adopts a streaming generation and syntax verification mechanism based on the multi-layer prompt information to generate a user-defined function creation statement; injecting the statement into a database system to execute a creation operation; if the execution is successful, performing correctness verification on the generated user-defined function; when the verification result is passed, recording metadata and a boundary value sample set of the user-defined function, and generating a corresponding user-defined function entity; constructing a database test statement group based on the metadata, boundary value sample set and target database structure of the user-defined function entity, and performing automated testing on the user-defined function entity.

The present disclosure involves systems, software, and computer implemented methods for enabling custom formulas in a cloud platform office add-in. An example method includes automatically loading a public landing page of a cloud platform add-in of a spreadsheet application. The public landing page includes a declaration and a first implementation of at least one custom function. Login credentials for a customer tenant of the cloud platform are obtained. A redirect is performed to a private web application for the customer tenant. The private web application includes, for each custom function, a second implementation that is configured to retrieve customer-specific cloud platform data of the customer tenant. Each first implementation of a custom function is replaced with the second implementation of the custom function. In response to a user request in the spreadsheet application to use a first custom function, the second implementation of the custom function is invoked.

The invention discloses a simulated liquid level dynamic control method based on a Fluent continuous casting tundish, which comprises the following steps: S1, establishing a geometric model of the tundish and a long nozzle, and carrying out grid division; s2, importing the geometric model of the tundish and the long nozzle subjected to grid division into Fluent software, and setting calculation parameters; s3, developing a Fluent user self-defined function, and importing the Fluent user self-defined function into Fluent compiling; and S4, after the user-defined function is imported into Fluent to be compiled, analog calculation is started, and dynamic control over the liquid steel level in the tundish is achieved. The method has the advantages that real-time dynamic control of the liquid level of the molten steel in the tundish in the simulation process is achieved, the liquid level is accurately controlled, the limitation of single-phase flow or constant flow assumption adopted in a traditional simulation method is overcome, the actual production working condition is met, and the consistency of the simulation result and the actual production process is remarkably improved.

Techniques and solutions are provided for improving query performance using inverse functions. Often a function is used to perform operations such as data type conversions. The use of these functions can be resource intensive, such as if a conversion needs to be performed for all rows of a particular relational database table. The present disclosure allows for the registration of inverse functions that can be used, or at least be considered for use, in place of a function. A given inverse function can be associated with its function using techniques such as maintaining mapping information or using a particular naming convention. A particular syntax is provided for designating and creating an inverse function.

Embodiments described herein provide techniques for in-line compiling of UDFs in other programming languages. These techniques enable faster programming iterations because it allows users to compile directly in the cloud processing system. Moreover, it allows the UDFs to tie into existing libraries. The compiled results are treated as sensitive and handled with appropriate security policies, as with any other user data in the system.

The invention discloses a tunnel train fire smoke spreading prediction method based on machine learning, which comprises the following steps: S1, carrying out numerical simulation in Fluent, realizing variable-speed movement of a train and a fire source through a user-defined function (UDF) technology, and recording the change condition of the temperature of a key point along with time and the change condition of the carbon monoxide density along with time; s2, realizing multi-working-condition automatic solution and automatic data storage through a supercomputing platform and a PyFluent technology; the temperature distribution and the smoke concentration of the key evacuation position are obtained, and a learning sample is provided for the rapid prediction technology of the evacuation condition in the railway tunnel; and S3, training the recurrent neural network model to realize rapid prediction of disaster-causing parameters of the key point location. According to the method, the reduction degree is higher, the method better fits the actual situation, the CNN-LSTM model obtained through key input variable training is selected, and the flue gas spreading situation in the tunnel can be achieved.

According to the present disclosure, disclosed is a method by which an electronic device provides information, the method comprising the steps of: obtaining information about a user define function set for big data operation processing related to a service provided by the electronic device; confirming an operation processing method to be applied to an operation by the user define function among an offline big data operation processing method and an online big data operation processing method on the basis of the information about the user define function; performing operation processing for input data to be operated by the user define function on the basis of the user define function and the confirmed operation processing method; and providing information about output data obtained in response to the operation processing.

The invention discloses an industrial intelligent software development method and platform of a fusion model-driven architecture, relates to the technical field of industrial software, and solves the problems that a traditional development mode is difficult to flexibly adapt to complex and changeable industrial scenes, the service logic reusability is poor, a UI and a core service are disjointed, and the collaboration efficiency of all stages is low. A user-defined function is supported through a data modeling tool, input and output attributes are visually defined, and flexible data structure construction under a complex service rule is achieved; the service modeling tool assembles a modular service process based on a domain model library through node dragging, gateway branch control and sub-process nesting; and the UI modeling tool automatically analyzes the attributes of the business model, and matches the template library to generate an interface and a standardized interface. And traditional coding is converted into visual operation, so that the development efficiency is improved, the service change response period is shortened, the maintenance cost is reduced, and industrial software is promoted to be upgraded to intelligence and standardization.

A data platform for managing an application as a first-class database object. The data platform includes at least one processor and a memory storing instructions that cause the at least one processor to perform operations including detecting a data request from a browser for a data object located on the data platform, executing a stored procedure, the stored procedure containing instructions that cause the at least one processor to perform additional operations including instantiating a User Defined Function (UDF) server, an application engine, and the application within a security context of the data platform based on a security policy determined by an owner of the data object. The data platform then communicates with the browser using the application engine as a proxy server.

Disclosed in the present application are a data processing method and apparatus, and a storage medium and an electronic device. The method comprises: receiving a data processing request, wherein the data processing request at least comprises target data to be processed and a target processing mode for the target data; on the basis of the target processing mode in the data processing request, generating a structured query statement for calling a first user defined function; and calling the first user defined function from a target interface of a target database on the basis of the structured query statement, and processing the target data on the basis of the first user defined function, so as to obtain a processing result. The present application solves the technical problem in the prior art of the processing efficiency of data being relatively low due to the fact that the data can be processed by means of a user defined function only after a user performs operations such as compilation and packaging, resource addition and function creation.

A system executes user defined functions (UDFs) invoked by database queries. The UDF includes UDF code specified using a programing language distinct from a database query language. A hash value from the UDF code provided by a client application for creating the UDF is compared with a hash value generated from UDF code invoked by database queries to determine whether the two UDF codes match. If the two hash values fail to match, the system takes an action, for example, storing an indication of UDF code mismatch or disabling subsequent executions of the database queries invoking the UDF. The system may use encoded UDF code that is decoded by the system at runtime using a key obtained from a separate system such as the client application. The client application can disable execution of database queries executing the UDF code by refusing to provide the key.

The application discloses a kind of data operation execution systems for enterprise level low code, specifically relates to low code development technical field, including atomic executor module, dependent parallel scheduling module and debugging sandbox module. Query, new, update, delete, rule check and custom function are uniformly encapsulated as standard atomic executor by atomic executor module, each executor configuration execution condition expression and trigger actual logic when condition is satisfied, while introducing adaptive timeout fuse mechanism to guarantee system stability. Dependent parallel scheduling module constructs data dependency graph between executors by regular matching, and based on topological sorting, non-dependent executors are divided into parallel groups. After priority sorting, they are executed in parallel through thread pool. The application solves the problems of low efficiency of low code platform data operation serial execution, dirty data in debugging process and opaque process, and realizes efficient parallel scheduling and safe and observable debugging experience.

The invention discloses a proton exchange membrane electrolytic cell electric-water-hot gas multi-physical field performance prediction software framework and a construction method. The software framework comprises a user-defined layer opened to a user and a bottom layer framework invisible to the user; the function of the user-defined layer is realized through a user-defined function; the bottom-layer architecture comprises a storage-oriented data structure, a CFD universal solver input and a solving-oriented data structure; the storage-oriented data structure is an underlying data packet and is used for storing various data; the CFD universal solver input is used for receiving data packet data in the storage-oriented data structure and writing an xml file configuration to the solving-oriented data structure; the solution-oriented data structure is used for solving xml file configuration to obtain different physical fields in the proton exchange membrane electrolytic tank. The method has the characteristics that the degree of freedom of user operation is high, the calculation stability is higher, and the solved physical field better conforms to the reality.

The invention provides a test code generation method and a low-code test platform, and relates to the technical field of computers, in particular to the technical field of software engineering and software testing. According to the specific implementation scheme, the generation method comprises the steps that according to a test description file, test data, a configuration file, a use case process and an original code snippet containing a self-defined function are obtained; constructing a foundation project according to the test data and the configuration file; generating a plurality of preliminary code snippets according to step information in the use case process and a preset code template file; replacing a user-defined function contained in the preliminary code snippet with a function for calling a corresponding library to obtain an executable code snippet; and according to the step sequence and the executable code snippets in the use case process, generating an executable code project file in the directory of the basic project. According to the scheme of the embodiment of the invention, a completely executable test code product can be output, and the development and maintenance cost of the test code is reduced.

The invention relates to the technical field of computers, in particular to a data processing method and device, electronic equipment and a storage medium. According to the method, firstly, a single-channel data processing mode is adopted, each single channel independently analyzes target data characteristics corresponding to original data, and a target processing function corresponding to the target data characteristics is obtained from a pre-constructed configuration table; even in the face of multiple sampling paths, the data processing processes of different channels can be inconsistent, so that the limitation of uniformly processing data in an array form traditionally is avoided, and the flexibility of data processing is improved. Meanwhile, the configuration table comprises processing functions corresponding to different data characteristics, when the service requirements change, a developer can select a proper processing function from the configuration table according to new data characteristics, or create a self-defined function and add the self-defined function into the configuration table when the corresponding processing function does not exist in the configuration table, so that the service requirements of the developer can be met. And the whole code does not need to be reconstructed, so that the workload of developers is greatly reduced.

The invention discloses a data processing method and device, a storage medium and electronic equipment. The method comprises the steps that a data processing request is received, and the data processing request at least comprises to-be-processed target data and a target processing mode of the target data; according to a target processing mode in the data processing request, generating a structured query statement used for calling a first custom function; and calling a first custom function from a target interface of the target database according to the structured query statement, and processing the target data according to the first custom function to obtain a processing result. According to the data processing method and device, the technical problem that in the prior art, a user needs to compile, package, add resources, create functions and the like to process the data through the self-defined functions, and consequently the data processing efficiency is low is solved.

A method and system of providing indirect and visualization access to data of a data-lake is disclosed. A user request from a user to access the data of the data lake is received. A user profile from a plurality of user profiles associated with the user is determined based on a first level of authentication. The first level of authentication is based on the domain object name and the public key. A user defined function (UDF) from a plurality of predefined UDFs associated with the user profile is determined based on the first level of authentication. A portion of the data of the data-lake requested in the user request is selectively rendered based on a second level of authentication. The second level of the authentication is based on the domain object name and the private key.

Systems and methods disclosed herein may include a plurality of operators to search and retrieve various types of data in a result set, simultaneously. The operators may include a retrieval operator, user defined function (UDF) operator, and artificial intelligence (AI) operator in communication with an interface layer and multiple shards of a database for generating the result set.