Computer-implemented method, information processing system, and computer program (Automated feature preparation for high-performance online inference)
By optimizing data transformation operators through batch, streaming, and online pipelines, the method addresses inefficiencies in data preparation, enhancing performance and reducing costs in machine learning systems.
JP7751943B2Active Publication Date: 2025-10-09INTERNATIONAL BUSINESS MACHINE CORPORATION
Patent Information
- Application Number
- JP2022053941
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-03-31
- Filing Date
- 2022-03-29
- Publication Date
- 2025-10-09
- Estimated Expiration
- 2042-03-29
Smart Images
Figure 0007751943000001 
Figure 0007751943000002 
Figure 0007751943000003
Abstract
To provide a method, an information processing system and a computer program for generating scheduled jobs (batches) to prepare data for machine learning model inference.SOLUTION: A method comprises: analyzing, while training a machine learning model, a set of first data transformation operators in a first data preparation pipeline that generates a plurality of constructed features from a set of training data; creating a plurality of second data preparation pipelines from the first data preparation pipeline, where the set of first data transformation operators is converted to a set of second data transformation operators, and each first data transformation operator is assigned to one of the second data preparation pipelines; and deploying the second data preparation pipelines to a runtime system.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art
Citation Information
Patent Citations
Machine learning service
JP2017524183A
Systems and methods for inferring data transformations through pattern decomposition
JP2019532366A
Complex Event Processing for Micro-Batch Streaming
JP2019535056A
Data ingestion and analytics platform with systems, methods and computer program products useful in conjunction therewith
US20180203744A1