Validating code of an extract, transform and load (ETL) tool

Abstract

An approach for validating code for an extract, transform and load (ETL) tool is provided. Naming, coding, and performance standards for the code is received. The code is exported to a job definition file and parsed. Violations of the standards are determined by determining the parsed code does not match the standards. A report identifying the violations is generated. Based on a review of the report and a rework of the code to comply with the standards, the reworked code is exported to another job definition file and parsed, the parsed reworked code is determined to not include the violations of the standards, and a second report is generated that indicates that the reworked code does not include the violations. An approval of the reworked code is received based on the second report.

Description

TECHNICAL FIELD[0001]The present invention relates to reviewing ETL code, and more particularly to validating ETL code to accelerate review of ETL projects.BACKGROUND[0002]ETL projects involve complex logic and a large number of jobs and other objects. For example, each project may include 100 to 1000 jobs and other objects. Effective and quality delivery demands disciplined coding. Software developers drawing from different experiences may generate undisciplined coding of low quality. Low quality code has defects and experiences malfunctions, which leads to increased cost and time requirements to rework the code to fix the defects. In the long run, low quality code leads to a lower client confidence in the developers' ability to deliver quality code, which impacts the reputation of the developers. For any project, code quality standards are set before development activities start. The standards specify how to name objects, the best coding practices to be followed, etc. Low quality ...

AI Technical Summary

Benefits of technology

[0006]Embodiments of the present invention provide a tool named “Validation Script” that automatically validates ETL code based on naming, coding, and performance standards and reports violations of the standards, which facilitates effective review of the code in less time. The Validation Script tool described herein facilitates the generation of high quality, disciplined coding for an ETL tool, and traps most code issues before code is delivered from the development environment, thereby decreasing costs involved in reworking code to fix code defects. The reporting of violations includes indicators (e.g., red highlights of standards violation...

Problems solved by technology

ETL projects involve complex logic and a large number of jobs and other objects.

Software developers drawing from different experiences may generate undisciplined coding of low quality.

Low quality code has defects and experiences malfunctions, which leads to increased cost and time requirements to rework the code to fix the defects.

In the long run, low quality code leads to a lower client confidence in the developers' ability to deliver quality code, which impacts the reputation of the developers.

Low quality code still results when developers do not comply with the standards.

Not complying with the standards may result from various reasons, including the lack of experience of a developer, the developer bein...

Images