Get in Touch

Course Outline

Enterprise Architecture and Pipeline Design

  • Multi-layer ETL architecture structures.
  • Creating modular and reusable components.
  • Hybrid integration approaches across different systems.

Advanced Performance Engineering

  • Optimization at the step level.
  • Strategies for parallelism and threading.
  • Monitoring pipelines under high load.

Automation, Scripting, and Custom Extensions

  • Using scripting within transformations.
  • Building custom plugins.
  • Expanding PDI functionality with Java and JavaScript.

Complex Data Processing and Integrations

  • Integrations for real-time and streaming data.
  • Interacting with big data platforms.
  • Advanced handling of files and APIs.

Data Governance, Security, and Compliance

  • Protecting transformations and credentials.
  • Tracking data lineage and traceability.
  • Addressing regulatory and compliance requirements.

Enterprise Orchestration and Scheduling

  • Overseeing large job networks.
  • Designing error recovery and failover mechanisms.
  • Orchestration at the environment level.

Repository, Version Control, and CI/CD

  • Strategies for enterprise repositories.
  • Connecting PDI with Git.
  • Continuous deployment patterns.

Deployment, Monitoring, and Production Operations

  • Advancing solutions across different environments.
  • Operational tools and dashboards.
  • Ensuring end-to-end production readiness.

Summary and Next Steps

Requirements

  • Familiarity with ETL pipelines and data modeling concepts.
  • Hands-on experience with intermediate-level PDI transformations.
  • Strong proficiency in SQL and scripting languages.

Target Audience

  • Senior data engineers.
  • ETL architects.
  • Professionals overseeing complex data integration workloads.
 21 Hours

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories