Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layer ETL architecture structures.
- Creating modular and reusable components.
- Hybrid integration approaches across different systems.
Advanced Performance Engineering
- Optimization at the step level.
- Strategies for parallelism and threading.
- Monitoring pipelines under high load.
Automation, Scripting, and Custom Extensions
- Using scripting within transformations.
- Building custom plugins.
- Expanding PDI functionality with Java and JavaScript.
Complex Data Processing and Integrations
- Integrations for real-time and streaming data.
- Interacting with big data platforms.
- Advanced handling of files and APIs.
Data Governance, Security, and Compliance
- Protecting transformations and credentials.
- Tracking data lineage and traceability.
- Addressing regulatory and compliance requirements.
Enterprise Orchestration and Scheduling
- Overseeing large job networks.
- Designing error recovery and failover mechanisms.
- Orchestration at the environment level.
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories.
- Connecting PDI with Git.
- Continuous deployment patterns.
Deployment, Monitoring, and Production Operations
- Advancing solutions across different environments.
- Operational tools and dashboards.
- Ensuring end-to-end production readiness.
Summary and Next Steps
Requirements
- Familiarity with ETL pipelines and data modeling concepts.
- Hands-on experience with intermediate-level PDI transformations.
- Strong proficiency in SQL and scripting languages.
Target Audience
- Senior data engineers.
- ETL architects.
- Professionals overseeing complex data integration workloads.
21 Hours
Testimonials (1)
It's a hands-on session.