Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Structuring
- Multi-tier ETL architectural models
- Crafting modular and reusable components
- Cross-system hybrid integration strategies
Advanced Performance Engineering
- Optimization at the step level
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Integrating scripts within transformations
- Creating custom plugins
- Expanding PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integrations
- Interaction with big data platforms
- Advanced handling of files and APIs
Data Governance, Security, and Compliance
- Protecting transformations and credential management
- Data lineage and audit traceability
- Regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Administration of extensive job networks
- Design for error recovery and failover
- Orchestration across different environments
Repository Management, Version Control, and CI/CD
- Strategies for enterprise repositories
- Connecting PDI with Git workflows
- Patterns for continuous deployment
Deployment, Monitoring, and Production Operations
- Transitioning solutions between environments
- Utilizing operational tools and dashboards
- Ensuring end-to-end production readiness
Conclusions and Future Directions
Requirements
- Familiarity with ETL pipelines and data modeling concepts
- Practical experience with intermediate-level PDI transformations
- Strong proficiency in SQL and scripting languages
Target Audience
- Senior data engineers
- ETL architects
- Specialists overseeing complex data integration operations
Testimonials (1)
It's a hands-on session.
