Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layer ETL architectures
- Creating modular and reusable components
- Implementing hybrid approaches across systems
Advanced Performance Engineering
- Step-level optimization
- Strategies for parallelism and threading
- Monitoring high-load pipelines
Automation, Scripting, and Custom Extensions
- Incorporating scripting within transformations
- Creating custom plugins
- Extending PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming integrations
- Interaction with big data platforms
- Advanced file and API processing
Data Governance, Security, and Compliance
- Protecting transformations and credentials
- Data lineage and traceability
- Regulatory and compliance considerations
Enterprise Orchestration and Scheduling
- Managing extensive job networks
- Error recovery and failover design
- Environment-level orchestration
Repository, Version Control, and CI/CD
- Enterprise repository strategies
- Integrating PDI with Git
- Continuous deployment patterns
Deployment, Monitoring, and Production Operations
- Promoting solutions across environments
- Operational tooling and dashboards
- End-to-end production readiness
Summary and Next Steps
Requirements
- Familiarity with ETL pipelines and data modeling concepts.
- Proficiency with intermediate-level PDI transformations.
- Strong competencies in SQL and scripting.
Target Audience
- Senior data engineers.
- ETL architects.
- Professionals overseeing complex data integration tasks.
21 Hours
Testimonials (1)
It's a hands-on session.
