Professional Data Engineer
SBL-Khas Scheme Registered
Registered employers can fully claim the course fee and allowanced through the HRD Corp portal.
Course Description
Course Outline
Storage Systems: Choosing the optimal storage (e.g., Relational, NoSQL, or Data Warehouses) based on schema, scalability, and performance needs.Data Pipelines: Designing batch and streaming pipelines.Security and Compliance: Implementing encryption, access control, and compliance regulations
Extract, Transform, and Load (ETL): Processing and moving data from source to destination using tools like Apache Spark or dataflow.Data Warehousing and Lakes: Building analytics engines and structuring data for business intelligence.Orchestration and Automation: Automating workflows, scheduling jobs, and monitoring system health
ML Pipeline Integration: Building repeatable and scalable pipelines for training and evaluating models.Model Deployment: Serving models in production, tracking performance, and retraining based on new data
Testing and Validation: Testing pipelines for accuracy and reliability.Monitoring and Logging: Tracking system metrics, setting up alerts, and debugging pipeline errors.
Registration Details
Individual Fee
RM 6,400.00
Exclusive of 8% SST