Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Introduction to Huawei CloudMatrix
- Overview of the CloudMatrix ecosystem and deployment workflows
- Common use cases and compatible chipsets
Preparing Models for Deployment
- Exporting models from training frameworks such as MindSpore, TensorFlow, and PyTorch
- Applying ATC (Ascend Tensor Compiler) for format translation
- Distinguishing between static and dynamic shape models
Deploying to CloudMatrix
- Creating services and registering models
- Launching inference services through the UI or CLI
- Configuring routing, authentication, and access controls
Serving Inference Requests
- Managing batch versus real-time inference streams
- Designing data preprocessing and postprocessing pipelines
- Integrating CloudMatrix services with external applications
Monitoring and Performance Tuning
- Reviewing deployment logs and tracking requests
- Implementing resource scaling and load balancing strategies
- Optimizing latency and throughput
Integration with Enterprise Tools
- Linking CloudMatrix with OBS and ModelArts
- Utilizing workflows and model versioning systems
- Establishing CI/CD processes for model deployment and rollback
End-to-End Inference Pipeline
- Implementing a complete image classification workflow
- Conducting benchmarking and accuracy validation
- Testing failover mechanisms and system alerts
Summary and Next Steps
Requirements
- A solid grasp of AI model training processes
- Practical experience with Python-based machine learning frameworks
- Fundamental knowledge of cloud deployment principles
Target Audience
- AI operations teams
- Machine learning engineers
- Cloud deployment experts managing Huawei infrastructure
21 Hours
Testimonials (2)
The extensive selection of tools presented
Miruna Buzduga - Aeronamic Eastern Europe
Course - AI Enablement Training for Engineers
Step by step training with a lot of exercises. It was like a workshop and I am very glad about that.
