Secure & Portable AI Inference with Docker: From Local to Cloud Training Course
Docker serves as a containerization platform designed to create portable, isolated, and secure deployment environments for AI inference services.
This instructor-led live training, available online or onsite, is intended for technical professionals ranging from beginner to intermediate skill levels who aim to develop secure, portable AI inference microservices. These services can be deployed consistently across local machines, servers, or cloud virtual machines (VMs).
Upon completing this workshop, participants will be able to:
- Create lightweight inference containers suitable for both local and cloud deployment.
- Enhance the security of containerized AI services by applying industry best practices.
- Establish portable microservice workflows that ensure consistent operational environments.
- Deploy AI inference endpoints across various infrastructure types.
Course Format
- Guided lectures combined with practical demonstrations.
- Hands-on exercises to reinforce deployment and security techniques.
- Live-lab sessions for building and running portable inference services.
Customization Options
- To customize this training to align with your specific infrastructure or AI tooling stack, please contact us to arrange a tailored session.
Course Outline
Introduction to AI Inference with Docker
- Understanding AI inference workloads
- Benefits of containerized inference
- Deployment scenarios and constraints
Building AI Inference Containers
- Selecting base images and frameworks
- Packaging pretrained models
- Structuring inference code for container execution
Securing Containerized AI Services
- Minimizing container attack surface
- Managing secrets and sensitive files
- Safe networking and API exposure strategies
Portable Deployment Techniques
- Optimizing images for portability
- Ensuring predictable runtime environments
- Managing dependencies across platforms
Local Deployment and Testing
- Running services locally with Docker
- Debugging inference containers
- Testing performance and reliability
Deploying on Servers and Cloud VMs
- Adapting containers for remote environments
- Configuring secure server access
- Deploying inference APIs on cloud VMs
Using Docker Compose for Multi-Service AI Systems
- Orchestrating inference with supporting components
- Managing environment variables and configs
- Scaling microservices with Compose
Monitoring and Maintenance of AI Inference Services
- Logging and observability approaches
- Detecting failures in inference pipelines
- Updating and versioning models in production
Summary and Next Steps
Requirements
- Fundamental understanding of machine learning concepts
- Experience in Python programming or backend development
- Knowledge of foundational containerization concepts
Audience
- Software Developers
- Backend Engineers
- Teams responsible for deploying AI services
Open Training Courses require 5+ participants.
Secure & Portable AI Inference with Docker: From Local to Cloud Training Course - Booking
Secure & Portable AI Inference with Docker: From Local to Cloud Training Course - Enquiry
Secure & Portable AI Inference with Docker: From Local to Cloud - Consultancy Enquiry
Testimonials (1)
The training met expectations with its clear explanations, real-world examples, and hands-on labs that made complex topics easy to understand. It provided valuable insights into container orchestration, security, scaling and many other advanced topics.
Anna Wyszomirska-Szmyd - Akamai
Course - Docker and Kubernetes advanced
Upcoming Courses
Related Courses
Advanced Docker
14 HoursThis instructor-led, live training in Uzbekistan (online or on-site) is intended for engineers who wish to deepen their Docker expertise to deploy applications at scale while maintaining full control.
By the end of this training, participants will be able to:
- Build their own Docker images.
- Deploy and manage large numbers of Docker applications.
- Evaluate various container orchestration solutions and select the most appropriate one.
- Establish a continuous integration pipeline for Docker applications.
- Integrate Docker applications with existing continuous integration tooling.
- Secure their Docker applications.
Docker & Kubernetes Advanced
21 HoursUpon completion of this training, participants will be capable of:
- Creating custom Docker images.
- Deploying and managing a large number of Docker applications.
- Evaluating various container orchestration solutions to select the most appropriate one.
- Establishing a continuous integration process for Docker applications.
- Integrating Docker applications with existing continuous integration toolchains.
- Implementing security measures for Docker applications.
- Utilizing Kubernetes to deploy and manage diverse environments within a single cluster.
- Securing, scaling, and monitoring a Kubernetes cluster.
Containerized AI & ML Deployment with Docker
14 HoursDocker serves as a containerization platform that facilitates the creation of consistent, portable, and reproducible environments specifically for artificial intelligence and machine learning tasks.
Designed for intermediate-level professionals, this live, instructor-led training (available online or onsite) focuses on packaging ML codebases, dependencies, and models using Docker to establish reliable workflows from development through to production.
Upon completing this course, participants will be equipped to:
- Create and maintain Docker images optimized for AI and ML applications.
- Encapsulate machine learning pipelines, tools, and dependencies within containers.
- Enhance Docker environments for improved performance and portability.
- Deploy containerized ML services across various runtime environments.
Course Structure
- Conceptual demonstrations accompanied by guided discussions.
- Practical exercises centered on real-world containerization scenarios.
- Live implementation using interactive Docker lab environments.
Customization Options
- Contact us to tailor this training to your specific organizational needs.
CI/CD for AI: Automating Docker-Based Model Builds and Deployments
21 HoursCI/CD for AI represents a systematic method for automating the packaging, testing, containerization, and deployment of AI models through continuous integration and delivery pipelines.
This instructor-led training session, available both online and onsite, is designed for professionals with an intermediate level of expertise who aim to streamline end-to-end AI model delivery workflows using Docker and CI/CD platforms.
Upon completing this course, participants will be equipped to:
- Develop automated pipelines for constructing and evaluating AI model containers.
- Establish version control and ensure reproducibility throughout the model lifecycle.
- Incorporate automated deployment strategies for AI services.
- Apply CI/CD best practices specifically adapted for machine learning operations.
Course Format
- Instructor-led presentations coupled with technical discussions.
- Hands-on labs and practical implementation exercises.
- Realistic simulations of CI/CD workflows within a controlled environment.
Customization Options
- If your organization requires tailored pipeline workflows or specific platform integrations, please reach out to customize this course for your needs.
Certified Kubernetes Administrator (CKA) - exam preparation
21 HoursThe Certified Kubernetes Administrator (CKA) program was established by The Linux Foundation in collaboration with the Cloud Native Computing Foundation (CNCF).
Kubernetes has become the leading platform for container orchestration.
NobleProg has been providing Docker and Kubernetes training since 2015. With over 360 successfully completed training projects, we have become one of the most recognized training providers globally in the field of containerization.
Since 2019, we have also been assisting our customers in validating their performance in Kubernetes environments by preparing them to take and pass the CKA and CKAD exams.
This instructor-led live training (available online or onsite) is designed for System Administrators and Kubernetes users who wish to validate their knowledge by passing the CKA exam.
Additionally, the training focuses on gaining practical experience in Kubernetes Administration. Therefore, we recommend participating even if you do not intend to take the CKA exam.
Course Format
- Interactive lectures and discussions.
- Extensive exercises and practice.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- To request customized training for this course, please contact us to arrange.
- To learn more about CKA certification, please visit: https://training.linuxfoundation.org/certification/certified-kubernetes-administrator-cka
Certified Kubernetes Application Developer (CKAD) - exam preparation
21 HoursThe Certified Kubernetes Application Developer (CKAD) program has been developed by The Linux Foundation and the Cloud Native Computing Foundation (CNCF), the host of Kubernetes.
This instructor-led, live training (online or onsite) is aimed at Developers who wish to confirm their skills in design, build, configure, and expose cloud native applications for Kubernetes.
On the other hand, the training also focuses on gaining practical experience in Kubernetes application development, so we recommend participating even if you do not intend to take the CKAD exam.
NobleProg has been delivering Docker & Kubernetes training since 2015. With more than 360 successfully completed training projects, we have become one of the best-known training companies worldwide in the field of containerization. Since 2019, we have also been helping our customers validate their performance in k8s environments by preparing them and encouraging them to pass CKA and CKAD exams.
Course Format
- Interactive lectures and discussions.
- Abundant exercises and practice opportunities.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- To request a customized version of this course, please contact us to arrange.
- To learn more about CKAD, please visit: https://training.linuxfoundation.org/certification/certified-kubernetes-application-developer-ckad/
Introduction to Docker
14 HoursDocker is an open-source platform designed to automate the construction, distribution, and execution of applications within containers.
This instructor-led live training, available online or on-site, targets engineers who want to leverage Docker for deploying and managing software as containers rather than traditional standalone applications.
Upon completing this training, participants will be able to:
- Install and set up Docker.
- Grasp and apply the principles of software containerization.
- Manage applications hosted on Docker.
- Establish networks between various Docker applications and systems.
- Understand and modify Docker registries.
Course Format
- Interactive lectures and discussions.
- Extensive exercises and practical practice.
- Hands-on implementation within a live laboratory environment.
Customization Options for the Course
- To request a customized training session for this course, please contact us to make arrangements.
- For more information on Docker, visit: https://www.docker.com
Container Platforms Administration with Docker, Kubernetes and OpenShift
35 HoursDiscover how to build, deploy, and administer containerized environments using Docker, Kubernetes, and OpenShift. This five-day, interactive training spans container images, Kubernetes workloads, cluster networking, storage solutions, security measures, monitoring techniques, and practical OpenShift administration. Participants will acquire the necessary skills to operate modern container platforms and troubleshoot applications across both development and production settings.
Docker and Kubernetes: Building and Scaling a Containerized Application
21 HoursThrough this instructor-led live training in Uzbekistan (onsite or remote), participants will acquire the skills to create and manage Docker containers, as well as deploy a sample application within one. The curriculum also covers automating, scaling, and managing containerized applications inside a Kubernetes cluster. Furthermore, the training progresses to advanced topics, guiding participants through securing, scaling, and monitoring a Kubernetes cluster.
Upon completion of this training, participants will be able to:
- Set up and operate a Docker container.
- Deploy a containerized server and web application.
- Construct and oversee Docker images.
- Establish a Docker and Kubernetes cluster.
- Utilize Kubernetes to deploy and manage a clustered web application.
- Secure, scale, and monitor a Kubernetes cluster.
Docker for MLOps: End-to-End Pipeline Containerization
21 HoursDocker serves as a containerization platform that enables the creation of reproducible, portable, and scalable environments tailored for machine learning systems.
This live, instructor-led training—available online or onsite—is designed for intermediate to advanced technical professionals seeking to operationalize and containerize complete ML pipelines using Docker.
By the end of this course, participants will be equipped to:
- Encapsulate ML training, validation, and inference workloads within containers.
- Architect and orchestrate comprehensive ML pipelines leveraging Docker alongside complementary tools.
- Establish version control, reproducibility, and CI/CD practices for ML components.
- Deploy, monitor, and scale ML services within containerized infrastructures.
Course Structure
- Engaging lectures reinforced by practical demonstrations.
- Practical exercises centered on constructing real-world ML pipeline elements.
- Live-lab sessions focused on implementing end-to-end containerized workflows.
Customization Possibilities
- To tailor the training to specific ML infrastructure requirements, please reach out to us to explore available options.
Docker and Kubernetes
21 HoursTraining objectives: Acquire both theoretical and practical skills in Docker and Kubernetes.
Docker and Kubernetes advanced
35 HoursThe "Advanced Docker and Kubernetes" course is a comprehensive training covering the Kubernetes platform and its ecosystem. It is designed for participants with varying levels of experience, offering a full range of both fundamental and advanced Kubernetes functionalities. Key topics include Containers, Labels, Controllers, Services, Secrets, Persistent Volumes, Claims, Namespaces, Resource Quotas, the Container Networking Model, Service Discovery, Scaling, Load Balancing, Cluster Management, Kubernetes Installation, Cluster Security, Access Control, High Availability of Control Planes, Monitoring and Logging, Self-Healing of Applications, Advanced Scheduling, Microservices-Based Applications, Application Design Patterns, and Deployment of Applications on Kubernetes Clusters.
GPU-Accelerated AI & Deep Learning with Docker Containers
21 HoursTo execute high-performance deep learning tasks with both scalability and efficiency, GPU acceleration is a critical requirement.
Designed for intermediate-level technical experts, this instructor-led live session (available online or on-site) focuses on setting up, fine-tuning, and managing GPU-powered AI workloads within Docker containers.
By the end of the training, participants will be equipped to:
- Construct and execute GPU-enabled containers for both training and inference processes.
- Configure CUDA, drivers, and runtime libraries specifically for containerized AI pipelines.
- Enhance resource allocation and ensure proper isolation for applications with heavy GPU demands.
- Implement scalable, containerized deep learning services suitable for production environments.
Course Delivery Format
- Engaging instruction complemented by practical, real-world examples.
- Practice exercises centered on GPU-enabled development tasks.
- Practical implementation within a live-lab setting.
Customization Opportunities
- To align the training with your specific infrastructure or GPU stack, please reach out to us for arrangements.
Hybrid AI Deployment: Docker, Cloud, and Edge Integration
21 HoursHybrid AI deployment involves executing AI inference across cloud, on-premises, and edge environments through unified container-based workflows.
This instructor-led, live training (available online or onsite) is designed for advanced-level professionals aiming to design and deploy distributed AI inference systems in heterogeneous environments.
After completing this training, participants will be capable of:
- Creating secure and scalable containerized AI services for multi-location setups.
- Deploying AI inference workloads to cloud platforms, local servers, and edge devices using Docker.
- Integrating orchestration tools to automate distributed AI operations.
- Enhancing inference latency, reliability, and resilience across diverse infrastructure.
Course Format
- Guided presentations and expert-led discussions.
- Extensive hands-on practice with applied exercises.
- Real-world experimentation in a controlled live-lab environment.
Customization Options for the Course
- To tailor this course to align with your organization’s specific infrastructure or use cases, please contact us to arrange customization.
Kubernetes from Basic to Advanced
14 HoursIn this instructor-led, live training Uzbekistan (onsite or remote), participants will learn to deploy sample servers within containers, followed by automating, scaling, and managing these servers in a Kubernetes cluster. The training advances to sophisticated topics, guiding participants through the processes of securing, networking, and monitoring a Kubernetes cluster.
By the end of this training, participants will be able to:
- Set up and run a Docker container.
- Deploy containerized databases and servers.
- Set up a Docker and Kubernetes cluster.
- Use Kubernetes to deploy and manage different environments under the same cluster.
- Secure, scale and monitor a Kubernetes cluster.