HSDP AI Inference is a multi-tenant service that provides functionality to register, deploy, and run predictions on AI models. It offers a CPU/GPU-based endpoint, job inference capabilities using AWS SageMaker, and CPU/GPU-based job inference capabilities with AWS EKS as the execution engine.