Job Title: Senior AI Operations Engineer
Location: Washington, DC
Type: Contract
We are seeking a Senior AI Operations Engineer to lead the operationalization, deployment, and ongoing support of Generative AI (GenAI) systems within a secure, scalable, and highly optimized environment. The ideal candidate will bring deep expertise in AI infrastructure, cloud operations, and DevSecOps practices, with a focus on automation, performance optimization, and system reliability.
Deploy, manage, troubleshoot, and scale GenAI-based systems in production environments
Implement observability, monitoring, and control mechanisms to ensure system performance and stability
Continuously analyze and fine-tune AI system performance
Drive automation across deployment pipelines and operational processes
Secure AI systems by applying best practices and conducting regular security assessments
Measure and improve AI system behavior and efficiency
Collaborate with engineering and data science teams to support fine-tuning and optimization of LLMs
Maintain compliance with applicable government cloud standards and security frameworks
10+ years of experience in AI, Data Science, or Software Engineering
Bachelor’s degree in Computer Science, Information Systems, or a related field (or equivalent experience)
Experience in AWS cloud architecture design and operations
Proficient with Terraform, Docker, Kubernetes, and GitLab
Strong scripting skills using Python and Bash
Hands-on experience with AI frameworks and tools such as:
AWS Bedrock, SageMaker, Transformers, TensorFlow, PyTorch, LangChain, LlamaIndex
Experience with open-source LLMs (e.g., LLaMA, Mistral) and fine-tuning models
Familiarity with AI design patterns and infrastructure automation tools
Strong foundation in DevSecOps, CI/CD pipelines, and Agile delivery models
Knowledge of government compliance frameworks such as FedRAMP, FISMA, etc.
Excellent analytical, problem-solving, and communication skills
Demonstrated emotional intelligence, adaptability, and ability to collaborate with cross-functional, remote teams
Professional certifications in AWS architecture and development (strongly preferred)