Mitratech Logo

Mitratech

Senior Software Engineer - Infrastructure - AI/ML

Reposted 8 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Munich, Bavaria
Senior level
In-Office or Remote
Hiring Remotely in Munich, Bavaria
Senior level
The Senior Software Engineer will focus on Machine Learning model development, data management, model deployment, and staying updated on NLP advancements.
The summary above was generated by AI

At Mitratech, we are a team of innovators focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions. We are a close-knit, globally dispersed team that thrives in an ecosystem that supports individual excellence and takes pride in its diverse and inclusive work culture centered around great people practices, learning opportunities, and having fun! Our culture is the ideal blend of entrepreneurial spirit and enterprise investment, enabling the chance to move at a rapid pace with some of the most complex, leading-edge technologies available.

For over 35 years, the experts at Mitratech have been focused on solving the complex needs. Today, we serve 20,000 client companies of all sizes globally, representing 30% of the Fortune 500 and over 500,000 users in over 160 countries.
As we continue to grow, we’re always looking for resourceful, enthusiastic, and fresh perspectives. Join our global team and see what makes Mitratech a truly exceptional place to work!

Given our continued growth, we always have room for more intellect, energy, and enthusiasm - join our global team and see why it's so special to be a part of Mitratech!

Job Overview 

We are seeking a highly skilled Senior Infrastructure Engineer to join our dynamic AI Platform team. The ideal candidate will play a pivotal role in designing, building, and maintaining the cloud and systems infrastructure that powers our machine learning and generative AI workloads. This position requires deep expertise in cloud architecture, systems reliability, and automation, combined with a strong understanding of scalable AI/ML environments. The right candidate is passionate about performance, reliability, and enabling teams to deliver AI solutions efficiently and securely.

Essential Duties & Responsibilities:

  • Design, deploy, and maintain scalable and secure infrastructure supporting AI and ML workloads.
  • Build and maintain AWS cloud environments for compute (EC2, ECS/EKS, Lambda), storage (S3, EFS, FSx), and networking (VPC, Transit Gateway, PrivateLink, Route 53, load balancers).
  • Implement security best practices using IAM, KMS, Secrets Manager, GuardDuty, and Security Hub.
  • Support and optimize AI/ML workloads across AWS services (SageMaker, Bedrock, Batch, Step Functions).
  • Develop and maintain Infrastructure as Code (IaC) using Terraform, AWS CDK, and CloudFormation.
  • Manage containerized workloads and orchestration platforms (Docker, EKS, Fargate), including GPU scheduling and scaling.
  • Set up and maintain monitoring and observability frameworks using CloudWatch and OpenTelemetry.
  • Build and manage CI/CD pipelines (CircleCI, GitHub Actions, GitLab CI) for infrastructure automation and ML/Gen AI deployments.
  • Collaborate with ML and Generative AI teams to scale models, optimize performance, and design efficient prompt or inference pipelines.
  • Develop runbooks and SOPs for AI service deployment, troubleshooting, and performance optimization.
  • Ensure security, compliance, and data protection across AI datasets and environments.

Requirements & Skills:

  • Deep expertise in AWS cloud services, with experience in compute, storage, networking, and security domains.
  • Proficiency in container orchestration (Kubernetes/EKS) and infrastructure automation tools.
  • Hands-on experience with IaC tools such as Terraform, AWS CDK, or CloudFormation.
  • Familiarity with monitoring, logging, and observability stacks (Prometheus, Grafana, OpenTelemetry).
  • Experience implementing CI/CD pipelines for automated deployment and testing.
  • Understanding of AI/ML concepts, including model deployment, inference scaling, and LLM performance tuning.
  • Working knowledge of security best practices, IAM roles, encryption, and compliance controls.
  • Excellent collaboration and communication skills to partner with ML engineers, data scientists, and product teams.

Education:                         

  • A Master’s degree in Machine Learning, Computer Science with a preference for specialization in the NLP domain.

We are an equal-opportunity employer that values diversity at all levels. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity, disability, or veteran status.

Similar Jobs

34 Minutes Ago
Remote
Mid level
Mid level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Own and grow a portfolio of large enterprise accounts in Germany, run full multistakeholder sales cycles from discovery to close, build executive relationships, manage pipeline, partner with solutions engineers and channel partners, and provide market intelligence to leadership.
Top Skills: CloudMeddpiccRubrik Agent CloudRubrik Security CloudSalesforce
2 Hours Ago
Easy Apply
Remote or Hybrid
Easy Apply
103K-148K Annually
Senior level
103K-148K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Manage a German territory to acquire net-new logos and drive upsell at large enterprises. Build C-level relationships, create long-term account strategies, collaborate cross-functionally, and act as a trusted advisor aligning Zscaler solutions to customer goals.
Top Skills: Ai-Powered Sales IntelligenceAi/MlCloud-NativeConversational AiPredictive ForecastingZero TrustZero Trust Exchange
7 Hours Ago
Easy Apply
Remote or Hybrid
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Software
Resolve complex technical customer issues for Vercel customers, troubleshoot with Engineering, develop internal tools and runbooks, act as domain owner for v0, partner with Product and Customer Success, mentor team members, and participate in scheduled on-call rotations.
Top Skills: AILlmV0VercelWeb Services

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account