← Serch more jobs

Senior Staff Software Engineer, ML Inference

LinkedIn Cognitiv Bellevue, WA
Mid-Senior level Posted March 27, 2026 Job link
Thinking about this job
Not Met Priorities
What still needs stronger evidence
Requirements
  • Languages: C++17+, C#, Java
  • Cloud: AWS, GCP, or Azure
  • Infrastructure: Terraform, Ansible, containers
  • ML: PyTorch ecosystem & model serving
  • Optimization: parallelism, quantization, tiling
  • Hardware Acceleration: GPU inference
  • Strong C++ Systems Engineer: 5+ years building performance-critical software in C++17 or later, with a focus on reliability, efficiency, and production quality.
  • Infrastructure-Minded Builder: Comfortable working with infrastructure-as-code (Terraform, Ansible, etc.) and thinking beyond code into deployment, reproducibility, and operational scalability.
  • End-to-End Owner: You naturally take services from planning and design through implementation, delegation, testing, release, and ongoing operation — and feel accountable for outcomes, not just code.
  • Clear Technical Communicator: You can articulate complex technical ideas simply, shape organization-level technical narratives, and drive alignment across Engineering, Research, and Product.
  • Familiar with PyTorch or equivalent ML framework
  • Familiar with containerization (Docker, Kubernetes, etc.)
  • Experience with advanced ML architectures (two-tower models, teacher-student learning, etc.)
  • Experience with AI development technology (AI code review, AI code assistants, etc.)
Preferred Skills
  • ML: PyTorch ecosystem & model serving
  • Familiar with PyTorch or equivalent ML framework
  • Experience with deep learning optimization (parallelism, quantization, tiling, etc.)
  • Experience with GPU/hardware acceleration (NVIDIA TensorRT, etc.)
  • Experience with ML Ops technologies (model lifecycle management, ML integrated platforms, model observability, automation, etc.)
  • Familiar with containerization (Docker, Kubernetes, etc.)
  • Experience with advanced ML architectures (two-tower models, teacher-student learning, etc.)
  • Experience with Rust
  • Experience with AI development technology (AI code review, AI code assistants, etc.)