Senior Software Engineer, Observability

Role Overview

The AI Infrastructure team at Together AI is building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management.

What You Will Do

Design and implement a scalable observability platform, develop automated monitoring, alerting, and anomaly detection systems, build and deploy custom observability tools and infrastructure-as-code.

Why It Might Be a Fit

Expertise in observability platforms and cloud-native monitoring services, strong programming skills in Go, Python, or similar languages, experience designing, operating, and scaling large-scale distributed systems and pipelines.

Requirements

• Expertise in observability platforms (Prometheus, Grafana, ClickStack, OpenTelemetry) and cloud-native monitoring services (AWS, GCP, Azure)
• Strong programming skills in Go, Python, or similar languages, with proficiency in infrastructure-as-code tools (Terraform, Ansible, Helm)
• Experience designing, operating, and scaling large-scale distributed systems and pipelines for high-volume data ingestion and real-time querying
• Deep understanding of containerization (Docker) and orchestration (Kubernetes)
• Knowledge of microservices architecture, service mesh technologies, CI/CD pipelines, and GitOps workflows
• Expertise in managing databases (PostgreSQL, MongoDB, Redis) and time-series databases with high-cardinality data

Benefits

• Competitive compensation
• Startup equity
• Health insurance
• Flexibility in terms of remote work

Originally posted on Himalayas