Data Engineer

Datadog is the leading service for cloud-scale monitoring. It is used by IT, operations, and development teams who build and operate applications that run on dynamic or high-scale infrastructure. Because Datadog collects metrics and events from 100+ different technologies and services out of the box, including other monitoring tools, you can monitor your entire stack in one place, without any gaps.

We’re on a mission to bring sanity and clarity to Dev & Ops. We need you to build massively scalable, elegant systems that turn billions of data points per day into meaning for our customers. If you’re excited to work on a fast-moving team with the best open-source data tools at high scale, we want to meet you.

* Build distributed, high-volume data pipelines to power new product features based on analytics and machine-learning * Do it with Hadoop, Spark, Luigi, Kafka and other open-source technologies * Work all over the stack, moving fluidly between programming languages: Python, Java, Pig, Go, Scala, and more * Join a tightly knit team solving hard problems the right way * Own meaningful parts of our service, have an impact, grow with the company

* You have a BS/MS/PhD in a scientific field * You have built and operated data pipelines for real customers in production systems * You are fluent in several programming languages (JVM & otherwise) * You enjoy wrangling huge amounts of data and exploring new data sets * You tend to obsess over code simplicity and performance * You want to work in a fast, high growth startup environment **Bonus Points** * You are deeply familiar with Hadoop and/or Spark * In addition to data pipelines, you’re also quite good with Chef or Puppet * You’ve built applications that run on AWS * You have opinions about Lambda architecture / Kappa architecture * You’ve built your own data pipelines from scratch, know what goes wrong, and have ideas for how to fix it