Data Pipeline Engineer

Chartboost is the world’s largest mobile games-only platform, helping developers grow their audience, monetize, and make better data-driven decisions. We work with 90% of the top-grossing iOS and Android game developers and are currently being leveraged by over 300,000 games, reaching 1 billion active players around the world every month.

We are seeking a data pipeline engineer to join our team, helping to build and maintain a data platform that supports data analysis, exploration, aggregation, and apis delivering significant impact to both our game developers and internal customers. In this role, you are expected to be comfortable working as a data engineer and dealing with huge amounts of data (hundreds of TBs). Our technology stack includes Spark, Presto, Hive, Kafka, Cloudera, Redshift, Dynamo, Cassandra, Airflow, HDFS, HBase, Scala, Python, MySQL, MongoDB, AWS, Git, Spinnaker, and Puppet. You have the opportunity to evaluate new technologies and use them to design better and more reliable systems.

* Develop reliable data pipelines that convert data into powerful signals and features * Design real time and batch data processing pipelines for different systems to consume * Develop tools to monitor, debug, and analyze data pipelines * Design and implement data schemas and models that can scale for hundreds of millions of users * Collaborate closely with product team to build new features and infrastructure

* 2+ years of experience in Data Warehousing, and SQL * 2+ years of experience in programming in any of Python / Java / Scala * Experience with data pipelines in Hive, HDFS processing larger than 10TB of data is a plus * Strong experience in improving performance of queries and data jobs and scaling the system for exponential growth in data * Expert debugging skills and emphasis on automated tests to build high quality systems * Experience working with Spark is a plus * BS in Computer Science or related technical discipline