Data Engineer (Scala/Spark)

Sharethrough

(San Francisco, California)
Full Time
Job Posting Details
About Sharethrough

Sharethrough is the largest & most sophisticated platform for in-feed, native monetization. Built for the new paradigm of modern content marketing, Sharethrough is a mobile-first, content-driven platform for advertisers to engage users with quality content, integrated natively to each site it lives on + for publishers to monetize with premium ads while maintaining a high quality user experience.

Summary

As a data engineer at Sharethrough, you’ll build out our 1 terabyte/day data infrastructure, generating insights used by top publishers and brands on the open web, powering critical revenue behind companies like Hearst, CBSi and Time Inc. You'll be a key contributor to our Scala and Spark-based pipeline and the backend services that make thousands of complex, real-time decisions per second possible.

Responsibilities
  • Having a say: You’ll participate in problem definition and solution with a diverse group of engineers, designers and business owners from around the company.

  • Proper engineering: Writing Scala and Spark-based pipeline processing and infrastructure that is performant, well-tested, and easy to maintain.

  • Technical heavy lifting: You’ll architect and implement major components of an ambitious technical roadmap, evaluating and implementing tools like Redshift, Kinesis and Mesos.

Ideal Candidate
  • You’ve shipped software: You have production experience with a nice bit of our stack: Scala, Spark, EMR, Kinesis, etc. and for the parts you don’t, you’re excited to learn.

  • You care about code: You take pride in engineering, and have a deep understanding of how to write high quality, maintainable, extensible software.

  • You like moving quickly: We push to production on every commit via our continuous integration and deployment pipeline.

Questions

There are no answered questions, sign up or login to ask a question

sign up or login to save this job and more
San Francisco, California
Skills Desired
Sign up or login to see how your skills match up.
  • Scala
  • Apache Spark
  • Continuous Integration
  • Redshift
  • Amazon Elastic MapReduce
  • Apache Mesos
  • Amazon Kinesis
  • Deployment Pipeline

Want to see jobs that are matched to you?

DreamHire recommends you jobs that fit your
skills, experiences, career goals, and more.