Senior Data Infrastructure Engineer

We love the internet, and the colorful characters and interesting conversations that make up its diverse communities. Disqus exists to make better communities and an even better web.

We're looking for an experienced Data Infrastructure Engineer to lead our Data Infrastructure efforts at Disqus. The ideal person has built a working data infrastructure from scratch, or come in and improved an existing one at a prior company, and is interested in building and maintaining clean data pipelines for a growing company with tons of incoming data.

• Design, build, and maintain all parts of the data infrastructure. Maintain data quality and accuracy across analytics and production data systems.
• Develop and maintain cross platform ETL processes. Design and develop data aggregation and summarization jobs for reporting.
• Work with our DevOps team to scale our data infrastructure
• Work with our Data Analyst team to get the right data to the right people at the right time

• 4-8+ years in software development
• Proven ability to build large, reliable, scalable infrastructure
• Proficient with relational databases and SQL
• Ability to troubleshoot complex data and system interaction problems
• Experience working with data delivery and data streaming systems (e.g. Kafka, Storm)
• Experience working with data processing, loading and transformation systems (e.g. MapReduce, Spark, Esper)
• Experience working with large-scale data storage systems (e.g. HDFS, BigTable, Cassandra, DynamoDB)
• Experience building high quality, large-scale, distributed systems using Java, Scala, C++ or Python
• Familiarity with data cluster management and configuration systems (Mesos, Yarn, Zookeeper)
• Independent and passionate about learning new technologies
• Ability to communicate technical concepts clearly and concisely in oral and written form
• Ability to provide technical leadership to the team in terms of vision and roadmap