Tech Lead, Compute and Data Processing (RecordService)

Cloudera delivers the world’s fastest, easiest, and most secure platform for data management and analytics, built on Apache Hadoop and latest open source technologies.

Cloudera is looking for a Tech Lead with distributed computing experience to help define and build a highly-scalable next generation data access platform for Hadoop and integrate this with compute and storage frameworks such as Spark, MapReduce, HDFS, and HBase.

RecordService is a new distributed, scalable, highly-performant data access platform for all Apache Hadoop compute frameworks. RecordService is Apache Licensed open source with plans to transition to the Apache Software Foundation. Our goal is to make each individual feel valued for his or her contributions to the company’s mission. We are looking for smart people who want to do remarkable things. We strive to create an environment of casual intensity where people enjoy coming to work every day. Our senior management team meets regularly with the whole company to discuss strategy, successes, and challenges.

• Design and implement engineering systems and APIs that scale well – to petabytes of data and thousands of nodesDeliver functionality that integrates seamlessly with compute and storage frameworks
• Formulate and present architecture and design documents internally and to the open source community
• Analyze large-scale distributed systems to identify performance bottlenecks, failure points, and security holes
• Establish and evolve productive software development practices and workflows.
• Introduce and promote new technologies to the world through blogs and conference presentations
• Work primarily in our San Francisco office

Qualifications:

• 5+ years of experience writing production-quality code (C/C++, Java, and/or Scala)
• Served as the tech lead on multiple successful releases of software products of high technical complexity
• Evangelist of high code quality standards
• Familiarity with RDBMS concepts and SQL
• Experience with scalable distributed multi-node environments
• Interest and experience mentoring junior engineers. Excellent communication skills
• Proven strong customer focus

Pluses:

• Experience with Hadoop and related technologies. Spark and/or MapReduce development knowledge is a strong plus
• Knowledge of SQL authorization, LDAP, Kerberos, TLS, certificates, and/or related security technologies
• Hands-on experience with Scala