Senior Hadoop Engineer

Royal Bank of Canada is Canada’s largest bank, and one of the largest banks in the world, based on market capitalization. We are one of North America’s leading diversified financial services companies, and provide personal and commercial banking, wealth management, insurance, investor services and capital markets products and services on a global basis.

As a senior platform engineer you will be working with a small team responsible for building out a big data platform running Hadoop and other big data technologies to help drive growth of a multi-billion dollar enterprise. As a key member of the team, you will take on challenges of scaling out systems for performance, resiliency and multi-tenancy using leading-edge technology. Work on large scale clusters spanning multiple data centres. Scale out cluster and services to hundreds of applications. Design and build multi-tenant solutions. Deploy and test out new technologies like Kylin, Apex and NiFi. Desire to grow and learn the rest of the big data platform ecosystem. Have fun, celebrate our successes and mourn our failures.

Help lead the platform engineering team adopt new technologies, through sound design, automation, data-driven decisions through collaboration and collective ownership. Our goals is to embrace change and minimize friction for platform use and adoption. * Configuration Management through tools like Ansible, Rundeck, Jenkins, Git and Consul * Leverage REST APIs for automation and reporting * Have an open mind, always learning and challenging the norms * Help lead the conversation and design, understanding the architectural tradeoffs * Scalability, Resiliency, High Availability and Security * Develop standards and policies to support a large enterprise * Capacity planning and solution review

**Must have skills:** * Linux administration (RHEL/CentOS 7 preferred) * LDAP, DNS, Networking, Kerberos, OpenSSL, Java and more * Experience with design, build and administration of Hadoop (HDP 2.3, 2.4 preferred) * HDFS, Hive, Ambari, YaRN, Oozie, Spark, Kafka, Storm, Kerberos * Nice to have: Ranger, Flume, Grafana, ElasticSearch, LogStash, SolR, HBase, Python, R * Java applications * Garbage tuning, JMX * Experience with distributed system engineering for scale and resiliency * Desire for excellence and continuous improvement * Nice to have: Experience with Cisco UCS **Personal Qualities** * Be honest and demonstrate integrity * Be fair and respectful to others * Be responsible * Pursue excellence