Senior Data DevOps Engineer

Shutterstock

(New York, New York)
Full Time
Job Posting Details
About Shutterstock
Shutterstock, Inc. (NYSE: SSTK), is a leading global provider of high-quality licensed photographs, vectors, illustrations, videos and music to businesses, marketing agencies and media organizations around the world. Working with its growing community of over 100,000 contributors, Shutterstock adds hundreds of thousands of images each week, and currently has more than 80 million images and nearly 4 million video clips available.
Responsibilities
* Day to day operational support of our Hadoop installations in Dev, QA, Product * Ownership of cost, performance and scale management in a cloud environment including recommendations * Evaluate relevant new technologies as they come out. * Work closely and collaboratively in an Agile environment with our developers and product teams to analyze issues and find new insights into our business and operations. **Basic Responsibilities:** * Familiarity with building hosts (kickstart, PXE boot), and configuration management system (Pupppet, Chef). * Strong Linux background. * Development and Operational Experience within Hadoop ecosystem (MR, HDFS, YARN, Hive, Sqoop, Oozie, etc). * Focus on delivering a quality experience to customers Must be self starter and motivated. * 2+ years experience in managing AWS resources. * Understanding of VPC, EC2, Route53, Kinesis, ECS, IAM, and other AWS concepts. * EMR, Hadoop, Redshift operations experience. * Strong understanding of Docker. * Infrastructure as code - Terraform experience.
Ideal Candidate
* Proficiency in Python, Java, or Scala Proficiency in SQL, Hive or another SQL-on-Hadoop tool. * NoSQL exposure [Cassandra, MongoDB, DynamoDB, etc] * RDBMS exposure [MySQL, SQLServer, etc] * Experience with ETL process / software [Pentaho, Scalding, Cascading, Luigi, Oozie, etc]. * Experience with Cassandra, Vertica Experience with a stream processing technology (Spark, Storm, Samza, Flink, etc).

Questions

Answered by on
This question has not been answered
Answered by on

There are no answered questions, sign up or login to ask a question

Want to see jobs that are matched to you?

DreamHire recommends you jobs that fit your
skills, experiences, career goals, and more.