Data Engineer

Toptal is a network of the world’s top 3% of software engineering, design, and finance talent – available on demand to help companies accelerate, adapt, and scale. With $100+ million in annual revenue and triple-digit growth, Toptal is the largest fully distributed workforce in the world.

As a Data Engineer, your main goal is to be one step ahead of data scientists and analysts, and support them by providing infrastructure and tools they can use to deliver end-to-end solutions to business problems that can be developed rapidly and maintained easily. This is more than building and maintaining ETL pipelines. We need innovation, creativity and solutions that will have significant impact on our velocity. We, in turn, will give you autonomy and freedom to turn your ideas into reality.

* Build scalable, highly performant infrastructure for delivering clear business insights from a variety of raw data sources. * Develop batch & real-time analytical solutions, prototypes, and proofs of concept for selected solutions. * Implement complex analytical projects with a focus on collecting, managing, analyzing, and visualizing data. * Build frameworks and tools to empower our data scientists and analysts. * Be in constant communication with team members and other relevant parties and convey results efficiently and clearly.

* Working experience with Python, Pandas. Prior experience with Luigi is a plus. * Working experience with Scala and Spark is a big plus. * Familiarity with Google Cloud Platform (e.g. GCS and BigQuery) is a plus. * Working experience with Ruby and Rails is a plus. * Familiarity with the basic principles of distributed computing and data modeling. * Extensive experience with object-oriented design and coding and testing patterns, including experience with engineering software platforms and data infrastructures. Familiarity with functional programming concepts is a plus. * Outstanding communication and interpersonal skills. * Be excited about collaborating daily with your team and other groups while working via a distributed model. * Be eager to help your teammates, share your knowledge with them, and learn from them. * Be open to receiving constructive feedback. * You must be a world-class individual contributor to thrive at Toptal.