Data Engineer

Hired by Matrix, Inc., a certified Women-owned Business Enterprise (WBE) is dedicated to providing the highest quality staffing services to our clients as their trusted business partner. This is achieved through the in-depth use and understanding of today’s emerging technologies and the commitment of a dedicated, highly motivated, staff. We use innovative, agile and social techniques to deliver the best value to our Clients.

Our client is one of the largest providers of commercial business information solutions. The purpose is to mitigate credit and supplier risk, increase cash flow and drive increased profitability. They also provide marketing solutions to increase revenue from new and existing customers and convert prospects into clients faster by enabling business professionals to research companies, executives and industries.

**As a member of Data Engineering team your responsibilities will include:** * Work closely with analytics and content innovation teams to design and build datasets (structured and unstructured) for complex experiments * Develop solutions and tools to analyze and efficiently process large datasets for machine learning experiments and statistical analysis * Work in heterogeneous environment of multiple platforms in multiple languages. (SAS, Mainframe (JCL, Cobol, SAS, etc.), Open Source (R, Python, etc.), SQL, HQL, Unix/Linux) * Provide stewardship and best practices for data wrangling and analysis of structured and unstructured data * Collaborate with software engineers, ML experts, and business teams * Work in cross functional agile teams to regularly experiment, iterate, and deliver on new data product objectives

* Bachelor's degree or higher required in Computer Science, applied quantitative field (math/statistics, engineering) is a plus * At least 3 years of relevant experience in a software development environment * Demonstrated expertise in numerical and statistical packages in R, familiarity with other packages Panda, Sklearn, etc. is a plus. * Strong analytical skills and comfort with common statistical techniques * Demonstrated expertise in problem solving and technical innovation * Demonstrated expertise with software architecture & design, data structures and algorithms * Familiarity with Hadoop big data stack, Impala, Hive, Pig or Spark a plus * Ability to write complicated, efficient HQL/SQL queries to extract and process data * Familiarity with best practices for scalability and performance of data processing solutions * Hands-on experience in delivering software in Java and at least one scripting language (Python, Perl, etc.) * Well versed in Linux * Data-drive with high level of creativity, curiosity, and free thinking * Organized, thorough, and detail oriented as working with multiple datasets across multiple time periods with different units of analysis requires attention to detail * Quick learner who can master and manage multiple projects simultaneously with minimal supervision and a flexible positive attitude * Strong written and oral communication skills; must be able to clearly explain design considerations, options, and trade-offs