Big Data Lead Developer

UnitedHealth Group

(Bernards, New Jersey)

Full Time

Job Posting Details

About UnitedHealth Group

UnitedHealth Group is the most diversified health care company in the United States and a leader worldwide in helping people live healthier lives and helping to make the health system work better for everyone.

Responsibilities

* Provide hands - on leadership for the design and development of ETL data flows using Hadoop and Spark ECO system components
* Lead the develop of large - scale, gh - speed, and low - latency data solutions in the areas of large scale data manipulation, long - term data storage,  data warehousing, Low - latency retrieval systems,  real - time reporting and analytics Data applications - visualization, BI, dashboards, adhoc analytics
* Rapidly architect, design, prototype, and implement architectures to tackle the Big Data solutions
* Work in cross - disciplinary teams with our company experts to understand client needs and ingest rich data sources
* Research, experiment, and utilize leading Big Data methodologies such as Hadoop, Spark etc.
* Architect, implement and test data processing pipelines on a variety of Hadoop hosted clusters
* Design & implement work flow jobs using Talend & Unix / Linux scripting to perform ETL on Hadoop platform
* Design, develop and implement ETL data flows jobs using Hive / Pig  or Java Map / Reduce
* Ingesting data into Hadoop layer using various big data technologies (eg. Pig, Hive, Map / Reduce)
* Translate complex functional and technical requirements into detailed design
* Perform analysis of data sets and uncover insights
* Maintain security and data privacy
* Propose best practices / standards
* Work with the System Analyst and development manager on a day - to - day basis
* Work with other team members to accomplish key development tasks
* Work with service delivery (support) team on transition and stabilization
* Design and develop optimal solutions for the implementation, maintenance  and monitoring of all components of software
* Responsible for integrating all development with the architecture used across the company
* Help shape and augment team’s continuous delivery capabilities and utilize DevOps best practices to improve delivery automation, collaboration, and efficiency
* Working with the team on a day - to - day basis and guiding them for the development and doing Code reviews etc.

Provide hands - on leadership for the design and development of ETL data flows using Hadoop and Spark ECO system components
Lead the develop of large - scale, gh - speed, and low - latency data solutions in the areas of large scale data manipulation, long - term data storage, data warehousing, Low - latency retrieval systems, real - time reporting and analytics Data applications - visualization, BI, dashboards, adhoc analytics
Rapidly architect, design, prototype, and implement architectures to tackle the Big Data solutions
Work in cross - disciplinary teams with our company experts to understand client needs and ingest rich data sources
Research, experiment, and utilize leading Big Data methodologies such as Hadoop, Spark etc.
Architect, implement and test data processing pipelines on a variety of Hadoop hosted clusters
Design & implement work flow jobs using Talend & Unix / Linux scripting to perform ETL on Hadoop platform
Design, develop and implement ETL data flows jobs using Hive / Pig or Java Map / Reduce
Ingesting data into Hadoop layer using various big data technologies (eg. Pig, Hive, Map / Reduce)
Translate complex functional and technical requirements into detailed design
Perform analysis of data sets and uncover insights
Maintain security and data privacy
Propose best practices / standards
Work with the System Analyst and development manager on a day - to - day basis
Work with other team members to accomplish key development tasks
Work with service delivery (support) team on transition and stabilization
Design and develop optimal solutions for the implementation, maintenance and monitoring of all components of software
Responsible for integrating all development with the architecture used across the company
Help shape and augment team’s continuous delivery capabilities and utilize DevOps best practices to improve delivery automation, collaboration, and efficiency
Working with the team on a day - to - day basis and guiding them for the development and doing Code reviews etc.

Ideal Candidate

**Required Qualifications:**

* 8+ years of hands - on experience in designing, leading, & developing enterprise application solution for distributed systems
* 5+ years of hands - on experience with Java OR Python OR ETL tools as a developer
* 3+ years Big Data development experience
* Understanding of database internals and data warehouse implementation techniques; working knowledge of SQL
* Solid understanding of data structures & common algorithms
* Understanding of time - complexity of algorithms

**Preferred Qualifications:**

* Experience with HBase, Talend , NoSQL databases
* Experience Apache Spark or other streaming big data processing
* Experience in Hadoop ECO System
* Strong experience in Java and PIG
* Experience with Python & Scala
* Experience loading from disparate data sets
* Pre-processing experience using Hive / Pig / Python / Unix scripting
* Experience in Linux, XML, JSON, REST
* Experience with UNIX and Shell scripting
* Hands - on experience with Hadoop, Map / Reduce, Hive, HBase & Pig
* Ability to write Pig Latin Scripts
* Hands - on experience writing Hive QL and tuning Hive QL
* Knowledge of workflow / schedulers like Oozie
* Previous experience with Healthcare industry
* Able to work well in extremely fast paced and entrepreneurial environments Independent self-starter who is highly focused and results oriented
* Strong analytical and problem solving skills

Required Qualifications:

8+ years of hands - on experience in designing, leading, & developing enterprise application solution for distributed systems
5+ years of hands - on experience with Java OR Python OR ETL tools as a developer
3+ years Big Data development experience
Understanding of database internals and data warehouse implementation techniques; working knowledge of SQL
Solid understanding of data structures & common algorithms
Understanding of time - complexity of algorithms

Preferred Qualifications:

Experience with HBase, Talend , NoSQL databases
Experience Apache Spark or other streaming big data processing
Experience in Hadoop ECO System
Strong experience in Java and PIG
Experience with Python & Scala
Experience loading from disparate data sets
Pre-processing experience using Hive / Pig / Python / Unix scripting
Experience in Linux, XML, JSON, REST
Experience with UNIX and Shell scripting
Hands - on experience with Hadoop, Map / Reduce, Hive, HBase & Pig
Ability to write Pig Latin Scripts
Hands - on experience writing Hive QL and tuning Hive QL
Knowledge of workflow / schedulers like Oozie
Previous experience with Healthcare industry
Able to work well in extremely fast paced and entrepreneurial environments Independent self-starter who is highly focused and results oriented
Strong analytical and problem solving skills