We are seeking an expert Java developer with strong understanding of the Big Data Hadoop Ecosystem (HDFS, MapReduce2, Accumulo, Pig, Hive, HBase, MongoDB etc.) to work within a DevOps team. This position will be responsible for designing, developing, testing, tuning and the deployment of software solutions within the Hadoop Ecosystem. The developer will work closely with the administrators and application teams to insure business applications are highly available and performing within agreed upon service levels. This position will also work closely with business, architects and other development teams in an agile manner to quickly realize business value.
Key Responsibilities
-Lead troubleshooting and development on Hadoop technologies including HDFS, MapReduce2, YARN, Hive, Pig, Flume, HBase, MongoDB, Accumulo, Tez, Sqoop, Zookeeper, Spark, Kafka, and Storm.
-Lead software development in a collaborative team environment using Scrum Agile methodologies, primarily using Java and JavaScript with frameworks
-Translate, load and present disparate data sets in multiple formats and multiple sources including JSON, text files, Kafka queues, and log data.
-Performance tuning applications and systems for high volume throughput
-Lead designing, building, installing, configuring applications that lend themselves to a continuous integration environment.
-Translate complex functional and technical requirements into detailed design.
-Lead analysis of data stores and uncover insights.
-Ensures solutions developed adhere to security and data privacy policies.
-Lead investigations and proof of concepts as Big Data technology evolves.
-Test prototypes and oversee handover to operational teams.
-Define best practices/standards.
Required:
-5+ years of Java programming with frameworks, Scrum Agile, SOA, and software architecture
-2 years of experience developing utilizing Big Data Hadoop Ecosystem components (Sqoop, Hive, Pig, Flume, etc.)
-Experience in developing for high performance and large Hadoop clusters
-Strong understanding of Hadoop architecture, storage and IO subsystems, network and distributed systems
-Experience managing and developing utilizing open source technologies and libraries
-Experience with Java Virtual Machines (JVM) and multithreaded processing
-Expert scripting with shell scripting (Bash, PHP, PERL, Python, etc.)
-Expert with versioning, change control, problem management and troubleshooting
Desired Skills/ Experience:
-Experience with RDBMS technologies and SQL language; Oracle and MySQL highly preferred
-Knowledge of NoSQL platforms
-Data modeling (Entity-Relational-Diagram)
-Hands on experience with open source management tools (Pig, Hive, Flume, Thrift API, etc.) including participation in the community
-Large scale data warehousing
-Data Quality, DataCleaner, etc.
-Hadoop Developer Certified
Comcast is an EOE/Veterans/Disabled/LGBT employer
