Hadoop Developer (Atlanta, GA, or other unanticipated locations throughout U.S.).

Overview

Our team is looking for an experienced Hadoop Developer.

Responsibilities

Responsibilities include: Helping to build new data pipelines, identify existing data gaps, and providing automated solutions to deliver advanced analytical capabilities and enriched data to applications that are supporting the operations team. Supporting software projects within the Data & Engineering Analytics team. Implementing a software cyber security Logging & Monitoring strategy that will Standardize Infrastructure/Apps/Sec. logs used by GIS. Signaling Intelligence through Automated ETL and enrichment to mitigate and proactively identify and profile adversary behavior, infrastructure, tradecraft, and capability, at scale, speed, and depth not currently available with existing infrastructure and computational power. Working with MySQL, HIVE, Impala, SPARK SQL software. Applying data ingestion experience from message queue, file share, REST API, relational database, etc. and working in data formats like Json, csv, xml. Working with SPARK Structured steaming, Hadoop/Big Data and Distributed Systems. Providing software administrative product support and troubleshooting. Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc. Designing software in Scala, Python, PHP, or

Shell Scripting, to name a few. Providing performance tuning experience with spark /MapReduce and/or SQL jobs. Working with Linux operating system; end-to-end design and building process of Near-Real Time and Batch Data Pipelines. Working in Agile development process and deep understanding of various phases of the Software Development Life Cycle. Using Source Code and Version Control systems like SVN, Git, Bit Bucket etc. Working with Jenkins and Jar management to create software. Ability to comprehend customer software requests and provide the correct solution. Resolving issues and forecasting potential issues and providing software solutions. Adapting and continuing to learn new technologies and staying current.

Qualifications

M.S. in Computer Science, Data Science or closely related. 24 mo. exp in any related Software Development position. 24 mon. in: Hadoop; Spark Core; Spark Streaming; Scala; Python; Kafka; Hive; Amazon AWS; Tableau; Cloudera; MapReduce. Telecommuting permitted.

40 hrs/wk. 8:00 am - 5:00 pm.