Sr. Big Data Engineer

Neshent Technologies
  • Charlotte, NC

  • Post Date: May 19, 2020

Key Skills: Big Data, Hadoop, Sqoop, Hive, Spark, Oozie

  • Experience: 3 to 5 Yrs
  • Domain: Information And Communication Technology
  • Job Type: Contract - Corp-to-Corp, Contract - Independent, Contract - W2

Job Description

Our client is looking for a Sr. Data Engineer with extensive experience on the Hadoop platform related tools, and with leading teams to deliver complex products.
Key Responsibilities:
• Build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications.
• Responsible for obtaining data from the System of Record and establishing real-time data feed to provide analysis in an automated fashion.
• Develop Hadoop applications to analyze massive data collections
• Develop processing framework to detect conditions
• Develop techniques supporting trending and analytic decision-making processes
• Apply Hadoop technologies for responsive front-end experience
Key Requirements and Technology Experience:
• Bachelor s degree in computer science or a related discipline. In lieu of a degree, a minimum of 10 years of related business experience.
• Work experience in addition to the degree: 5-10 years as an IT Application Analyst or equivalent
• Proven experience within Hortonworks Hadoop ecosystems (MR1, MR2, HDFS, YARN, Hive, HBase, Sqoop, Pig, Hue, etc.)
• 3 to 5 years of Hadoop experience (Experience working on the Data and Analytics Solutions team):
• Hive Programming
• Sqoop (utilizing various data sources)
• Oozie workflows
• Spark/PySpark
• HBase/Phoenix
• MapReduce and Yarn
• Hadoop File Formats (e.g. ORC; Parquet; Avro; JSON)
• HDFS, Storm, Scala, C++, Python, Java
• BitBucket/Jenkins
• Experience with NiFi a plus
• BitBucket and workflow scheduling tools such as CA ESP Automation
• Familiarity with AWS stack a plus

Share this vacancy

Related Jobs

Data Scientist (Image Analytics)

2T Consulting, Atlanta, Georgia

Key Skills Data, Data Scientist, Data Engineer, Data Specialist, SDLC, Scrum, Agile, Conceptual Data Model, Physical Data Model, Mapping, Neural Networks, Naive Bayes, SVM, Tableau, HDFS, Hive, Spark

Experience: 3 to 5 Yrs

Java Lead

Longfinch, Chandler, Arizona

Key Skills Apache HTTP Server, Apache Kafka, Apache Spark, Apache Struts, Dashboard, Database, J2EE, JMS, JSP, Java, Java Servlets, JavaScript, Leadership, Microservices, Reporting, SQL, Software Development, Spring, Writing, XML, XPath, XSD, XSLT, JQuery

Experience: 3 to 5 Yrs

Java Lead Developer

Longfinch, Woburn, Massachusetts

Key Skills Hive, Sqoop, SQL, Unix, Pig, RDBMS, Hbbase

Experience: 3 to 5 Yrs

Associate Java Developer

Longfinch, Saint Louis, Missouri

Key Skills ELT, Big Data, Talend, Apache Spark, Apache Hadoop

Experience: 3 to 5 Yrs

Contact Neshent Technologies

Charlotte, NC CharlotteNorth Carolina 28201