Close
Login

Big Data Engineer

capital one
  • Plano, TX

  • Post Date: Feb 10, 2020

  • Salary: Up to $65 (Per Hour)

  • Key Skills: BIG DATA ENGINEER
  • Experience: 5 + Yrs
  • Domain: Information And Communication Technology
  • Work Authorization: US citizen
  • Job Type: Contract - Corp-to-Corp

Job Description

Bill rate guidelines below, but I will send ANYONE who does well on Glider

Spark Streaming-MUST
Some ETL- how to dump data into Snowflake-MUST
Metadata experience (identify where to encrypt or decrypt)-MUST
AWS (S3)


COAF Data Engineer Contractor Job Requirements

Minimum Requirements:

At least 3 years of experience developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python
At least 2 years experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC etc..)
At least 3 years of developing applications with Monitoring, Build Tools, Version Control, Unit Test, TDD, Change Management to support DevOps
At least 3 years of experience with SQL and Shell Scripting experience
At least 2 years of experience with software design and must have an understanding of cross systems usage and impact


Nice to Have qualifications:

2+ years of experience working with Dimensional Data Model and pipelines in relation with the same
2+ years' experience with Amazon Web Services (AWS), Microsoft Azure or another public cloud service
2+ years of experience working with Streaming using Spark or Flink or Kafka or NoSQL
Intermediate level experience/knowledge in at least one scripting language (Python, Perl, JavaScript)
Hands on design experience with data pipelines, joining data between structured and unstructured data


Share this vacancy

Related Jobs

Big Data Engineer

capital one, Plano, Texas

Key Skills BIG DATA ENGINEER

Experience: 5 + Yrs

Big Data Engineer

capital one, Plano, Texas

Key Skills BIG DATA ENGINEER

Experience: 5 + Yrs

Big Data Engineer

American Express, Phoenix, Arizona

Key Skills BIG DATA ENGINEER

Experience: 5 + Yrs

Contact capital one

Plano, TX PlanoTexas 75023