Close
Login

Senior BIG Data Developer / BIG Data Engineer

Longfinch
  • Mclean, VA

  • Post Date: May 15, 2020

  • Salary: $90 - 100 (Per Hour)


Key Skills: BIG DATA, HADOOP, R, PYTHON, PYSPARK, SCALA, SQL, JSON, SHELL SCRIPTING, DEVOPS, CI/CD, DOCKER, JENKIN, Multi-Terabyte Data Sets, Hadoop Ecosystem, Xml, Data Integration, Aws, Lambda, EC2, EMR, ECS, S3, CLOUD

  • Experience: 4 to 6 Yrs
  • Domain: Information And Communication Technology
  • Job Type: Contract - Corp-to-Corp, Contract - Independent, Contract - W2

Job Description

• Requirements/Critical Skills (4-6 years working experience):
• Able to work efficiently under UNIX/Linux environment
• Experience working with in-memory computing using R, Python, Spark, PySpark and Scala. ( as many as possible)
• Experience in parsing and shredding XML and JSON, shell scripting, and SQL
• Experience working with SQL (DB2, SQLServer, Sybase, Oracle) and No SQL databases (MongoDB, DynamoDB)( as many as possible)
• Experience with DevOps, CI/CD implementations of the following technologies: Docker or Jenkins or Test Driven Development patterns
• Experience designing and developing data sourcing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching
• Knowledge of data, master data and metadata related standards, processes and technology
• Experience working with multi-Terabyte data sets (structured, semi/unstructured data)
• Knowledge of job scheduling and monitoring tools like Oozie and Autosys
Preferred Skills:
• Experience in the Financial, and information management needs are a plus
• Experience in Financial Services/Secondary Mortgage industry is a plus
• Demonstrated flexibility and adaptability to changes – Agile methodology experience with Jira
• Demonstrated ability to manage multiple priorities and deadlines
• Ability to work independently or as part of a team
• Cloud infrastructure experience working with one or more of the following Amazon Web Services (AWS) Cloud services is a plus: EC2, EMR, ECS, S3, SNS, SQS, Cloud Formation, Cloud watch, Lambda
 


Share this vacancy

Related Jobs

Test Automation Engineer

2T Consulting, Durham, North Carolina

Key Skills Software, Test, Engineer, Quality, QA, Management, Development, Testing, System, Performance, SQL, Excel, Automation, Test Plans, Test Scripts, Manual, Test Cases, Scripting, Functional, Structural, Regression, System Testing, Agile, Scrum, Azure, DevOps, Jira, XML, Selenium, Postman, MSTest, JavaScript, Test, Engineer, C, System, Engineering, Computer, Systems, Management, SQL, project Manager, ReactJS, NodeJS, MongoDB, Express.JS, Java, Microservices, Pub-sub, Kafka, Splunk, Resful, API, Agile, Analysis, Apache, API, Architecture, AS400, Bash, COBOL, Configuration Management, CSS, Database, Development, Excel, GIT, Java, JavaScript, JCL, Jenkins, Lifecycle, Management, NoSQL, Oracle, PL/1, PowerPoint, Programming, Quality Assurance, RPG, Scrum, SDLC, Shell Script, SOAP, Software Engineer, SQL, SQL Server, TCP/IP, Testing, UML, Unix, VMware, Windows, Agile, Automated, Business Requirements, Call Center, Development, Embedded, Genetic, Lifecycle, Manager, Programming, Protocols, Sales, SDLC, TDD, Testing, Software, Systems, Engineer, Engineering, Computer, Web, IP, SSL, Security, IT, FPGA, Architect, • Software, Engineer, Linux, System, Systems, Test, Security, Program Manager, Engineering, SQL, Outlook, Excel, PowerPoint, XSLT, Java, Defense Systems, IT, Automated Testing, Business Requirements, COM, Data Analysis, Data Modeling, Data Warehouse, Defect Tracking, Engineering, Onshore, Process Flow, QA, Reporting, Software, Test Cases, Test Plans, Test Strategy, DWH, Datawarehouse, Test Automation Engineer, Test Engineer, Automation Engineer, Test, Engineer, Video, SQL, MySQL

Experience: 4 to 6 Yrs

DWH Test Automation Engineer

2T Consulting, Saint Louis, Missouri

Key Skills Software, Test, Engineer, Quality, QA, Management, Development, Testing, System, Performance, SQL, Excel, Automation, Test Plans, Test Scripts, Manual, Test Cases, Scripting, Functional, Structural, Regression, System Testing, Agile, Scrum, Azure, DevOps, Jira, XML, Selenium, Postman, MSTest, JavaScript, Test, Engineer, C, System, Engineering, Computer, Systems, Management, SQL, project Manager, ReactJS, NodeJS, MongoDB, Express.JS, Java, Microservices, Pub-sub, Kafka, Splunk, Resful, API, Agile, Analysis, Apache, API, Architecture, AS400, Bash, COBOL, Configuration Management, CSS, Database, Development, Excel, GIT, Java, JavaScript, JCL, Jenkins, Lifecycle, Management, NoSQL, Oracle, PL/1, PowerPoint, Programming, Quality Assurance, RPG, Scrum, SDLC, Shell Script, SOAP, Software Engineer, SQL, SQL Server, TCP/IP, Testing, UML, Unix, VMware, Windows, Agile, Automated, Business Requirements, Call Center, Development, Embedded, Genetic, Lifecycle, Manager, Programming, Protocols, Sales, SDLC, TDD, Testing, Software, Systems, Engineer, Engineering, Computer, Web, IP, SSL, Security, IT, FPGA, Architect, • Software, Engineer, Linux, System, Systems, Test, Security, Program Manager, Engineering, SQL, Outlook, Excel, PowerPoint, XSLT, Java, Defense Systems, IT, Automated Testing, Business Requirements, COM, Data Analysis, Data Modeling, Data Warehouse, Defect Tracking, Engineering, Onshore, Process Flow, QA, Reporting, Software, Test Cases, Test Plans, Test Strategy, DWH, Datawarehouse, Test Automation Engineer, Test Engineer, Automation Engineer

Experience: 4 to 6 Yrs

Software Integration Engineer / Linux System Administrator

2T Consulting, San Diego, California

Key Skills Software, Test, Engineer, Quality, QA, Management, Development, Testing, System, Performance, SQL, Excel, Automation, Test Plans, Test Scripts, Manual, Test Cases, Scripting, Functional, Structural, Regression, System Testing, Agile, Scrum, Azure, DevOps, Jira, XML, Selenium, Postman, MSTest, JavaScript, Test, Engineer, C, System, Engineering, Computer, Systems, Management, SQL, project Manager, ReactJS, NodeJS, MongoDB, Express.JS, Java, Microservices, Pub-sub, Kafka, Splunk, Resful, API, Agile, Analysis, Apache, API, Architecture, AS400, Bash, COBOL, Configuration Management, CSS, Database, Development, Excel, GIT, Java, JavaScript, JCL, Jenkins, Lifecycle, Management, NoSQL, Oracle, PL/1, PowerPoint, Programming, Quality Assurance, RPG, Scrum, SDLC, Shell Script, SOAP, Software Engineer, SQL, SQL Server, TCP/IP, Testing, UML, Unix, VMware, Windows, Agile, Automated, Business Requirements, Call Center, Development, Embedded, Genetic, Lifecycle, Manager, Programming, Protocols, Sales, SDLC, TDD, Testing, Software, Systems, Engineer, Engineering, Computer, Web, IP, SSL, Security, IT, FPGA, Architect, • Software, Engineer, Linux, System, Systems, Test, Security, Program Manager, Engineering, SQL, Outlook, Excel, PowerPoint, XSLT, Java, Defense Systems, IT

Experience: 4 to 6 Yrs

Software Systems Lab Engineer

2T Consulting, Fairfax, Virginia

Key Skills Software, Test, Engineer, Quality, QA, Management, Development, Testing, System, Performance, SQL, Excel, Automation, Test Plans, Test Scripts, Manual, Test Cases, Scripting, Functional, Structural, Regression, System Testing, Agile, Scrum, Azure, DevOps, Jira, XML, Selenium, Postman, MSTest, JavaScript, Test, Engineer, C, System, Engineering, Computer, Systems, Management, SQL, project Manager, ReactJS, NodeJS, MongoDB, Express.JS, Java, Microservices, Pub-sub, Kafka, Splunk, Resful, API, Agile, Analysis, Apache, API, Architecture, AS400, Bash, COBOL, Configuration Management, CSS, Database, Development, Excel, GIT, Java, JavaScript, JCL, Jenkins, Lifecycle, Management, NoSQL, Oracle, PL/1, PowerPoint, Programming, Quality Assurance, RPG, Scrum, SDLC, Shell Script, SOAP, Software Engineer, SQL, SQL Server, TCP/IP, Testing, UML, Unix, VMware, Windows, Agile, Automated, Business Requirements, Call Center, Development, Embedded, Genetic, Lifecycle, Manager, Programming, Protocols, Sales, SDLC, TDD, Testing, Software, Systems, Engineer, Engineering, Computer, Web, IP, SSL, Security, IT, FPGA, Architect

Experience: 4 to 6 Yrs

Contact Longfinch

Mclean, VA Mc LeanVirginia 22101