Software Developer In Test – ETL
Location: Gaithersburg, Maryland - Remote
Category: QA
Employment Type: Contract
Job ID: 15575
Date Added: 06/23/2023
This opening is for SDET 3 whose primary responsibility will be assuring the quality of an ETL application with multiple pipelines and intermediate stages.
The job will include developing automated framework to test ETL application, AWS functionality and setting up Jenkins pipelines.
Essential Job Functions:
• Develop custom automation framework in Scala and Spark to test complex ETL pipelines with multiple processes and inter-dependencies.
• Good understanding and implementation of Git practices and branching strategy
• Mentor and assist with Junior Developers in the team with technical and business domain knowledge
• Communicate with other stake holders like Engineering Manager , QA Manager and Product
• Develop and Schedule Jenkins Pipelines or Gitlab or similar
Must have skills:
• Proficient in developing and maintaining Complex Spark based automation frameworks from scratch using Big data design patterns
• Proficient in designing and maintaining automation solutions to run in Jenkins
• Proficient in designing test cases from business requirements and technical implementation
• Developed testing solutions using Risk based approach
• Experience in AWS Cloud
• Good understanding of Spark fundamentals like Spark context, Executors , DAG and spark checkpoint and able to tune spark properties and variables
• Experience in using Spark-shell and sparkSQL for debugging and analyzing the application and automation framework
Desired additional skills:
• Experienced in using NOSQL Key value stores like Dynamo and Search based Engines like Elastic Search
Education/Experience Requirements:
• Bachelor’s degree in Computer Science, Information Systems or related discipline with at least six (5) years of related experience,
or equivalent training and/or work experience;
#LI-WB
#Dice
