Description of Task to be Performed:
Successful candidate will need to be able to maintain existing software as the transition from server-based to cloud-based occurs. The candidate will work with a GOTS-based Extract, Transform, and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. In addition, the candidate will be highly involved in the
engineering planning and transition of the existing system software/data into a Cloud-based (currently AWS) solution.
This position is on-site in McLean, VA and requires a Top Secret clearance and the ability to obtain an SCI clearance.
Required Qualifications:
- 6 or more years of extraction, transformation, and loading (ETL) experience
- Proficient in Java development with multi-threading experience
- Proficient in Python development with big data extraction, analysis, and deduplication experience
- Experience troubleshooting to develop new data pipelines and keep 60+ data pipelines up and running
- Excellent communication skills adept at collaborating with end users to fulfill custom data pull requests
- Bachelor’s degree in Computer Science, Information Systems or related discipline
Preferred Qualifications:
- Ability to ingest processed data into Splunk for Dashboard display
- Experience with Go / Golang
- Experience with Cribl (or other data ingest tools)