We are seeking an experienced Data Engineer to play a vital role in advancing our Counterintelligence (CI) and Human Intelligence (HUMINT) operations by designing, implementing, and maintaining sophisticated data management systems. In this crucial position, you will be responsible for building and optimizing robust data pipelines and selecting the most suitable database technologies to support high-stakes intelligence operations. Your efforts will directly enhance the efficiency and effectiveness of data accessibility and performance, ensuring that our analytical capabilities meet the dynamic needs of defense intelligence.
As a Data Engineer, you will collaborate closely with data scientists and engineers to ensure the seamless collection, storage, and processing of large-scale, complex datasets. Your expertise in developing scalable data architectures will be essential for enabling advanced analytics and machine learning models that drive intelligence insights. You will focus on optimizing data workflows, improving data quality, and ensuring that our data infrastructure is both resilient and adaptable to evolving operational requirements.
Your role will involve working hands-on with cutting-edge technologies and tools to develop data solutions that meet stringent security and performance standards. You will be responsible for automating data processes, implementing data governance best practices, and ensuring that data systems are optimized for rapid analysis and decision-making. By maintaining a sharp focus on operational excellence, you will help create data environments that empower intelligence teams to access the information they need, when they need it, to respond swiftly and effectively to emerging threats. Join us in shaping the future of intelligence operations through innovative data engineering solutions that support national security efforts.
Responsibilities
Design and implement data architectures that support Counterintelligence and Human Intelligence operation, ensuring scalability, efficiency, and security.
Develop and maintain data pipelines to support ETL processes, ensuring data is available for real-time and batch processing.
Collaborate with data scientists and machine learning (ML) engineers to ensure smooth integration of data systems with ML models and analytics frameworks.
Optimize data throughput and query performance for large datasets, ensuring minimal latency and high responsiveness for critical intelligence analysis.
Work with team stakeholders to determine optimal data structures, storage solutions, and database technologies based on operational needs.
Manage the selection, configuration, and optimization of backend database technologies.
Monitor and troubleshoot the data pipeline and infrastructure, ensuring high reliability.
Ensure data management systems comply with security standards.
Essential
Hold an active TS/SCI clearance.
BS/BA or in Data Science, Computer Science, Statistics, or a related field.
4+ years of experience in data engineering, database management, or a related field, preferably in a defense or intelligence environment.
Experience designing and implementing ETL pipelines, managing data ingestion processes, and optimizing data storage and access.
Proficiency with database and data processing technologies such as SQL, NoSQL, Hadoop, Spark, or similar.
Strong programming skills in Python, Java, Scala, or similar languages for data engineering.
Experience with cloud platforms like AWS, Azure, or Google Cloud, particularly in managing data workflows and scalable infrastructure.
Familiarity with data pipeline orchestration tools such as Kubernetes, Airflow, Luigi, etc.
Experience with version control (Git) and CI/CD practices for data pipeline development.
Strong understanding of data modeling, database optimization, and query performance tuning.
Experience with securing data systems, ensuring compliance with security protocols and regulations.
Preferred
Experience with intelligence-specific data sources and multi-intelligence systems.
Experience working with large-scale data environments in support of ML driven systems.
We are an Equal Opportunity Employer that considers all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status, or any other protected class.
