At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking a Data Engineer to join one of our clients' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.
Key Responsibilities:
Design, develop, and maintain ETL/ELT pipelines using Apache Airflow and AWS Glue.
Build robust and scalable data architectures leveraging AWS services such as S3, Lambda, CloudWatch, Kinesis, and Redshift.
Integrate real-time and batch data pipelines using Kafka and AWS streaming solutions.
Ensure data quality, reliability, and performance through effective monitoring, debugging, and optimization.
Collaborate with cross-functional teams to understand data requirements and deliver efficient solutions.
Manage version control and collaborative workflows using Git.
Implement infrastructure as code solutions with Terraform and Ansible to automate deployments.
Establish CI/CD pipelines to streamline testing, deployment, and versioning processes.
Document data models, workflows, and architecture to support transparency and scalability.
Key Requirements:
-Core Languages:
Proficient in SQL, Python, and PySpark.
-Framework Knowledge:
Experience with Apache Airflow, AWS Glue, Kafka, and Redshift.
-Cloud & DevOps:
Strong hands-on experience with the AWS stack (Lambda, S3, CloudWatch, SNS/SQS, Kinesis).
-Infrastructure Automation:
Practical experience with Terraform and Ansible.
-Version Control & CI/CD:
Skilled in Git and familiar with continuous integration and delivery pipelines.
-Debugging & Monitoring:
Proven ability to maintain, monitor, and optimize ETL pipelines for performance and reliability.
Qualifications
Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related field.
4+ years of hands-on experience as a Data Engineer.
Strong understanding of data modeling, warehousing, and distributed systems.
Excellent English communication skills, both written and verbal.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Be the first to apply. Receive an email whenever similar jobs are posted.
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
Data Engineer Q&A's