Design and maintain scalable data pipelines while ensuring data quality and reliability, collaborating with various teams and managing cloud infrastructure.
Job Title: Data Engineer Location: [Insert Location] Department: [Insert Department] Reports To: [Insert Manager Name] ________________________________________ Role Overview We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience in data modeling, ETL processes, and working with large datasets to enable analytics and business intelligence. ________________________________________ Key Responsibilities • Design, develop, and maintain data pipelines for ingestion, transformation, and storage. • Implement ETL processes to ensure data quality, consistency, and reliability. • Collaborate with data scientists, analysts, and business teams to understand data requirements. • Optimize data workflows for performance and scalability. • Manage and monitor data infrastructure (cloud/on-premise). • Ensure compliance with data governance, security, and privacy standards. • Troubleshoot and resolve data-related issues promptly. ________________________________________ Required Skills & Qualifications • Bachelor’s/Master’s degree in Computer Science, Engineering, or related field. • Strong proficiency in SQL and experience with relational databases. • Hands-on experience with Python/Scala/Java for data processing. • Familiarity with big data technologies (Hadoop, Spark, Kafka). • Experience with cloud platforms (AWS, Azure, GCP) and data services. • Knowledge of data modeling, warehousing, and architecture principles. • Understanding of CI/CD pipelines and version control (Git). ________________________________________ Preferred Skills • Experience with streaming data and real-time processing. • Knowledge of containerization (Docker, Kubernetes). • Exposure to machine learning pipelines and analytics tools. ________________________________________ Soft Skills • Strong problem-solving and analytical skills. • Excellent communication and collaboration abilities. • Ability to work in a fast-paced, dynamic environment.
Brillio is a global leader in Enterprise Digital Transformation Solutions, partnering with companies to drive business improvement and competitiveness through innovative technology solutions.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Ace your job interview
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
