Lead the design and implementation of data pipelines using Python, Spark, and Hive, showcasing expertise in advanced SQL and big data technologies while fostering collaboration in a hybrid environment
Senior Data Specialist
Primary Skills
MapReduce, HDFS, Spark - Pyspark, ETL Fundamentals, SQL, SQL (Basic + Advanced), Spark - Scala, Python, Data Warehousing, Hive, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures, Oozie
Job requirements
• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Design, develop, and maintain data pipelines and ETL processes using Python, Hive, Spark, and other relevant technologies.
• Good Hands on Exp with java
• Minimum of 6+ years of experience as a Data Engineer, with proven expertise in Python, Hive, and Spark. • Advance SQL experience and working experience with Big data Hadoop .
• Strong understanding of data engineering concepts, including data modelling, data integration, and data warehousing. • Hands-on experience with tools such as Apache Airflow.
• Experience with Docker and containerization technologies is a plus.
• Strong SQL skills and experience with relational databases, such as PostgreSQL, MySQL, or similar.
• Familiarity with Apache Spark.
• Knowledge of data processing frameworks such as Apache Beam, Apache Flink, or similar.
• Strong problem-solving and troubleshooting skills, with attention to detail.
• Excellent communication and interpersonal skills, with the ability to work collaboratively in a team environment.
Brillio is a global leader in Enterprise Digital Transformation Solutions, partnering with companies to drive business improvement and competitiveness through innovative technology solutions.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Get hired quicker
Be the first to apply. Receive an email whenever similar jobs are posted.
Ace your job interview
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
