Description:
Primary Responsibilities
• Establish technical designs to meet requirements aligned with architectural and data standards
• Optimize ETL/data pipelines balancing performance, functionality, and operational requirements
• Fine-tune and optimize queries using Snowflake platform and database techniques
• Manage data ingestion, transformation, processing, and orchestration of pipelines
• Develop and maintain API, ETL Pipeline, and CI/CD integration processes
• Assist with technical solution discovery to ensure feasibility
• Set up and manage CI/CD pipelines and develop automated tests
• Conduct peer reviews for quality, consistency, and rigor for production-level solutions
• Promote best practices for code management, automated testing, and deployments
• Create design and development documentation based on standards
• Actively contribute to Data Engineering community and define leading practices and frameworks
Qualifications
Required
• Bachelor's degree in computer science, engineering, or similar quantitative field
• 5+ years of relevant experience developing backend, integration, data pipelining, and infrastructure
• Strong expertise in Python, PySpark, and Snowpark
• Proven experience with Snowflake and AWS cloud platforms
• Experience with Informatica/IICS for data integration
• Expertise in database optimization and performance improvement
• Experience with data warehousing and writing efficient SQL queries
• Understanding of data structures and algorithms
Preferred
• Knowledge of DevOps best practices and associated tools:
o Containers and containerization technologies (Kubernetes, Argo, Red Hat OpenShift)
o Infrastructure as code (Terraform)
o CI/CD Pipelines (JFrog Artifactory)
o Scripting and automation (Python, GitHub, GitHub actions)
Axiom is a global information technology, consulting and outsourcing company and services provider. Our IT solutions empower organizations and individuals throughout the world to maximize value and quality to succeed in today's challenging business environment. As a fast-growing new economy company, we focus our strengths to offer world-class solutions and services through the convergence of technology, innovation, expertise and experience. We provide software consulting, development and IT-enabled services to clients across the globe. We work towards delivering sustained value creation for customers, employees, industries and society at large. Core offerings include data warehousing, middleware development, product development and web-enablement of legacy applications in verticals like telecom, finance, healthcare, manufacturing, energy & utilities, retail & distribution, enablement of legacy Relentless exploration of technology horizons and a Global Delivery Model that is a judicious combination of onsite, offsite and offshore development, offer a complete range of high-ROI business solutions spanning the consulting, technology, operations and process outsourcing value chain.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Be the first to apply. Receive an email whenever similar jobs are posted.
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
Data Engineer Q&A's