• Data Pipeline Development:
Design, implement, and manage scalable ETL/ELT pipelines using AWS services and Databricks.
• Data Integration:
Ingest and process structured, semi-structured, and unstructured data from multiple sources into AWS Data Lake or Databricks.
• Data Transformation:
Develop advanced data processing workflows using PySpark, Databricks SQL, or Scala to enable analytics and reporting.
• Databricks Management:
Configure and optimize Databricks clusters, notebooks, and jobs for performance and cost efficiency.
• AWS Architecture:
Design and implement solutions leveraging AWS-native services like S3, Glue, Redshift, EMR, Lambda, Kinesis, and Athena.
• Collaboration:
Work closely with Data Analysts, Data Scientists, and other Engineers to understand business requirements and deliver data-driven solutions.
• Performance Tuning:
Optimize data pipelines, storage, and queries for performance, scalability, and reliability.
• Monitoring and Security:
Ensure data pipelines are secure, robust, and monitored using CloudWatch, Datadog, or equivalent tools.
• Documentation:
Maintain clear and concise documentation for data pipelines, workflows, and architecture
Axiom is a global information technology, consulting and outsourcing company and services provider. Our IT solutions empower organizations and individuals throughout the world to maximize value and quality to succeed in today's challenging business environment. As a fast-growing new economy company, we focus our strengths to offer world-class solutions and services through the convergence of technology, innovation, expertise and experience. We provide software consulting, development and IT-enabled services to clients across the globe. We work towards delivering sustained value creation for customers, employees, industries and society at large. Core offerings include data warehousing, middleware development, product development and web-enablement of legacy applications in verticals like telecom, finance, healthcare, manufacturing, energy & utilities, retail & distribution, enablement of legacy Relentless exploration of technology horizons and a Global Delivery Model that is a judicious combination of onsite, offsite and offshore development, offer a complete range of high-ROI business solutions spanning the consulting, technology, operations and process outsourcing value chain.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Be the first to apply. Receive an email whenever similar jobs are posted.
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
Data Engineer Q&A's