Embark on an exciting journey into the realm of data engineering and architecture with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. As a Data Architect you will be at the heart of the organization and support our clients to take control of their data and get value out of it by defining a reference architecture for our customers. This means that you will work closely with business leaders and information management teams to define and implement a roadmap on data architecture, data management, business intelligence or analytics solutions..
Minimum Qualifications:
Translate business requirements into data requests, reports and dashboards.
Strong Database & modeling concepts with exposure to SQL & NoSQL Databases
Strong data architecture patterns & principles, ability to design secure & scalable data lakes, data warehouse, data hubs, and other event-driven architectures
Expertise in designing and writing ETL processes in Python / Java / Scala
Understanding of Hadoop framework - Exposure to PySpark, Spark, Storm, HDFS, Hive
Strong hands-on experience with either Databricks or Snowflake; experience with both is desirable.
Knowledge of Master Data management and related tools
Strong exposure to data security and privacy regulations (GDPR, HIPAA) and best practices
Skilled in ensuring data accuracy, consistency, and quality
Experience with the AWS/Azure/GCP data engineering services
Knowledge of AWS services viz., AWS S3, Redshift, Lambda, DynamoDB, EMR, Glue, Lakeformation, Athena, Quicksight, RDS, Kinesis, Managed Kafka, API Gateway, CloudWatch
And / OR
Knowledge of Azure services viz., ADF, Data Catalog, Databricks, Azure Synapse Analytics, ADLS Gen2, Azure Devops
Ability to implement data validation processes and establish data quality standards.
Experience in Linux
Proficiency in data visualization tools like Tableau, Power BI or similar to create meaningful insights
Additional Experience Desired:
Experience working with data ingestion tools such as Fivetran, stitch, or Matillion
AWS IOT solutions
Apache NiFi, Talend, Informatica
Exposure to AI / ML technologies
Regards
3Pillar Global