REQUIREMENTS:
- Experience: 10+ Years
- Must have hands-on experience in Azure cloud services such as ADF, ADLS, Azure SQL, Logic Apps, and Azure Functions.
- Strong hands-on experience in Databricks and related architecture like Medallion.
- Experience in implementing and delivering data solutions and pipelines on Databricks.
- A strong understanding of data modeling, data structures, data warehouses, databases, and ETL processes.
- An in-depth understanding of large-scale data sets, including structured and unstructured data.
- Experience in SQL, Python, and PySpark.
- Able to work under tight timelines and deliver on complex problems.
- Create documentation and knowledge bases for data pipelines, best practices, and solutions.
- A strong and positive team player.
- Good to have CI/CD and DevOps experience..
RESPONSIBILITIES:
- Understanding the client’s business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements.
- Mapping decisions with requirements and be able to translate the same to developers.
- Identifying different solutions and being able to narrow down the best option that meets the client’s requirements.
- Defining guidelines and benchmarks for NFR considerations during project implementation
- Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers
- Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it
- Understanding and relating technology integration scenarios and applying these learnings in projects
- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
