As a Lead Engineer in Data and AI Platform, you will be a technical leader for the Data-as-a-Services development team based in Bangalore, India. You will be responsible and accountable for creating a product tasked with creating core datasets for Visa’s transactions. Visa is the world’s largest processor of credit and debit transactions and the platform you build will process hundreds of billions of transactions records every year and serve to deliver clean and enriched data to Visa and other financial institutions. You will also own systems responsible for all aspects of data governance required to deliver high quality and mission-critical data to Visa and its partners. This role will lead design discussions, build and deploy solutions to ensure successful delivery of business capabilities. Visa provides a challenging environment of volume, velocity and variety that is rarely matched. This position will report to the Sr. Director of Data-as-a-Services development based in Bangalore.
Primary Responsibilities
Take complete end-to-end ownership of one or more applications.
Translate business requirements into technical solutions.
Responsible for the design and implementation of an innovative, scalable, and distributed systems that take advantage of technology to allow standardization, security, timeliness and quality of data.
Design and deploy data and pipeline management frameworks built on top of open-source components, including Hadoop, Hive, Spark, HBase, Kafka streaming and other Big Data technologies.
Work in and promote an agile development culture focused on high quality code development and deployment to production.
Champion Design and Coding best practices while technically leading a small team.
This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office two days a week, Tuesdays and Wednesdays with a general guidepost of being in the office 50% of the time based on business needs.
Basic Qualifications
• 12+ years of relevant work experience with a Bachelor’s Degree or at least 7 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 4 years of work experience with a PhD, OR 13+ years of relevant work experience.
Preferred Qualifications
• 12 or more years of work experience with a Bachelor’s Degree or 8-10 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 6+ years of work experience with a PhD
• 12+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in leveraging standard development best practice methodologies.
• Expertise in Microservice architecture.
• Expertise in Object Oriented Programming Language – Scala, Java/Python.
• 6+ years of hands-on experience in Hadoop using Scala/Java Programming, Spark, Hive, PIG scripts, Sqoop, any ETL tool exposure.
• Candidate should have knowledge of underlying mathematical foundations of machine learning and statistics.
• Candidate should be able to transform a problem into a mathematical process and build algorithms to solved the problem. Exposure to Data science would be a big plus.
• Strong knowledge of Database concepts and UNIX.
• Experience in handling very large data volume in low latency and/or batch mode.
• Expertise in building large data warehouses and/ or data lakes and/ or lake house architecture
• Experience in building data intensive pipelines using Lambda/ Kappa architecture
• Strong leadership and team player, including mentoring/growing junior engineers
• Strong on driving for results and self-motivated, strong learning mindset, with good understanding of related advanced/new technology. Keep up with the technology
• development in the related areas in the industry, which could be leveraged to enhance current architectures and build durable new ones.
• Outstanding verbal, written, presentation, facilitation, and interaction skills, including ability to effectively communicate architectural issues and concepts to multiple organization levels and executive management.
• Quick learner, self-starter, detailed and work with minimal supervision.
• Payment industry experience (preferred).
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
