Data Engineer (Intermediate)

About SecurityScorecard:

SecurityScorecard is the global leader in cybersecurity ratings, with over 12 million companies continuously rated, operating in 64 countries. Founded in 2013 by security and risk experts Dr. Alex Yampolskiy and Sam Kassoumeh and funded by world-class investors, SecurityScorecard’s patented rating technology is used by over 25,000 organizations for self-monitoring, third-party risk management, board reporting, and cyber insurance underwriting; making all organizations more resilient by allowing them to easily find and fix cybersecurity risks across their digital footprint. 

Headquartered in New York City, our culture has been recognized by Inc Magazine as a "Best Workplace,” by Crain’s NY as a "Best Places to Work in NYC," and as one of the 10 hottest SaaS startups in New York for two years in a row. Most recently, SecurityScorecard was named to Fast Company’s annual list of the World’s Most Innovative Companies for 2023 and to the Achievers 50 Most Engaged Workplaces in 2023 award recognizing “forward-thinking employers for their unwavering commitment to employee engagement.”  SecurityScorecard is proud to be funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV and Riverwood Capital.

About the Team

The Data Analytics Engineering team is responsible for developing and managing the core data platform for ratings infrastructure, architecting and implementing business-critical data solutions and pipelines, and enabling data-driven decisions within the organization and for our customers.

About the Role

As a Senior Data Engineer - you will work alongside outstanding engineers to implement new products and features focused on meeting the evolving needs of our customers, while refining requirements with product management and collaborating cross-team. All our team members actively participate in product definition, technical architecture review, iterative development, code review, and operations. Along with this, you’ll have the opportunity to interact with customers to ensure their needs are met. You will be working in a high-performance, fast-paced environment, and contribute to an inclusive work environment.

Responsibilities:

• Lead and collaborate with engineers to deliver projects from inception to successful execution
• Write well-crafted, well-tested, readable, maintainable code
• Participate in code reviews to ensure code quality and distribute knowledge
• Share engineering support, release, and on-call responsibilities for an always-on 24x7 site
• Participate in Technical Design Review sessions, and have the ability to explain the various trade-offs made in decisions
• Maintain existing APIs and data pipelines, contribute to increasing code-coverage 
• Understand requirements, build business logic and demonstrate ability to learn and quickly adopt 
• Automate and improve existing processes to sustainably maintain the current features and pipelines
• Analyze our internal systems and processes, and locate areas for improvement/automation

Requirements

• BS/MS in computer science or equivalent technical experience, and must have worked in Data engineering space for 3+ years
• Must have experience in full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations 
• Technical requirements:
• Must have 2+ years experience in building and maintaining big data pipelines using Scala with Spark, Airflow, Hive, Presto, Redis
• Must have 2+ years experience with NoSQL databases, preferably Cassandra / Scylla and Clickhouse; and SQL databases, preferably Postgres
• Must have 2+ years experience in developing batch/real-time data streams 
• Worked with CI/CD pipelines using Jenkins
• Experience with cloud environments, preferably AWS
• Worked with variety of data (structured/unstructured), data formats (flat files, XML, JSON, relational, parquet)
• Worked in Agile methodology

Benefits

We offer a competitive salary, stock options, a comprehensive benefits package, including health and dental insurance, unlimited PTO, parental leave, tuition reimbursements, and much more!

SecurityScorecard is committed to Equal Employment Opportunity and embraces diversity. We believe that our team is strengthened through hiring and retaining employees with diverse backgrounds, skill sets, ideas, and perspectives. We make hiring decisions based on merit and do not discriminate based on race, color, religion, national origin, sex or gender (including pregnancy) gender identity or expression (including transgender status), sexual orientation, age, marital, veteran, disability status or any other protected category in accordance with applicable law. 

We also consider qualified applicants regardless of criminal histories, in accordance with applicable law. We are committed to providing reasonable accommodations for qualified individuals with disabilities in our job application procedures. If you need assistance or accommodation due to a disability, please contact [email protected].

Any information you submit to SecurityScorecard as part of your application will be processed in accordance with the Company’s privacy policy and applicable law. 

SecurityScorecard does not accept unsolicited resumes from employment agencies.  Please note that we do not provide immigration sponsorship for this position. #LI-DNI