Principal Software Engineer - Observability Infrastructure Monitoring
Splunk, a Cisco company, is building a safer and more resilient digital world with an end-to-end full stack platform made for a hybrid, multi-cloud world. Leading enterprises use our unified security and observability platform to keep their digital systems secure and reliable. Our customers love our technology, but it's our caring employees that make Splunk stand out as an amazing career destination. No matter where in the world or what level of the organization, we approach our work with kindness. So bring your work experience, problem-solving skills and talent, of course, but also bring your joy, your passion and all the things that make you, you. Come help organizations be their best, while you reach new heights with a team that has your back.
As applications and systems become more sophisticated and user experience is at high stake, observability - the ability to monitor and understand the systems and how they impact users, becomes one of the biggest challenges for engineering teams. We are building world-class tools to help engineers deliver better, faster, and more reliable applications!
About the role
Splunk is looking for hardworking and creative full stack Software Engineers to join our Splunk Observability team who will work on systems that empower our customers to quickly detect and resolve their infrastructure and application issues!
You will be a key contributor and lead for the user facing web application for Splunk Observability Infrastructure Monitoring. Splunk’s Observability Suite is a leader in the Gartner Magic Quadrant and Infrastructure Monitoring is one of the most used and popular products in this suite.
What you'll get to do
- Operates as a technical lead, solution architect & full stack developer of the team, leading technical roadmap and vision
- Own and organize processes for the team such as sprint planning, retrospectives, backlog refinements, program increment (PI) planning, and more.
- Work with leadership team to influence products and process strategies
- Understand the business direction and is able to promote innovative ideas and acquire alignment with multi-functional teams; can influence PM on features, product direction and priority.
- Collaboratively lead design discussions under technical purview, ensuring both functional & non-functional requirements (like scale, security, operability, usability, etc) are considered
- Lead the development new product features, clarify and improve designs, help put together a plan for how to make it happen; participate in code review
- Build relationships with cross-area teams to effectively understand dependencies, gain alignments and set up collaborations
- Grow senior engineers and technical leaders through design & code review, tech seminars, mentoring, pair-programming, and etc.
- Take actions to improve the engineering team’s engineering and operational practices
Must have qualifications
- Proven track record of architecting, designing, and delivering complex, large-scale backend systems.
- Expertise in Golang for backend development; experience with Python or Java is a plus.
- Strong hands-on experience with OpenTelemetry, Prometheus, and Grafana for observability and monitoring in distributed environments.
- Deep understanding of microservices architecture and distributed systems, ensuring scalability, performance, and reliability.
- Experience developing cloud native applications in Kubernetes, or Openshift, Server clusters in distributed environments in AWS, GCP clouds or on-prem clusters.
- Rich experience with 1 or more relational databases & NoSQL databases
- Knowledge and experience leveraging AI technologies is a BIG plus and desirable.
- Knowledge and experience using observability tools would be an advantage.
- Ability to drive architectural decisions, set technical direction, and mentor engineers, fostering a culture of excellence and innovation.
- Strong communication skills, both verbal and written.
- Bachelor’s degree in Computer Science, Computer Engineering or related majors; 10+ years of relevant proven experience
Meet the Products and Technology Team
Want to build security and observability products people love AND work with people as smart (and humble) as you are? Our products and technology team delivers digital resilience at enterprise scale with a self-service Splunk portfolio that offers unified security analytics, full stack observability and real-time visibility of streaming data. Learn more about the team, meet our leaders, and hear from Splunk technologists and engineers at
splunk.com/careers/products-and-technology.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Splunk is an Equal Opportunity Employer
Splunk, a Cisco company, is an Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.
