Staff Software Engineer - SRE Performance Test Engineering

Visa’s Technology Organization is a community of problem solvers and innovators reshaping the future of commerce.   We operate the world’s most sophisticated processing networks capable of handling more than 65k secure transactions a second across 80M merchants, 15k Financial Institutions, and billions of everyday people.   While working with us you’ll get to work on complex distributed systems and solve massive scale problems centered on new payment flows, business and data solutions, cyber security, and B2C platforms.     

The Opportunity: 

We are looking for Versatile, curious, and energetic Software Engineers who embrace solving complex challenges on a global scale.  As a Visa Software Engineer, you will be an integral part of a multi-functional development team inventing, designing, building, and testing software products that reach a truly global customer base. While building components of powerful payment technology, you will get to see your efforts shaping the digital future of monetary transactions.   

The Work itself: 

• Design code and systems that touch 40% of the world population while influencing Visa’s internal standards for scalability, security, and reusability 
• Collaborate multi-functionally to create design artifacts and develop best-in-class software solutions for multiple Visa technical offerings 
• Actively contribute to product quality improvements, valuable service technology, and new business flows in diverse agile squads 
• Develop robust and scalable products intended for a myriad of customers including end-user merchants, b2b, and business to government solutions. 
• Leverage innovative technologies to build the next generation of Payment Services, Transaction Platforms, Real-Time Payments, and Buy Now Pay Later Technology 
• Opportunities to make a difference on a global or local scale through mentorship and continued learning opportunities 

Essential Functions:

• Full Stack Developer supporting application availability, stability and resilience
• Design and Promote AIOps methodology across E2E cloud and Kubernetes platforms using ServiceNow.
• Lead monitoring, instrumentation and logging strategy and implementation of cloud and distributed systems.
• Developing software and scripts to automate operational tasks, reduce manual effort, and improve the reliability and efficiency of systems. 
• Lead and manage Observability applications and infrastructure utilizing Splunk, Grafana, Prometheus, Open Telemetry, Elastic Search, Open Search, Cloudwatch.
• Partner with development teams to design monitoring solutions to create development, non-production, and production environments.
• Ensure systems are secure against cybersecurity threats by continuously applying new hotfixes and OS patches.
• Monitor system performance, identify issues, and implement solutions to improve reliability and efficiency.
• Perform root cause analysis for production errors and implement preventive measures.
• Create and maintain documentation for infrastructure, processes, and procedures.
• Provide support and troubleshooting for infrastructure and deployment issues.
• Coach and mentor junior resources with AI, Automation and monitoring tools

The Skills You Bring:

• Responding to and resolving production incidents, performing root cause analysis, and conducting blameless post-mortems to prevent future issues. 
• Setting up and maintaining monitoring tools to track system performance, detect issues early, and configure alerts for critical events. 
• Analyzing usage patterns and future demand to ensure the infrastructure has the necessary capacity to meet business needs. 
• Working closely with development and operations teams to build reliable services from the ground up and ensure operational excellence is a shared goal. 
• Setting up and maintaining monitoring tools to track system performance, detect issues early, and configure alerts for critical events. 
• Analyzing usage patterns and future demand to ensure the infrastructure has the necessary capacity to meet business needs. 
• Improving system performance, efficiency, and scalability. 
• Managing changes to production systems to ensure they are implemented smoothly and don't compromise reliability. 
• Deep knowledge of tools and practices for monitoring, logging, and tracing to understand the behavior of complex systems. 
• We do not expect that any single candidate would fulfill all of these characteristics. For instance, we have exciting team members who are really focused on building scalable systems but didn’t work with payments technology or web applications before joining Visa.

Visa will accept applications for this role until at least November 30, 2025.

This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager. 

Basic Qualifications:
5+ years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience.

Preferred Qualifications:
6 or more years of work experience with a Bachelors Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD
4-8 or more years of work experience with the following:
Scripting Language: Expertise with Java, Python, Java,GoLang,Python, MS Sql query
IDE: Jet Beans, VSCode, Java, GoLang, Python, MS Sql query
Container platforms: Docker, Kubernetes
Setting up exporters (Node exporter, Cert exporters, other
exporters) to collect metrics.
Splunk Enterprise, Splunk, Prometheus container images, Grafana, Elastic Search, Kibana, Open Search, CloudWatch.
AI Tools: Claude, Cline, ChatGPT, Copilot
CI/CD pipeline management with GitHub, Ansible, Ansible, Jenkins, Scalable Run
Experience working in a Linux environment and Unix scripting.

Work Hours: Varies upon the needs of the department.

Travel Requirements: This position requires travel 5-10% of the time.

Mental/Physical Requirements: This position will be performed in an office setting.  The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer.  Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.  Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law, including the requirements of Article 49 of the San Francisco Police Code.

U.S. APPLICANTS ONLY: The estimated salary range for this position is $124,300.00 to $198,600.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401 (k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.