Senior Site Reliability Engineer

GOVX is seeking an experienced Senior Site Reliability Engineer (SRE) to ensure the reliability, scalability, and performance of our production systems through automation, observability, and operational excellence. This position is remote but must be located in one of the following states: California, Washington, Texas, Tennessee, Florida, Colorado, or New York.  

The Senior Site Reliability Engineer (SRE) plays a key role in maintaining resilient infrastructure, monitoring critical services, and improving deployment and recovery processes across environments. The Senior Site Reliability Engineer works under the direction of the Director of Engineering and collaborates closely with Site Reliability Engineers, Automation Engineers, and other members of the engineering organization. 

This position will report to the Director of Engineering. 

Responsibilities 

• Maintain scalable, secure, and reliable cloud services ensuring reliable system operations within Service Level Objectives. 

• Implement and manage monitoring, alerting, and observability systems using Prometheus, Grafana, and Azure Monitor to proactively identify and resolve issues. 

• Develop and maintain automation scripts and tools in PowerShell, Bash, and C# to improve deployment efficiency, system reliability, and developer productivity. 

• Create, refine, and maintain detailed runbooks for production systems to ensure consistent operational procedures and effective incident response. 

• Define and manage Service Level Indicators (SLIs), Service Level Objectives (SLOs), and error budgets to measure and maintain system reliability. 

• Collaborate with software engineers and automation engineers to integrate reliability practices into CI/CD pipelines using Azure DevOps. 

• Design and implement intelligent alerting strategies that ensure high signal-to-noise ratios and enable rapid triage of critical issues. 

• Participate in incident response, post-incident reviews, and blameless root cause analysis to drive continuous improvement of system reliability and uptime. 

• Contribute to deployment strategy evolution, including blue-green and canary deployments, to minimize downtime and release risk. 

• Collaborate closely with Automation Engineers to enhance automated validation and testing of production environments. 

• Monitor system health, capacity, and performance, providing data-driven insights and recommendations for optimization. 

• Conduct chaos engineering experiments and resilience testing to proactively identify and address system weaknesses. 

• Develop and maintain disaster recovery and business continuity plans, including regular failover testing. 

• Participate in the on-call rotation for platform services, ensuring high availability and rapid incident resolution. 

• Proactively monitor and respond to production support tickets and alerts within established SLA timeframes, delivering first-level diagnosis, troubleshooting, and escalation as needed to maintain system reliability 

• Continuously improve incident response playbooks and reduce Mean Time to Recovery (MTTR). 

• Participate in sprint planning, stand-ups, and retrospectives to ensure alignment with development and operational objectives. 

• Identify opportunities to improve resiliency, reduce toil, and strengthen the reliability culture across the engineering organization. 

• Collaborate with security and compliance teams to ensure infrastructure meets regulatory and security standards. 

• Support cost optimization efforts by monitoring cloud resource usage and recommending efficiency improvements. 

• Explore and integrate AI/ML-based observability tools for predictive monitoring and anomaly detection. 

• 8+ years of professional experience in site reliability, infrastructure, or systems engineering roles. 

• Proficiency with Azure cloud infrastructure, services, and resource management 

• Experience in operating systems, network concepts, protocols, and architecture. Microsoft/Linux operating systems, active directory, OSI.  

• Technical ability in Node JS, .NET/C# and knowledge of both current and legacy architecture, software development practices, and conventions.  

• Strong experience with Rest APIs 

• Hands-on experience with containerization and orchestration using Kubernetes and microservices architecture. 

• Strong automation and scripting skills in PowerShell, Bash. 

• Experience with Infrastructure as Code tools for provisioning and configuration management. 

• Deep understanding of CI/CD processes and tools, preferably using Azure DevOps. 

• Experience implementing and managing observability solutions including Azure Monitor, Application Insights, and Log Analytics Workspaces, Prometheus and Grafana. 

• Strong problem-solving, analytical, and troubleshooting abilities in distributed systems and cloud environments. 

• Ability to write, maintain, and execute operational runbooks and automation for incident management and recovery. 

• Ability to work self-directed, plan and execute projects involving multiple technical resources and stakeholders. 

• Excellent communication and collaboration skills, with the ability to work across software development, infrastructure, and operations teams. 

Preferred Education and Experience 

• Bachelor’s degree in Computer Science, Engineering, or related technical field. 

• Experience working in Agile/Scrum delivery environments. 

• Experience supporting .NET applications and microservices in a production environment. 

• Experience supporting SQL Server and Cosmos DB applications in production environments. 

• Knowledge of network fundamentals, load balancing, and high-availability architectures. 

Supervisory Responsibility 

This position does not include supervisory responsibilities but provides mentorship and technical guidance to the Site Reliability team members. 

Travel Requirements 

Yearly travel to the San Diego office headquarters is expected for this position. 

Work Environment 

This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets, and fax machines. This role occasionally must lift and carry office equipment. 

 
Physical/Mental Demands 

• Physical – This is largely a sedentary role. 

• Mental – Problem-solving, making decisions, interpreting data, organizing, reading/writing. 

• Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions. 

Work Location 

Due to state law and tax implications, remote work candidates must live and work in one of the following states: California, Washington, Texas, Tennessee, Florida, Colorado, or New York. 

• Paid Time Off, Paid Sick Leave, Paid Holidays
• Competitive Medical, Dental, Vision, and Life Insurance
• 401(k) plan with discretionary match available
• Flexible Spending Account (FSA), Health Savings Account (HSA)
• Voluntary benefits including Critical Illness, Group Accident, and Voluntary Life
• Employee Referral Program
• Exposure to a growing ecommerce company
• Discounts on the GOVX website

Salary Range
$165,000 - 175,000 Annually

AAP/EEO Statement
EOE. Veterans/Disabled.  Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions. 

Position will require successful completion of a background check and drug testing prior to starting employment.

About GOVX, Inc.

Savings for Those Who Serve

GOVX was founded in 2011 to offer exclusive benefits to those who serve our country. The GOVX membership is comprised of current and former members of the United States military, law enforcement, firefighting, medical services, and government personnel. We are dedicated to supporting these communities and to offering unique value to our members, while delivering an authentic platform for brands to reach our growing customer base. As the largest and fastest growing digital platform serving this deserving audience, we are committed to stretching the limits of ecommerce to deliver the best assortment for our members’ on-duty and off-duty needs.