BlackLine automates and controls financial close processes for midsize and large organizations.

Senior Site Reliability Engineer at BlackLine (Remote)

| Remote
Sorry, this job was removed at 11:16 a.m. (PST) on Thursday, April 21, 2022
Find out who’s hiring remotely
See all Remote jobs
Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Job Summary

The Senior Site Reliability Engineer (SRE) plays a pivotal role in ensuring that Blackline’s services/infrastructure are carefully planned and deployed in a time, place, and configuration which is ideal for serving BlackLine’s clients. The SRE role sits at a nexus of capacity planning, technical project execution, product planning, business analysis, site reliability, and software engineering.

The Sr Site Reliability Engineer is responsible for assessing, testing, tracking, predicting and reporting all related aspects of a suite of production applications from a scalability, performance, responsiveness, capacity and availability perspective.

Roles and Responsibility (list in order of importance)


  • Develop and maintain subject matter expertise in BlackLine’s service and infrastructure architecture, operation, performance characteristics
  • Act as a primary resource for the Support organization in responding to customer escalations for performance or availability issues
  • Identify and communicate issues or conditions that currently, or may in the future, prevent BlackLine services and infrastructure from performing as needed to meet customer expectations; act to resolve the issue, including determining the root cause of the issues, facilitating development of a solution to resolve the issue, gathering a cross-functional team as needed
  • Improve and maintain a continuous metric framework that observes and records and trends real time availability data for all of our clients
  • Develop and maintain on premise and cloud capacity plans that ensure we are delivering a BlackLine service that is performant and cost effective
  • Collaborate with development and other technology teams on requirements definition, observability standards, capacity planning, and process refinement
  • Improve the BlackLine SaaS service experience by discovering and highlighting optimization opportunities with existing code to address application availability, performance, observability, efficiency, and security challenges.
  • Develop tools and systems to automate the identification, analysis, and remediation of application events, infrastructure issues, or requests.
  • Establish and maintain Key Performance Indicators for the overall health of the service and build tools to exercise and evaluate if these KPI’s are being met.
  • Work cross-functionally with other teams to surface common pain points, architect solutions, establish conventions, and evangelize application development and operations best practices.
  • Transform discoveries into requests to others or action items for you and your team.
  • Regularly learn new systems and tools as the BlackLine platform and ecosystem evolves.
  • Contribute knowledge, skills, and personal qualities to a dedicated team of top engineers solving real-life problems in a bleeding-edge, high-performance, and high-traffic environment.
  • Publish performance result findings, conclusions, recommendations
  • Create second tier level analysis of capacity constraint points and performance and discuss with development teams/infrastructure
  • Support integration of performance data into customer experience analytics tools and reporting
  • Ensure application and infrastructure capacity management efforts have verifiable capacity data to support business cases
  • Monitor industry trends and keep abreast of new tools and technologies.
  • Participate in our on-call rotation, act as crisis manager/tier 3 technical support for major incidents, and conduct incident reviews
  • Other duties as assigned


Required Qualifications

Years of Experience in Related Field: 5+ Years

Education: BS in Computer Science or equivalent work experience

Technical/Specialized Knowledge, Skills, and Abilities:


  • A minimum of five years of experience with a significant subset of the following technologies: GCP, AWS, Azure, Kubernetes, GCP, AWS, Azure, HTML, CSS, XML, SOAP, Ajax, JavaScript, IIS, MSSQL, MySQL, Go, Jenkins, Chef, PowerShell, WMI, Java, Apache, Tomcat, SSL, Docker
  • Extensive knowledge of managing cloud platforms and cloud native tools.
  • Demonstrated expertise with networking and distributed systems.
  • Capable of participating in, and leading customer-facing performance evaluations and briefings
  • Intermediate knowledge of at least two of the following programming languages: C#, Visual Basic, PowerShell, Java, Go, Linux Shell, Ruby.
  • Demonstrated history of developing or operating production web applications and solid understanding of HTTP(S), HTML, JavaScript, CSS, and XML.
  • Significant experience in a lead role on a software development or operations team.
  • Intermediate level knowledge of IIS and Windows Server or Linux and Apache. Intermediate level knowledge of Windows and Linux based systems and automating the management of core kernel and systems configurations, experience with Java and Python.
  • Intermediate level knowledge with configuration management tools.
  • Experience with container orchestration platforms like Kubernetes.
  • Intermediate level knowledge deploying and managing observability tools; such as Elastic, Kibana, Prometheus, etc.
  • Capable of producing clean, readable code in a multi-developer team environment.
  • Someone energized by a fast-paced, iterative approach.
  • Eager to learn and soak in new information.
  • Must maintain the highest level of integrity, courtesy and respect while interacting with internal and external customers, employees and business contacts
  • Excellent oral and written communication skills
  • Ability to interface with internal technical experts using professional interpersonal skills
  • Experience in analyzing datasets to draw conclusions, and graph datasets supporting these conclusions
  • Exhibit creative problem-solving, logical troubleshooting and analytical skills
  • Basic level proficiency in application load balancing methods (F5 LTM, Windows NLB, etc.)
  • Working knowledge of TCP/IP and networking concepts
  • Proficiency with statistical concepts; confidence interval, hypothesis testing, sampling
  • Operating systems concepts such as CPU, memory, CPU and disk queues and graphing/analyzing these over time
  • Must possess strong organizational skills and be able to work with minimal oversight
  • Ability to understand new technologies quickly and adapt these into daily work and goals 


Preferred Qualifications

  • Prior C#, ASP.NET, Ruby, Go or Java development experience, preferably in an agile SaaS environment.
  • Significant experience with open source platforms and technologies.
  • Experience with software development processes and methodologies.
  • Track record of architecting, developing, implementing robust, distributed online solutions.
See More
Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Where we are

BlackLine’s headquarters feature open work stations, informal lounge areas, a game room, a music room, quiet pods, training areas, and more.

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • C#Languages
    • JavaLanguages
    • JavascriptLanguages
    • SqlLanguages
    • TypeScriptLanguages
    • ReactLibraries
    • ASP.NETFrameworks
    • HadoopFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • NiFiFrameworks
    • HiveFrameworks
    • Microsoft SQL ServerDatabases
    • MongoDBDatabases
    • MySQLDatabases
    • OracleDatabases
    • PostgreSQLDatabases
    • BasecampManagement
    • ConfluenceManagement
    • JIRAManagement
    • DriftCRM
    • LinkedIn SalesNavigatorCRM
    • SalesforceCRM
    • Salesforce CPQCRM
    • WrikeCRM
    • GainsightCRM
    • MarketoLead Gen
    • LushaLead Gen

What are BlackLine Perks + Benefits

BlackLine Benefits Overview

BlackLine believes in providing the best possible service to its clients, and that starts with offering amazing perks to its employees. These perks include 100% coverage for healthcare, vision, and dental, 401(k) matching, ESPP, food, drinks, games, and so much more!

Volunteer in local community
Partners with Nonprofits
Friends outside of work
Eat lunch together
Intracompany committees
Daily sync
Open door policy
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Open office floor plan
Documented equal pay policy
Dedicated Diversity/Inclusion Staff
Highly diverse management team
Unconscious bias training
Diversity Employee Resource Groups
Hiring Practices that Promote Diversity
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
At BlackLine, we feel that paying 100% of our employees’ health benefits is 100% the right thing to do. Medical, dental, and vision are taken care of by the company.
Life Insurance
Pet Insurance
Wellness Programs
Team workouts
BlackLine has been offering company wide virtual fitness classes such as, Aerobics and Yoga!
Mental Health Benefits
Retirement & Stock Options Benefits
401(K) Matching
BlackLine provides employees with a 401(k) matching plan.
Company Equity
Employee Stock Purchase Plan
BlackLine offers and Employee Stock Purchase Plan with the ability to buy stock at a discounted price.
Performance Bonus
Match charitable contributions
Child Care & Parental Leave Benefits
Child Care Benefits
Generous Parental Leave
Flexible Work Schedule
Remote Work Program
Family Medical Leave
Vacation & Time Off Benefits
Unlimited Vacation Policy
Generous PTO
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Commuter Benefits
Company Outings
BlackLine hosts company outings several times per year.
Game Room
Our game room includes Ping Pong, Pool Table and Video Games.
Stocked Kitchen
Some Meals Provided
Happy Hours
We offer employees free on-site garage parking.
Fitness Subsidies
Home Office Stipend for Remote Employees
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
Diversity Program
Lunch and learns
Promote from within
Time allotted for learning
Online course subscriptions available
Customized development tracks

Additional Perks + Benefits

We’re better together and know that amazing individuals make amazing teams. We also know that we bond through socializing and shared experiences. That’s how teams gel and support each other.

So, we like to play games together: table tennis, poker, and video games. We encourage company sports leagues and fitness groups. We relax with happy hours and team get-togethers, and we never let a holiday season go by without a celebration.

An Insider's view of BlackLine

How would you describe the company’s work-life balance?

One of the best advantages of working at BlackLine is a great company's work-life balance that offers flexibility and supports employee’s needs. The company offers a flexible work environment by letting employees choose from working in the office, working from home or a hybrid schedule.


Manager, Integration Engineering

How does the company support your career growth?

Since joining BlackLine three years ago, I’ve been encouraged by my direct manager and our leadership team to pursue opportunities that will help improve not only our product but our business overall. Even before my first day on the job, I was supported by my hiring Manager to participate in both internal and external leadership development!


Sr. Director, Product Management

What's the biggest problem your team is solving?

I work on the Finance Automation team. The vision of this solution is to provide a single place where customers can manage their end to end accounting processes. We are using the latest technology stack and will be hosted on cloud. We focus heavily on customer experience. It is an excellent opportunity to learn and contribute to a great solution.


Staff Software Engineer

More Jobs at BlackLine