Design, develop, and operate a highly scalable ClickHouse-based data platform processing massive transaction and data volumes. Responsibilities include schema and query optimization, replication, sharding, capacity planning, production troubleshooting, cloud migration, resilient client SDK development, operational instrumentation, and platform advocacy. The role also requires Java development, infrastructure automation, CI/CD, distributed systems expertise, and collaboration across engineering teams.
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
Senior Software Engineer (Data Platform, ClickHouse)
We are seeking a highly motivated and talented Senior Software Engineer to work on Qualys’ next-generation Data Platform and middleware. For this position, we are looking for someone with expertise in ClickHouse.
Working alongside a very talented team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable SaaS based cloud security Data Platform. This is a great opportunity to be an integral part of a team building Qualys’ next generation microservices based technology platform processing over a 100 million transactions and terabytes of data per day, leverage open source technologies, and work on challenging and business-impacting projects.
Responsibilities
For this position, we are especially looking for someone with below capabilities:
- Brings deep expertise in ClickHouse internals and architecture, various ClickHouse engines, partitioning, ordering keys, indexing, and query execution.
- Design and review schemas against real-world read/write patterns, optimizing ingestion, query performance, and storage efficiency.
- Operate ClickHouse at scale on premise or cloud, including replication, sharding, workload management, performance tuning, and production troubleshooting.
- Drive capacity planning across CPU, memory, storage I/O, and network resources, accounting for workload growth, concurrency, background merges, and reliability requirements.
- You will be responsible for engineering of services running data stored with millions of transactions per second, scaling to 100s of terabytes of data. You will be responsible for driving the data source and providing data platform as a service to various applications built in Qualys.
- Be the face and developer advocate of the technology stack you own and contribute back to open-source community if any enhancement needed to fit in Qualys ecosystem.
- You will be instrumenting both day 1 and day 2 operations on these data technologies keeping the 100s of thousands if not millions of operations per second. Migrate, burst into cloud and scale the stack with zero or least amount of downtime.
- You will be responsible for delivering resilient client SDKs to the applications to communicate with the data source you are responsible for.
- You will be constantly in the hunt for better solutions out there to resolve the current scaling, availability, and cost-effective alternative solutions.
Qualifications
- BS/MS degree in Computer Science, Applied Math or related field.
- Experience and expertise in ClickHouse as outlined earlier
- 5+ years hands-on experience with developing SaaS based software products and solutions for service-oriented deployments in public (AWS, GCP, Azure, OCI, etc.) or private clouds.
- Proven expertise in data-driven critical thinking problem-solving
- Ability to debug systems of software and people
- Demonstrated ability to write high-quality, production-ready code (readable, well-tested, with well-designed APIs)
- Demonstrated passion for innovation with an ability to work within agile software development methodologies
- Experience with infrastructure orchestration and automation tools (Terraform)
- Hands-on experience using CI/CD pipelines
- Strong analytical and debugging skills.
- Java programming skills including object-oriented design, prototyping, development, testing, profiling, etc.
- Knowledge of JVM concepts like garbage collection, heap, stack, profiling, class loading, etc.
- Strong in data structures and algorithms.
- Ability to clearly articulate and communicate technical concepts within and across teams.
- Knowledge of the below is a plus
- Experience with distributed systems like Cassandra, Redis, Elasticsearch, Kafka, Ceph, Flink, Spark or similar technologies
- Experience with applying data encryption and data security standards.
- Experience with container and orchestration technologies such as Docker, Kubernetes etc.
- Experience with monitoring tools such as Graphite, Grafana and Prometheus.
- Experience with HashiCorp technologies such as Consul, Vault, Terraform and Vagrant.
- Experience with configuration management tools such as Chef, Puppet or Ansible.
- In-depth experience with continuous integration and continuous deployment pipelines.
- Exposure to Maven, Ant or Gradle for builds.
*******************************************************************************************************************************
The salary range for this position is $125,000 - $145,000 per year. Final compensation will be determined based on several factors, including but not limited to skills, relevant experience, and work location. Please note this range reflects base salary and does not include incentive compensation or potential equity grants. We also offer a comprehensive and highly competitive benefits package.
Qualys is an Equal Opportunity Employer, please see our EEO policy.
Similar Jobs
Information Technology
Provides advanced networking expertise to support sales teams, engage customers, recommend technical solutions, qualify opportunities, and drive networking solution growth. Presents networking concepts, advises on competitive solutions, identifies related technology opportunities, supports sales enablement, collaborates with solution teams and partners, and maintains relevant certifications and technical knowledge.
Top Skills:
Cloud ConnectivityData CenterLoad BalancingNetworkingSd-WanSecurityWireless
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Designs, builds, deploys, and operates cloud-native platform services and Kubernetes workloads. Leads technical projects, develops operators and controllers, improves reliability and scalability, writes tests and instrumentation, participates in on-call, and mentors junior engineers. The role requires strong Go programming, Kubernetes, hyperscaler, CI/CD, GitOps, and infrastructure-as-code experience, with work supporting US regulated markets.
Top Skills:
AWSAzureCi/CdCniContainersDashboardsGCPGitopsGoInfrastructure-As-CodeKubernetesKubernetes ControllersKubernetes OperatorsMetricsMtlsObservabilitySecrets ManagementService MeshTracingWorkload Identity
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design, build, deploy, and operate cloud-native platform services and Kubernetes workloads. Lead technical projects, develop operators and controllers, improve reliability and scalability, write tests and instrumentation, maintain runbooks, participate in on-call, and mentor junior engineers. The role requires strong Go programming, hyperscaler experience, CI/CD, GitOps, infrastructure-as-code, and extensive Kubernetes experience.
Top Skills:
AWSAzureCi/CdCniContainer NetworkingContainersDashboardsGCPGitopsGoInfrastructure-As-CodeKubernetesKubernetes ControllersMetricsMtlsObservabilityOperator PatternSecrets ManagementService MeshTracingWorkload Identity
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
