Granica Logo

Granica

Senior Software Engineer — Distributed Compute / Spark Systems

Posted 2 Months Ago
Hybrid
Mountain View, CA
160K-240K Annually
Senior level
Hybrid
Mountain View, CA
160K-240K Annually
Senior level
Build and optimize distributed compute infrastructure for large-scale analytical and AI workloads. Responsibilities include improving query execution, scheduling, resource allocation, reliability, workload routing, and compute efficiency across Spark and related systems. The role involves debugging performance bottlenecks, optimizing joins, scans, shuffles, caching, partitioning, and memory usage, and working with lakehouse formats and cloud object storage. Candidates will implement workload optimization algorithms and may contribute to open source or research.
The summary above was generated by AI
Senior Software Engineer — Distributed Compute / Spark Systems
 
Location: Mountain View, CA — Downtown HQ

Employment Type: Full-time

Work Model: On-site, 5 days/week

Department: Research

 
About Granica

Granica helps enterprises run AI for less, from the data layer to agent execution.

Granica is building across three related layers:

  • Crunch reduces storage and processing costs across enterprise data infrastructure.

  • Large Tabular Models unlock predictions and generated data from governed enterprise tables.

  • Myelin reduces token and compute overhead for long-running AI agents.

 

Everything runs inside the customer’s perimeter, so enterprises retain control of their data and the intelligence it creates.

 

Granica has already processed hundreds of petabytes of enterprise data in production for customers including Snap, Pinterest, Lyft, and ShareChat.

 

Our research organization is led by Stanford Professor Andrea Montanari.

 

We operate at the intersection of data infrastructure, AI systems, and applied research, building the efficiency and intelligence layer for enterprise AI.

About the Role

Granica is hiring a Senior Software Engineer to build distributed compute systems for enterprise-scale data and AI workloads.

You will work on the core infrastructure behind Crunch, Granica’s continuous optimization product for enterprise lakehouse data. This includes systems for distributed execution, workload optimization, query performance, scheduling, resource management, and compute cost reduction across petabyte- and exabyte-scale environments.

You will own core systems that directly affect customer compute spend, query latency, workload reliability, cluster efficiency, and the performance of large-scale analytical data processing.

This is a hands-on systems role for engineers who have gone deep on distributed execution — particularly Apache Spark or similar query/runtime systems — and want to own performance, scheduling, reliability, and compute efficiency at massive scale.

What You’ll Do
  • Build and optimize distributed compute infrastructure for large-scale analytical and AI workloads

  • Improve execution performance across scans, joins, aggregations, shuffles, spills, caching, partitioning, and task scheduling

  • Design adaptive systems for workload routing, execution planning, resource allocation, and cluster efficiency

  • Debug bottlenecks across CPU, memory, network, storage, metadata, and distributed execution layers

  • Improve reliability, fault tolerance, and compute efficiency across Spark and adjacent systems such as Trino, Presto, Flink, Iceberg, Delta Lake, Hudi, and cloud object stores

What We’re Looking For
  • Deep engineering experience in distributed systems, query engines, databases, or cloud infrastructure

  • Production experience building, extending, or deeply optimizing distributed compute or query systems such as Spark, Spark SQL, Trino, Presto, Flink, or similar execution engines

  • Strong understanding of distributed execution, query planning, scheduling, resource management, fault tolerance, workload isolation, and performance optimization

  • Hands-on experience with Spark internals such as Catalyst, Adaptive Query Execution, shuffle, joins, aggregation, spill, memory management, or task scheduling

  • Strong programming skills in Scala, Java, Go, Rust, C++, or a similar systems-oriented language, with a pragmatic end-to-end builder mindset

Bonus
  • Contributions to Spark, Trino, Presto, Flink, Velox, DuckDB, DataFusion, Iceberg, Delta Lake, Hudi, Parquet, ORC, or related systems

  • Experience with cost-based optimization, vectorized execution, workload schedulers, execution control planes, resource managers, storage-aware execution, or adaptive query optimization

  • Research or open-source contributions in distributed systems, databases, query processing, data processing, or cloud infrastructure

Why Join Granica
  • Build foundational infrastructure for enterprise data and AI

  • Work on deep systems problems across distributed compute, query execution, scheduling, and compute efficiency

  • Own meaningful parts of the architecture in a small, high-caliber engineering team

  • Work directly with Product, Engineering, and company leadership

  • Have direct impact on customer performance, infrastructure cost, product direction, and company growth

Compensation & Benefits
  • Competitive salary, meaningful equity, and performance bonus for top performers

  • 401(k) with company match, comprehensive health coverage, and unlimited PTO

  • Daily catered meals in our Mountain View office

  • Support for research, publication, and conference participation

At Granica, you'll help build the next generation of enterprise AI—from exabyte-scale data infrastructure, Large Tabular Models (LTMs), and stateful AI agents. Together, we're creating the infrastructure that enables enterprises to own their data, own the intelligence built on it, and scale both efficiently.

 

Similar Jobs at Granica

An Hour Ago
In-Office
Expert/Leader
Expert/Leader
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
Build Granica’s marketing function from the ground up, defining positioning, messaging, category narrative, customer proof, sales enablement, thought leadership, launches, events, PR, and analyst relations. Partner with executive, product, research, engineering, and sales teams to translate complex AI and data infrastructure capabilities into enterprise value. Establish marketing priorities, channels, measurement, and eventually a team while connecting efforts to pipeline, adoption, bookings, and revenue.
Top Skills: Ai/MlCloud ComputingData InfrastructureDatabasesDatabricksLakehouse ArchitecturesLarge Tabular ModelsMl InfrastructureSnowflakeStateful Ai Agents
2 Months Ago
In-Office
160K-240K Annually
Senior level
160K-240K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
Build foundational lakehouse infrastructure for exabyte-scale AI data environments. Responsibilities include metadata and transaction systems, table maintenance, schema and partition evolution, snapshot isolation, compaction, clustering, file-layout optimization, object-store performance, columnar-format optimization, and query performance across major lakehouse engines. The role also involves debugging distributed systems, implementing compression and data-efficiency algorithms, and contributing to open-source or research efforts.
Top Skills: Amazon S3Apache FlinkApache HudiApache IcebergSparkAzure Data Lake StorageC++DatabricksDelta LakeGoGoogle Cloud StorageHive MetastoreJavaOrcParquetPrestoRustScalaSnowflakeTrinoUnity Catalog
2 Months Ago
In-Office
140K-180K Annually
Senior level
140K-180K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
Lead finance strategy including capital raising, forecasting, performance modeling, and risk management to support company’s growth and IPO readiness.
Top Skills: Ai InfrastructureFinancial Modeling

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account