Fuse Energy Logo

Fuse Energy

CUDA Engineer

Reposted 2 Months Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in United States
Mid level
In-Office or Remote
Hiring Remotely in United States
Mid level
Design, implement, and optimize low-level CUDA kernels for transformer inference. Profile and eliminate GPU bottlenecks, apply kernel fusion, optimize memory access and mixed-precision kernels, build caching for autoregressive decoding, benchmark performance, and maintain CUDA libraries and tests.
The summary above was generated by AI

Fuse Energy is an energy startup on a mission to make energy abundant and affordable, fast. We combine first-principles thinking with cutting-edge technology to build a radically better energy system.

We've raised over $200M from top-tier investors including Balderton, Lakestar, Accel, Creandum, Lowercarbon, Ribbit, 20VC, Hummingbird and Collaborative Fund, alongside strategic angels including Nico Rosberg and GPs behind Meta, Revolut, Spotify and Uber.

We're building a fully integrated energy company: developing our own solar, batteries and other generation projects, building our own hardware, improving and developing grid infrastructure, trading power in real time, using AI across the business, and installing distributed energy in homes. By selling directly to consumers we cut out the middleman, lower costs and pass the savings on to our customers.

As data centres become one of the largest and fastest-growing sources of electricity demand, Fuse is expanding into high-performance compute infrastructure at the intersection of energy and AI. We're looking for a CUDA Engineer to write and optimise the low-level GPU code that powers our inference workloads: designing custom CUDA kernels, tuning performance across memory bandwidth and compute bottlenecks, and squeezing maximum throughput out of every GPU in our fleet, working at the level of SMs, warps and memory hierarchies.

Responsibilities
  • Write and optimise custom CUDA kernels for core transformer inference operations
  • Profile kernels to identify and eliminate bottlenecks in occupancy, memory throughput and warp divergence
  • Apply kernel fusion to reduce memory round-trips and launch overhead across inference pipelines
  • Optimise memory access patterns and manage the memory hierarchy for maximum bandwidth utilisation
  • Implement quantisation-aware kernels and mixed-precision arithmetic to reduce latency and memory footprint
  • Build and tune caching mechanisms for efficient autoregressive decoding
  • Tune kernel launch configurations for target GPU architectures
  • Benchmark kernels against existing baselines and drive measurable throughput and latency improvements
  • Write tests for CUDA code to catch performance and correctness regressions
  • Maintain internal CUDA libraries and contribute to team coding standards and documentation

Requirements
  • 4+ years writing production CUDA code, with a track record of shipping performance-critical kernels
  • Deep understanding of GPU microarchitecture: warps, occupancy, register pressure and memory hierarchy
  • Strong CUDA C++ skills, including streams and asynchronous execution
  • Hands-on experience profiling to diagnose compute-bound vs memory-bound bottlenecks
  • Experience with kernel fusion, memory coalescing and avoiding warp divergence
  • Experience writing quantised and mixed-precision kernels
  • Solid grasp of parallel algorithm design and numerical precision tradeoffs
  • Bonus: transformer/attention-style kernels or autoregressive decoding; building high-performance GPU libraries from scratch; HPC or latency-critical performance engineering; multi-GPU or multi-node kernel-level optimisation; comfortable reading PTX/SASS to validate kernel efficiency

Benefits
  • Competitive salary and eligibility for equity
  • Biannual bonus scheme
  • Fully expensed tech to match your needs
  • Private health insurance
  • Breakfast and dinner allowance for office-based employees

As we hire globally, benefits vary by location.

Similar Jobs

6 Days Ago
In-Office or Remote
85K-110K Annually
Senior level
85K-110K Annually
Senior level
Artificial Intelligence • Information Technology • Software • Consulting
Develop and optimize CUDA-based workloads on modern GPUs for AI, scientific computing, and high-throughput data processing. Responsibilities include writing custom kernels, profiling production workloads, integrating kernels with ML frameworks, optimizing performance, collaborating with engineering and research teams, conducting code and design reviews, and mentoring junior engineers.
Top Skills: C++CudaCuda C/C++CutlassFastertransformerGpu ArchitecturesGpu ProgrammingHigh-Performance InterconnectsLlvmMlirMpiNcclTensorrtTritonVllm
7 Days Ago
In-Office or Remote
TX, USA
152K-288K Annually
Senior level
152K-288K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Design and implement GPU performance profiling tools focused on AI applications. Build features used by CUDA developers, collaborate with NVIDIA compiler and CUDA driver teams, and influence tool design. The role requires strong C++ software engineering experience, GPU hardware knowledge, and familiarity with performance tools, with preferred expertise in CUDA kernel programming, profiling, and DWARF parsing.
Top Skills: C++CudaDwarfGpuNvidia Nsight Compute
11 Days Ago
Remote
Georgia, USA
Entry level
Entry level
Information Technology • Consulting
Optimize LLM inference on modern GPUs by analyzing GPU architecture, memory access, kernels, and performance bottlenecks. Develop, debug, reverse-engineer, and optimize CUDA kernels and low-level GPU operations for matrix multiplication, attention, and neural network layers. Benchmark latency, throughput, and utilization using frameworks such as vLLM, SGLang, TensorRT-LLM, Triton, and FlashAttention. Investigate technically challenging AI systems and high-performance computing problems.
Top Skills: CudaDistributed InferenceFlashattentionGpu ProgrammingKv Cache OptimizationLlm InferencePyTorchQuantizationSglangTensorrt-LlmTritonVllm

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account