Lead GPU-edge inference systems, ensuring compliance and performance through design and monitoring. Manage global infrastructure for AI deployment.
Full-time | Remote | Infrastructure | Reports to CTO
About Elloe
Elloe is the trust layer for AI.
We sit between the world’s most powerful language models and the institutions that can't afford to get it wrong — hospitals, banks, regulators. We trace and block failures in real time. That’s not marketing — we’re deployed at the European Commission, with NIH clinical trials, and inside a Top-5 EU bank catching GDPR violations live.
This is the enforcement layer GenAI has been missing. We're not visualizing problems — we're fixing them.
About the Role
You’ll lead our GPU-edge inference systems. From chaos-resilient deployment to SHAP-driven compliance metrics, you’ll own global infra that makes AI safe and performant.
What You’ll Own
1. Global Edge Routing
- Design zone-routing that ensures <50ms SLA in 10+ regions
- Build fallback orchestration to handle compliance-aware rollbacks
2. GPU Infra Ops
- Maximize utilization across 100K+ GPUs via mesh & load prediction
- Integrate compliance overlays with VaultChain and SHAP triggers
3. Reliability Telemetry
- Ship `/vault/audit`, `/inference/predict`, `/compliance/log` endpoints
- Trace every edge request across governance and model layers
Who You Are
- Senior systems engineer with GPU fleet experience (KubeRay, Istio, Envoy)
- Operated real-time AI infra with 10M+ QPS loads
- Comfortable with compliance observability and infra governance
Why This Matters
Our competitive edge isn’t just AI — it’s defensible enforcement. This role turns that into product.
You’ll Leave This Role With
- Referenceable contributions to enforcement infra that’s live in EU and US institutions
- First-hand product work across legal, engineering, and GTM teams
- Influence over how regulatory primitives become systems people trust
Logistics & Application
- Start Date: Flexible (Q3–Q4 ideal)
- Location: Remote-first; timezone overlap with NY or EU preferred
- Compensation: Top of market salary + equity
- To Apply: Send your resume and a sentence on the hardest infra problem you'd want to own at scale.
Similar Jobs
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Deliver and configure Ericsson Communication Services solutions, including CS Core and IMS products. Execute system, module, and acceptance testing; resolve technical delivery issues; maintain solution documentation; improve delivery processes; provide R&D feedback; and support knowledge transfer and customer competence building.
Top Skills:
Cloud InfrastructureCloud/NfviCs CoreCscfCtcDnsEnumEricsson Communication ServicesImsMgwMrfMsc-SMtasSbcSoftware Virtualization
Beauty • Robotics • Design • Appliances • Manufacturing
Manage and grow key retailer accounts in Kenya/East Africa by developing account plans, launching products, executing online and in-store promotions, forecasting, negotiating, analyzing sell-out data, organizing trade shows, reporting competitor activity, identifying new retailers, and supporting sales meetings and events. Occasional regional travel required.
Top Skills:
LaptopExcelMS OfficeMobile DevicePowerPoint
AdTech • Marketing Tech • Design
Leads client media business and integrated communications planning across digital, performance, search, social, programmatic, offline, commerce, data, analytics, measurement, and investment. Builds senior client relationships, translates business objectives into commercially sound strategies, oversees quality and delivery, aligns multidisciplinary teams, coaches talent, manages account economics, and drives revenue retention, organic growth, and new business opportunities.
Top Skills:
AIDigital MediaMarketing MeasurementMedia AnalyticsPerformance MarketingProgrammatic AdvertisingSearch MarketingSocial Media
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
