The role involves building and scaling data infrastructure for multimodal AI systems, developing high-throughput data pipelines, and collaborating with ML researchers and product teams to enhance data systems.
About the Role
As a Data Infrastructure Engineer in Research at Luma, you will play a critical role in building and scaling the data infrastructure that supports our cutting-edge multimodal AI systems. Your work will focus on developing high-throughput, large-scale data processing pipelines tailored for machine learning research and internal ML platform needs. You will collaborate closely with ML researchers and product teams to create reliable, efficient, and easy-to-use data infrastructure that empowers innovation and accelerates development. This role requires a strong foundation in distributed systems and data engineering, with an emphasis on supporting complex machine learning workflows rather than traditional product data infrastructure.
Responsibilities
- Build and maintain scalable data infrastructure for high-throughput machine learning workflows
- Collaborate with ML researchers and product teams to ensure data systems meet evolving needs
- Develop and optimize large-scale data pipelines and batch processing jobs
- Contribute to the architecture and implementation of reliable, high-performance data platforms
- Integrate open-source tools and continuously improve data infrastructure through monitoring and tuning
- Participate in cross-functional projects to improve data reliability, scalability, and operational excellence
- Support the evaluation and adoption of new programming languages and frameworks relevant to data infrastructure
- Engage in continuous improvement of data infrastructure through monitoring, troubleshooting, and performance tuning
- Collaborate with research & engineering teams to help define and refine best practices for data infrastructure development
Qualifications
- Proficiency in Python (or similar languages with willingness to learn Python) and experience with large-scale, high-throughput data infrastructure
- Familiarity with distributed computing frameworks (e.g., Ray, Spark, Beam)
- Ability to design and optimize data pipelines for ML research and internal teams
- Strong problem-solving skills and understanding of data engineering at scale
- Collaborative, product-focused mindset; comfortable in fast-paced environments
- Experience sourcing, integrating, and optimizing data from diverse and large datasets
- Comfortable working in a fast-paced, product-focused environment with a strong execution mindset
- Open to candidates across seniority levels, from mid-level individual contributors to senior engineers and managers.
Nice to have
- Prior experience working with complex data infrastructure or AI/ML platforms highly desirable
- Experience with open source data infrastructure projects is a plus
Luma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
Similar Jobs
Gaming
Lead UX design for a new mobile game: define user flows and information architecture, prototype and test features, build and maintain a scalable Figma design system, own end-to-end feature UX, audit player experience, mentor junior designers, and champion UX quality across the studio.
Top Skills:
Auto LayoutComponent PropertiesFigmaFigma Variables/TokensPrefabsTweensUi AnimationsUnity (Ugui)
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Field-driven Territory Account Executive responsible for full-cycle, self-sourced sales: prospecting, in-person demos, closing deals, building pipeline, establishing partnerships, and managing Salesforce-driven operations to exceed quota and grow local merchants using Square's payments and software ecosystem.
Top Skills:
AfterpayLoyalty PlatformsPayment ProcessingPayroll SystemsSalesforceSquareTime Management Software
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design, build, and operate production ML decision systems to detect and prevent payment fraud, account takeover, scams, and other abuse. Integrate diverse signals into low-latency serving and batch scoring, own feature pipelines and model lifecycle, develop AI-assisted triage and feedback loops, and partner cross-functionally to balance fraud reduction with legitimate customer access.
Top Skills:
Cloud InfrastructureData LakehouseData WarehouseEmbeddingsFeature StoreJavaKafkaKotlinKubernetesLightgbmModel ServingMonitoringObservabilityPythonPyTorchSQLTensorFlowWorkflow OrchestrationXgboost
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
