Linkup Logo

Linkup

Senior Data Engineer

Reposted 2 Months Ago
In-Office
San Francisco, CA
Senior level
In-Office
San Francisco, CA
Senior level
The Senior Data Engineer will build and maintain data pipelines, distributed ETL/ELT workflows, and data storage systems while collaborating with various teams to optimize data quality and performance.
The summary above was generated by AI
About the role

We’re looking for a top-tier Senior Data Engineer to join our tech team and work hand-in-hand with our CTO, Denis Charrier, and the rest of the tech team.

Your core responsibilities will be to:

  • Build and operate large-scale, high-throughput data pipelines powering AI-ready web search

  • Design and maintain distributed ETL / ELT workflows for web indexing, embeddings, and analytics

  • Develop and optimize data ingestion and transformation systems across structured and unstructured sources

  • Manage and scale data storage layers (SQL, NoSQL, and object stores) for performance and reliability

  • Participate in architecture discussions and contribute to system design for data infrastructure

  • Collaborate with ML and backend teams to deliver high-quality, real-time data for ranking and retrieval

  • Write clean, maintainable code and participate in code reviews

Requirements

You’re a great match if you:

  • Are excited to help build Google for AI agents — and believe in Linkup’s mission

  • Have strong experience in data engineering or backend development (3y minimum)

  • Understand distributed systems, data modeling, and streaming architectures

  • Care about data quality, observability, and system reliability

  • Enjoy debugging tough pipeline issues and optimizing for latency or throughput

  • Are curious about AI infrastructure, indexing systems, and retrieval-augmented generation (RAG)

  • Thrive in a fast-paced, high-ownership startup environment

Example Projects
  • Stream and transform billions of web facts per day under strict freshness SLAs (< 5 min)

  • Build a real-time data lake to serve embeddings, metadata, and ranking features to LLMs

  • Design fault-tolerant pipelines for continuous crawling, deduplication, and enrichment

  • Develop internal tools to monitor and profile data flows across terabytes of web-scale content

Our Stack
  • Node.js / NestJS

  • Python

  • Java

  • PostgreSQL

  • OpenSearch

  • Vespa

  • Apache Storm

  • Kubernetes

  • GitHub Actions

  • Terraform

Details

The ideal candidate will play a central role in our engineering team, partnering closely with the founders to spearhead groundbreaking products. Your expertise will shape the future of AI‑powered applications and bring our vision to life.

We offer a flexible remote‑work policy- see the details here.

Join us and leverage your expertise to push the boundaries of AI!

About Linkup

Our Vision

We believe in a future of AI agents and the agentic web. These digital entities can create more value for humanity than we ever could alone, but they depend on the internet to operate, collaborate, take action, and gather information.

AI agents need web search. To perform well, they require information that is current, reliable, and context‑specific—not the diffuse, steadily aging knowledge frozen at their last training cut‑off.

Modern web search is built for humans, not AIs. Instead of trusted facts, it serves links, ads, and click‑bait. People want visually engaging pages; AI systems need structured truth. An AI can absorb oceans of data, while human attention barely skims the surface. Humans think visually and intuitively; AI reasons in latent space.

Web 2.0 is sunsetting. The deck is being reshuffled, and the Bing‑Google search oligopoly is crumbling. Indexing ever more pages is no longer the goal; semantically organizing facts for AI systems is. In the coming agentic web, Google’s ad‑driven model has no natural home.

Search for AI must be rebuilt from the ground up. We are reconstructing the web as a rigorously structured knowledge layer, mapping every concept, entity, and claim into a coherent semantic graph. This foundation delivers verified facts and rich context to AI instantly, unlocking faster reasoning, higher accuracy, and radically more useful answers for everyone.

Humans search Google; AI searches Linkup.

Our Mission

Reality never stands still, and neither should intelligence. Linkup reconnects language models to a living stream of verified facts, ensuring AIs remain as current and insightful as the world they serve.

Our mission is to deliver the world’s freshest, most trusted knowledge to AIs.

Our Culture

Our culture is built on the following values:

  • Mission. We believe we play a critical role in building the agentic web. We are 100% committed to our mission of bringing the reality of the world to AI agents.

  • Speed. We build fast, we build to last. We get things done, well.

  • Ownership. We empower every team member to take ownership of their projects, ensuring they see them through to successful completion.

  • Teamwork. Our strength lies in our unity. We rely on one another and embrace our diversity as a core asset.

  • Humility. We maintain low egos, showing respect for others and continuously learning from their insights and experiences.

We expect all team member to take an active role in shaping our company culture.

Our Team

We are small technical team, working shoulder to shoulder to build the web of agents.

A bit more about our 3 co-founders:

  • Philippe Mizrahi- Led the development of Lyft’s Autonomous Vehicles marketplace. Previously launched Amundsen, an open source search engine.

  • Denis Charrier- Founding Engineer at Niland, an audio search company (acquired by Spotify), then Staff Engineer at Spotify. 15y of software development experience.

  • Boris Toledano- Led robotics at Carrefour, after 3y at McKinsey & Co working on public affairs and digital transformation.

Similar Jobs

8 Hours Ago
Hybrid
120K-196K Annually
Senior level
120K-196K Annually
Senior level
Fintech • Financial Services
Lead enterprise data engineering and integration efforts, designing pipelines, data models, migration strategies, automation, and highly available database solutions. Support MongoDB, Cassandra, and Oracle environments; perform performance tuning and operational support; and implement automation using Liquibase, Harness, Python, and OpenShift. The role provides technical leadership, mentoring, vendor communication, collaboration with security and application teams, and oversight of complex projects in a regulated banking environment.
Top Skills: AgileCassandraETLGenerative AiHarnessJIRALdapLiquibaseMongo ShellMongoDBMongodb Ops ManagerMongodb UtilitiesOpenshift Container PlatformOracle DatabasePythonRhelShell Scripting
7 Days Ago
In-Office or Remote
CA, USA
168K-297K Annually
Senior level
168K-297K Annually
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Lead product data engineering across architecture, data modeling, pipelines, monitoring, lineage, and data quality. Build reliable analytical datasets, support experimentation and machine learning use cases, and resolve business-critical pipeline issues. Partner with product and engineering stakeholders to translate business needs into automated data solutions. The role requires ownership of end-to-end data engineering projects, on-call participation, and development of AI-assisted monitoring and automation.
Top Skills: AirflowDatabricksDbtGitOmniPrefectPythonSnowflakeSQLTerraform
8 Days Ago
Remote or Hybrid
CA, USA
168K-297K Annually
Senior level
168K-297K Annually
Senior level
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Lead product data engineering initiatives by designing data models, owning critical pipelines, building data quality and lineage monitoring, and supporting experimentation and ML-ready datasets. Translate business needs into automated data solutions, maintain pipeline SLAs through on-call support, and develop AI-assisted tools for issue detection and resolution. Collaborate with Product, Engineering, Data Science, Machine Learning, and Applied AI teams across Block’s products.
Top Skills: AirflowDatabricksDbtGitOmniPrefectPythonSnowflakeSQLTerraform

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account