Worldly Logo

Worldly

Senior Data Engineer

Posted 14 Hours Ago
Remote
Hiring Remotely in United States
135K-165K Annually
Senior level
Remote
Hiring Remotely in United States
135K-165K Annually
Senior level
Own and evolve Worldly’s production data lake, Postgres warehouse, CDC and streaming pipelines, dbt transformations, orchestration, BI access controls, and graph integrations. Maintain reliable, governed analytics infrastructure using Iceberg, Trino, Dagster, Terraform, and AWS. Support production generative AI workflows involving embeddings, similarity search, extraction, and classification. Responsibilities include data quality, monitoring, security, incident response, disaster recovery, schema governance, and collaboration with data science and analytics stakeholders.
The summary above was generated by AI
Senior Data Engineer

Location: Remote - US

About Worldly
Worldly is the world's most comprehensive impact intelligence platform — delivering real data to businesses on impacts within their supply chain. Worldly is trusted by 40,000 global brands, retailers, and manufacturers to provide the single source of ESG intelligence they need to accelerate business and industry transformation.

Through strategic and meaningful customer relationships, Worldly provides key insights into supplier performance, product impact, trends analysis, and compliance. When a company wants to change how business is done, we enable that systemic shift.

Backed by a dedicated global team of individuals aligned by values, Worldly proudly operates as a public benefit corporation with backing from mission-aligned investors. Want to learn more? Read our story.

About the Opportunity

Worldly is hiring a hands-on data engineer with a passion for sustainability to join our dynamic team. You will take on a primary role in building, operating, maintaining, and evolving the systems that support our internal analytics and power our customer-facing analytics platforms.

In this role, you will:

  • Own our production data lake — a CDC-fed, medallion (bronze/silver/gold) lake on Apache Iceberg, queried through Trino — as well as our independent Postgres data warehouse.

  • Play a core role in integrating our graph database with the warehouse, lake, and primary databases, including migrating legacy pipelines onto a single, governed integration layer.

  • Apply generative AI and embeddings-based techniques already running in production (e.g., entity matching, document extraction) to keep expanding what our data can do.

What You'll Do

Data Warehouse & Data Lake

  • Operate and evolve our Postgres data warehouse (schema, performance, access controls) and build analytics-ready datasets from it.

  • Own the lake end-to-end: CDC ingestion (source database → message bus → streaming writer → Iceberg bronze/silver/gold), the Trino query layer, and the table catalog.

  • Own pipeline health — latency SLAs, schema-drift detection, source reconciliation — and the GitOps/Terraform infrastructure and backup/DR posture underneath it.

  • Bring consistent schemas, documented lineage, and clear ownership to a data estate that's grown quickly through acquisitions.

Orchestration, Transformation & Reporting

  • Maintain and evolve our Dagster-orchestrated dbt pipelines: sensor-triggered and scheduled builds, data quality tests, branch-based versioning for curated releases.

  • Operate our BI/reporting layer, including per-user, policy-based data access enforced at the query engine (not just the dashboard), and consistent metric definitions across dashboards.

Graph Integration

  • Own pipelines integrating the graph database with the warehouse, lake, and primary databases, working within canonical data models and a single write path.

  • Partner with data science to migrate legacy direct-to-graph services onto that shared path, and to evolve relational structures into graph-native models.

GenAI/NLP Enablement

  • Support and extend production genAI workflows — embeddings/similarity search, LLM-based extraction and classification — and keep our data infrastructure "AI-ready."

We'd Like to See

  • 5+ years in data engineering, analytics engineering, or data platform engineering.

  • Advanced SQL and relational database experience (Postgres, MongoDB).

  • Hands-on graph database experience in production, including integrating graph models with warehouses and lakes — core, not peripheral, to this role.

  • Experience with open table formats and medallion lake architectures (e.g., Apache Iceberg) and distributed SQL engines (e.g., Trino, Presto).

  • Experience with streaming/CDC pipelines (e.g., Kafka or Pulsar, Debezium, Flink or similar).

  • Strong Python skills for pipelines, automation, and operational tooling.

  • Experience with dbt orchestrated by a modern scheduler (e.g., Dagster, Airflow).

  • AWS infrastructure experience (EKS, VPC, IAM, S3) via infrastructure-as-code (e.g., Terraform), plus CI/CD, GitOps (e.g., ArgoCD), and Docker.

  • Experience with analytics data modeling, metric definitions, and automated monitoring/data-quality controls.

  • Experience operating production data systems: incident triage, root-cause analysis, runbooks, reliability improvements.

  • Comfortable working with cross-functional/analytics stakeholders (Jira/Confluence, Agile).

  • Familiarity with data security practices (PII protection, encryption, access management).

It Helps If You Have

  • Experience with BI tooling supporting per-user, policy-based data access (e.g., Superset with SSO impersonation).

  • Experience with policy-based access control (e.g., OPA) and identity platforms (e.g., Keycloak).

  • Familiarity with multi-region data residency (e.g., separate EU/China data handling).

What We Can Offer You

  • Medical, Dental, and Vision Insurance are offered through multiple PPO options. Worldly covers 90% of employee premiums and 60% of spouse/dependent premiums.

  • Company-sponsored 401k with up to 4% match for US employees.

  • Incentive Stock Options.

  • 100% Parental Paid Leave.

  • Unlimited PTO.

  • 12 paid company holidays.

Life at Worldly
Our team is motivated to transform the way products are made. By helping our customers succeed in a new era of sustainable production, we can build technology that makes a difference on a planetary level.

Our team represents over 15 countries and brings unique experiences from technology to farming to the table. Surround yourself with kind, enthusiastic, and dedicated people who put collaboration and growth at the center of our shared goals.

Benefits and Perks

  • Earn a competitive salary and performance-based bonuses. Get healthcare, retirement matching, and equity for US employees.

  • Use the office stipend to get the supplies you need—combat Zoom fatigue with no-meeting Fridays.

  • Flexible time off. Take the time you need to recharge. Our culture encourages team members to explore and rest to be their best selves.

  • We're remote, not lonely. Join the culture committee, coffee chats, or a variety of other interest groups.

Travel Notice
Roles at Worldly may require occasional travel to support business needs, including but not limited to team collaboration, customer engagement, or company events.

Equity Statement
We believe reflecting the diversity of those we strive to serve is essential. True innovation happens when everyone has room at the table, including the tools, resources, and opportunity to excel. We're dedicated to building a culturally and experientially diverse team that leads and works with empathy and respect.

Compensation Overview
Annual Base Rate (USD): $135,000 - $165,000
10% Annual Bonus
Incentive Stock Option Package
Work-From-Home Stipends

*Final compensation figures will be determined based on a wide variety of factors, including experience and location. These factors will be evaluated and considered by Worldly throughout the entirety of this process.

Similar Jobs

2 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
185K-245K Annually
Senior level
185K-245K Annually
Senior level
Legal Tech • Software • Generative AI
Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.
Top Skills: AirflowClaude CodeDbtFivetranGithub ActionsIcebergMcp ServersParquetPythonSnowflakeSQLTerraform
2 Days Ago
Remote or Hybrid
United States
165K-235K Annually
Senior level
165K-235K Annually
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.
Top Skills: Amazon AuroraAmazon RdsApache AirflowSparkBigQueryCdcClickhouseCloud Object StorageDatabricksDelta LakeIamOpenmetadataPostgresSnowflakeUnity Catalog
6 Days Ago
Remote or Hybrid
United States
Senior level
Senior level
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech • SEO
Build and support scalable data platforms and pipelines, leading migrations such as Snowflake to BigQuery and transitioning reporting to Looker. Responsibilities include data architecture, ETL/ELT, API and marketing integrations, data quality, production troubleshooting, warehousing, performance optimization, and platform modernization. The role partners with analytics and business teams, owns projects through production, documents solutions, and provides technical guidance.
Top Skills: AWSAzureBigQueryConfluenceDraw.IoGCPGitJIRAKafkaLookerLucidchartMiroModeNotionPower BIPythonSnowflakeSparkSQLTableauTalend

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account