Cargill Logo

Cargill

Sr. Data Engineer

Posted 2 Days Ago
Be an Early Applicant
In-Office
Atlanta, GA
Senior level
In-Office
Atlanta, GA
Senior level
Own the architecture, development, and operations of Cargill’s enterprise data platform. Build and optimize Azure and on-premises ETL/ELT pipelines, manage databases and migrations, implement CI/CD, improve performance and reliability, and create embedded Superset dashboards. Monitor platform health, data quality, security, and costs while integrating emerging AI capabilities. Mentor data professionals and make architectural decisions across global teams.
The summary above was generated by AI
Cargill is committed to providing food and agricultural solutions to nourish the world in a safe, responsible, and sustainable way. Sitting at the heart of the supply chain, we partner with farmers and customers to source, make and deliver products that are vital for living.
Our 155,000 team members innovate with purpose, providing customers with life's essentials so businesses can grow, communities prosper, and consumers live well. With over 160 years of experience as a family company, we look ahead while remaining true to our values. We put people first. We reach higher. We do the right thing-today and for generations to come.
Job Purpose and Impact
    • The Senior Data Engineer will be a core contributor to the architecture, delivery, and operations of the Company's internal business intelligence and data platform, which delivers automated ETL, ad-hoc and automated analytics, and embedded dashboards to users across the enterprise. The successful candidate will own day-to-day data engineering architecture, accelerate feature delivery and performance tuning, and mentor the team's data professionals to ensure the platform scales sustainably with enterprise demand.

Key Accountabilities
    • Owns and evolves the architectural design of the data platform - Azure Data Factory, Azure Blob Storage, Azure SQL Server, and on-premises ETL/data-acquisition components - maintaining architecture standards, decision records, and consistency of data feeds, models, and pipeline design.
    • Analyzes and optimizes query performance, including indexing strategy, execution-plan analysis, and tuning of slow workloads; leads break-fix for performance degradation.
    • Designs, builds, and maintains ETL/ELT pipelines spanning on-premises source systems to Azure, with an emphasis on reliability, idempotency, and data quality.
    • Manages database lifecycle operations - schema changes, migrations, and maintenance with a zero-downtime discipline - and delivers feature work to clear and prevent delivery backlogs.
    • Owns CI/CD for database and pipeline deployments, including version control, peer review, and audited rollouts and rollbacks; monitors platform health, pipeline success rates, and resource/cost consumption, driving capacity and cost optimization.
    • Designs and builds Apache Superset dashboards, balancing dashboard authoring with architectural priorities; dashboards are auto-mapped and embedded for customers via the platform's tagging system, eliminating manual publishing work.
    • Monitors the platform on behalf of customers, including automated and AI-driven features, to ensure capabilities behave reliably; contributes to automation and self-healing service scaling to minimize manual intervention, shifting toward quality, governance, and monitoring of AI-generated outputs as generative-AI dashboard creation matures.
    • Contributes to integrating AI capabilities into the platform - including Model Context Protocol (MCP), Superset MCP, and Azure AI Foundry readiness - and evaluates emerging data and AI technologies for adoption.
    • Collaboration, Mentoring & Security practices

Qualifications
    • 5-6 years experience experience designing, building, and supporting enterprise data platforms.

    • Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field, or equivalent practical experience.
    • Significant professional experience designing, building, and supporting enterprise data platforms.
    • Strong hands-on experience with Azure Data Factory, Azure Blob Storage, and Azure SQL Server.
    • Advanced proficiency in T-SQL, including query optimization, execution-plan analysis, indexing strategies, stored procedures, tables, and views.
    • Demonstrated experience building reliable ETL/ELT pipelines that integrate on-premises systems with Azure cloud environments.
    • Experience managing database schema changes, migrations, maintenance, and production performance issues.
    • Experience implementing CI/CD practices for database and data-pipeline deployments, including version control, peer review, deployment, and rollback processes.
    • Strong understanding of data modeling, data quality, platform monitoring, access controls, audit logging, and secure deployment practices.
    • Ability to independently make technical and architectural decisions in a complex enterprise environment.
    • Strong communication and stakeholder-management skills, with the ability to collaborate across global teams and mentor other data professionals.

Equal Opportunity Employer, including Disability/Vet.
At Cargill, we care about your safety and want your job search experience to be a positive one. Unfortunately, there are scams out there where individuals pretend to be Cargill recruiters to try to collect personal information or request payment. Please know that Cargill will never ask you for money during the hiring process, and in most cases, we only accept applications through our official careers site, with the exception of some roles in our production plants. If something doesn't feel right or you have questions, don't hesitate to contact us. To learn more, visit our Notice on Fraudulent Job Offers.
To apply using chat/text, please click Apply Now button OR use this link to create a login to apply.

Similar Jobs at Cargill

3 Days Ago
In-Office
Senior level
Senior level
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Designs, builds, and maintains scalable data infrastructure, streaming and batch pipelines, data systems, data models, and cloud-based data products. Develops automated deployment pipelines, evaluates architectures, supports data governance, and collaborates with analytics teams and stakeholders. The role requires advanced programming and SQL expertise, modern data architecture experience, and proficiency with cloud platforms, Spark, Kafka, orchestration tools, and data modeling frameworks.
Top Skills: Apache AirflowApache FlinkApache IcebergApache ParquetSparkAWSAws GlueAzureCi/CdDbtDevOpsGCPJavaKafkaPythonScalaSQL
Yesterday
In-Office
Senior level
Senior level
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Provides technology leadership for SAP S/4HANA and related systems across supply chain, manufacturing, logistics, warehousing, and transportation. Captures requirements, evaluates solution alternatives, configures applications, designs and deploys releases, supports users, and leads complex application support. Partners with stakeholders, architects, developers, and product teams while representing the Operations workstream, managing staffing and budgets, and mentoring team members.
Top Skills: Agentic AiAutomationSap BtpSap ErpSap FioriSap IbpSap Integration TechnologiesSap MmSap PpSap S/4Hana
2 Days Ago
In-Office
160K-195K Annually
Senior level
160K-195K Annually
Senior level
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Leads the global real estate product strategy, vision, roadmap, backlog, and value delivery. Advises leadership using data and insights, develops scalable processes and technology capabilities, partners with cross-functional stakeholders, delivers minimum viable products, and guides global implementation and operational improvements for real estate users.
Top Skills: Artificial IntelligenceIbm MaximoIbm TririgaMref

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account