Manages data engineering teams and leads architecture, design, and delivery across the data lifecycle. Builds scalable data infrastructure, pipelines, warehouses, and ETL processes using cloud and big-data technologies. Responsibilities include data modeling, system optimization, automation, analytics, predictive modeling support, and collaboration with business intelligence and data warehouse teams. The role also evaluates business needs, interprets trends, develops prototypes, and communicates analytical results to stakeholders.
About Us
The Data Engineering Sr Manager will be responsible for managing data engineering deliverables to support our technology and product engineering teams as well as the needs of our data scientists and business analysts. This role will be responsible for employing techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field.
Job Responsibility
• Manage team of data engineers (both full-time associates and/or third-party resources).
• Lead and participate in architecture and design efforts.
• Lead the building of systems for all parts of the data lifecycle: collection, storage, accessibility, insights, and business action.
• Identify, design, and implement internal process improvements including re-designing infrastructure for scalability, optimizing data delivery, and automating manual processes.
• Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using Snowflake/Azure and SQL technologies.
• Analyze and organize raw data.
• Build data systems and pipelines.
• Evaluate business needs and objectives.
• Interpret trends and patterns.
• Conduct complex data analysis and report on results.
• Prepare data for prescriptive and predictive modeling.
• Build algorithms and prototypes.
Job Qualifications
• Must be able to communicate ideas and analysis results effectively both verbally and in writing to both internal and external clients.
• Responsible for executing analytical projects, leading project development for data analysis and decision support tools.
• Coordinate closely with the Business Intelligence and DWH team for data integration and alignment.
• Knowledge of programming languages (e.g., Java and Python).
• Hands-on experience with SQL database design.
• Great numerical and analytical skills.
• Degree in Computer Science, IT, or similar field; Master's preferred.
• Data engineering certification (e.g., IBM Certified Data Engineer) is a plus.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with Snowflake/Azure cloud services: EC2, EMR, RDS, Redshift.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Education/Experience
Degree in information technology or computer science with additional vendor-specific certification. BS or MS degree in Computer Science or a related technical field. 4+ years of Python or Java development experience. 4+ years of SQL experience (No-SQL experience is a plus). 4+ years of experience with schema design and dimensional data modeling. Ability to manage and communicate data warehouse plans to internal clients. Experience designing, building, and maintaining data processing systems. Experience working with a cloud platform such as Snowflake / Azure or Databricks.
Job Responsibility
• Manage team of data engineers (both full-time associates and/or third-party resources).
• Lead and participate in architecture and design efforts.
• Lead the building of systems for all parts of the data lifecycle: collection, storage, accessibility, insights, and business action.
• Identify, design, and implement internal process improvements including re-designing infrastructure for scalability, optimizing data delivery, and automating manual processes.
• Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using Snowflake/Azure and SQL technologies.
• Analyze and organize raw data.
• Build data systems and pipelines.
• Evaluate business needs and objectives.
• Interpret trends and patterns.
• Conduct complex data analysis and report on results.
• Prepare data for prescriptive and predictive modeling.
• Build algorithms and prototypes.
Job Qualifications
• Must be able to communicate ideas and analysis results effectively both verbally and in writing to both internal and external clients.
• Responsible for executing analytical projects, leading project development for data analysis and decision support tools.
• Coordinate closely with the Business Intelligence and DWH team for data integration and alignment.
• Knowledge of programming languages (e.g., Java and Python).
• Hands-on experience with SQL database design.
• Great numerical and analytical skills.
• Degree in Computer Science, IT, or similar field; Master's preferred.
• Data engineering certification (e.g., IBM Certified Data Engineer) is a plus.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with Snowflake/Azure cloud services: EC2, EMR, RDS, Redshift.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Education/Experience
Degree in information technology or computer science with additional vendor-specific certification. BS or MS degree in Computer Science or a related technical field. 4+ years of Python or Java development experience. 4+ years of SQL experience (No-SQL experience is a plus). 4+ years of experience with schema design and dimensional data modeling. Ability to manage and communicate data warehouse plans to internal clients. Experience designing, building, and maintaining data processing systems. Experience working with a cloud platform such as Snowflake / Azure or Databricks.
Work Where You Matter
At Dollar General, our mission is Serving Others! We value each and every one of our employees. Whether you are looking to launch a new career in one of our many convenient Store locations, Distribution Centers, Store Support Center or with our Private Fleet Team, we are proud to provide a wide range of career opportunities. We are not just a retail company; we are a company that values the unique strengths and perspectives that each individual brings. Your difference truly makes a difference at Dollar General. How would you like to Serve? Join the Dollar General Journey and see how your career can thrive.
Company Overview
Dollar General Corporation has been delivering value to shoppers for more than 80 years. Dollar General helps shoppers Save time. Save money. Every day.® by offering products that are frequently used and replenished, such as food, snacks, health and beauty aids, cleaning supplies, basic apparel, housewares and seasonal items at everyday low prices in convenient neighborhood locations. Learn more about Dollar General at www.dollargeneral.com/about-us.html.
Similar Jobs
Edtech • Social Impact
Leads the design, delivery, and optimization of data architecture, pipelines, semantic layers, data quality frameworks, and Tableau BI platforms. Partners with stakeholders to manage requirements, project plans, sprint execution, monitoring, governance, and release delivery. Guides data engineers, manages team members, and supports AI-enabled analytics capabilities. Requires strong SQL, Spark, PySpark, SSIS, cloud data platform, CI/CD, Tableau infrastructure, and data engineering expertise.
Top Skills:
Azure DevopsBitbucketCi/CdDatabricksETLGitGitGitlabMicrosoft FabricOnelakePysparkSnowflakeSparkSQLSQL ServerSsisTableau
.png){kind=icon}
Greentech • Software • Energy
Leads and grows the data engineering team while owning enterprise data architecture, ingestion, modeling, semantic layers, governance, secure APIs, and reliable platform outcomes. Partners with finance, operations, sales, marketing, and product to deliver governed, traceable data for products and AI agents. Sets the roadmap, manages vendors and costs, reviews architecture, contributes code, and delivers cross-functional data platform projects.
Top Skills:
Ai AgentsAPIsAuthorization And Access ControlBigQueryData GovernanceData WarehousesDbtPythonSemantic LayersSnowflakeSQL
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Lead and grow a global data engineering team while establishing foundational data platforms and engineering standards. Design and oversee GCP-based pipelines, medallion data models, DataOps, monitoring, SLAs, CI/CD, governance, and data quality practices. Drive AI adoption across engineering workflows and build reliable, AI-ready data. Partner with business and technology stakeholders to prioritize roadmaps, deliver scalable solutions, and support data democratization.
Top Skills:
Apache AirflowBigQueryCeligoChatgptClaudeCloud ComposerCloud IamCloud StorageCopilotData Policy TagsDataflowDbtGCPInfrastructure As CodeLookerPub/SubPythonSQL
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
