Leads the design, development, and implementation of scalable data pipelines, APIs, cloud-based integrations, and Customer Data Platform solutions. Builds unified customer data ecosystems supporting analytics, personalization, and enterprise integration. Responsibilities include data modeling, Lakehouse and API optimization, governance, privacy compliance, CI/CD automation, monitoring, troubleshooting, documentation, and cross-functional collaboration. Requires extensive experience with Python, SQL, REST APIs, cloud platforms, data integration tools, CDPs, and modern data engineering architectures.
The Sr. Data Integration Engineer will lead the design, development, and implementation of scalable data solutions, including a Customer Data Platform (CDP) and associated API frameworks. This role is critical in building a unified, secure, and high-performing data ecosystem that supports customer insights, personalization, analytics, and enterprise-wide data integration.
Job Duties and Responsibilities (Essential Job Functions) Common job activities are listed below; actual position responsibilities may vary. Refer to your manager or human resources for specific duties and performance expectations.
1. Data Engineering & Integration
- Develop and maintain scalable data pipelines and workflows using Python and modern data tools.
- Build and maintain production-grade data integrations across internal and third-party systems.
- Code, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes and associated automation in accordance with best practices and security standards throughout the development lifecycle.
- Design and implement a robust, scalable Customer Data Platform (CDP) to centralize and unify customer data from multiple sources (CRM, ERP, web, mobile, etc.).
- Develop and maintain APIs and data pipelines to support real-time and batch data integration between the CDP and internal/external systems.
2. Optimization & Performance
- Optimize and manage data environments, including data modeling, security practices, and Lakehouse performance.
- Monitor and optimize data flows and API performance to ensure high availability and low latency.
- Troubleshoot and resolve data-related issues, ensuring system reliability and efficiency.
3. Collaboration & Communication
- Collaborate with cross-functional teams including marketing, product, engineering, and business stakeholders to define data requirements and integration strategies.
- Communicate effectively with stakeholders, translating technical concepts into actionable insights.
4. Governance & Compliance
- Implement data governance and privacy practices to ensure compliance with regulations (e.g., GDPR, CCPA).
- Ensure data quality, governance, and compliance with internal policies and external regulations.
5. Tools & Automation
- Utilize Git version control and CI/CD pipelines to deploy and manage data workflows.
- Evaluate and recommend tools, platforms, and technologies to support the CDP and integration framework.
- Document architecture, data flows, and integration patterns to support maintainability and scalability.
6. Perform other duties as requested or as needed to fulfill the purpose of the job.
Performance Expectations
- Meet all performance and behavior expectations outlined in the company performance appraisal form or communicated by management.
- Perform responsibilities as directed achieving desired results within expected time frames and with a high degree of quality and professionalism.
- Establish and maintain positive and productive work relationships with all staff, customers and business partners.
- Demonstrate the behavioral and technical competencies necessary to effectively complete job responsibilities. Take personal initiative for technical and professional development.
- Follow the company HR Policy, the Code of Business Conduct and all subsidiary and department policies and procedures, including protecting confidential company information, attending work punctually and regularly, and following good safety practices in all activities.
Qualifications
Education:
- Bachelor’s or Master’s degree in computer science, engineering, or related field.
Experience:
- 10+ years of experience with RESTful APIs.
- 10+ years of experience with SQL, Python, or PowerShell.
- 5+ years of experience with cloud platforms such as Azure, AWS, GCP, ect.
- 5+ years of experience with cloud-native tools (ADF, Glue, Cloud Data Fusion, dbt, Airflow).
- Proven experience building or integrating with Customer Data Platforms such as Segment, Salesforce CDP, Adobe Experience Platform, or custom-built solutions.
- Experience with data integration tools such as Apache NiFi, Talend, Informatica, etc.
- Experience with identity resolution, customer segmentation, and real-time personalization use cases preferred.
Knowledge and Skills:
- Strong proficiency in ETL/ELT pipelines and data modeling.
- Familiarity with event-driven architectures, message queues (ex., Kafka), and microservices.
- Strong understanding of data privacy and security best practices.
- Familiarity with CI/CD pipelines and Infrastructure as Code (IaC) tools (Bicep, Terraform, Pulumi, CloudFormation)
- Knowledge of data warehousing and analytics platorms (ex. Snowflake, BigQuery, Databricks) preferred.
Wage: $153,000 - $178,000 annually; actual wage is based upon education and experience. Potential for annual discretionary bonus.
Benefits: Full suite of benefits including Medical, Health Savings Account, Dental, Vision, Life Insurance, Paid Vacation (PTO), 401(k) with employer match, Flexible Spending Account, and Employee Assistance Program (EAP)
Equal Opportunity Employer
Equal Opportunity EmployerThis employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.
Similar Jobs
Artificial Intelligence • Information Technology • Professional Services • Software • Analytics • Generative AI • Big Data Analytics
Manage a complex executive calendar, coordinate meetings and governance events, prepare presentations and agendas, arrange extensive travel, oversee meeting logistics, and support organizational special projects. The role requires strong communication, global teamwork, Google Workspace proficiency, and at least four years of relevant administrative, coordination, or office operations experience. It also includes promoting information security practices and protecting sensitive data in compliance with privacy standards.
Top Skills:
Google Workspace
Machine Learning • Payments • Security • Software • Financial Services
Provides enterprise technology support through phone, ticketing, and potentially chat channels. Troubleshoots hardware, software, network, access, and application issues; manages incidents and escalations; documents resolutions in ServiceNow or similar ITSM tools; analyzes trends and operations data; supports knowledge management, training, process improvement, and automation; and coaches junior analysts while maintaining customer service, security, and confidentiality standards.
Top Skills:
Call Center TechnologiesHardware InfrastructureItsmNetworkingServicenow
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Leads strategy, roadmap, and execution for Rapid7’s SIEM and threat detection products. Translates customer, market, and competitive insights into prioritized capabilities for data ingestion, detection, search, and reporting. Aligns global engineering, detection science, SOC operations, marketing, sales, and customer success teams while driving delivery excellence, data-backed decisions, and improvements to the MDR customer experience.
Top Skills:
B2B SaasCloud EnvironmentsLog ManagementManaged Detection And Response (Mdr)SIEMSoc PlatformsThreat Detection
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
