Design, deploy, automate, and support Cloudera Data Platform clusters and Hadoop ecosystem services. Build Ansible automation and CI/CD for provisioning, configuration, patching, monitoring, security integrations (Kerberos/LDAP/TLS), capacity planning, disaster recovery, and on-call operations to support data ingestion, processing, and analytics workloads.
Job Title: Data Platform engineer
Experience: 6 to 7 years
Location: Hybrid - Scottsdale, Arizona
No. of Positions: 1
Job Summary
We are seeking a data platform engineer who will be responsible for responsible for designing, deploying, automating, and supporting enterprise data platform infrastructure built on Cloudera Data Platform (CDP). The role emphasizes platform reliability, automation, and operational excellence by leveraging Ansible to provision, configure, patch, and manage large-scale Hadoop and cloud-based data environments. Working closely with infrastructure, security, DevOps, and data engineering teams, the engineer ensures the platform remains secure, highly available, scalable, and optimized to support critical financial data processing and analytics workloads.
Key Responsibilities
- Deploy, administer, and maintain Cloudera Data Platform (CDP) clusters across development, testing, and production environments.
- Automate infrastructure provisioning, software installation, configuration management, and patching using Ansible playbooks and roles.
- Monitor platform health, troubleshoot performance issues, and optimize Hadoop ecosystem services.
- Perform cluster upgrades, capacity planning, disaster recovery testing, and lifecycle management.
- Implement security controls including Kerberos, LDAP/Active Directory integration, TLS, and role-based access control.
- Collaborate with data engineering and application teams to support ingestion, processing, and analytics workloads.
- Develop operational automation and CI/CD workflows to improve platform efficiency and reduce manual effort.
- Maintain system documentation, standard operating procedures, and automation artifacts.
- Ensure platform compliance with enterprise security, governance, and regulatory standards.
- Participate in 24 hrs on-call support in rotation (secondary and primary Pager duty).
Required Skills & Qualifications
- Strong experience in SQL and data modeling
- Experience with workflow orchestration tools like Airflow
- Good understanding of ETL/ELT processes and data pipeline architecture
- Familiarity with cloud platforms (AWS/Azure/GCP) is a plus
- Strong problem-solving and analytical skills
- Excellent Communication skills
- Ability to effectively collaborate with global stakeholders and teams
- Cloudera Data Platform (CDP) and Cloudera Manager
- Ansible automation, playbook development, and configuration management
- Linux system administration (RHEL/CentOS)
- Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, Solr, Kafka, Oozie)
- Shell scripting (Bash) and Python
- Git, Jenkins, and CI/CD pipelines
- Monitoring tools such as Prometheus, Grafana, or Splunk
- Networking, DNS, load balancing, and storage concepts
- Cassandra (docker) knowledge is a plus.
- AI knowledge will be welcomed
- Experience in fintech and banking would also count
Responsibilities
Key Responsibilities
- Deploy, administer, and maintain Cloudera Data Platform (CDP) clusters across development, testing, and production environments.
- Automate infrastructure provisioning, software installation, configuration management, and patching using Ansible playbooks and roles.
- Monitor platform health, troubleshoot performance issues, and optimize Hadoop ecosystem services.
- Perform cluster upgrades, capacity planning, disaster recovery testing, and lifecycle management.
- Implement security controls including Kerberos, LDAP/Active Directory integration, TLS, and role-based access control.
- Collaborate with data engineering and application teams to support ingestion, processing, and analytics workloads.
- Develop operational automation and CI/CD workflows to improve platform efficiency and reduce manual effort.
- Maintain system documentation, standard operating procedures, and automation artifacts.
- Ensure platform compliance with enterprise security, governance, and regulatory standards.
- Participate in 24 hrs on-call support in rotation (secondary and primary Pager duty).
Graduate in Computer Science, or related field. 6+ years of experience in data engineering or a related field.
Base Compensation Range: $110,000 - $130,000
The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale. Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position. The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.
About Us EXL (NASDAQ: EXLS) is a leading data analytics and digital operations and solutions company. We partner with clients using a data and AI-led approach to reinvent business models, drive better business outcomes and unlock growth with speed. EXL harnesses the power of data, analytics, AI, and deep industry knowledge to transform operations for the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 54,000 employees spanning six continents. For more information, visit www.exlservice.com.
Similar Jobs
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
Lead operational reliability and platform enablement for Databricks: build monitoring, CI/CD, deployment standards, compute and job policies, observability, runbooks, and governance to support secure, cost-aware, production data workloads across regulated environments. Mentor engineers and align platform with cloud/infrastructure and compliance requirements.
Top Skills:
Ci/CdDatabricksDatabricks Asset BundlesDatabricks WorkflowsDelta LakeInfrastructure-As-CodeService PrincipalsUnity CatalogVersion Control (Git)
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead design, build, and deploy of large-scale data platforms for LLMs, RAG, and agentic AI systems. Hands-on coding, architecting fault-tolerant pipelines, establishing MLOps/DataOps best practices, mentoring engineers, and operationalizing research into production across Exabyte-scale distributed systems.
Top Skills:
AirflowAWSBigQueryDaskDevsecopsDockerFlinkGCPGoJvmKafkaKubeflowKubernetesLangchainLlamaindexLlmsMlflowOciPulsarPythonRetrieval-Augmented Generation (Rag)RustSagemakerSnowflakeSparkVertex Ai
Fintech • Information Technology • Software
Lead design and evolution of SentiLink's data platform for fraud detection. Architect scalable batch and streaming pipelines, improve reliability, performance, and observability, set engineering standards, mentor engineers, drive cross-team technical initiatives, participate in production support/on-call, and evaluate build-vs-buy and emerging technologies.
Top Skills:
AWSDockerEksEmrFlinkGlueGoHadoopKafkaKubernetesLambdaOpensearchPostgresPythonRedshiftS3SnsSparkSqs
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
