Hexaware Technologies Logo

Hexaware Technologies

Big Data Lead

Posted 7 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead design and implementation of data ingestion, data lake, and ETL solutions using Big Data technologies. Build performant cloud data pipelines, integrate multiple data sources, optimize query performance, enable analytics and data science teams, and lead offshore engineering teams.
The summary above was generated by AI

What Working at Hexaware offers: 
Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team member is valued and empowered to succeed. Hexaware provides access to a vast array of tools that enhance, revolutionize, and advance professional profile. We complete the circle with excellent growth opportunities, chances to collaborate with highly visible customers, chances to work alongside bright brains, and the perfect work-life balance. With an ever-expanding portfolio of capabilities, we delve deep into and identify the source of our motivation. Although technology is at the core of our solutions, it is still the people and their passion that fuel Hexaware s commitment towards creating smiles. At Hexaware we encourage to challenge oneself to achieve full potential and propel growth. We trust and empower to disrupt the status quo and innovate for a better future. We encourage an open and inspiring culture that fosters learning and brings talented, passionate, and caring people together. We are always interested in, and want to support, the professional and personal you. We offer a wide array of programs to help expand skills and supercharge careers. We help discover passion the driving force that makes one smile and innovate, create, and make a difference every day.

What would you do?

Job Description:

Position:  Bigdata Lead

Location: Newtown Square, PA (3-4 days onsite per week)

 

Responsibilities

  • Design & Implement Data ingestion and Data lakes-based solutions using Big Data Technologies. 
  • The Tech Lead should be highly proficient in the use of Big Data / Open-Source Technologies and standard techniques of Data Integration, Data Manipulation. 
  • Should be able to design and develop cost efficient and performant data pipelines in the cloud platform. 
  • Create data environment to support our data analytics, reporting and data science teams. 
  • Experience with integration of data from multiple data sources.
  • Knowledge of various Data Pipeline techniques and frameworks. 
  • Performance optimization - need to monitor the complete process and apply necessary infrastructure changes to speed up the query execution. 
  • Efficient data ingestion - Discovering patterns in data sets with data mining techniques and using different data ingestion APIs and inject data into the data lake as per need. 

 

The Role offers 

  • Great opportunities to learn various tools and technologies used in sophisticated data architecture within the Business Intelligence and Analytics Data Services.
  • Gives an opportunity to showcase candidates’ strong analytical skills and problem-solving ability. 
  • An outstanding opportunity to re-imagine, redesign, and apply technology to add value to the business and operations. 
  • Grow into a Technical architect role over a period. 

 

Essential Skills: 

  • 6+ Years hands on knowledge on SQL as well as SQL/NoSQL databases.
  • Proficient in programming languages such as Python, PySpark, Scala and Java 
  • Experience with Spark , Databricks.
  • Working knowledge of XML, ETL, API and Web Services.
  • Experience with integration of data from multiple data sources.
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
  • Knowledge of various ETL techniques and frameworks, such as Flume. 
  • Experience with various messaging systems, such as Kafka or RabbitMQ. 
  • Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming.
  • Working knowledge and experience in Big data services in one of the Cloud Provider will be good (AWS or Azure or GCP).
  • Experience in leading offshore teams.

 

 Essential Qualification 

  • BE/Btech in Computer Science, Engineering or relevant field.

Equal Opportunities Employer: 
Hexaware Technologies is an equal opportunity employer. We are dedicated to providing a work environment free from discrimination and harassment. All employment decisions at Hexaware are based on business needs, job requirements, and individual qualifications. We do not discriminate based on race including colour, nationality, ethnic or national origin, religion or belief, sex, age, disability, marital status, sexual orientation, parental status, gender reassignment, or any other status protected by law. We encourage candidates of all backgrounds to apply.

Find out more at Hexaware.com.


Similar Jobs

3 Days Ago
Remote
United States
Senior level
Senior level
Information Technology • Consulting
Lead development of enterprise data and analytics systems using Snowflake and Python. Build and optimize data pipelines on AWS (Lambda, Step Functions, ECS), write advanced SQL, and apply domain knowledge of asset management and financial markets.
Top Skills: Amazon EcsAws LambdaAws Step FunctionsPythonSnowflakeSQL
9 Days Ago
Remote
United States
Expert/Leader
Expert/Leader
Information Technology • Consulting
Lead data engineer responsible for designing, building, and operating production data pipelines using Python, Airflow, Snowflake, DBT, and AWS. Automate ETL, implement CI/CD, testing and DBT validations, troubleshoot pipelines, and work client-facing to deliver reliable data solutions.
Top Skills: Ai IdeApache AirflowAws EcsAws IamAws S3Ci/CdCsvDbtGitJinjaJSONPythonSnowflakeSQLXML
25 Days Ago
Remote
United States
Senior level
Senior level
Information Technology • Consulting
Design, build, and optimize end-to-end ETL/ELT pipelines using Python and PySpark for large structured and unstructured datasets. Ensure data quality through validation and reconciliation, troubleshoot performance issues, implement CI/CD and code review practices, and collaborate with IT and business stakeholders to translate requirements into scalable data solutions.
Top Skills: AWSAzureBitbucketCi/CdData WarehousingDistributed ComputingEtl/EltGCPGitHadoopMicrosoft Sql ServerPysparkPythonSparkSQL

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account