LiveRamp Logo

LiveRamp

Sr. Software Engineer - Big Data

Posted 10 Days Ago
Hybrid
San Francisco, CA
130K-197K Annually
Senior level
Hybrid
San Francisco, CA
130K-197K Annually
Senior level
Lead the design, implementation, modernization, and optimization of large-scale big data systems processing trillions of identity graph connections. Develop batch processing solutions, REST APIs, and scalable applications using Spark, cloud platforms, and modern infrastructure tools. Collaborate with product managers and engineering teams while emphasizing performance, reliability, security, privacy, compliance, and cost effectiveness.
The summary above was generated by AI

LiveRamp is shaping the future of responsible data collaboration between the world’s leading brands, retailers, financial services providers, and healthcare innovators. As consumers embrace new AI-driven experiences, the LiveRamp data collaboration network exponentially expands the breadth and accuracy of the data on which marketing AI capabilities operate, powering deeper customer insight and measurable performance on a global scale. LiveRamp is headquartered in San Francisco, California, with offices worldwide. Learn more at LiveRamp.com.

We on the Identity Engineering team maintain the graph processing engine that connects the trillions of different identifiers for consumers and the devices they use online. Help us process this trillion edge graph as quickly and efficiently as possible.

We handle product requests and enhancements, focusing on scalability, modernization, performance, cost, security, legal compliance, reliability, and quality. Projects include architectural refreshes like POCs for batch data processing, developing new REST APIs, and migrating applications to Spark and SingleStore. These initiatives aim to improve processing speed, scalability, maintainability, and cost-effectiveness.

You will:
  • Lead complex problems, by breaking into their essential components, design and implement elegant solutions focussing on value delivered.

  • Deliver on the problems problems by collaborating with the team and cross functional teams

  • Modernize our applications to be modular, scalable by leveraging the latest stack

  • Collaborate closely with product managers, and other engineers to deliver high-quality software

  • Design with privacy and security-first principles and err on the side of shipping fast and iterating.

About you:
  • 6+ years of professional software development experience, primarily focused on big data technologies.

  • 3+ years of experience writing and optimizing large-scale batch processing using Spark/Hadoop or similar

  • 3+ years of Java , SQL programming skills

  • 2+ years of experience using cloud based platforms such as GCP, AWS, Azure or similar technologies.

  • Experience with technologies like Docker, Terraform and/or Kubernetes

  • Startup personality and enjoy working as part of a team: smart, ethical, friendly, hard-working, and productive.

Preferred Qualifications:
  • Experience with GCP products such as BigTable, BigQuery, Dataproc, PubSub or other data tools like Kafka, Hive, or Apache Beam

  • Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle

  • Experience with designing and implementing interfaces and infrastructure for large scale systems and RESTful APIs

The approximate annual base compensation range is $130,000 to $196,500. The actual offer, reflecting the total compensation package and benefits, will be determined by a number of factors including the applicant's experience, knowledge, skills, and abilities, geography, as well as internal equity among our team.

We use automated decision systems (ADS) as part of our recruitment and hiring process. If you require an accommodation or believe that the use of an ADS may create a barrier to your application or participation in the hiring process due to a disability or other protected characteristic, please let us know. We are committed to providing reasonable accommodations and ensuring an equitable hiring experience for all candidates.

To all recruitment agencies: LiveRamp does not accept agency resumes. Please do not forward resumes to our jobs alias, LiveRamp employees or any other company location. LiveRamp is not responsible for any fees related to unsolicited resumes.

Similar Jobs

2 Months Ago
In-Office or Remote
124K-255K Annually
Senior level
124K-255K Annually
Senior level
AdTech • Marketing Tech
Design and implement scalable data infrastructure and pipelines on AWS using Spark and Scala. Build fault-tolerant batch and streaming workflows, optimize storage formats and engines, enforce automated data quality checks, and collaborate with Data Science and Product teams to deliver reliable data assets and APIs.
Top Skills: AWSBatch ProcessingCloud Data WarehousesData LakesScalaSparkSQLStreaming Pipelines
2 Months Ago
In-Office or Remote
Santa Monica, CA, USA
140K-200K Annually
Senior level
140K-200K Annually
Senior level
Big Data • HR Tech • Mobile • Software • Database
Senior Software Engineers will build data processing pipelines and deploy cloud technologies, focusing on big data and machine learning infrastructure. They are expected to write and deploy efficient code within a Kubernetes environment.
Top Skills: Amazon Kinesis Data AnalyticsApache BeamApache FlinkApache HudiApache KafkaAzure DatabricksCassandraDelta LakeDockerFlumeGoogle Cloud DataflowHadoopHbaseHiveKubernetesMongoDBNifiSpark
29 Minutes Ago
Remote or Hybrid
United States
111K-150K Annually
Senior level
111K-150K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Collaborate with GuidePoint Security and regional partners to drive Rapid7 solution adoption and revenue. Deliver technical training, product demonstrations, proof-of-concept evaluations, and sales enablement for partner engineers and sellers. Explain technical value propositions to technical and non-technical audiences, support partner-led opportunities, create enablement plans, and coordinate with Partner Account Managers. The role requires frequent travel to strategic partners nationally and is limited to East Coast residents.
Top Skills: Application SecurityAWSAzureDevOpsGCPIncident ResponseSaaSSecurity AutomationVulnerability Management

What you need to know about the Los Angeles Tech Scene

Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.

Key Facts About Los Angeles Tech

  • Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
  • Key Industries: Artificial intelligence, adtech, media, software, game development
  • Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
  • Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account