As a Senior Data Engineer, you will design and maintain data pipelines and infrastructure, develop scalable systems for data analytics, and collaborate across teams to implement technical solutions.
About Zignal Labs
Zignal Labs’ real-time intelligence technology helps the world’s largest organizations protect their people, places, and position. Analyzing billions of data points in real time, Zignal's AI-powered platform accelerates mission-critical decision making by empowering leaders with contextual situational awareness of the information environment.
Fully remote, with Silicon Valley roots and team members in over 20 states, Zignal serves customers around the world. Learn more at zignallabs.com.
About the Role
As a Senior Data Engineer at Zignal Labs, you’ll design and build a distributed data and analytics infrastructure using open-source technologies like Apache Spark, Apache Storm, and Elasticsearch. We process data from social media, news, blogs, and other media sources to empower users with real-time insights.
In This Role, You Will:
- Build and maintain scalable, high-performance data pipelines for large-scale data ingestion, real-time analytics, and ML services
- Develop and optimize distributed systems that support downstream NLP, LLMs, and other AI-powered applications
- Design and implement reliable, maintainable backend services and microservices
- Write scalable, testable code and follow modern engineering practices (e.g., version control, CI/CD, code reviews)
- Collaborate with product, QA, and operations teams to co-develop and deliver technical solutions that meet user needs
What We’re Looking For
- Proficiency in Scala, Java, and Python for backend development and data engineering
- Experience with Apache Spark (and Spark Streaming) and platforms like Databricks or Delta Lake
- Practical experience working with AWS services (e.g., Lambda, EC2, API Gateway)
- Experience with real-time data streaming frameworks like Apache Storm, Kafka, or Pekko
- Familiarity with search technologies such as Elasticsearch
- Experience with NoSQL databases (e.g., MongoDB, Redis), and relational databases (e.g., RDS)
- Exposure to workflow orchestration tools like Apache NiFi is a plus
- Experience with cloud-native deployments, CI/CD pipelines, and DevOps best practices
- Strong understanding of computer science fundamentals, such as algorithms, data structures, and system design
- Experience in database query optimization and performance tuning
To Be Successful in This Role, You Will Need
- A bachelor’s degree (or higher) in Computer Science, Engineering, or a related field, or equivalent practical experience
- At least 3 years of experience building scalable data pipelines with Apache Spark or Databricks, or equivalent experience with Apache Storm
- Strong communication and collaboration skills, and the ability to work effectively during U.S. time zones
- Proficiency in Java or Scala, with a willingness to work in Scala
- Experience with Python is a plus
The salary range applies to the general US and may be adjusted based on geographic location. Compensation decisions depend on the circumstances of each case, including skill sets, experience, certifications, and business and organizational needs. The estimated salary range for this role is $165,000 - $185,000 per year.
Why join Zignal Labs?
- Competitive salary based on the work you do
- Flexible time off – work with your manager to take the time you need
- Excellent medical, dental, and vision coverage
- Paid parental leave plan
- Professional development and growth programs
- A tight knit, collaborative, and transparent environment to help you succeed
Zignal Labs is proud to be an Equal Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.
Applicants must be authorized to work in the United States for any employer. No sponsorship is available for this position.
Top Skills
Apache Nifi
Spark
Apache Storm
Api Gateway
AWS
Ec2
Elasticsearch
Java
Kafka
Lambda
MongoDB
NoSQL
Python
Rds
Redis
Scala
Similar Jobs
AdTech • Cloud • Digital Media • Marketing Tech • Analytics • Consulting
Lead design and delivery of data solutions for clients using Adobe Experience Platform. Architect data workflows, mentor junior engineers, and optimize data models.
Top Skills:
Adobe AnalyticsAdobe CampaignAdobe Data CollectionAdobe Experience PlatformAdobe TargetAirflowAWSAzureDbtFivetranGCPJavaScriptPythonReal-Time CdpSnowflakeSQL
.png)
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
As a Senior Data Engineer, you will enhance data solutions, manage data models, and collaborate with teams to optimize data architecture and accessibility for insurance business.
Top Skills:
BigQueryGoogle Cloud PlatformPythonSQL
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
As a Senior Data Engineer, you'll design prototypes, integrate technologies, automate tasks, and support data governance while collaborating with various stakeholders.
Top Skills:
AWSAzureDatabricksGCPHugging FaceOpen Ai ApiPower BIPythonPyTorchSnowflakeSQLTableau
What you need to know about the Los Angeles Tech Scene
Los Angeles is a global leader in entertainment, so it’s no surprise that many of the biggest players in streaming, digital media and game development call the city home. But the city boasts plenty of non-entertainment innovation as well, with tech companies spanning verticals like AI, fintech, e-commerce and biotech. With major universities like Caltech, UCLA, USC and the nearby UC Irvine, the city has a steady supply of top-flight tech and engineering talent — not counting the graduates flocking to Los Angeles from across the world to enjoy its beaches, culture and year-round temperate climate.
Key Facts About Los Angeles Tech
- Number of Tech Workers: 375,800; 5.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Snap, Netflix, SpaceX, Disney, Google
- Key Industries: Artificial intelligence, adtech, media, software, game development
- Funding Landscape: $11.6 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Strong Ventures, Fifth Wall, Upfront Ventures, Mucker Capital, Kittyhawk Ventures
- Research Centers and Universities: California Institute of Technology, UCLA, University of Southern California, UC Irvine, Pepperdine, California Institute for Immunology and Immunotherapy, Center for Quantum Science and Engineering
