Senior Software Engineer- Big Data

  • Data Science
  • Full- time
  • San Francisco, CA, USA
Apply now

At Change we are a unique blend of engineers, activists, marketers, designers and scientists with a common goal: to give the voiceless a voice and a chance to be heard in today’s digital jungle; to allow everyone to connect with likeminded community and help people change the world for the better. People, the members, the activists, and our employees, are at the center of our mission and everything we do. Actually, employees at Change are a lot like the service itself: bright, brave, and innovative. Collaboration is the foundation of our workforce, and we're looking for smart individuals who are self-motivated and passionate to join us. Be a part of the team that creates a brighter future for everyone. Discover your future at Change!

Change has a great opportunity for a senior big data engineer with several years of diverse experience who will help deliver Change to millions of people around the world. We are looking for someone who will own, lead and execute projects. You should have outstanding analytical and programming skills with a deep understanding and proven track record of building robust, scalable, data processing pipelines. As a member of our highly motivated team, you should be dedicated to excellence and have a strong sense of personal responsibility. We hold ourselves to high standards and take pride in our work. We are looking for someone who is not afraid to get their hands dirty in data and be an integral part of the machine learning team's expansion.

What you'll do:

  • Work with data scientists and other data and machine learning engineers to design and implement complex and reliable batch and streaming ETLs using Spark for generating signals and datasets and to productize ML models
  • Tool our systems for observability, reliability, and monitoring, and manage our warehouses and big data computation engines for optimal performance at scale  
  • You’ll take lead on a number of feature engineering projects using scalable data processing solutions and leveraging technologies such as Spark, Druid, Kafka/Kinesis, Lambda, Glue, Athena, etc.
  • You’ll build and support internal A/B testing, multi-armed bandit and other machine learning experimentation platforms
  • Most of all, you’ll have fun, make friends and enjoy a rewarding job in a uniquely progressive engineering culture, helping millions of activists around the world to create social change.


Requirements:

  • 5 years development experience of which at least 2-3 years are focused on building complex data transformations and applications with Spark and Scala
  • Significant software engineering experience developing high quality reliable software in Python, Scala or Java
  • Significant experience with complex data preprocessing, enrichment, transformation, and integration processes from multiple data sources (ETLs)
  • A deep understanding of Spark internals (or other open source, scalable, and real-time stream processing computation system) and ability to build things from scratch
  • Experience with AWS (or similar Cloud) services


Bonus Skills:

  • Experience with recommender, or search/ranking systems
  • Experience with cloud based relational data storage (eg. PostgreSQL, MySQL)
  • BA/BS or above in Computer Science or a related field
  • Experience with NoSQL databases and key-value stores, such as Cassandra, Redis
  • Experience designing, deploying and/or maintaining stream processing software (Kafka strongly preferred)

This is a full-time opportunity. The position is located in San Francisco, CA, U.S.A.

Change.org is committed to being a diverse and inclusive workplace. We encourage applicants of different backgrounds, cultures, genders, experiences, abilities and perspectives to apply.

All qualified applicants will receive consideration for employment without regard to race, color, national origin, religion, sexual orientation, gender, gender identity, age, physical disability, or length of time spent unemployed.
Change.org Careers

Outsized impact

Change.org is the fastest growing social change organization in the world, empowering more than 200 million people to create change in their communities.

Amazing people

We are building a world-class team of technologists and creatives along with the most accomplished team of social movement creators in the world.

Extraordinary benefits

Plenty of vacation

Personal growth