Principal Software Development Engineer, Big Data - Customer Data Platform at Zillow
Seattle, WA, US

The Data Engineering team architects and builds data pipelines working with petabytes of data for product and analytic needs. This team builds data products like Zestimate, Search, Personalization, and more. This team sits within the larger Data group, which is responsible for crafting and serving data for,,, Zillow Offers, etc.

Learn more about what we are doing at and

About the role

Consumer data team collects and processes billions of events daily and enhances the data by creating the session, joining with property data, other consumer data sources, creating user identity and creating consumer data store for marketing, personalization and Zillow Offers. In this role you will help design and build the next-generation customer data platform for consumer data including clickstream using Kafka and Flink. Build consumer data sets for analytics and product use cases.

Who you are

  • You are a Big Data expert in processing real time data and understands data modeling

  • You are proficient in Scala, Java, Python, SQL

  • You have designed and built complex, highly scalable / reliable data pipelines, using Kafka, Flink, Spark, and Airflow, or equivalents

  • You have experience with Public Cloud platforms such as AWS, GCP, Azure

  • You have worked with large quantities of data in realtime and batch.

  • You have experience applying automation to data engineering (DataOps)

  • You like to work very closely with business and product partners

  • You have excellent interpersonal skills

  • You can learn new technologies quickly

  • You have a degree (BS +) in Computer Science or a related technical discipline; or equivalent work experience

Preferred Skills

  • Relational and NoSQL databases like MySQL, Postgres, SQL Server, Redis, DynamoDB, MongoDB, Cassandra, HBase, RedShift, and stores like HDFS and S3

  • Event streaming (e.g. Kafka, Flink, Kinesis) and real time processing (Flink, Spark streaming)

  • Real Time OLAP systems like Druid

  • Data architecture & data governance

Get to know us

At Zillow Group, we're powered by our inclusive work culture, where everyone has the support and resources to do the best work of their careers. Our efforts to streamline the real estate transaction is supported by our passion to empower people and enrich lives around everything home, a deep-rooted culture of innovation, a fundamental commitment to Equity and Belonging, and world-class benefits. But, don't just take our word for it. Read our reviews on Glassdoor and recent recognition from multiple organizations, including: Fortune 100 Best Companies to Work For (#69), Fortune Best Workplaces for Diversity (#38), Fortune Best Workplaces for Parents (#31), Fortune Best Workplaces for Women (#20), Fatherly's Best Workplaces for New Dads (#37), JUST Capital 100 Company (#69), Bloomberg Gender Equality Index constituent.

Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. Therefore, we provide employment opportunities without regard to age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. If there are preparations we can make to help ensure you have a comfortable and positive interview experience, please let us know.

See what information we collect about you.