Data Engineering Manager

Data Engineering Manager

Company details

Description of the offer

Who We Are

Perchwell is the modern data and workflow platform for real estate professionals and consumers. Based on the industry’s foundational data, Perchwell builds a modern software suite to empower real estate professionals to do their best work, provide differentiated service to their clients, and grow their businesses.

Backed by Lux Capital, Founders Fund, and some of the country’s leading Multiple Listing Services (MLSs), Perchwell builds next generation workflow software/data products for the multi-trillion dollar residential real estate industry. Perchwell is the first new entrant to come to market in decades and is currently scaling its best-in-class platform.

What We’re Looking For:

As a Data Engineering Manager, you will lead the team that owns the data infrastructure and pipelines of Perchwell. You will spearhead the effort of building a resilient and high performing data platform. You will bring a background of engineering rigor and excellence and work cross-functionally with the rest of the organization. You will be helping execute large strategic technical initiatives within the Data Engineering domain.

You have deep experience in building and operating data infrastructure for large production systems. You understand good data governance practices and build systems and processes that allow the business to innovate while protecting its data. You are rigorous and meticulous in your work and hold others to the same high engineering standards. You are unbothered by large, messy data sets and have wrangled and integrated them into a platform others can build easily on top of.

You will work closely with the VP of Engineering and other senior leaders to tackle and remediate our current problem set while also building net new capabilities. You will build important relationships and partner deeply with our product and SRE organizations. This role has an on-call requirement.

We believe that in an ever-changing, innovative environment, we do our best work when we are working as a team in-person. In this role, you’ll work out of our New York City HQ in Soho Manhattan 3 days/week.

What You’ll Work On:

• Lead and mentor our existing team of data engineers and contractors
• Design and build scalable processes and solutions to our data engineering challenges
• Design and manage large performant data pipelines for ETL and enrichment
• Be a leader and driver of our complete data strategy
• Partner with the Data Team to help drive data quality and governance
• Help us evolve our current data models and systems architecture
• Build and operate reliable data systems that have observability, reconnaissance and automation baked in from the start
• Ensuring that data, whether structured or unstructured, is easily accessible and usable to analysts and engineers for insights and analysis and feature work
• Partner with FinOps and the infrastructure teams to identify and manage cost savings as well as monetization opportunities

Required For the Role:

• BS or MS in Computer Science, related technical field, or equivalent experience
• Hands-on in being able to design, build, test, deploy and maintain real-time and batch processed data systems
• Hands-on experience building pipelines that span from RDBMS to NoSQL databases
• Designed, built and operated streaming data platforms
• Experience owning cloud data warehouse and data lake implementations
• Hands-on experience writing software for pipelines using Airflow, Java, Kotlin, Python, Kafka, SQL
• Deep experience with big data technologies such as BigQuery, Redshift, dbt, Snowflake, Fivetran
• You’ve built and operationalized data systems using via CI/CD pipelines using GitLab, GitHub actions, Terraform, or Jenkins
• You’ve built tools and or enabled automation for your team or others
• 5+ years of experience in a dedicated Data Engineering role with at least 2 years of management experience

Bonus Points for Any of the following:

• Experience running your services on Kubernetes
• Experience with Event Driven System designs and the required messaging technologies and patterns (kafka, nats, aeron)
• Experience with Elasticsearch

**Note:* At this time, we are only considering candidates who are authorized to work in the U.S.*

Location of employment

How to apply?