Senior Data Engineer Data Engineer

Palm is building the future of Business Identity. We help small businesses auto-complete government filings with AI, while powering a unified Data Profile that keeps their business identity accurate, verified, and permissioned. With Palm, Members spend less time on paperwork and unlock smarter access to services – from banks to AI agents.
We’re growing fast with 25,000+ businesses on the platform and backing from top-tier VCs like Better Tomorrow Ventures and Grand Ventures.
Come join us at the ground floor – and help make small business data work smarter.

Apply Here

About the Role

We’re looking for a Senior Data Engineer to lead cross-functional initiatives and drive architectural decisions as they architect and scale Palm’s data infrastructure. This role is ideal for someone who has built and maintained production-grade data platforms before, and who thrives on enabling others to ship quickly while solving strategic technical challenges.
This role owns the systems, tooling, and data architecture that will allow the rest of the team to scale our data coverage with speed and quality. You’ll work closely with engineering, product, and ops to make Palm’s data platform robust, extensible, and easy to contribute to.

What You’ll Do

• Design and implement scalable, modular data pipelines to support multi-state expansion, partner integrations and integration of multiple data sources
• Build infrastructure others can use: define best practices and set technical standards for ingestion, transformation, validation, and testing
• Identify technical bottlenecks and resourcing gaps, propose scalable solutions or team structure adjustments, and contribute to the technical roadmap while mentoring others to improve team capacity
• Own data observability, integrity, and monitoring best practices
• Collaborate across teams to make data accessible via APIs and internal tools
• Maintain alignment with long-term product goals while accelerating data coverage efforts

Apply here: https://app.dover.com/apply/Palm/de44bb27-1aba-4691-acee-144328398302?rs=40116684

About You

• 5+ years of professional data engineering experience, with proven success designing, implementing, and maintaining scalable, cloud-based data platforms.
• Expert in building high-performance ETL pipelines using Apache Spark (Scala or PySpark), Python, and SQL, with deep experience running workloads on AWS (e.g., S3, Athena, Glue, EMR, AWS Batch).
• Strong background in data modeling, designing APIs for data access, and implementing robust monitoring/alerting strategies for production data pipelines.
• Able to mentor other engineers, create clear technical documentation, and champion best practices for maintainable, reusable code.
• Excellent communication skills — thrives in asynchronous, distributed teams and aligns engineering decisions with company-level objectives.
• Bonus: experience with RPA and AI-driven data processing, familiarity with business compliance data, document parsing, or public records integration.

Why Palm

• Own core infrastructure in a fast-growing AI-first startup
• Tackle real, strategic data problems in the SMB compliance space
• Work on systems that power automation for thousands of businesses
• Join a team that values velocity, ownership, and thoughtful engineering