[Remote] Senior Data Engineer
Note: The job is a remote job and is open to candidates in USA. Trulieve is one of the fastest growing companies in the nation, focused on providing patients with trusted products to alleviate various medical conditions. They are seeking a Senior Data Engineer who will design and implement data architectures, lead the development of data pipelines, and ensure data security and compliance standards are met.
Responsibilities
- Design and Implement Snowflake-Native Data Architectures
- Lead the creation and optimization of modern data architectures on Snowflake, including multi-layer pipelines (bronze/silver/gold), real-time streaming ingestion, and governed analytics layers
- Ensure that the architecture supports high-volume data workloads, near-real-time freshness requirements, and integrates seamlessly with upstream operational systems and downstream analytics consumers
- Lead the Development of Complex, End-to-End Data Pipelines Using Native Snowflake Services
- Architect and build data pipelines using Dynamic Tables for declarative SQL-based transformations with automated dependency management and incremental refresh
- Implement real-time and near-real-time ingestion using Snowpipe and Snowpipe Streaming
- Design event-driven and procedural pipeline logic using Streams and Tasks for complex orchestration scenarios (MERGE, SCD patterns, external function calls)
- Leverage Snowpark (Python) for advanced transformations that require procedural logic beyond SQL
- Collaborate with Data Scientists, Analysts, and Other Stakeholders
- Work closely with analytics and data science teams to understand data requirements and translate them into scalable, performant Snowflake solutions
- Build and maintain Semantic Views and governed consumption layers that provide self-service access to curated data
- Provide technical guidance on Snowflake best practices for data usage, cost optimization, and warehouse sizing
- Ensure Data Security, Governance, and Compliance Standards Are Met
- Implement and manage Snowflake data governance features including Dynamic Data Masking, Row Access Policies, Object Tagging, and Data Classification
- Establish and maintain data governance frameworks ensuring data quality and compliance with relevant regulations (SOX, GDPR, HIPAA)
- Manage role-based access control (RBAC), data sharing, and cross-account governance using Snowflake's native security model
- Lead the Technical Design of New Projects
- Responsible for making critical decisions regarding Snowflake architecture patterns, product direction, and delivery tradeoffs, including when to use Dynamic Tables, Streams/Tasks, Materialized Views, and external orchestration based on business requirements and user needs
- Develop and enforce best practices for pipeline development, testing, deployment, and monitoring within the team
- Design and document data contracts and SLAs for pipeline freshness (TARGET_LAG), data quality, and availability
- Mentor and Develop Junior Engineers
- Provide technical leadership and mentorship to junior and mid-level engineers, fostering a culture of continuous learning and improvement
- Lead code reviews, pair programming sessions, and technical workshops focused on Snowflake-native development patterns and engineering best practices
- Create reusable patterns, templates, and documentation for common pipeline scenarios (CDC ingestion, SCD management, real-time aggregations)
- Operate as a Product Minded Data Engineering Leader
- Partner with business stakeholders, analytics teams, and engineering leaders to shape the roadmap for data products and platform capabilities based on business value, user needs, and operational priorities
- Translate ambiguous business problems into clearly defined product requirements, success metrics, delivery plans, and prioritized engineering work
- Own the lifecycle of key data products and shared platform services, including intake, prioritization, stakeholder alignment, adoption, and continuous improvement
- Continuously Evaluate and Improve Existing Systems
- Regularly review current data systems to identify opportunities for migration to modern patterns (for example, migrating legacy Streams/Tasks to Dynamic Tables where appropriate)
- Monitor pipeline health, refresh performance, and cost efficiency using Snowflake's INFORMATION_SCHEMA, ACCOUNT_USAGE, and alerting capabilities
- Implement optimizations including incremental refresh tuning, warehouse right-sizing, and query performance improvements
Skills
- Design and Implement Snowflake-Native Data Architectures
- Lead the Development of Complex, End-to-End Data Pipelines Using Native Snowflake Services
- Collaborate with Data Scientists, Analysts, and Other Stakeholders
- Ensure Data Security, Governance, and Compliance Standards Are Met
- Deep Understanding of Data Engineering Concepts
- Expertise in Snowflake Platform and Native Data Pipeline Services
- Proficiency in SQL, Python, and Data Engineering Frameworks
- Experience with Real-Time Data Processing and Streaming Architectures
- Strong Knowledge of Cloud Infrastructure and Cost Optimization
- Lead the Technical Design of New Projects
- Mentor and Develop Junior Engineers
- Operate as a Product Minded Data Engineering Leader
- Continuously Evaluate and Improve Existing Systems
- Substantial Professional Experience in Data Engineering
- Typically requires 7+ years of experience in data engineering or related fields
- Proven track record of designing and implementing large-scale data solutions on Snowflake or similar cloud data platforms
- 2+ years of hands-on experience with Snowflake-native pipeline services (Dynamic Tables, Streams/Tasks, Snowpipe)
- SnowPro Advanced: Data Engineer, SnowPro Core, or AWS/Azure/GCP data engineering certifications
- Continuous learning through relevant certifications and training to stay current with Snowflake platform releases and modern data engineering practices
- Familiarity with Snowflake's release cycle and ability to evaluate new features (for example, Cortex AI, Document AI, Iceberg Tables) for team adoption
Benefits
- A comprehensive benefits package including paid time off
Company Overview