Lead Data Engineer – Big Data & Cloud Data Warehousing Specialist for Engagement Analytics

Join arenaflex: Power the Future of Streaming Intelligence

Are you ready to transform raw data into powerful business insights at one of the most iconic entertainment companies in the world? arenaflex is seeking an exceptional Lead Data Engineer to join our Information and Investigation group within our Streaming Services division (DSS). This role sits at the heart of our global digital entertainment ecosystem, powering decisions that shape how hundreds of millions of subscribers discover content, how advertisers measure campaign effectiveness, and how content partners optimize their strategies across emerging markets.

At arenaflex, data is not just a byproduct — it is the foundation upon which every strategic decision is built. From product design to pricing models, from personalization algorithms to subscriber retention strategies, the work you do will directly influence the experiences of millions of viewers worldwide. Our Engagement and Retention Data Engineering team is looking for a highly motivated, technically brilliant Data Engineer who is passionate about diving deep into Big Data ecosystems and developing cutting-edge data solutions that drive meaningful business outcomes.

About arenaflex and the Streaming Intelligence Division

arenaflex stands as a global leader in digital entertainment, connecting audiences with the stories and experiences they love. Our technology organization, known for innovation and engineering excellence, supports a portfolio of streaming platforms that serve diverse audiences across continents. Within this ecosystem, our Information and Investigation group serves as the analytical nerve center — collecting, processing, modeling, and delivering the data that fuels product innovation, business growth, and operational excellence.

The Engagement and Retention Data Engineering team is responsible for building the data infrastructure that powers our most critical analytical capabilities. We architect the data products and warehouses that enable our data scientists, analysts, and business stakeholders to uncover deep insights about viewer behavior, content performance, and market dynamics. If you thrive at the intersection of large-scale data engineering, cloud architecture, and business impact, this is the role you have been waiting for.

What You'll Do: Key Responsibilities

• Architect and Develop Data Products and Data Warehouses: Contribute to the design, development, and continuous improvement of our data products and enterprise data warehouses focused on Engagement and Retention Analytics and Data Science initiatives. You will own significant components of our data platform and drive technical excellence across the stack.
• Build Scalable ETL Pipelines: Design, develop, and maintain highly scalable data warehousing solutions, building robust ETL pipelines in Big Data environments spanning cloud, on-premises, and hybrid architectures. Your pipelines will process petabytes of data reliably and efficiently.
• Work with Modern Tech Stack: Leverage our cutting-edge technology stack, which includes Hadoop, AWS, Snowflake, Spark, and Airflow. Write production-grade code in Python and Scala to build data solutions that meet the highest standards of quality and performance.
• Engineer Data Solutions and Define Models: Help architect comprehensive data solutions and frameworks, defining logical and physical data models for the enterprise data warehouse and downstream data marts. Ensure data structures support both operational reporting and advanced analytics use cases.
• Cross-Functional Collaboration: Partner closely with Data Product Managers, Data Modelers, and Data Architects to design, implement, and deliver successful data solutions. Translate complex business requirements into elegant technical architectures.
• Documentation and Data Governance: Maintain meticulous documentation of your work, including design decisions, data lineage, schema changes, and operational runbooks. Champion data quality and data governance practices that safeguard the integrity of our analytical assets.
• Operational Excellence: Ensure high operational efficiency and quality of your solutions to consistently meet Service Level Agreements (SLAs) and uphold our commitments to internal customers including Data Science teams, Data Analysts, and business stakeholders.
• Agile Methodology Leadership: Be an active participant and contributor to our agile/Scrum practices, championing engineering health, process improvements, and continuous delivery excellence within your team.

Essential Qualifications and Required Skills

• Educational Background: A Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field from an accredited institution.
• Advanced SQL Expertise: Strong SQL skills with the demonstrated ability to craft complex queries to extract, manipulate, and transform data while building highly performant datasets that scale to billions of rows.
• Distributed Systems Experience: Hands-on experience with distributed computing systems such as Apache Spark, Hadoop (including HDFS, Hive, Presto, and PySpark) to efficiently query and process massive datasets in parallel.
• Programming Proficiency: Strong programming skills in Python, Java, or Scala, with the ability to write clean, maintainable, production-quality code that handles edge cases and operational concerns.
• Cloud and MPP Database Knowledge: Working experience with at least one major Massively Parallel Processing (MPP) or cloud-native database technology such as Snowflake, Amazon Redshift, or Google BigQuery.
• Data Integration Expertise: Solid hands-on experience with modern data integration toolsets such as Apache Airflow, including composing, scheduling, and maintaining complex data pipelines that orchestrate multi-stage workflows.
• Data Modeling and Warehousing Mastery: Strong foundational knowledge of data modeling techniques (dimensional, normalized, Data Vault) and data warehousing best practices, patterns, and standard methodologies.
• Agile Familiarity: Comfortable working within Scrum and other Agile methodologies, with an understanding of ceremonies, artifacts, and the principles that drive iterative delivery.
• Problem-Solving Mindset: You are a natural problem solver with strong attention to detail, excellent analytical capabilities, and outstanding communication skills that enable you to translate technical concepts for diverse audiences.

Preferred Qualifications and Nice-to-Have Skills

• Cloud Platform Experience: Hands-on experience with major cloud platforms, particularly AWS services such as S3, EMR (Elastic MapReduce), EC2, Glue, and Lambda for building cloud-native data solutions.
• Streaming Technologies: Familiarity with real-time data streaming platforms such as Apache Kafka, Amazon Kinesis, or Apache Flink for processing event-driven data pipelines.
• Data Quality and Observability: Experience with data quality frameworks, data observability tools, and metadata management platforms that ensure trust in analytical outputs.
• DevOps and CI/CD: Understanding of infrastructure-as-code tools (Terraform, CloudFormation), containerization (Docker, Kubernetes), and CI/CD pipelines for data engineering workflows.
• Industry Experience: Prior experience in media, entertainment, subscription-based services, or digital advertising industries is a strong plus.

Skills and Competencies for Success

Beyond technical expertise, the ideal candidate will demonstrate a relentless curiosity about data and its potential to transform business outcomes. You should possess excellent written and verbal communication skills, enabling you to document complex systems clearly and present technical concepts to non-technical stakeholders. A collaborative mindset is essential — you will work closely with data scientists, analysts, product managers, and engineers across multiple teams. You should be self-directed, capable of managing competing priorities, and passionate about mentoring junior engineers and elevating the technical capabilities of the broader team.

Compensation, Perks, and Benefits

arenaflex is proud to offer a compensation package that reflects the value of the talent we seek. This position offers a competitive hourly rate of $24/hour for full-time employment, with standard working hours of 8 hours per day. Beyond base compensation, our team members enjoy a comprehensive benefits package that typically includes:

• Comprehensive medical, dental, and vision insurance coverage
• 401(k) retirement savings plan with company matching contributions
• Generous paid time off, including vacation days, sick leave, and company holidays
• Access to learning and development programs, conference budgets, and certification reimbursement
• Employee discounts on streaming services, theme parks, and entertainment offerings
• Wellness programs, mental health resources, and fitness subsidies
• Parental leave and family planning support
• Flexible work arrangements and remote work opportunities where applicable

Compensation specifics may vary based on experience, qualifications, and location. This role is based in San Francisco, USA, where you will be part of a vibrant technology community working on some of the most exciting challenges in streaming entertainment.

Career Growth and Learning Opportunities

At arenaflex, we believe in investing deeply in our people. As a Lead Data Engineer, you will have unparalleled opportunities to grow your technical depth and leadership capabilities. You will work alongside world-class engineers and data scientists, tackle problems at unprecedented scale, and contribute to systems that process data for hundreds of millions of users. We provide dedicated budgets for professional development, support for attending industry conferences, sponsorship for relevant certifications, and clear pathways to senior engineering, architecture, and management roles. Whether you aspire to become a Principal Engineer, a Data Architect, or an Engineering Manager, arenaflex will support your journey.

Our Culture and Work Environment

arenaflex fosters a culture of innovation, inclusion, and excellence. We believe that the best ideas can come from anywhere, and we empower every team member to voice their perspective, challenge assumptions, and contribute to our collective success. Our engineering teams embrace modern agile practices, value work-life balance, and celebrate diversity in all its forms. You will find a workplace where collaboration is the default, where mentorship flows in all directions, and where your contributions are recognized and rewarded. We are committed to building a diverse and inclusive workforce that reflects the global audiences we serve.

Your Next Step: Apply Today

If you are a passionate data engineer with a love for big data, cloud architectures, and building systems that drive real business impact, arenaflex wants to hear from you. This is more than a job — it is an opportunity to shape the future of streaming entertainment analytics, to work with some of the brightest minds in the industry, and to build a career that combines technical excellence with meaningful impact. Bring your curiosity, your craftsmanship, and your collaborative spirit to arenaflex, and let us build the data platform that powers the next generation of entertainment experiences. We cannot wait to welcome you to our team.

Location: San Francisco, USA | Employment Type: Full-Time | Industry: Private Sector, Digital Entertainment and Streaming Technology