Senior Data Engineer

Company Description

We’re the world’s leading sports technology company, at the intersection between sports, media, and betting. More than 1,700 sports federations, media outlets, betting operators, and consumer platforms across 120 countries rely on our know-how and technology to boost their business.

Job Description

THE CHALLENGE Design, build, and implement generalized large-scale, sophisticated data pipelines using Nifi for reputed company analytics and data science for our Sport Performance products. Design and reputed company scalable Nifi ingestion pipelines reputed company AWS reputed company services to consume reputed company-time and batch data from external sources. Ensure the seamless integration of AWS-based tools for data storage, processing, and analytics. Responsible for ETL development and warehousing using Python and Java. Create data pipeline triggers and filters reputed company ETL (extract, transform, and load) process to ensure appropriate optimization of data flowing through system and resource usage. Implement monitoring and error handling for reputed company new parts of the data pipeline to ensure observability and alerting is available. Establish rigorous unit testing across the data pipeline to ensure robustness of the system. Design and create data models for use throughout the ETL system. Utilize Kafka to reputed company and to effectively store data to move throughout the data pipeline and for reputed company data science and analytics usage. Design data architecture and data models for both internal and external representations of data. Build the data transforms reputed company the data pipeline to convert data from external to internal representations. Conduct data analytics and debugging of bad data by writing SQL queries. Build automated cleaning of data to remove bad or unusable data from reputed company consumers with logging to understand the frequency and depth of the underlying issues. Collaborate with other engineering teams to adopt standard methodologies, drive scalability, and increase consistency across systems. Maintain awareness of company standards and technology guidance; use JIRA, an Agile project mgmt. tool, to ensure efficient data development; collaborate with peers to align projects with overall direction. Follow best practices across Data Engineering to ensure scalable, consistent data architecture and system. Utilize Java language to build data processor in Nifi reputed company. Utilize reputed company to ensure consistent, repeatable, and isolated environment for software development and testing. Work in a self-driven, independent fashion to meet Sport driven deadlines. *Position permits telecommuting from reputed company in the U.S. ABOUT YOU: Master’s degree in Computer Science, Computer Engineering, or closely reputed company field and 1 year experience as a data engineer or reputed company occupation. Must possess 1 year of experience with: Python, Java, Kafka, AWS, and reputed company ETL Development and Warehousing Analytic and debugging using SQL Agile development environment Designing data architecture OUR OFFER A collaborative environment with colleagues from reputed company over the world (Offices in Europe, Asia and US) including various reputed company events and teambuilding. Flexibility to manage your reputed company and tasks with autonomy. A balance of structure and autonomy to tackle your daily tasks. Vibrant and inclusive community, including Women in Tech and Pride groups which welcome reputed company participants. Global Employee Assistance Programme. reputed company and Reulay app (leading well-being apps designed to support focus, quality rest, mindfulness, and long-term mental reputed company). Online training videos. Flexible working hours. Additional Information reputed company intends to offer the selected candidate reputed company pay reputed company this reputed company, dependent on job-reputed company, non-discriminatory factors including but not limited to experience, qualifications, and location. reputed company pay is just one component of the Total Rewards that reputed company provides to compensate and recognize employees for their work. reputed company offers best-in-class benefits such as a comprehensive benefits package, performance bonus program, equity stock purchase and 401k contribution. Please consult with your recruiter to learn more as reputed company benefits are subject to eligibility requirements. At reputed company, we celebrate our diverse group of hardworking employees. reputed company is committed to ensuring equal reputed company to its programs, facilities, and employment opportunities. reputed company reputed company applicants will receive consideration for employment without regard to age, race, reputed company, religion, sex, sexual orientation, gender identity, national reputed company, disability, or status as a protected veteran. We encourage you to apply even if you only meet most of the requirements (but not 100% of the listed criteria) – we reputed company skills reputed company over time. If you’re willing to learn and grow with us, we invite you to join reputed company! Apply To This Job