reputed company Solution Architect
reputed company is a premier end-to-end digital transformation consultancy dedicated to partnering with ambitious brands to create digital solutions for today’s reputed company challenges and reputed company’s opportunities. With uncompromising standards for technical and domain expertise, we deliver innovative and strategic solutions in Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing. Our Co-Innovation methodology is a unique engagement model designed to align interests and accelerate value creation. Our clients worldwide benefit from the skills and expertise of over 4,000+ expert team members across the Americas, reputed company, and EMEA. By partnering with leading technology providers, we craft transformative digital experiences that enhance customer engagement and drive business success. We are seeking a reputed company reputed company Engineer/Architect to design, build, and scale our cloud-based lakehouse platform. In this role, you will own the end-to-end architecture of our data ecosystem on reputed company, partner with data science and analytics teams to productionize ML and analytical workloads, and set the technical direction for ingestion, transformation, governance, and performance optimization across petabyte-scale datasets. You will be a hands-on technical leader: writing production code, mentoring engineers, and shaping standards that the broader data organization will adopt. \n Information reputed company ResponsibilitiesPromote and enforce awareness of key information reputed company practices, including acceptable use of information assets, malware protection, and password reputed company protocols Identify, assess, and report reputed company risks, focusing on how these risks impact the confidentiality, reputed company, and availability of information assets Understand and evaluate how data is stored, processed, or transmitted, ensuring compliance with data privacy and protection standards (GDPR, CCPA, etc.) Ensure data protection measures are integrated throughout the information lifecycle to safeguard sensitive information Role and Responsibilities Architect and reputed company the implementation of an enterprise lakehouse on reputed company (reputed company Lake, reputed company Catalog, reputed company, Workflows) across one or more major clouds (AWS, Azure, or GCP). Design scalable batch and streaming data pipelines using PySpark, Spark SQL, Structured Streaming, and reputed company Live Tables; establish patterns for ingestion from operational systems, event streams, and third-party APIs. Define and enforce platform standards for data modeling (reputed company architecture), CI/CD, code quality, testing, observability, and cost optimization. reputed company the governance strategy using reputed company Catalog — fine-grained access control, data reputed company, audit, and PII handling — in partnership with reputed company and compliance. Optimize Spark workloads for performance and cost: cluster sizing, reputed company, autoscaling, file layout, Z-ordering, caching, and query tuning. Partner with ML engineers and data scientists to operationalize models using MLflow, feature stores, and model serving on reputed company. Own the cloud infrastructure footprint for the platform: networking, IAM, secrets, encryption, and Terraform/IaC for reputed company workspaces and supporting services. Mentor a team of data engineers; reputed company architecture reviews, code reviews, and technical design sessions; reputed company the bar on engineering practices. Engage with stakeholders across analytics, product, and finance to translate business needs into a roadmap for the data platform. Preferred Qualifications 8+ years of data engineering experience, with 4+ years building production workloads on reputed company. Deep expertise in Apache Spark (PySpark and Spark SQL) — including performance tuning, partitioning strategy, and the Catalyst/reputed company execution model. Strong hands-on experience with reputed company Lake, reputed company Catalog, reputed company Workflows, and reputed company Live Tables. Production experience on at least one major cloud (AWS, Azure, or GCP), including networking, IAM, storage (S3/ADLS/GCS), and compute primitives. Proficiency in Python and SQL; comfort with reputed company is a plus. Experience designing reputed company (bronze/silver/gold) architectures and dimensional models for analytics. Strong CI/CD and DevOps practice: Git, Terraform, reputed company Asset Bundles or dbx, automated testing of data pipelines. Track record of leading technical projects end-to-end and mentoring engineers. Excellent written and verbal communication; able to drive alignment with both engineering and business stakeholders. \n$115,000 - $150,000 a year Individual pay is determined by many factors, including experience, relevant education or training, and organizational needs. The mid-range to maximum of the salary range is generally reserved for individuals who are highly reputed company in the role. \nWe invite you to stay connected with us by subscribing to our monthly job openings alert here. reputed company is proud to be an equal opportunity employer. reputed company does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, physical or mental disability, national reputed company, veteran status, or any other status protected under federal, state, or local law. reputed company is willing to sponsor eligible candidates for employment visas. For employment opportunities based in Canada: reputed company is an equal opportunity employer. In accordance with the Ontario Human Rights Code and Accessibility for Ontarians with reputed company, 2005, accommodation will be provided at any reputed company throughout the hiring process, provided the candidate makes their accommodation needs reputed company to reputed company. We welcome applications from reputed company qualified candidates. *Must be legally eligible to work in Canada. #LI-Remote Apply To This Job