Senior Data Engineer (m/w)
PROBIS is a fast-growing PropTech startup from Munich that is currently redefining financial controlling for real estate projects worldwide with its cloud-based platform - from high-rises in New York to megaprojects in Saudi Arabia. Our software is technically sophisticated, complex in terms of content - and yet should be easy and intuitive for our users to operate.
Now, in the most exciting phase of our growth, we are looking for you as our Senior Data Engineer.
The Senior Data Engineer is responsible for designing, implementing, and maintaining enterprise-scale data architecture solutions. This role designs and develops a greenfield data lakehouse system, including data ingestion pipelines, storage optimization, and high-performance query APIs. The position requires hands-on technical implementation combined with strategic architectural design skills and English speaking individual.
Data Architecture Design
- Understand PROBIS data model, identify bottlenecks and translate into
- actionable designs
- Design a modern data lakehouse architecture for greenfield implementation
- Architect scalable data storage and processing solutions using Azure
- ecosystem and applicable open source components
- Design the best stack for the job, considering data sovereignty and storage
- requirements in target markets
- Implement data ingestion pipelines from existing postgres database systems
- and integrations
- Improve the .net based data access of existing postgres system
- Build and verify high-performance query APIs on top of the greenfield design, enabling orders of magnitude growth in data volume, with improved performance
- Develop and optimize data transformation processes
- Set up monitoring and observability for reliable live operation
- Integrate the data lakehouse with existing enterprise systems
- Design and implement performant query engines for user interfaces
- Ensure data consistency and quality across integrated systems
- Execute performance and consistency testing under increased loads
- Collect evidence and document the architecture
- Ensure compliance and support necessary certification processes
- Minimum 6 years of experience in data engineering
- Minimum 4 years of hands-on experience with Microsoft Azure data services
- Proven track record of shipping performant data projects on Azure / Postgres / Data Factory / Databricks
- Expert proficiency in Microsoft Azure data platform (Synapse, Data Factory, SQL Databases, Data Lake)
- Good .NET Core development skills
- Strong SQL and database (psql) optimization capabilities
- Experience with data modeling techniques and methodologies
- Ideally, experience with sovereign data solutions including Spark based data warehousing
- Knowledge of ETL/ELT processes and data pipeline design
- Opportunity to work with cutting-edge AI, cloud technologies and tools
- Full access to our comprehensive toolset
- Flexible remote work options with home office capability
- International, team-oriented atmosphere with flat hierarchies
- Culture of open feedback and quick decision-making processes
- Regular team and company events
- Opportunity to shape the technical direction of a growing PropTech company
- Highly professional and high-skilled Senior Developers