Databricks Architect Senior
Description
We are looking for a highly skilled and experienced Senior Databricks Architect with deep expertise in Data Lakehouse architecture, data platform engineering, and hands-on Azure Databricks development. In this role, you will lead the transformation and optimization of our client’s data platform environment, driving technical excellence across the organization. Your primary responsibility will be to guide the migration of the current data platform to Databricks Lakeflow pipelines, while continuously enhancing and extending the platform to align with evolving business needs and industry best practices. You will work within a hybrid Agile DevOps model, partnering closely with cross-functional teams to design, build, and deliver robust, scalable, enterprise-grade data solutions.
office remoteEuropean UnionPoland
Requirements
- Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related discipline
- 5+ years of experience in data architecture and data modeling, with a strong focus on Data Lakehouse and big data technologies
- Advanced hands-on experience with Azure Databricks, including Lakeflow Pipelines, Unity Catalog, Asset Bundles, and Databricks Compute Configuration
- Experience working with modern cloud storage platforms—preferably Azure Data Lake, with additional familiarity in GCP Storage, AWS S3, or similar systems
- Solid understanding of ELT concepts and demonstrated experience in designing and building scalable data pipelines
- Good understanding of Azure Data Factory (ADF)
- Strong programming skills in PySpark and SQL
- Strong proficiency with data modeling tools (e.g., Erwin, Mega Hopex, or equivalent) and methodologies such as dimensional modeling and normalization
- Experience working with both relational and NoSQL database technologies
- Excellent analytical and problem-solving skills, with strong attention to detail
- Effective communication skills, with the ability to translate complex technical concepts for both technical and non-technical stakeholders
- Upper-intermediate English proficiency or higher
Nice to have
- Hands-on experience with Azure Databricks, preferably including the migration of complex data solutions
- Practical experience working with Databricks Lakeflow, including object types, pipeline design, orchestration, and optimization
- Databricks Certified Data Engineer (Associate or Professional)
- Experience working with cloud-based data platforms, preferably Azure
- Familiarity with data visualization and reporting tools such as Tableau or Power BI
- Experience implementing CI/CD practices and working with Databricks Asset Bundles
Responsibilities
- Design and develop a 3NF data models (Silver/ODS layer) leveraging the Lakehouse architecture on Azure Databricks, built using the Medallion design pattern, ensuring alignment with business requirements and analytical objectives
- Lead the migration of existing data pipelines to Databricks Lakeflow Declarative Pipelines (formerly DLT), establishing scalable and maintainable patterns for modernization
- Define and establish migration frameworks and repeatable patterns to accelerate and standardize pipeline conversion across teams
- Collaborate closely with business and technical stakeholders, including data engineers, analysts, and architects
- Implement and enforce best practices for data governance, data quality, metadata management, and data lifecycle management within the Lakehouse environment
- Optimize data models for performance and scalability, enabling efficient data retrieval, reporting, and analytical workloads
- Conduct data profiling and analysis to understand source system structures, data quality issues, and interdependencies
- Develop and maintain documentation including data models, data flows, data dictionaries, and architectural diagrams
- Support data ingestion, integration, and broader system architecture, ensuring that solutions follow enterprise standards and best practices
- Identify and drive opportunities for platform optimization, automation, performance tuning, and technical debt reduction
We offer
- Projects for such clients as PayPal, Wargaming, Xerox, Philips, Adidas and Toyota
- Competitive compensation that depends on your qualification and skills
- Career development system with clear skill qualifications
- Flexible working hours aligned to your schedule
- Options to work remotely
- Corporate medical insurance covering services of private and public medical centers
- English courses online
- Corporate parties and events for employees and their children
- Internal conferences, workshops and meetups for learning and experience sharing
- Gym membership compensation
- 5 days of paid sick leave per year with no obligation to submit a sick-leave certificate
Any questions?
Natalya
hh@itransition.comApply for
Apply for
Databricks Architect Senior
Apply by filling in the form beside or sending your CV to hh@itransition.com