Senior Azure Databricks Engineer

Our Story

The world is changing rapidly, and so is the role of a bank. We are committed to a sustainable, stable and secure financial system. Detecting financial crime is therefore on top of our agenda.

Within the Detecting Financial Crime (DFC) department, we have brought together all activities to fight money laundering, terrorist financing and corruption. By combining knowledge, expertise and strengths, we are better able to bring down financial crime while implementing new developments. We benefit from advancing technology to improve our investigative work, but at the same time, this same technology makes organized crime increasingly sophisticated. Detecting financial crime is therefore an ongoing process that demands our utmost attention day in, day out.

We are looking for a Senior Data Engineer within our Data Enabling team. Are you able to ingest and transform all relevant data of our bank and subsidiaries into usable data for our DFC employees and applications to detect financial crime? Then please continue to read!

Your job

As a Senior Data Engineer you work within one of the IT teams of DFC, namely the CAAP Data Enabling team (CAAP DE team). CAAP stands for CDD (Customer Due Diligence) Advanced Analytics Platform and is the domain datastore for DFC. This platform runs on Microsoft Azure Cloud and offers DFC employees and applications all the data that is necessary to detect financial crime, in combination with highly advanced (data) analytic solutions. The CAAP Data Enabling team is responsible for the ingestion and transformation of all relevant data of our bank and subsidiaries for this purpose. 

Your responsibilities are the following:

• Stakeholder requirements gathering and documentation of design decisions.
• Designing data model transformations  by applying Kimball, Data Vault or 3NF modelling techniques.
• Developing and maintaining data model transformations using Azure Databricks PySpark and SQL.
• Developing and enhancing Data Factory pipelines and Dataflow ETL code.
• Refactoring existing SQL code in different solutions into a single version of the truth.
• Ability to thoroughly analyse and test data and report findings in order to validate transformations.
• Improving metadata driven data loading and transformation processes.
• Monitoring and ensuring stability of the environment.
• Maintaining and improving the CICD pipelines and DevOps way of working .
• Cost optimization on Azure and data usage.
• Proactively training and coaching less experienced colleagues in and outside the team.

Your work environment

Working within DFC means working in a department that is in full development and has grown strongly in the past year. In addition to your daily work, we consider your (personal) development, vitality, inspiration, pleasure and involvement as equally important. We believe this encourages our employees to motivate and set an example for their colleagues. 

Our team consists of members of different ages, from different countries and from different backgrounds. The working language is generally English. Our way of working is agile / scrum. We are a full-fledged DevOps team, meaning that we take full responsibility for every step in the development and maintenance process of our IT systems, from requirements management to software maintenance. This implies that we strive to automate our processes as much as possible and to constantly look for opportunities to improve our systems and work, while we have fun.  We work from the office in Amsterdam and from home.

Who are we looking for? We need team players who are responsible, hardworking, structured, socially involved, honest and curious. Who want to do the right thing for customers, the society and the bank.

As an organization and team, we will fully support you in your further development. A curriculum specifically tailored to this position and your ambitions is available. We take the time and have the patience to help you with anything you want to learn. We are also very curious about what you can teach us. Knowledge sharing is key in our team!

Your profile

You are intrinsically motivated to stay on top of developments in the field. You are good at conveying your expertise to others, sharing information with team members and working together to come up with solutions to complex problems. You get enthusiastic from creative and innovative solutions. You are not afraid to voice your opinion and getting things done is a motto you live by. Furthermore, you constantly look to push the boundaries of new possibilities. What are we looking for:

Your really need to have:

• 5 years of working experience with Azure Databricks and preferably PySpark
• 10 years of working experience as data engineer ETL 
• 5 years of working experience with data quality, data governance and data lineage
• experience in requirement analysis, prototyping and designing based on stakeholder requirements.

It would be nice if you also have: 

• Experience with Azure Data Factory and Data Lake.
• Experience with large data platforms and parallel processing technologies.

You recognize yourself in the following soft skills: 

• Creative and problem-solving mind to design effective data models.
• Good interpersonal communication skills: presenting solutions, coaching and training of team members.
• Ability to quickly grasp the banking domain model concepts and business rules.

Interested?

If you find this vacancy interesting and it fits your expectations and qualifications, you can apply online. If you have any questions, please contact Jacques.van.den.Belt@nl.abnamro.com (Cluster Lead) or Drilon.Ferati@nl.abnamro.com (Engineering Lead).

Equal opportunities for all

The success of our organisation depends on the quality of our people and the ideas that they have. Truly surprising insights and innovative solutions for our clients result from an interplay of cultures, knowledge and experience. Diversity is therefore extremely important to our organisation. To ensure that everyone at ABN AMRO can develop their talents, we encourage an inclusive culture in which all colleagues feel engaged and appreciated.

Disclaimer external recruitment agencies

The success of our organisation depends on the quality of our people and the ideas that they have. Truly surprising insights and innovative solutions for our clients result from an interplay of cultures, knowledge and experience. Diversity is therefore extremely important to our organisation. To ensure that everyone at ABN AMRO can develop their talents, we encourage an inclusive culture in which all colleagues feel engaged and appreciated.