Model Validation Senior Manager
About the role
Senior Manager role leading the 2LoD Model Oversight for Generative AI at Monzo, driving embedding of the Model Risk Framework for Gen AI, overseeing independent validations of operational models, and promoting best practices in Model Risk Management.
Responsibilities
- Drive the embedding of the Model Risk Framework for Generative AI use cases across Monzo
- Lead collaboration with first line of defence teams to strengthen policies, standards and procedures for Generative AI model design, implementation, governance, monitoring and use
- Own the setting and maintenance of Generative AI validation methods, evidence expectations and reusable technical assets with 1LoD modelling teams
- Convert modelling/validation experience into controlled playbooks, tests and working examples for 2LoD Validation standards across Gen AI models and systems
- Coach Generative AI validation methodologies to 2LoD Model Oversight colleagues to enable consistent application across Financial, Credit and Fincrime/Fraud models
- Perform and oversee independent model validations of new Operational models (primarily Gen AI), and changes to existing ones, with clear validation reports
- Build relationships with first line modelling teams and wider risk teams to embed the model risk framework
- Review ongoing model performance monitoring to ensure models operate within risk thresholds and provide guidance to development teams
- Monitor and measure overall level of Operational model risk and drive action plans to mitigate residual risk
- Support operation of the Model Risk Oversight Committee as a regular attendee and promote a strong risk culture
- Promote and embed easily understandable risk best practices across Monzo
Qualifications
- - Robust Data Science or Machine Learning background with strong Python capability
- - Experience with design of Generative AI evaluation frameworks, architectures, methods, practical tooling and platform alignment
- - Knowledge of Gemini implementations and change assessment
- - Experience of managing a modelling project through its full lifecycle
- - If possible: Coaching and standard setting; Banking MRM and regulatory context
Skills
Benefits
- Full list of benefits available at Monzo careers page

About Monzo Bank
A bank as smart as your phone.
YC has written a good overview of our business on their blog: https://blog.ycombinator.com/monzo-makes-money-work-for-everyone/ Our mission is to make money work for everyone. We are the UK's leading digital bank for individuals and businesses, reinventing the traditional banking industry one customer at a time. We're relentlessly mission driven and always put our customers first - from what products we chose to launch next to our transparency and use of simple language. With a Net Promoter Score of 70+, it shows. From our founding in 2015, we now have over 7 million customers in the UK (13% of UK adults) and are building out our team in the US. We've seen incredible organic growth, acquiring 150,000 customers / month in 2022, with 80% of this coming from word of mouth. Our weekly active user rate is ~60% and ~40% of our active users use us as their Main Bank account, showing that we are a product that is embedded in our users' daily lives. We've grown to ~2,450 staff (~400 of which make up the product/tech team), and are backed by YC, Stripe, Tencent, Mike Moritz, and others. Internally, we encourage an open, collaborative, and inclusive working environment - we were voted the #1 startup where people in the UK want to work for the second year running in 2022. We contribute to open source software, and we continually engage with our wonderful community. We're hiring talented, creative problem-solvers to help us build the bank of the future. Join us!
More open roles at Monzo Bank
- Lead Brand Designer5d agoHybrid (London) · Design
- Sales Account Executive5d agoLondon · Operations
- Senior PR and Communications Manager (12 month fixed-term contract)5d agoHybrid (London / UK remote) · Marketing & Community
- Senior Growth Marketing Executive, Business Banking EU5d agoHybrid (London, UK) · Marketing & Community
- Team Manager, Financial Crime, EU (Spanish Speaking)1w agoHybrid (Remote (UK)), Remote · Customer Operations
