Manager, Model Quality Strategic Projects (Business Acceptance Testing) - Contract

Requisition ID: 193478

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

The world is changing faster than ever and so are we!

“Big data”, “AI” and “machine learning” are not just buzz-words; they are part of our daily life. We have decades of data powering hundreds of models deployed across a multitude of systems that are crying out for smart talented team players who are results-oriented, have a broad understanding of best-in-class processes and relish the opportunity to help us turn our vision into reality. Are you ready to join the Winning Team not only building but actively managing the high-performing prediction and forecasting models behind automated risk-management decisions and forecasts that impact millions of customers and keep hundreds of $billions safe every single day?

Model Quality is all about ensuring that everything we build, we build right the first time, and we build them to last. The right candidate for this role is NOT someone who wants to design and build a handful of models each year but rather, is someone willing to take on the challenge of understanding how hundreds of them (spanning a wide range of problem types, employing a myriad of methodologies) work and can, commensurately, design and execute testing plans, and build capabilities to stress, test, and validate those models during pre and post implementation, and ongoing production runs.

This role will be a key member of Scotiabank’s Retail & Small Business Model Operations team responsible for ensuring that every part of the model lifecycle from development to implementation, deployment to management, and tracking to governance unfolds as effectively & efficiently as possible. In Model Operations, we are passionate about arming our stakeholders with the best data & tools possible so that they can build and run the best models possible. We obsess over getting things done quickly and done right, the first time. We leverage a combination of business / technical consulting, collaborative development and verification / testing in our approaches.

We get excited by automation. We love working with people; both internally with our peers (across business strategy, risk & technology) and externally with vendors alike. We make modelling easier and models easier to use.

Getting models to market quickly is important but getting them “right” is even more so. That is where you come in.

What Are We Looking For?

We are seeking someone who embraces the idea of being:

• A key primary contributor (i.e., a thought leader and a doer) who ensures that alladvanced risk prediction and forecasting models, models that need to be not only accurate and precise, but highly stable, explainable, compliant, secure, and useful are implemented and monitored/reported properly

• A subject matter expert , sharing best-in-class testing and acceptance practices to the department to be leveraged across all programs

• A collaborative team player and owner who can prioritize projects and their own time to deliver the optimal balance of high value long-run results while remaining responsive to urgent and ever-shifting stakeholder needs

The ideal candidate for this role will be a consummate team player who is equally comfortable wearing the following hats:

• Manager of Quality Assurance / Control / Testing

• Data Engineer / Testing Automation

• Data Analyst

Make an Impact

In this role, you will lead the testing of data changes, models, and crucial reporting impacting not just our partners but the bank’s quarterly financial filings both with investors and with the regulator.

You will collaborate on a regular basis with a wide range of stakeholders and internal partners including Model Owners (model developers), Technology & Data, and Project Teams.

Is This Role Right for You?

• You are comfortable working with large datasets and have experience in data classification, cleansing, testing and validation. The ideal candidate will have hands-on experience with these tasks.

• You have demonstrated aptitude to design scenario-specific Test Approaches, TestStrategies & Plans, align test cases to requirements and user stories and select theappropriate test tools

• You understand data engineering and modeling concepts to strategize and execute End to End testing cycles (Including data extraction, transformations and conversion)

• You are passionate about ensuring the integrity and quality of data. This role requires meticulous attention to detail and a keen eye for spotting discrepancies in data models.

• You have a strong foundation in data analysis and testing methodologies. We’re looking for someone who can rigorously test and validate data models to ensure they meet our high standards.

• You ensure ongoing compliance with quality and industry regulatory requirements.

• Prepare quality documentation and reports by collecting, analyzing, and summarizing information and trends including failed processes, stability studies, corrective actions, and re-validations.

• You are familiar with automated testing tools and have the ability to create and execute detailed test plans. Proficiency in these areas will be crucial for success.

• You have strong interpersonal skills and are able to interface and effectively influence at all organizational levels.

• You are professional, motivated, AND FUN. We mean it.

What Do You Need to Succeed?

General

• Bachelor’s degree in computer science, Statistics, Mathematics, or a related field

• Experience in, and strong understanding of testing standards and methodology, in QAT / UAT / BAT environments

• Understands and utilizes both quality assurance and quality control best practices and how to apply them to models, data and technology from both a static and dynamic perspective.

• Work with technology partners to ensure seamless integration of models into production systems

• Familiarity with data models, machine learning algorithms, and statistical methods.

• Excellent prioritization and time management skills

Technical

• Strong fundamental understanding of mathematical models, forecasting and statistics

• Strong SQL or Excel skills, with aptitude for learning other analytics tools

• Programming experience (Python, SAS) with both legacy / traditional (RDBMS) and big data (Hadoop / Hive / Spark) systems

• Technical writing experience in relevant areas, including queries, reports, and presentations.

• Working Knowledge of Test Management Tools (Micro Focus ALM , XRAY, Test Rail)

• Experience with continuous Integration tools - Jenkins, Bit bucket, GitHub

What's in it for you?

• The opportunity to join a forward-thinking and collaborative team, surrounded by innovative thinkers

• A rewarding career path with diverse opportunities for professional development

• Internal training to support your growth and enhance your skills

• An inclusive working environment that encourages creativity, curiosity, and celebrates success!

• Work in an Ecosystem; a bright, modern space where you’ll have access to group seating, offices, collaboration spaces, a cafeteria with different options daily, a bistro, and more

• Hybrid Work Environment

Location(s): Canada : Ontario : Toronto

Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, pleaseclick here (https://www.scotiabank.com/careers/en/careers/technical-support-for-applicants.html) . Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.