2016 Refugee Claim Data and IRB Member Recognition Rates | Canadian Council for Refugees

This is really an impressive analysis  suggesting (no surprise) that individual decision-makers are not as objective and consistent as desired (as Kahneman and others have demonstrated in different contexts). All Canadian government tribunals should conduct this kind of analysis to improve consistency in decision making:

The following note and the accompanying data are provided by Sean Rehaag, Associate Professor, Osgoode Hall Law School.

8 March 2017

Data obtained from the Immigration and Refugee Board (IRB) through an Access to Information Request reveals vast disparities in refugee claim recognition rates across decision-makers in 2016. This is consistent with similar findings from prior years for Canada’s previous and new refugee determination systems.

Refugee claims referred to the IRB after 15 December 2012 are subject to the new system, whereas claims referred to the IRB prior to that date are legacy cases that are decided under the old system. Legacy and new system cases are not only decided under different rules, but are also decided by different cohorts of decision-makers. Because of these important differences, the data on RPD decision-making for 2016 is separated into legacy cases and new system cases.

In 2016, some Refugee Protection Division (RPD) decision-makers granted refugee status in most of the cases they heard, including R. Tiwari (95.9%, 74 new system cases), I. Singh (92.5%, 53 new system cases) and K. Genjaga (91.8%, 85 new system cases). Others granted refugee protection much less frequently, including B. Lloyd (23.8%, 63 new system cases), R. Gibson (26.0%, 77 new system cases) and M. Beatty (29.8%, 57 new system cases).

Some of the recognition rate variation may be due to specialization in particular types of cases. For example, some decision-makers specialize in geographic regions with especially high or low refugee claim recognition rates. For further possible explanations for variations in recognition rates, please see an IRB explanatory note, which was provided with a response to an earlier Access to Information Request: http://ccrweb.ca/files/7.irb_explanatory_note-2012.pdf

Although some of the recognition rate variation can be explained by factors related to specialization, the tables below suggest that country of origin specialization alone fails to fully account for the variations. The tables show substantial variance for some decision-makers between the recognition rates that would be predicted based on the average recognition rates for the countries of origins in the cases they decided, and their actual recognition rates. For instance, in new system cases B. Lloyd (predicted 57.4%; actual 23.8%), R. Gibson (predicted 53.9%; actual 26.0%) and J. Daubney (predicted 59.7%; actual 32.3%) had much lower recognition rates than predicted, whereas R. Tiwari (predicted 62.6%, actual 95.9%), J. Eberhard (predicted 56.5%; actual 87.4%) and J. Bousfield (predicted 63.6%; actual: 89.3%) had much higher recognition rates than predicted.

This year’s data also includes information about outcomes on appeals at the IRB’s Refugee Appeal Division (RAD). As with RPD decision-making, outcomes at the RAD appear to vary greatly depending on who serves as the decision-maker. For example, in RAD cases decided on the merits, claimants were much more likely to succeed in their appeals before S.S. Kular (56.5%, 46 cases), R. Dhir (50.5%, 32 cases) or L.F. Agostinho (46.6%, 58 cases) than before L. Favreau (5.3%, 94 cases), Stephen Gallagher (17.1%, 35 cases) or D.E. Sokolyk (20.6%, 63 cases). Remarkably, claimants were more than 10 times as likely to succeed on appeals with S.S. Kular than with L. Favreau.

A few implications of this year’s data are worth highlighting:

  • Some countries that are designated as “safe” in Canada’s refugee determination system produced many positive refugee determinations in 2016. Consider for example, Hungary, which had a 66.9% recognition rate, and which produced 184 successful refugee decisions (involving 529 individual claimants) in the new system in 2016. It is difficult to understand how such countries can reasonably be designated as “safe” or what could justify limitations on procedural rights (e.g. expedited processes, limitations on pre-removal risk assessments) that come with such designations. For further analysis, see: http://ssrn.com/abstract=2588058
  • The persistence of unexplained variations in recognition rates across adjudicators in the new refugee determination system, combined with the devastating potential impact of false negative refugee decisions (i.e. refugees being returned to face persecution), make robust oversight mechanisms essential. Unfortunately, many refugee claimants continue to be denied access to the appeal at the Immigration and Refugee Board and are ineligible for automatic stays on removal pending judicial review at the Federal Court. This includes large numbers of claimants who transited to Canada via the United States – even though one’s route to Canada has little to do with whether one has a well-founded fear of persecution. For further analysis, see: http://ssrn.com/abstract=2647638
  • While substantial variation in recognition rates persist, it should be noted that no new system decision-makers in 2016 who made 20 or more decisions denied every single claim they heard. This is in contrast to the old refugee determination system (S. Roy in 2013: 0.0%, 23 decisions; D. McSweeney in 2011: 0.0%, 127 decisions; D. McBean in 2010: 0.0%, 62 decisions; D. McBean in 2009: 0.0%, 72 decisions). It is worth considering whether this change relates to the professionalization of refugee decision-making and the shift to civil servant decision-makers (rather than political appointees as was the case under the old system).
  • The overall success rates on RAD appeals are remarkably high. Indeed, appeals brought by claimants and decided on the merits were granted in almost one third of cases (33.1%). On the one hand, the fact that the RAD is correcting large numbers of claims that were wrongly denied at the RPD emphasizes the importance of this form of oversight. On the other hand, however, it also suggests that there is room for improvement in initial decision-making at the RPD.

For a discussion of the methodology used to obtain the data and to calculate the statistics, as well as an analysis of the implications of similar data for a previous year, see Sean Rehaag, “Troubling Patterns in Canadian Refugee Adjudication” (2008) 39 Ottawa Law Review 335. This article is available via links here: http://ssrn.com/author=404046

Source: 2016 Refugee Claim Data and IRB Member Recognition Rates | Canadian Council for Refugees

Advertisements

About Andrew
Andrew blogs and tweets public policy issues, particularly the relationship between the political and bureaucratic levels, citizenship and multiculturalism. His latest book, Policy Arrogance or Innocent Bias, recounts his experience as a senior public servant in this area.

One Response to 2016 Refugee Claim Data and IRB Member Recognition Rates | Canadian Council for Refugees

  1. Pingback: Liberals accused of ‘housecleaning’ of Tory appointees at refugee board | Multicultural Meanderings

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: