Institutional review board

This article is about research ethical oversight in the United States. For a worldwide perspective, see Ethics committee.

An institutional review board (IRB), also known as an independent ethics committee (IEC), ethical review board (ERB), or research ethics board (REB), is a committee at an institution that applies research ethics by reviewing the methods proposed for research involving human subjects, to ensure that the projects are ethical. The main goal of IRB reviews is to ensure that study participants are not harmed (or that harms are minimal and outweighed by research benefits). Such boards are formally designated to approve (or reject), monitor, and review biomedical and behavioral research involving humans, and they are legally required in some countries under certain specified circumstances. Most countries use some form of IRB to safeguard ethical conduct of research so that it complies with national and international norms, regulations or codes. ^[1]

The purpose of the IRB is to assure that appropriate steps are taken to protect the rights and welfare of people participating in a research study. A key goal of IRBs is to protect human subjects from physical or psychological harm, which they attempt to do by reviewing research protocols and related materials. The protocol review assesses the ethics of the research and its methods, promotes fully informed and voluntary participation by prospective subjects, and seeks to maximize the safety of subjects. They often conduct some form of risk-benefit analysis in an attempt to determine whether or not research should be conducted. ^[2]

IRBs are most commonly used for studies in the fields of health and the social sciences, including anthropology, sociology, and psychology. Such studies may be clinical trials of new drugs or medical devices, studies of personal or social behavior, opinions or attitudes, or studies of how health care is delivered and might be improved. Many types of research that involves humans, such as research into which teaching methods are appropriate, unstructured research such as oral histories, journalistic research, research conducted by private individuals, and research that does not involve human subjects, are not typically required to have IRB approval.

United States mandate for IRBs

See also: Human subject research legislation in the United States

Formal review procedures for institutional human subject studies were originally developed in direct response to research abuses in the 20th century. Among the most notorious of these abuses were the experiments of Nazi physicians, which became a focus of the post-World War II Doctors' Trial, the Tuskegee Syphilis Study, a long-term project conducted between 1932 and 1972 by the U.S. Public Health Service, and numerous human radiation experiments conducted during the Cold War. Other controversial U.S. projects undertaken during this era include the Milgram obedience experiment, the Stanford prison experiment, and Project MKULTRA, a series of classified mind control studies organized by the CIA.

The result of these abuses was the National Research Act of 1974 and the development of the Belmont Report, which outlined the primary ethical principles in human subjects review; these include "respect for persons", "beneficence", and "justice". An IRB may only approve research for which the risks to subjects are balanced by potential benefits to society, and for which the selection of subjects presents a fair or just distribution of risks and benefits to eligible participants. A bona fide process for obtaining informed consent from participants is also generally needed. However, this requirement may be waived in certain circumstances – for example, when the risk of harm to participants is clearly minimal.

In the United States, IRBs are governed by Title 45 Code of Federal Regulations Part 46. ^[3] These regulations define the rules and responsibilities for institutional review, which is required for all research that receives support, directly or indirectly, from the United States federal government. Specifically, research on human subjects that is conducted by any institution must be reviewed by that institution's review board if it is not an exempt type and it also involves:

• is conducted by the federal government, ^[4]
• involves any type of federal funding (e.g., a research grant from the National Institutes of Health), ^{[4] [5]} or
• testing an FDA-regulated product. ^{[4] [5]}

Additionally, the states of California or Maryland have more expansive rules for reviewing research that is conducted within those two states. ^[5] Many institutions that engage in substantial amounts of research, such as research universities and research hospitals, have their board reviews all research programs, even though it is not required, as a matter of their own internal policy. ^{[4] [5]}

IRBs are themselves regulated by the Office for Human Research Protections (OHRP) within the Department of Health and Human Services (HHS). Additional requirements apply to IRBs that oversee clinical trials of drugs involved in new drug applications, or to studies that are supported by the United States Department of Defense. In the United States, the Food and Drug Administration (FDA) and the OHRP have empowered IRBs to approve, require modifications in planned research prior to approval, or disapprove research. IRBs are responsible for critical oversight functions for research conducted on human subjects that are "scientific", "ethical", and "regulatory". The equivalent body responsible for overseeing U.S. federally funded research using animals is the Institutional Animal Care and Use Committee (IACUC).

In addition to registering its IRB with the OHRP, an institution is also required to obtain and maintain a Federalwide Assurance or FWA, before undertaking federally funded human research. ^[6] This is an agreement in which the institution commits to abiding by the regulations governing human research. A secondary supplement to the FWA is required when institutions are undertaking research supported by the U.S. Department of Defense. ^[7] This DoD Addendum includes further compliance requirements for studies using military personnel, or when the human research involves populations in conflict zones, foreign prisoners, etc. ^[8]

Exceptions

U.S. regulations identify several research categories that are considered exempt from IRB oversight. These categories include:

• Research in conventional educational settings, such as those involving the study of instructional strategies or effectiveness of various techniques, curricula, or classroom management methods. In the case of studies involving the use of educational tests, there are specific provisions in the exemption to ensure that subjects cannot be identified or exposed to risks or liabilities. ^[9]
• Research involving the analysis of existing data and other materials, where the data is either already publicly available or will be analyzed such that individual subjects cannot be identified. ^[9]
• Studies intended to assess the performance or effectiveness of public benefit or service programs, or to evaluate food taste, quality, or consumer acceptance. ^[9]

Generally, human research ethics guidelines require that decisions about exemption are made by an IRB representative, not by the investigators themselves. ^[10]

Additionally, research projects conducted outside of a federal government agency or government-funded institution, such as a citizen science project conducted by a private individual or a group of private individuals, are generally not required to be approved by any institutional review board, unless the project is funded by the US federal government. ^{[4] [5]}

International ethics review committees

Main article: Ethics committee

Numerous other countries have equivalent regulations or guidelines governing human subject studies and the ethics committees that oversee them. However, the organizational responsibilities and the scope of the oversight purview can differ substantially from one nation to another, especially in the domain of non-medical research. The United States Department of Health and Human Services maintains a comprehensive compilation of regulations and guidelines in other countries, as well as related standards from a number of international and regional organizations. ^[11]

Naming and composition

Although "IRB" is a generic term used in the United States by the FDA and HHS, each institution that establishes such a board may use whatever name it chooses. Many simply capitalize the term "Institutional Review Board" as the proper name of their instance. Regardless of the name chosen, the IRB is subject to the US FDA's IRB regulations when studies of FDA-regulated products are reviewed and approved. At one time, such a committee was named the "Committee for the Protection of Human Subjects".

Originally, IRBs were simply committees at academic institutions and medical facilities to monitor research studies involving human participants, primarily to minimize or avoid ethical problems. Today, some of these reviews are conducted by for-profit organizations known as independent or commercial IRBs. Anyone, including private individuals, can pay a commercial IRB for review. ^[4] The responsibilities of these IRBs are identical to those based at academic or medical institutions, and within the US, they are governed by the same US federal regulations.

While its composition varies, it often includes a balance of academia and non-academia members. This serves to provide a greater scope of understanding which helps ensure ethics in research. In the US, regulations set out the board's membership and composition requirements, with provisions for diversity in experience, expertise, and institutional affiliation. For example, the minimum number of members is five, at least one scientist, and at least one non-scientist. The guidance strongly suggests that the IRB contain both men and women, but there is no regulatory requirement for gender balance in the IRB's membership. The full requirements are set out in 21 CFR 56.107. ^[12]

As IRBs are normally staffed with employees, who have to be paid, there are costs to operating them. In 2001, the cost of operating an IRB typically ranged from about $75,000 to $770,000 ($124,000 to $1,273,000, after accounting for inflation) per year, depending on the volume of research reviewed. ^[13]

Convened and expedited reviews

Unless a research proposal is determined to be exempt (see below), the IRB undertakes its work either in a convened meeting (a "full" review) or by using an expedited review procedure. ^[14] When a full review is required, a majority of the IRB members must be present at the meeting, at least one of whom has primary concern for the nonscientific aspects of the research. ^[14] The research can be approved if a majority of those present are in favor. ^[14]

An expedited review may be carried out if the research involves no more than minimal risk to subjects, or where minor changes are being made to previously approved research. ^[15] The regulations provide a list of research categories that may be reviewed in this manner. ^[15] An expedited review is carried out by the IRB chair, or by their designee(s) from the board membership. In the US, research activity cannot be disapproved by expedited review. ^[15]

Pharmaceutical trials and good clinical practice

The International Conference on Harmonisation sets out guidelines for registration of pharmaceuticals in multiple countries. It defines Good Clinical Practice (GCP), which is an agreed quality standard that governments can transpose into regulations for clinical trials involving human subjects. ^[16]

Here is a summary of several key regulatory guidelines for oversight of clinical trials:

• Safeguard the rights, safety, and well-being of all trial subjects. Special attention should be paid to trials that may include vulnerable subjects, such as pregnant women, children, prisoners, the elderly, or persons with diminished comprehension.
• Obtain trial protocol(s)/amendment(s), written Informed Consent Form(s) (ICFs) and consent form updates the investigator proposes for use in the trial, subject recruitment procedures (e.g., advertisements), written information to be provided to subjects, investigator's brochure, available safety information, information about payments and compensation available to subjects, the investigator's current curriculum vitae and/or other documentation evidencing qualifications, and any other documents the IRB may need to fulfill its responsibilities.
• Review both the amount and method of payment to subjects to assure neither presents problems of coercion or undue influence on the trial subjects. Payments to a subject should be prorated and not wholly contingent on completion of the trial by the subject. Information regarding payment to subjects, including the methods, amounts, and schedule of payment to trial subjects, should be set forth in the written informed consent form and any other written information to be provided to subjects. The way payment will be prorated should be specified.
• Ensure that the proposed trial is reviewed within a reasonable time and document opinions and decisions in writing, clearly identifying the trial, the documents reviewed and recorded dates for approvals, required modifications prior to approval, disapproval of a proposed trial, or termination/suspension of any prior approval. Continuing review of ongoing trials is required at intervals appropriate to the degree of risk to human subjects, but at least once per year.

The reviewers may also request that more information be given to subjects when, in their judgment, the additional information would add meaningfully to the protection of the rights, safety and/or well-being of the subjects. When a non-therapeutic trial is to be carried out with the consent of the subject's legally acceptable representative, reviewers should determine that the proposed protocol and/or other document(s) adequately address relevant ethical concerns and meets applicable regulatory requirements for such trials. Where the protocol indicates prior consent of the trial subject or the subject's legally acceptable representative is not possible, the review should determine that the proposed protocol and/or other document(s) adequately addresses relevant ethical concerns and meets applicable regulatory requirements for such trials (i.e., in emergency situations).

Adapting IRB review to social science

While the Belmont principles and U.S. federal regulations were formulated with biomedical and social-behavioral research in mind, the enforcement of the regulations, the examples used in typical presentations regarding the history of the regulatory requirements, and the extensiveness of written guidance have been predominantly focused on biomedical research.

Numerous complaints by investigators about the fit between the federal regulations and its IRB review requirements as they relate to social science research have been received. ^[17] Broad complaints range from the legitimacy of IRB review, the applicability of the concepts of risk as it pertains to social science (e.g., possibly unneeded, over-burdensome requirements), and the requirements for the documentation of participants' informed consent (i.e., consent forms). ^[18] Researchers have tried to determine under what instances participants are more likely to read informed consent forms, and ways to improve their efficacy in the social sciences. ^[19] Social scientists have criticized biomedical IRBs for failing to adequately understand their research methods (such as ethnography). For this reason, some large research institutions have set up multiple specialized IRBs, and may have one committee that exclusively oversees social science research.

In 2003, the US Office for Human Research Protections (OHRP), in conjunction with the Oral History Association and American Historical Association, issued a formal statement that taking oral histories, unstructured interviews (as if for a piece of journalism), collecting anecdotes, and similar free speech activities often do not constitute "human subject research" as defined in the regulations and were never intended to be covered by clinical research rules. ^[20]

Other US federal agencies supporting social science have attempted to provide guidance in this area, especially the National Science Foundation. In general, the NSF guidelines assure IRBs that the regulations have some flexibility and rely on the common sense of the IRB to focus on limiting harm, maximizing informed consent, and limiting bureaucratic limitations of valid research. ^[21]

Adapting IRB review to big data research

Aspects of big data research pose formidable challenges for research ethics and thus show potential for wider applicability of formal review processes. ^{[22] [23] [24]} One theme is data breaches, but another with high difficulty is potentially dangerous predictive analytics with unintended consequences, via false-positives or new ways to invade privacy. A 2016 article on the hope to expand ethics reviews of such research included an example of a data breach in which a big data researcher leaked 70,000 OkCupid profiles with usernames and sexual orientation data. ^[23] It also gave an example of potential privacy invasion and government repression in which machine learning was used to build automated gaydar, labeling strangers as "probably gay" based on their facial photographs. ^[23] Analogies with phrenology ^[22] and Nazis identifying people as "probably part-Jewish" based on facial features have been made to show what can go wrong with research whose authors may have failed to adequately think through the risks of harm. Such challenges broach familiar themes, such as mistaken identity, pre-crime, and persecution, in new applications.

Relationship with citizen science

Generally speaking, citizen science, whether conducted by a single private individual or a group of individuals, is not required to follow the IRB process. ^[4] This is true even if some of the individuals involved are professional researchers or are also employed at institutions that normally review all research conducted by the institution. ^[4]

However, many academic journals require proof of IRB approval for all human-subject research, even when it is not legally required, which means that citizen scientists may be unable to publish scientific papers describing their findings. ^[4] Citizen scientists who expect to need IRB approval for publication or to comply with the terms of a research grant can pay a commercial IRB company. ^[4] In the US, a standard initial review often costs a few thousand dollars; a review to determine that the project is less expensive. ^[25]

The IRB-based approach to ethics assumes that human-subject research is conducted by an institution employing researchers, and that the institution and researchers have far more power and knowledge than the participants. The researchers and the participants are seen as distinct groups, and the concern is to prevent the researchers from exploiting the participants as a means to an end. This leads to IRBs issuing requirements such as having researchers explain the research project and obtain informed consent. However, this model does not always fit citizen science projects, especially when the participants are themselves the experts and researchers. ^[4] In such cases, a requirement to explain the project means participants would absurdly be informing themselves of their own plans. In a citizen science project, the boundaries between the researcher and the participant are blurred. ^[26] Similarly, many institutionally-driven research programs are limiting or prohibiting the return of results to individuals, especially for genetic or medical studies, for fear that some participants could be harmed if they misunderstand the results. ^[4] In this restrictive model, the participant never finds out their test results, or they can only find out their test results if the researchers carefully explain the results to them. But in a citizen science project, learning the results is a highly desired reason for participating, and, since the researchers are themselves participants, it would be impossible to prevent them from obtaining the results.

Managing conflicts of interest

While the IRB approval and oversight process is designed to protect the rights and welfare of the research subjects, it has been the subject of criticism, by bioethicists and others, for conflicts of interest resulting in lax oversight. ^{[27] [28]} In 2005, the for-profit Western Institutional Review Board claimed to conduct the majority of reviews for new drug submissions to the FDA. ^[29] In a 2006 study of 575 IRB members at university medical centers, over one-third reported industry financial ties, and over one-third admitted they "rarely or never" disclosed conflicts of interest to other board members. ^[30]

In 2009 the US Government Accountability Office (GAO) set up a series of undercover tests to determine whether the IRB system was vulnerable to unethical manipulation. In one test, a fake product "Adhesiabloc" was submitted to a number of IRBs for approval for human tests. The product, company, and CVs of the supposed researchers were all fictitious and documents were forged by the GAO. The product was deliberately formulated to match some "significant risk" criteria of the FDA and was described by GAO as a "gel that would be poured into a patient's stomach after surgery to collect the bits and pieces left over from an operation." Despite this, one IRB approved the device for human testing. Other IRBs to whom the device was submitted rejected the application, one of them saying it was "the riskiest thing I've ever seen on this board". However, none of the IRBs approached detected that the company and product were fake. The GAO also set up a fake IRB and obtained requests for approval from companies. They succeeded in getting assurance approval from the HHS for their fake IRB. At the time, the US HHS has only three staff to deal with 300 IRB registrations and 300 assurance applications per month. HHS stated that it would not be worthwhile to carry out additional evaluation even if they had the staff to do it. ^{[31] [32] [33] [34] [35]}

See also

• Clinical trial
• Data monitoring committee
• Declaration of Helsinki
• Ethical problems using children in clinical trials
• Ethics committee (European Union)
• Informed consent
• Inside the Ethics Committee
• IRB: Ethics & Human Research (journal)
• National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research
• Office for Human Research Protections
• Unethical human experimentation in the United States

References

1. Mohamadi, Amin; Asghari, Fariba; Rashidian, Arash (2014). "Continuing review of ethics in clinical trials: a surveillance study in Iran". Journal of Medical Ethics and History of Medicine. 7: 22. PMC   4648212 . PMID   26587202.
2. The Office of Human Research Protection. Institutional Review Board Guidebook. "Chapter 3, Section A: Risk/Benefit Analysis." pp. 1-10 Retrieved May 30, 2012
3. "Code of Federal Regulations". HHS.gov. 2010-01-15. Retrieved 2014-03-28.
4. Guerrini, Christi J.; McGuire, Amy L. (2022). "An Ethics Framework for Evaluating Ownership Practices in Biomedical Citizen Science". Citizen Science: Theory and Practice. 7 (1): 48. doi: 10.5334/cstp.537 . ISSN   2057-4991. PMC   10237586 . PMID   37275350.
5. Resnik, David B. (August 2019). "Institutional Review Board Oversight of Citizen Science Research Involving Human Subjects". The American Journal of Bioethics: AJOB. 19 (8): 21–23. doi:10.1080/15265161.2019.1619864. ISSN   1536-0075. PMC   6760307 . PMID   31544642.
6. "IRBs and Assurances". hhs.gov. 22 December 2010.
7. Human Research Protection Program (HRPP). Archived 2014-09-16 at the Wayback Machine
8. HRPP Information Sheet for DoD Addendum. Archived 2014-09-16 at the Wayback Machine
9. Office for Human Research Protections (January 15, 2009). "Part 46, Protection of Human Subjects". Code of Federal Regulations. p. US 45 CFR 46.101. Retrieved 19 August 2014.{{cite book}}: |work= ignored (help)
10. Ritter, F. et al, Running Behavioral Studies with Human Participants, Sage Publications Inc. 2013., ISBN   9781452217420.
11. International Compilation of Human Research Protections, Office for Human Research Protections, U.S. Department of Health and Human Services
12. "PART 56 - INSTITUTIONAL REVIEW BOARDS". Food and Drug Administration (United States). 28 June 1991. Archived from the original on 13 August 2011. Retrieved 2009-05-12.
13. Wagner, Todd H.; Bhandari, Aman; Chadwick, Gary L.; Nelson, Daniel K. (June 2003). "The Cost of Operating Institutional Review Boards (IRBs)". Academic Medicine. 78 (6): 638–644. doi: 10.1097/00001888-200306000-00019 . ISSN   1040-2446. PMID   12805049. S2CID   22192522.
14. Office for Human Research Protections (January 15, 2009). "Part 46, Protection of Human Subjects". Code of Federal Regulations. p. US 45 CFR 46.108. Retrieved 19 August 2014.{{cite book}}: |work= ignored (help)
15. Office for Human Research Protections (January 15, 2009). "Part 46, Protection of Human Subjects". Code of Federal Regulations. p. US 45 CFR 46.110. Retrieved 19 August 2014.{{cite book}}: |work= ignored (help)
16. International Conference on Harmonisation of technical requirements for registration of pharmaceuticals for human use. "Good Clinical Practice" . Retrieved 27 September 2012.
17. Gunsalus, C.K.; Bruner, Edward M.; Burbules, Nicholas C.; Dash, Leon; Finkin, Matthew; Goldberg, Joseph P.; Greenough, William T.; Miller, Gregory A.; Pratt, Michael G. (2016-06-29). "The Illinois White Paper". Qualitative Inquiry. 13 (5): 617–649. doi:10.1177/1077800407300785. S2CID   144280954.
18. Perrault, E. K.; Nazione, S. A. (2016). "Informed Consent—Uninformed Participants: Shortcomings of Online Social Science Consent Forms and Recommendations for Improvement". Journal of Empirical Research on Human Research Ethics. 11 (3): 274–280. doi:10.1177/1556264616654610. PMID   27329533. S2CID   206765294.
19. Perrault, Evan K.; Keating, David M. (2017-11-08). "Seeking Ways to Inform the Uninformed: Improving the Informed Consent Process in Online Social Science Research". Journal of Empirical Research on Human Research Ethics. 13 (1): 50–60. doi:10.1177/1556264617738846. PMID   29117849. S2CID   36363858.
20. Ritchie, Don; Shopes, Linda (2003). "Oral History Excluded from IRB Review: Application of the Department of Health and Human Services Regulations for the Protection of Human Subjects at 45 CFR Part 46, Subpart A to Oral History Interviewing". Oral History Association. Archived from the original on 17 January 2008. Retrieved 31 December 2008.{{cite journal}}: Cite journal requires |journal= (help). See also An Update on the Exclusion of Oral History from IRB Review (March 2004).
21. "FAQs and Vignettes - NSF - National Science Foundation". www.nsf.gov.
22. Chen, Sophia (2017-09-18), "AI research is in desperate need of an ethical watchdog", Wired , retrieved 2017-09-18.
23. Zhang, Sarah (2016-05-20), "Scientists are just as confused about the ethics of big-data research as you", Wired , retrieved 2017-09-18.
24. Gibney, Elizabeth (2017-10-03), "Ethics of Internet research trigger scrutiny: Concern over the use of public data spurs guideline update", Nature, 550 (7674): 16–17, doi: 10.1038/550016a , PMID   28980649, S2CID   4468515.
25. "Institutional Review Board Tip Sheet" (PDF). Office of Population Affairs, US Department of Health and Human Services. July 2020. Retrieved 2023-08-10.
26. McFarlane, Anna; Roche, Brenda (2018-08-06). "Blurring the Boundaries between Research and Researchers, Academic and Activist". In Banks, Sarah; Brydon-Miller, Mary (eds.). Ethics in Participatory Research for Health and Social Well-Being: Cases and Commentaries. Routledge. ISBN   978-1-351-60534-2.
27. Emanuel, Ezekiel J.; Lemmens, Trudo; Elliot, Carl (2006). "Should Society Allow Research Ethics Boards to Be Run As For-Profit Enterprises?". PLOS Medicine. 3 (7): e309. doi: 10.1371/journal.pmed.0030309 . PMC   1518668 . PMID   16848618.
28. Caroline McNeil (2014-03-03). "Debate Over Institutional Review Boards Continues as Alternative Options Emerge". JNCI Journal of the National Cancer Institute. 99 (7): 502–503. doi: 10.1093/jnci/djk157 . PMID   17405992.
29. Elliott, Carl (2005-12-13). "Ethics for sale". Slate.com. Retrieved 2014-03-28.
30. "Hospital IRBs are "On the Take"-Tainted by Conflicts ofInterest_NEJM - AHRP". ahrp.org. 29 November 2006. Archived from the original on 14 April 2012. Retrieved 29 December 2011.
31. http://www.gao.gov/new.items/d09448t.pdf ^{[ bare URL PDF ]}
32. —By Carl Elliott. "Poor Reviews". Mother Jones. Retrieved 2014-03-28.
33. Mundy, Alicia (22 April 2009). "Coast IRB, Caught in Sting, to Close". The Wall Street Journal.
34. Archived June 2, 2011, at the Wayback Machine
35. "FDA Approves Nonexistent Product from Nonexistent Company for Human Testing | Food Freedom". Foodfreedom.wordpress.com. 2011-01-17. Retrieved 2014-03-28.

Further reading

• Enfield, K. B. & Truwit, J. D. (2008). The Purpose, Composition, and Function of an Institutional Review Board: Balancing Priorities. Respiratory Care, 53, 1330–1336.
• Fairchild, A. L. & Bayer, R. (1999). Uses and Abuses of Tuskegee. American Association for the Advancement of Science, 284, 919–921.
• Perrault, E. K. & Nazione, S. A. (2016). "Informed Consent—Uninformed Participants: Shortcomings of Online Social Science Consent Forms and Recommendations for Improvement". Journal of Empirical Research on Human Research Ethics. 11(3), 274–280. doi : 10.1177/1556264616654610.
• Pope, T. M. (2009). Multi-Institutional Healthcare Ethics Committees: The Procedurally Fair Internal Dispute Resolution Mechanism, 31 Campbell Law Review 257–331.

External links

• Human Research Report —a monthly newsletter for IRBs
• Office for Human Research Protections (OHRP) at HHS
• IRB: Ethics & Human Research – a peer-reviewed journal of The Hastings Center
• Ethics for Sale: For-profit ethical review, coming to a clinical trial near you, Carl Elliott and Trudo Lemmens, Slate, December 13, 2005