Leiter Reports: A Philosophy Blog

News and views about philosophy, the academic profession, academic freedom, intellectual culture, and other topics. The world’s most popular philosophy blog, since 2003.

  1. Fool's avatar
  2. Santa Monica's avatar
  3. Charles Bakker's avatar
  4. Matty Silverstein's avatar
  5. Jason's avatar
  6. Nathan Meyvis's avatar
  7. Stefan Sciaraffa's avatar

    The McMaster Department of Philosophy has now put together the following notice commemorating Barry: Barry Allen: A Philosophical Life Barry…

How many letters of recommendation should a job seeker have?

A senior philosopher elsewhere writes:

Over the years dossiers for applicants for junior positions have gotten larger and larger.  Some dossiers we have received for our current search  number more than 80 pages,  One thing that is particularly striking to me is the number of letters of recommendation that each dossier contains.  Back in the dark ages,  when I was in graduate school,  dossiers included on average three letters.  In this year's  search not a single dossier that  I have seen includes that few.   Many include six, seven or even eight letters.  I don't fully understand the reason why, though.    I am tempted to  attribute at least part of the ever increasing number of letters to understandable  anxiety on the part of job seekers.  There seems to be a view that the more people you can get to say good things about you, the better off you will be.    I certainly  understand and sympathize with the anxiety.  On the other hand,   I  doubt that there is a single search committee that is eager to read an average of six or seven letters per file.  Nor do I think that more letters means more information or a more honest assessment of the candidate.    Just for comparison sake,  a typical tenure file at my own university will generally include around  eight outside letters.  Do we really need the same number of letters for a junior appointment as for a tenure case?  Personally,  I don't think so.  But  I am sure reasonable people can disagree on this score and would like to know what others think.

To stir  the pot just a little, let me add the following.   In some number of cases  — though I'm not prepared to quantify whether it be many, most, or just a few — the additional letters come from people not from the candidate's home institution.  Sometimes this makes some sense and is helpful  — if, for example, the outside writer has taught, supervised, collaborated with,  or  been colleagues with the candidate.   Outside PhD  examiners are often asked to write, for example.    And you would certainly expect people who have moved a bit from place to place to have letters reflecting that fact.    Or, in another vein,  if a candidate has worked in somebody's lab, say, as sort of the philosopher in residence.    All that makes sense and I have no beef with it.    On the other hand,  many outside letters seem to be the result of proactive networking on the part of candidates.  Perhaps the thought is that  it is important to have letters from prominent people in other departments with whom one has had some degree of contact.   The thought may be that this networking will help increase and  demonstrate the reach and impact of one' s work.    In a few rare cases,  such letters may carry some tiny bit of weight.   But  that, I think,   really is the exception  rather than the rule.   In my experience,  most such letters are relatively bland and pointless.   They are neither particularly helpful nor, thank goodness for the candidates,  particular hurtful.  I suspect that it's an issue of divided loyalties.   Seldom  have I seen a letter from prominent philosopher P from  institution X writing for  candidate C from institution Y that directly compares C to P's own students at P's own institution.   Most of what such letters add is generic praise.  But there's usually enough of that in the "core" letters to suffice.

I'm not sure anything can stop the momentum for more and more letters.  And maybe I wrong to think the momentum needs to be stopped.  Maybe I'm just tired from reading thousands of pages of files.   But I thought this might make a good discussion point for your blog. 

I generally recommend candidates have not more than five or six letters, on the assumption that the 5th and/or 6th letters really add something–e.g., a letter from someone outside the department who is expert in the candidate's area and can add something useful about the candidate's work.  What do readers think?  Signed comments preferred, though grad students and job seekers may post with a pseudonym (pick a distinctive one).

Leave a Reply to Derek Bowman Cancel reply

Your email address will not be published. Required fields are marked *

26 responses to “How many letters of recommendation should a job seeker have?”

  1. I don't have an opinion about the optimal number of letters.

    But, all things equal, I prefer a glowing letter from an outside writer to one of the students' advisors or faculty members. The latter are, more or less, paid to place the student. They have a stake in placing the student that an outside writer usually lacks. While I doubt that most letter writers lie or consciously exaggerate, one need only glance at the vast literature on motivated reasoning and bias to see why such letters will be at least partially unreliable.

    Personally, I place much more weight on a well-placed journal article than one glowing letter from one's advisor, even if the advisor is the greatest philosopher ever.

  2. If you don't want greater than N letters, simply say in your ad or set up an application system that limits it. I cannot count the number of jobs I've applied to that have a hard limit of three letters, which forces me to choose amongst my letters for the ones I think are most relevant for the job.

    There is a maximalist bias for applicants, especially for ads written with minimal instructions or guidance. We have no idea what you want, departments ask for very different things, we've received very mixed guidance from our advisors and others, and we're going to send everything unless you tell us not to.

  3. I completely agree with this comment. But let me add that I wish departments would NOT limit the # of letters to just three. If there is going to be a maximum, I think it should be four. One wants to include letters from all three committee members, but one also wants to include a letter addressing one's teaching. So I'm always frustrated by a maximum of three.

    Also, and echoing "we've received very mixed guidance from our advisors and others", as much as I've heard complaints about there being too many letters, I've also heard people on search committees say something along the lines of "the more information about a candidate the better". So whatever your opinion, please don't blame the candidate. We don't know what you want!

  4. I'm not sure that limits in ads would be a positive development. Hard limits in ads or not, many departments will be sending a standard dossier that they won't hand tailor individually to fit the specifications laid out in an advertisement. While I agree that too many letters doesn't make a better case, we ought to be realistic on the amount of work we can ask office staff to do, or for that matter faculty who are doing service work.

  5. To anonjobseeker #2: Your post assumes that everyone has a committee made up of only three members. Mine had 7, not counting the chair or my advisor.

  6. I want to strongly second anonjobseeker's four-letters-rather-than-three suggestion.

    And if search committees are going to limit it to three, it would be great if they would make explicit whether they want a letter that addresses teaching or not.

    I've been assuming the three-letters-only-applications are asking for three letters that principally address a candidate's research potential rather than her teaching. But I'm not sure this is a good assumption to make.

    Also, in response to Mark van Roojen: The limits are already there for many jobs, not set by the advertisements but by the online submission systems for uploading letters. So there isn't any extra work to be done by imposing limits. (Not entirely sure I understood your posting correctly, so if this isn't germane, my apologies.)

  7. David Beard, Associate Professor of Rhetoric

    Wow. In my field (rhetoric), three is the customary max, and a significant but minority number of jobs will not even ask for letters until you are a finalist. There is just too much to process at the start, and it is daunting to ask for that many letters both for the applicant and the writers. We are being kind to ourselves and kind to our colleagues, I think. Six would exhaust everyone.

    That said, in my world, anyone out for two years with only letters from committee members is making a mistake. In two years since graduation, you need to be demonstrating what, at graduating, you are only promising. A letter from an institution not-your-doctoral-department helps make that case.

    –db

  8. another job seeker

    Here is the conflicting advice I have received as someone currently applying for jobs:

    1. It looks *bad* when you don't have letters from all of your committee members. This means that you have at least three letters right there. And since I gather dissertation committees are getting larger these days, some will have upwards of 5 committee members. So, 3-5 committee letters.

    2. It is important to have a teaching letter. And it is bad when the teaching letter is sort of an added chunk on a research letter. So there's one more.

    3. It is desirable to have an outside letter, from someone not at your home institution NOR on your committee, for the reasons Jason Brennan mentioned above. (Also, perhaps you have an AOS that's not the area of your dissertation that someone external could better speak to.) So there's a potential extra letter.

    Running total: 5-7.

    And the kicker:
    4. It is bad to have more than 3 or 4 because it waters down your file, annoys readers, etc.

    Where has this gone wrong?

  9. yet another job seeker

    I received pretty much the same advice as another job seeker. Add to that that some of us need to show competence in other fields (e.g. physics, psychology, etc.). So add in another letter from someone not in a philosophy department.

    Why can't departments just choose what letters and other materials they are interested in reading? I have been operating on the assumption that I should give search committees as much information as they might want to make up their minds, but that they might not look at everything. Why is this a bad idea? In other words, why should departments get upset at big files? They are not obligated to look at supplementary letters and documents, right?

  10. In a field where "who knows you" often makes the difference between getting an interview or not, it is perfectly rational for jobseekers to send as many strong letters as they can. Why wouldn't they? Jobseekers are simply responding to a set of (perverse?) incentives.

  11. Junior Faculty Member on a Search Committee

    "Why can't departments just choose what letters and other materials they are interested in reading? I have been operating on the assumption that I should give search committees as much information as they might want to make up their minds, but that they might not look at everything. Why is this a bad idea? In other words, why should departments get upset at big files? They are not obligated to look at supplementary letters and documents, right?"

    No one gets upset. It's just that there's a serious problem of information overload. SC members have an enormous number of files to look at, and only so much time to give to each. If your file runs to 80+ pages (or even 40+, probably), then it's impossible to give careful or even semi-careful attention to the whole thing, and this increases the possibility that we might overlook something that would count in your favor. Of course we understand that it's not your fault, that you're probably following advice that you were given and really just trying not to leave anything out, but none of this will change the number of hours in the day or days in the semester. This means that it's better if you can to choose quality over quantity, e.g. by having someone look over your letters to identify which are the most likely to be helpful. (Of course it sucks that some of you may not have someone who can do this for you.) Choosing instead to give us as much information as we could possibly want sounds great in the abstract, but the reality on the ground is that many of us simply don't have the time to figure out which of the pieces of information you've sent us are the most important ones.

  12. In reply to "another job seeker", I think it's not important to have letters from your entire committee. Often some committee members aren't really involved, and a perfunctory letter is worse than no letter at all. I also don't think it's important–at least for many jobs–to have a letter about teaching. Teaching letters are often shallow and uninteresting, reciting mere platitudes instead of substantial praise.

    Having been on a bunch of committees, I'm always surprised by candidates who send a lot of letters, some of which are much stronger than others. So maybe you're thinking you need 5+, which drives you toward including weak letters. But, again, I just don't think you need so many. And weak letters are bad: 4 strong letters is MUCH MUCH better than 4 strong letters plus 3 middling ones.

    It just often looks like placement coordinators aren't reading the dossiers, culling letters, sending them back for re-writes, and so on. (Having submitted letters to conscientious placement coordinators, I know that at least some put a LOT of time into this.) My suggestion, then, is to worry less about the number than the (average) quality. And get someone to read them and help make decisions about what to include/exclude.

  13. It seems silly for someone (e.g., Fritz) to say "I don't put stock into letters of X sort, so job seekers ought not include letters of X sort." One that says that ought to understand that a. job seekers don't know the preferences of each individual on every particular search committee, and b. other reviewers may disagree with your personal letter (or dossier) preferences. Because some reviewers may want to see letters from all my dissertation committee members, others want to see teaching letters, and I have no a priori method of determining what each reviewer wants to see, I must err on the side of including too much. As jobseeker said, there is a clear maximalist bias. Unless everyone can agree on what matters and what doesn't, I can't take a chance on failing to include, e.g., a teaching letter, an external letter, or letters from all my dissertation committee members.

  14. Pseudonymous Job Seeker

    Why isn't the first round of applications completely standardized? I get that departments will want to see different things through the whole of the process. That makes sense. But that doesn't mean that they don't (or shouldn't) all want basically the same thing at the very earliest stages.

    It seems like a lot of time and effort could be saved (for everyone involved) if the first round of consideration for every job was based on a standard file. (Say, a CV, research statement, teaching statement, writing sample, three research letters and a teaching letter—or whatever we agree on. Details really aren't important at this stage).

    Those materials should be more than enough for departments to figure out whether they'd like to know more or not. At that point they can ask for whatever else they'd like to see from their top 10, top 20, or top 100 candidates. Add in the ability to write a custom cover letter for each job at the initial stage and we're all set. (A bit that I really do think is important.)

    So I guess this is what I'm advocating: a completely centralized system to manage a completely standardized first-round application. That way there's no worrying, no guessing, no divining what *this* committee wants vs. that one; everybody gets enough to find out if they want to go on a second date. And! You only have to put it together once. Committees are happier, applicants are happier, office staff are happier. Everybody wins.

    I don't see why we just shouldn't make this standard for our profession.

  15. I am always surprised when I hear people asking for large complex "systems" like the philosophy job market to be standardized. It strikes me as inappropriate. First, the needs of the various institutions that are hiring philosophers are quite different. This is reflected, in part, in the various items that are requested in job applications. Second, I think people making such a request fail to see that the system might work as well as it does because it is not centralized. I am not an American, but I work in the USA, and one of the things that foreigners like me are impressed with is the lack of centralization in certain domains in the USA. Centralized systems can be homogenizing, and people are failing to see how inhumane and destructive this can be.

  16. A completely standardized first stage would be impossible to enforce and would deprive members of committees of information that some members of the committees want at the first stage. It would in effect be those setting the standards enforcing their judgements as to what is relevant on everyone else. Three letters may be fine for many applicants. But perhaps the people who can speak on behalf of a candidate's research are not those best placed to talk about teaching. And whether Fritz cares about teaching letters or not, some people will and they will be on hiring committees. Other candidates my have both interesting research and philosophy relevant experience running an ethics center, or teaching philosophy in high school. Again, the people best placed to talk about that work may not be their committee members or dissertation director. Why force them to pare down the number and eliminate relevant info. So I think a rule banning a fourth letter would be a bad idea.

    Relatedly, standard rules about the number of letters would privilege certain institutions over others in certain ways. I'm at an under-appreciated department but we do OK placement wise. Part of that is precisely because we take advantage of the current flexibility to present candidates as well as possible given their experience and talents. (It can still take several steps to get to a really good job, but our students do get them.) Having a letter from a top outside scholar in a candidate's field has helped at least a few present their work as being of genuinely top quality. That isn't going to be as important for candidates from universally well-regarded programs where people routinely work with people everyone recognizes as expert.

    In any case, a four letter dossier is currently pretty standard, as is the rest of what Pseudonymous Job Seeker suggests be sent under a proposed centralized system. So I think we already have most of the benefits of such a centralized procedure. The one way in which things have not been standardized is with documentary evidence related to teaching (people send all sorts of stuff that is hard to compare with the things other people send). And I suspect that any standardization that happens there will come not through rules but by people copying what they see others effectively using.

    I get that making decisions about how to present yourself on paper in applying to jobs is causing lots of anxiety and that candidates get conflicting advice. But that is part and parcel of going on any job market. People are largely advising you based on their own experience on the market and on hiring committees. Different people have different past experience, so it is helpful to get lots of advice and then sort through it for what makes sense given what you know. That cannot be eliminated from the process. It goes into the advice about how a cv should look and which writing sample to send and which people to ask for letters as much as it does into how many letters you should send. Departmental placement directors should be able to help you navigate that advice and look over your shoulder as you put things together to present yourself in the best way you can. Thus I think more leeway about how to present one's best work can be a good thing, if you use it to your advantage.

    The other thing that is motivating me to post is that I'm really against rules or systems that force other people to adhere to epistemic standards they do not themselves accept. It is a fact of life that different people on such committees will find certain kinds of evidence more useful than others. For there to be a centralized system that requires people to fit into someone else's idea of what they should find relevant information when hiring seems crazy to me. (There are limits, of course, perhaps there would be good reason to screen information that facilitates certain sorts of discrimination, but that isn't the issue here.) I think it would be epistemically better to eliminate interviews entirely, but I think it would be wrong for me to forbid interviewing by people who disagree. Absent discrimination blocking reasons to keep people from submitting certain kinds of info, I think that the relatively loose standard practices we have for the number of letters, etc. works well enough.

  17. While XYZ is right to warn of the downsides of standardization in complex social systems, the idea that "the system might work as well as it does because it is not centralized" is precisely what those calling for standardization are worried about. Does the current system really make effective use of candidates', search committees', placement directors', and department staff's time and effort?

  18. Placement from medical school to residency is standardized in the USA. The system is more complex than the philosophy job market, has more urgency than the philosophy job market, yet works very well. Facing severe uncertainty about how to construct one's application to a job can also be destructive. Sanctioning job-seekers because they fail to live up to unspecified criteria can also be inhumane.

  19. darkerwiththedays

    I must say that as a job seeker, I was so extremely moved with empathy for the plight of tenured professors who have to read hundreds of applications, that I almost forgot that I have to apply to for hundreds of positions in order to keep the lights on. Hang in there hiring committee members–you can make it through!

  20. It's important not to overestimate the importance of letters. The function of letters is to earn your work a closer look. If they succeed in doing that, they pretty much drop out of the picture as irrelevant the rest of the way through the hiring process. That is, once your letters help to earn your work greater scrutiny, the judgments of your letter writers about the quality of your work takes a serious back seat to the judgments of those who are considering hiring you. If so, then the a natural question to ask is whether the ever increasing number of letters increases, decreases, or has no effect on the chances of your work being closely scrutinized. Take two candidates of otherwise equal abilities, with equally strong recommendations, except that the one candidate has three strong letters while the other candidate has six strong letters. Is the candidate with twice the number of letters more likely to get a closer look than a candidate with fewer strong letters. That, as they say, is of course an empirical question. But from my own experience over many years, I think the answer is no. More letters per se does nothing to increase your chances of being closely scrutinized. ON the other hand, I doubt there is any assignable harm to particular candidates who have more letters than average. Which sort of gives candidates with any degree of risk-averseness or anxiety an incentive to be maximal.

    But the problem lies in the aggregation and universalization of that incentive. To the extent that the practice of maximizing the size of dossiers is universalized — which it seems rapidly on the way to becoming — candidates in general are sort of harmed as a group, if that makes sense. How so? Well, start with the fact that hiring faculty are not robots, but are finite limited beings, with many simultaneously competing pressures operating on them, vying for their time, energy and attention. Exhausted and overwhelmed search committee members, with many other things to do than just read hundreds of 80-90 page files, are much more likely to quick skims rather than deep reads — especially in make the first round of cuts. And again, once you get past the first round (or maybe, in some case, two rounds of cuts) letters stop playing much if any role.

    What does that add up to? Individual candidates may have an incentive to be maximal. But if a sort of arms race causes every candidate to converge on the maximalist strategy, all candidates may be to some extent harmed, since those whose job it is to sort through files will then feel compelled to resort to certain let's call them efficiencies. These efficiencies may or may not serve the interest of the candidate pool at large. Probably not. But that too is an empirical question about which I have hunches but no systematic data.

  21. I guess I don't see what's worrisome about the increasing tendency of candidates to send very large files. Search committee members shouldn't spend *less* time on a longer file than they would on a shorter file, so at worst this means that if you send a long file, maybe not all of it will get looked at. There's a lesson in there for job-seekers, of course: only send letters which are such that any arbitrarily chosen set of 3 are equally strong as any other arbitrarily chosen set of 3. A long file only raises the likelihood of important stuff being missed it the candidate includes some unimportant or weak stuff. Candidates: don't do that. And search committees: don't feel bad about not reading every letter. The candidate chose to send more than 3, so assume that he or she doesn't mind which 3 you read.

  22. Perhaps just one more anonymous job seeker

    I wonder if this problem could be resolved by making job announcements more specific. For example, why couldn't a job announcement specify whether they want a teaching letter, whether they want letters from every dissertation committee member, whether outside letters are encouraged or discouraged, etc.? Vague instructions like "at least three letters of recommendation" leaves the door open for job seeker anxiety to run wild, which inevitably leads to a panic-stricken sending of 7 plus letters.

    It seems like this strategy could also help resolve the more general problem with increasing length of application packages that concerned the initial poster. In addition to the problem of how many letters to send, information about required teaching documents is often equally sparse, so when in doubt, job seekers send a massive dossier that includes multiple sample syllabi and complete sets of student evaluations. This also contributes to the length of the total package, probably more so than letters. An announcement that says "at least three letters and relevant teaching materials" is inviting the maximum number of letters and the giant teaching dossier. Since we have no idea what you actually want, and you didn't bother to tell us, you get the whole package.

  23. Having been on the search committee side of 20+ searches I say this about Neal Tognazzini's remarks —

    Candidates: Don't learn his "lesson" (it implies among other things, that any file with a strongest letter should contain at most 3 letters — that's not a lesson at all, it's a falsehood.

    Search Committees: Don't assume what he says to assume. For example, don't assume that if a candidate sends 4 letters she "doesn't mind" if you read just the 3 that are not from the dissertation director.

  24. Fritz is right that an uncharitable interpretation of my suggestions makes them sound silly. I only meant to agree with what a few other people have said in this thread already, namely: (1) candidates shouldn't be sending weak letters, because there's always a chance that overwhelmed search committees will read those to the exclusion of your strong letters, and (2) search committees shouldn't feel obligated to read every letter that a candidate sends. If crunched for time, search committee members will have to use their good judgment to choose which letters to read — perhaps that will mean reading the letter from the dissertation director, but perhaps not. (Some above express skepticism that letters from dissertation directors are helpful.) Personally, I think that reading the letter from the dissertation director, a letter from someone outside the candidate's institution, and the teaching letter seems like a reasonable combo, but as Mark van Roojen points out, different people care about different things.

  25. Reverting to Friz Althoff’s post, it seems that if letters of recommendation are construed as premises to the conclusion that X is a good candidate, then the consequence relation governing job applications is non-monotonic. It may be for some people that the set of letters of reference {A, B & C} implies that X is a good candidate, but the set of letters of reference {A, B, C, D E and F} does not. This sort of makes sense, but it does put jobseekers in a terrible bind. Sometimes MORE IS MORE and sometimes MORE IS LESS and for individual jobseekers it is difficult to know which maxim applies in their own case.

    I have argued before that for anything above a post-doc the fairest way to make the first cut is to assess candidates solely on the evidence of the actual and forthcoming publications, adjusted for the candidate’s academic age and the prestige of the venues. That way you can forget about letters of reference until you are down to the final twenty by which time your can read them all with due care and attention, sifting the letters to see which you consider trustworthy and which you do not. (And many letters of reference are NOT very trustworthy for obvious reasons). You can also devote more time and attention to the evidence supporting the candidates’ teaching potential. This requires some thought and effort, since there is no standardization and different candidates will be adducing different kinds of evidence for their teaching abilities.

    To darkerwiththedays
    Sympathy and self-pity are not the issues here, comrade. It is simply IMPOSSIBLE to read 80 80-page dossiers thoroughly. (It’s equivalent to reading a book of 6400 PAGES and, at 200 words per page, twelve million and eight hundred thousand words! Thus there is absolutely no way that a hiring committee however stout-hearted and conscientious can ‘make it through’. That being so, if a search committee GETS 80 80-page dossiers most of them will remain unread. (Even fifty dossiers of twenty pages each is a considerable reading task. That’s a book of a thousand pages and [at a conservative estimate of 200 words per page] two hundred thousand words.) The ones that ARE likely to be read will be those with something eye-catching in the CV such as (unfortunately in my opinion) a good pedigree or a star referee. So there is a fairness issue here. Unless search committees adopt something like my strategy in making the first cut, long dossiers tend to reinforce the privilege of pedigree. ‘For he that hath, to him shall be given: and he that hath not, from him shall taken away even that which he hath’. Unlike Jesus, I am not particularly happy with this situation and would like to see it changed.

  26. I would like to complain about the application process regarding files. I have gone through the process before and am hired, so this doesn't affect me now. But it seems to me that philosophy applications are needlessly complex regarding the amount of materials requested with the initial application. As an example, in the hiring process of the History department at my institution, they initially only require a CV and a letter from candidates. On the basis of this, they then send requests to a limited number of candidates for more materials. This seems to work and I note each year they hire excellent people. Maybe someone who knows about this can speak to the norms in other fields. Are other fields as complicated as us? Our approach seems unnecessary and inefficient frankly.

Designed with WordPress