Leiter Reports: A Philosophy Blog

News and views about philosophy, the academic profession, academic freedom, intellectual culture, and other topics. The world’s most popular philosophy blog, since 2003.

  1. Fool's avatar
  2. Santa Monica's avatar
  3. Charles Bakker's avatar
  4. Matty Silverstein's avatar
  5. Jason's avatar
  6. Nathan Meyvis's avatar
  7. Stefan Sciaraffa's avatar

    The McMaster Department of Philosophy has now put together the following notice commemorating Barry: Barry Allen: A Philosophical Life Barry…

Evaluating Philosophy Programs: A Cautionary Tale about the IBHE

The Illinois Board of Higher Education (IBHE) requires that state universities report annually on what used to be called “low productivity programs” in compliance with the Illinois Public Act 097-0610. They then use this information to determine if the contribution of each program is “educationally and economically justified.” The IBHE has no regulatory authority over universities to tell them what programs to offer or eliminate, but the IBHE does make budget recommendations. So university administrators want to appease them.

You might be wondering what constitutes a “low producing” program in Illinois. Here are the IBHE standards (from page 8 of the October 2015 report):

Associate’s Degrees: 12 graduates
Bachelor’s Degrees: 6 graduates (25 enrolled majors)
Master’s Degrees: 5 graduates (10 enrolled majors)
Doctoral Degrees: 1 graduates (5 enrolled majors)

So if a program doesn’t have these averages for enrolled students and graduates over a rolling five-year period, it is considered low producing. When that happens, the IBHE recommends the following actions:

(1) Sunset status – A teach-out period is established and no new or transfer students admitted; 

(2) Consolidation; 

(3) Redesign – Further redesign and program changes will be applied to remediate low performance;
(4) Justification/No Further Action – There is no further action necessary due to the
justification; and 

(5) Priority Review – The program is placed under priority program review to best determine the appropriate status over the next academic year.

Remember, however, that the IBHE has no authority over university programs, and schools must simply submit an annual report. Some universities like University of Illinois make the required reports, but develop internal evaluations standards for their programs. Philosophers need to develop these kind of standards for philosophy programs.

WIU’s Philosophy program is on the list of “low producing” programs (page 220 of the report). We find ourselves in this unenviable position because philosophy is largely a discovery major, and it’s hard for students to discover philosophy when the program doesn’t have enough faculty members teaching classes. The number of philosophy teaching faculty at WIU is roughly half the average of the other Illinois philosophy program’s faculty, and as a small program, it is sensitive to faculty fluctuations due to sabbaticals, administrative changes, immigration, and in our case a tragic death. When philosophy course offerings are harmed by these factors, you might think it would play a role in the narrative to justify a program to the IBHE in a priority review. You’d be right, but there are other factors at play.

In one instance when we requested to replace a faculty member who left our department because of immigration issues, we were turned down even when we demonstrated “program need” and showed the four classes the faculty member taught each semester filled to capacity. Instead, our former provost told us that since the department of history had lower student enrollment in their general education classes, students who would have taken philosophy could now take history to satisfy their general education requirements. Our dean (a philosopher, by the way) accepted the argument. So as a result the philosophy program has fewer faculty, fewer course offerings, fewer majors, and fewer graduates making it a “low productivity” program.

You may know that Illinois is now in a full-blown budget crisis—nine months and counting without a state budget. On 2/18/2016, the IBHE released to state universities a new metric for: “Illinois Public Universities’ Academic Program Efficiency and Effectiveness Report.” (The file is in my public dropbox folder since it isn’t on the IBHE website yet.) Here are the new numbers for the new three-year rolling averages to determine “program efficiency and effectiveness.”

Associate’s: 12 graduates and (25 enrolled majors)
Bachelor’s: 9 graduates (up from 6) and (40 enrolled majors—up from 25)           
Master’s: 5 graduates and (10 enrolled majors)
Doctoral: 2 graduates and (10 enrolled major)

All of this effectiveness and efficiency talk is driven by the goal of having 60 x 2025. That’s 60% of Illinois adults (25-64) having a degree or certificate by 2025. Here is a quote from the IBHE’s FY 2017 Budget recommendation:

“At each meeting, the state’s commitment to the goal that Illinois would have 60 percent of adults (25-64 years of age) with a college degree or credential by the year 2025 was reinforced as well as the reasons for that goal. This goal is the North Star that guides all of our budgetary and strategic decisions.” (page 10)

So Illinois politicians want state universities to provide the most degrees and credentials to the most people in the most efficient way possible. Redundant and inefficient programs across the state must be eliminated. This might mean that there is only room for one philosophy program in the state at say, Illinois State, and one Law Enforcement Program at perhaps WIU, and one Engineering program at say, UIUC. This seems to be part of the goal in Illinois: eliminate redundant and inefficient programs (however these are defined). 

So philosophers might object to the methodology, right?

Why do government officials think that a single factor like graduates per year or number of enrolled students per year is the best way to evaluate the effectiveness of a degree program? Imagine a philosophy program that graduates 5 students a year with four faculty members. Now imagine a history program that graduates 6 students a year with 15 faculty members? Is history safe from IBHE review while philosophy is at risk of being identified as “inefficient” and as a result eliminated? Thanks to this overly simplistic bean counting, the answer is “yes.” Program evaluation requires vision and an understanding of a program’s function within a university, not circling a single criterion like degrees earned.

The problem arises when administrators and lawmakers think a university can be run like a business; to wit if all the philosophy programs don’t produce enough majors, then close them all except the one that does. Access to education isn’t a consideration in determining program effectiveness and efficiency, and no one is geographically constrained.

Some Real World Consequences of this “Low Productivity Analysis”

So how might this play out on a campus? I’ll tell you how it’s playing out at my university.

Philosophy is one of 13 programs that didn’t satisfy the “old” program efficiency metrics for the IBHE. The administration justified four of the programs—physics was one. So no further action was necessary for those four. Music gave up its B.A. in music and combined it with its B.F.A. So that left eight programs to consider. They are:

Philosophy
Religious Studies
Women’s Studies
African American Studies
Geography
Health Sciences
Musical Theater
Bilingual/Bicultural Education

Each program was required to do a priority review and submit it to the administration. We did that and justified our program in a number of ways including offering a recruitment plan to increase our number of majors. While our recruitment efforts have been successful over the last year, we went from numbers in the low teens to 26 majors in the fall and 24 currently (4 double majors, so 20 in the eyes of the admin), it hasn’t been successful in earning us a program justification. So our program’s fate hangs in the balance. In the meantime, the budget situation gets worse in Illinois.

On December 8th of last year, the administration announced they were going to lay off 50 faculty members. Then they asked me as chair of the Faculty Senate to hold an election for an “Academic Program Elimination Review” (APER) Committee. Our employee union has language in our contract for such a committee. You can read the contract here. The relevant section is Article 26 (page 72).

It reads: “26.1.  When the University is considering eliminating academic programs that would result in the layoff of an employee, it will constitute an Academic Program Elimination Review (APER) Committee…”

So here we are, waiting for an advisory committee of five people, one from each college and the library, to make a recommendation to the provost on what to do with these eight “low productivity” programs. The formation of APER committee indicates that faculty may be laid off with program eliminations, which is likely given the current and future budget situations in Illinois.

There is a lot more to our story than just this, but the fact is that in the fifth largest state in the U.S. the philosophy program at a state university is on the chopping block because of an overly simplistic evaluation metric. By all other metrics the philosophy program is an efficient and effective program, but others view it as a superfluous luxury and budget pressures make it and the other seven programs easy targets for elimination.

Philosophers must demonstrate the value of philosophy for a university education. I have written about assessment and non-academic administrators in the past. They’re here both on campus and in government, and they are making market-driven decisions about what a university education should be. Without a strong reply, lobbying effort, and PR campaign, we will see more of this kind of program evaluation in other states.  These metrics spread like cancer.

I encourage other Illinois philosophers to share their experiences with the IBHE and the program efficiency reports. If you are in another state that is dealing with similar issues, please let us know. And if you have developed methods of evaluating the effectiveness of a philosophy program (or other humanities program) other than number of graduates, please share what you have. Philosophers should be sharing assessment and evaluation methods for our mutual benefit.

Comments are open.

Leave a Reply to Derek Bowman Cancel reply

Your email address will not be published. Required fields are marked *

7 responses to “Evaluating Philosophy Programs: A Cautionary Tale about the IBHE”

  1. Chris Surprenant

    Louisiana is in the same position, although our term is "low completer" instead of "low producing." For the UL system (UNO, ULL, Southeastern, etc.), a program must maintain the following numbers over a rolling 5 year period in order to avoid termination for being a "low completer" program:

    Associate/Baccalaureate/Post-Bachelors 40 (avg. 8 per year)
    Master/Post-Master/Specialist 25 (avg. 5 per year)
    Professional/Doctoral/Post-Doctoral 10 (avg. 2 per year)

    As you can imagine, this policy puts incredible pressure on philosophy and other small(er) academic programs.

  2. Thanks very much for your insights and links to source documents! This is an unprecedented attack on higher education and we can't hope to repel it and minimize our losses without the kind of clearheaded analysis and timely information you have provided.

  3. Thanks for this sobering analysis. I want to ask a more specific version of a question I asked regarding some of your previous guest posts.

    Imagine a young philosophy ABD or recent PhD whose reasonable professional hope is to string together a series of 2-5 postdocs and or VAPs over the next 3-10 years in order to accumulate to accumulate the necessary teaching experience and research credentials to be competitive for jobs at state university like yours. If all goes well, she'll spend the next 5-7 years after that trying to accumulate the further research and teaching accolades to receive tenure. Now she reads your post and sees that even if all this goes well she will have to continue worrying about state budgets and devoting more and more of her professional time to matters of administration, public relations, and competing for resources with other disciplines and university departments.

    Why should she want to work and struggle so hard only so she can continue struggling? Why think such a career is a good choice for someone whose primary interest is in philosophical teaching and contemplation? At what point do the distractions of maintaining philosophy's place in the academy outstrip the distractions of doing philosophy while pursuing other lines of employment?

  4. Christopher Pynes

    Thanks for the questions. I will try to answer all three from your last paragraph in order.

    (1) Being a college/university professor isn't what it used to be (or what we think it used to be). Being a professor isn't an easy job, and if you are a professor who thinks it's an easy job, then you aren't doing it right, period. The struggles don't end with the tenure track job or with tenure, that's when the job gets even more demanding. So, the job doesn't end one's struggle. It is misguided to think that it does. It's just a different kind of struggle.

    (2) If your primary interests are philosophical teaching and contemplation, then it's the only game in town. It's not that it's a good choice, but rather it's the only real choice unless one is independently wealthy and you can teach for free and live off your wealth. But that's a rare situation.

    (3) This third question is a good question, and I have asked it of myself recently. The answer in my view is simple. If you do something other than philosophy teaching as a living, you will likely be consumed by it. It will become your life and your desire to teach philosophy and have a life of contemplation will be nudged out by other concerns. I know this from talking to friends who are no longer in the profession. They get involved in their lives and the philosophical concerns fade into the background. If you want to teach and do philosophy, college/university teaching is basically the only game in town. I am not sure at what point the distractions of promoting the discipline and profession become too much. That's an individual question that can only be answered when other factors like income needs and geographic living desires/needs are included. I have no simple answer for you, but I know I am not there yet. I certainly feel the push, and I certainly would like to do more philosophy with more colleagues and more students.

    I do, however, have one final comment. A big part of the reason philosophy is in this current situation as a profession is because philosophers of the past have let this happen by inaction and neglect. Those with the best resources and influence haven't paid much attention to the health of the profession. Being concerned for oneself at all times is bad for the profession and the discipline. If philosophers had done a better job of promoting philosophy in the past, we wouldn't have to work so hard to promote and protect it now. But we aren't in that situation. We are in the work like hell to save the profession for future philosophers. That is going to involve philosophical sacrifices by some philosophers for a flourishing future for others. I can’t do it alone. A few of us can’t do it. It’s going to have to be a full team philosophy effort. The game in public higher education has changed, and I’m just not sure most philosophers of influence realize what game we are playing now.

  5. Chris,

    Thanks for your reply. I actually think that accepting university employment as "the only game in town" is also part of the problem. It leads young philosophers to accept poor prospects of employment and to think they're supposed to feel lucky to receive whatever scraps they are able to collect. And it leads established philosophers to signal to their students and colleagues that the only way to avoid "leaving philosophy" is to maintain some form of academic employment, no matter how poor the pay or working conditions. The fact is there are other ways to teach and engage with philosophy. The university is just the default.

    You mention that doing other jobs can be consuming in a way that replaces philosophical practice. That's certainly true, but as any job candidate will tell you, the job of competing for positions can also be consuming in exactly that way. From what you say, it sounds like the job of lobbying for philosophy and dealing with the bureaucratic and administrative demands of the modern university also threatens to be consuming in that way.

    I commend the work that you do, and I can see why it is reasonable for someone in your profession position to decide that the best way to work for the future of philosophy is to work to promote the place of philosophy in the academy. But given what a daunting and consuming task that is, I'm not sure that we wouldn't be better off if we could find a way to channel that same collective effort into creating and expanding other social spaces for serious philosophical education and exchange. To the extent that university jobs really are "the only game in town," it's because philosophers make it so by giving over our professional and intellectual identity to our university employers. As you say, the game has changed, and philosophers need to think about whether we really want to play the new game.

  6. P.S. There's a huge gap between "easy job" and "constant struggle." I don't think anybody really expects the former, but think we all deserve better than the latter.

  7. These discussions are happening in many states, and in many state universities. My state's legislature hasn't included a "low performance" clause in the university regulations yet, but its cousin comes up every legislative session.

    Terms like "X by Y" become policy because they sound good. My own state's "55 by ‘25" is less ambitious than the Illinois "60 x 2025", but at some level it is better because it rhymes.

    Number of majors has become a key metric because it is something one can measure. Years ago, as a faculty senate chair, I managed to derail consideration of closure of one small major (in a popular/high student semester hours department) by asking if the goal was more basketweaving majors? What state need was that filling? And if so, was the campus willing to give them time and resources to build the number of majors?

    My state wants to increase the number of graduates, but they want those to be in majors in a narrow set of fields. Somehow the same fraction of students who currently lack the training to get into college are supposed to be getting degrees in electrical engineering 10 years from now. Naivete at this level would be charming, if it didn't have repercussions for so many people.

    All this said, there should be mechanisms and criteria for closing programs, since otherwise you have to put in difficult-to-surmount barriers to create new programs; it is hard to get support for a new program if the commitment is for the life of the institution. This can lead to intellectual stagnation at the institutional level. The mechanisms should be faculty-led, and the criteria should *not* include counts of majors, though counts of overall students is not a terrible metric as long as it is just one of several things considered.

    It is easy for those of us in traditional fields to assume that we should be protected from closure, but it is hard to craft a convincing argument for this. Our best hope is come up with fair, objective, and realistic policy ourselves, or else legislators will micromanage our curriculum for us.

    —–
    KEYWORDS:
    Primary Blog

Designed with WordPress