6 Course Material Decisions and Factors: Unpacking the Opaque Box
Anita Walz
Introduction
Course material adoption within higher education is a complex, pedagogically driven, but relatively opaque process. To students, librarians, and those not teaching semester-length courses or involved in curriculum design, course material evaluation and selection in higher education can feel like a black box: opaque, proprietary, and mysterious, minimally transparent with only a few clues available through institutional policy requirements or instructor disclosures. Few instructors seem to openly discuss course materials among themselves or others. For open education advocates this opacity poses a problem. How can one provide relevant, customized information regarding open options when scant information is available regarding instructor motivations, criteria, processes, and ultimately curriculum or pedagogy decisions?
Several reasons exist for this opacity: a lack of training during instructors’ college and graduate programs, and cultural factors which perpetuate limited discussion of course material selection processes. Authors in both K–12 and higher education indicated that there are few training opportunities (Stein, Steuen, Carnine, & Long, 2001, p. 8; Allen & Seaman, 2014, p. 5) or that they have “little formal knowledge” (Smith & DeRidder, 1997, p. 367) of criteria used to evaluate textbooks or of protocols used by other institutions for textbook selection. A humanities faculty member reflects the limited, but changing culture of sharing within higher education:
There is a strangely idiosyncratic culture around course resources that is perhaps the consequence of academic freedom traditions in the US. There is little centralized sharing of best practices [regarding learning resource evaluation], although social media has changed this somewhat—I have witnessed substantial Facebook threads on textbook selection and approaches to teaching specific topics. Resource awareness and selection should be part of teacher training, which graduate students at Research I institutions do not receive. (Full-time humanities faculty in Allen & Seaman, 2014, p. 5)
There are likely other reasons including limited time, few perceived rewards for sharing, political factors, or a perception that course material selection falls outside of one’s area of research and expertise.
To education advocates, this lack of transparency may be viewed a missed learning opportunity for instructors and graduate students bound for teaching, as well as students themselves who might miss out on the benefits of their instructors’ knowledge and skill. For open education advocates, especially those based within libraries, the lack of transparency also poses some practical problems. The least of these problems is the barrier to joining and contributing to existing conversations and processes. At worst, lack of transparency regarding course material selection negatively affects the abilities of open advocates and librarians to carefully design appropriate, insightful, scalable, and effective programs and services for a range of open education applications. Open education advocates and librarians have a great deal to gain in better understanding course material evaluation processes and selection decisions. Better understanding these processes means a greater ability to join existing conversations, better understanding of the particulars of how their specific institution works, opportunities to expand one’s area of expertise, and the opportunity to add value regardless of the processes found.
Why it Matters
In 2007, the Advisory Committee on Student Financial Assistance issued a report stating “faculty have been faulted for largely ignoring price, routinely assigning textbooks only partially relevant to the course, switching from textbook to textbook on a whim, selecting lower-priced alternatives very rarely and failing to use all the material in the bundles students are required to buy” (p. 1). Students groan under the cost of course materials, many choosing to download illegal in-copyright copies, share, borrow, or go without. Students may express frustration when very little of the course material they purchased is actually used, or when they are required to spend extra money to rent homework software in order to submit homework (Walz, 2015). Students are increasingly deciding to not to acquire access to required textbooks, believing that lecture material is a substitute for textbooks. Many feel overwhelmed by the expanding amount and variety of resources (Berry, Cook, Hill, & Stevens, 2011).
Applying the dialectic concept of “open” as sharing, give-and-take, contributing, and giving credit, open practices are quite possibly the antithesis of the current idiosyncratic culture around course resources. However, as applied to many other aspects of higher education, the ethic or concept of “openness” is highly valued and directly relevant to the purpose and practices valued in higher education teaching and learning, research, and service activities, not to mention professional ethics and responsible use of resources. A lack of transparency and exchange of learning and expertise regarding course material selection appears to be a missed opportunity that affects instructors as well as students.
Conceptions of open education vary. Open education does not just include OER (open educational resources) or just open pedagogy or open source infrastructure. Open practices described in Librarians as Open Education Advocates describe a foundation which I believe has potential applications for teaching, research and scholarship, publishing, system design, outreach, service, and nearly any other function championed in higher education (McKernan, Skirko, & West, 2015). The authors describe these open practices as: sharing, giving (and receiving) [constructive] feedback, sharing and integrating new ideas about teaching and learning, understanding and using open licenses whenever possible, giving credit to others for their work, and “considering students and their needs as central to the activity of teaching and learning” (McKernan, Skirko, & West, 2015).
As practitioner-scholars, many academic librarians and instructional designers are already involved in open educational practices and engaged in modeling, championing, critiquing, improving, inventing, and/or supporting various open educational practices. Many instructors also within higher education adhere to and implement these values by sharing, valuing student learning, and providing service to their community, institution, and disciplinary associations. Sharing potentially messy processes regarding teaching and learning is perhaps not easy. My intent is to identify what we can know about this seemingly hidden process.
This chapter is intended to provide an introduction to the myriad ways that course materials are or could be evaluated, selected, and incorporated into curricular design with an emphasis on the contributions that could be made regarding course material selection by open education librarians. It reviews the literature in which instructors in higher education describe their learning material selection processes, the very few large studies covering course material selection evaluations in multiple disciplines, and the prescriptive literature describing how course material can—or should—be selected. This chapter touches on traditional course materials and those that have emerged as educational theory, technology, and instructor readiness have changed over time, making this one snapshot in a quickly changing environment.1 And it asks the question: Where can an open education advocate, or simply someone that cares about teaching and learning, start to make a contribution if they are not the course material decision-maker?
My hope in writing this chapter is that librarians and others involved in the open education movement who are also interested in applying open principles as a way to add value to teaching and learning processes will benefit from additional information regarding course material production, evaluation, and selection practices. I also hope that readers will be motivated to become increasingly savvy and valuable consultants and experts regarding course material selection in general and openly licensed course material use, production, or publishing, in particular, and that they will leverage open practices to solve problems in higher education.
What is in that Box? Course Material Evaluation and Selection
Several groups of literature predominate this area of study: Descriptive articles document rigorous processes of course material selection for particular college-level disciplines (accounting, foreign language, psychology, and history). Prescriptive documents, such as the dated but otherwise excellent Handbook for Evaluating and Selecting Curriculum Materials (Gall, 1981), and various shorter guides and rubrics provide recommended approaches. Thoughtful analyses of how course materials, philosophies of education, pedagogical approaches, and differing levels of teaching expertise interact with one another are relevant in this area. Last are the very few recent large quantitative studies, which explore instructors’ values in course materials and activities undertaken by instructors in selecting materials for courses.
Aspects of Course Materials Instructors Value Most
Recent large-scale studies on this topic in the U.S. or Canada reported that teachers in higher education most highly value comprehensiveness, effectiveness, cost, and writing quality in their evaluation of textbooks or course materials. A number of large-scale studies identify the top reported values. Individual articles supplement these with additional values not listed in the large-scale studies. And finally, the rubric used in the Open Textbook Library adds several.
Table 1. Top values of faculty in course content selection (multi-site research and individual reflections)
|
Scope of study |
Top values reported |
Source |
|---|---|---|
|
Large-scale study |
Efficacy, proven quality, cover a wide range of subjects |
“Babson report” Allen and Seaman, 2014, pp. 8, 34 |
|
Large-scale study |
Cost to the student, comprehensive content and activities, easy to find |
“Babson report” Allen and Seaman, 2016, p. 7 |
|
Large-scale study |
How well they address course objectives, accuracy, currency, consistency |
Florida Virtual Campus, 2012, p. 5 |
|
Large-scale study |
Clear and accessible writing, comprehensive coverage, ease of fit |
Jhangiani, 2017 |
|
Individual (regarding digital course materials) |
“My own assessment of [digital course materials],” cost to my students, and colleague comments |
Green, 2016 |
|
Economics |
Faculty time saving |
McMahan, 2013, p. 45 |
|
Hospitality-tourism |
Currency, subject-specific examples; interesting writing style |
Hsu and Lin, 1999, p. 25 |
|
Accounting |
“Relevance of the text material and its exposition quality, and compatibility between the text material and homework problems” |
Smith and DeRidder, 1997 |
|
Psychology |
Accuracy, readability/writing quality, and examples |
Landrum and Hormel, 2002 |
|
Any |
Comprehensiveness, content accuracy, relevant longevity [currency], and clarity of text |
Open Textbook Library, n.d. |
Given the ongoing public dialog regarding the cost of course materials (Are College Textbooks Priced Fairly?, 2004; U.S. Government Accountability Office, 2005; Popken, 2015) and the orientation of many institutions and some open education advocates toward cost, readers may have a particular interest in how instructors value cost. While cost appeared periodically in the top three most important factors, suggesting that cost is a factor, it was rarely reported as the most important factor. Hsu and Lin (1999) affirmed cost “as a relatively important conversation in textbook adoption … but [not] important enough to dictate the textbook selection decision” (p. 25). In reviewing Allen and Seaman’s 2014 survey,2 cost ranked as the lowest factor of all of the factors listed, but jumped to the top of the list in 2016 (Allen & Seaman, 2014, 2016). The 2016 report clarified this: it appears that faculty consider cost ceteris paribus: all other things being equal. “Faculty reinforce the idea that cost to the student is important, but only after content, relevance, quality, and presentation have been considered. Cost alone is not sufficient to drive the resource selection” (Allen & Seaman, 2016, p. 10). Factors which could be described as reflecting accuracy, effectiveness, andappropriateness of “fit” to subject and the given context seem to summarize the values well.
Course Material Selection Activities
We turn now to the literature on course material selection activities. The research literature on systematic course material selection processes abounds in K–12 literature. The literature, however within higher education is limited in quantity and tends to be highly discipline-specific. Further, higher education literature on systematic course material evaluation and selection leans toward novel high-effort approaches rather than repeatable, manageable, sustainable, and likely less flashy practices.
A few examples of these novel and wide-ranging approaches however may be helpful: One article examined five leading American Government texts, comparing their structure, guiding perspectives, in-text and electronic features for students and faculty, and notable strengths and weaknesses “with the goal of identifying appealing textbooks for instructors who value different approaches” (Knutson, 2017, p. 536). In the field of foreign languages, a study summarized an admittedly “time consuming” two-year collaborative textbook selection process for Spanish language instruction, which included the development of a 19-item evaluation rubric suitable for application to foreign language texts, collaborative and reflective review of results, and satisfaction rankings one year later (Czerwionka & Gorokhovsky, 2015, p. 4). A student, medical resident, and faculty textbook review process for pharmacy students aims to understand a learner-centric approach to textbook evaluation and selection, and to describe differences in textbook selection preferences between students and faculty (Peeters, Churchwell, Maura, Cappelletty, & Stone, 2010, p. 31). To complete an apparent gap in the literature, a dissertation by Tate reported on the determinants for selecting a successful principles of economics textbook based on an analysis of six adoptive criteria: textbook-integrated learning aids, organization format or layout, content, readability and rigor, and ancillaries for students and ancillaries for instructors (Tate, 1991, p. 66).
These are likely some of the exemplars illustrating new and novel practices. But how do all of the other time-strapped instructors in higher education select course materials? What are their roles? And what do they actually do?
The policies, strategies, and cultures of an institution and department determine how decisions regarding how to teach and what course materials to use are resolved. In general, and consistent with academic freedom in universities, decisions are made by an individual instructor or staff member, by teams of instructors, or by departmental curriculum committees. While often championed as an individual right, a department may choose not to extend the freedom to select course materials to individuals, seating this authority in committees. Given the importance of academic freedom in higher education, course material decisions are rarely made at the administrative level, but it does happen (Jhangiani, 2017).
Every educational institution is different from the next. At the large Research 1 Polytechnic University where I am employed, I have not found a consistent pattern of course material decision processes based on discipline type or level of course. For example: learning materials for some introductory courses in the sciences are decided by a committee which identifies core knowledge and skills students must master as a foundation for more advanced courses. Other large introductory courses on the more analytic side of social sciences are taught in sections by three or four different instructors, each using different textbooks and/or homework software, presumably equally able to prepare students to build on the subject material, but taking a different approach. Some departments choose a common text for fall and spring semesters but allow for experiments and other types of course material during summer or online sessions. Other departments in which large introductory courses are team-taught appoint a course coordinator who either builds consensus or decides about course materials. These committees and individuals may have formal or informal processes for course material selection.
Two patterns that seem to be prevalent pertain to textbook authors and tenure-track faculty. These observations vary widely from one institution or institutional type to the next, where different structures, traditions, and culture prevail. This implies value in knowing one’s own institution and interpretation of academic freedom. For textbook authors, the decision at my institution is simple: current policy allows authors to require the book they authored in their course.3 For tenure-track faculty teaching upper division and graduate levels, decisions about course design, teaching methods, and course content are solely their prerogative. This practice opens the door to a growing number of faculty that increasingly teach from their notes and/or select course readings from a variety of sources, an approach suggested by several authors (Novotny, 2011; Landrum, 2012) and anecdotally more common. When a tenure-track instructor suddenly inherits a course and the instructor’s predecessor is accessible, the inheriting instructor is likely to seriously consider the previous instructor’s recommendation regarding course material and teaching methods. In contrast, and common to most institutions grappling with an increase in temporary, adjunct, graduate teaching assistant, or non-tenure line instructors, is the assignment of course materials by someone other than the course instructor. External choice often leaves few happy with the selection of text or the proscribed role of the text in the course. The divide between teaching-focused and tenure faculty continues and is an important characteristic to know about.
Prescriptive Perspectives and Processes for Review of Course Materials
Process matters and many scholars have opinions and suggestions regarding how learning materials should be selected. Again, this literature is weighted toward analysis of traditional print textbooks, though some concepts may be transferable to interactive electronic resources. By far, the most insightful one-volume handbook I located is Meredith Gall’s 1981 Handbook for Evaluating and Selecting Curriculum Materials. While out of print and far out of date for electronic, internet-hosted, or interactive content, the handbook, I believe, accurately and succinctly describes issues related to any era of course material selection. Especially helpful for those wanting an introduction to curriculum studies, Gall mentions the timeless issues of: curriculum quality and commercialization, roles for various actors in higher education, the wide range of types of curriculum objects, the propensity of instructors to limit their searches to what’s easily available, the lack of instructor time and expertise in selecting course materials, relationships between instruction and course materials, and differences in learning resources even when options appear to be equivalent. Several helpful tools are included in the book, including an inventory and description of dimensions for analyzing curriculum materials (Chapters 4–6), a high-level course material process relevant for any topic and level of education, even higher education, and an appendix of featured curriculum materials that may facilitate learning. While updates would be needed, this source is very helpful and takes seriously the importance of selection of instructional materials in light of the fact that students spend far more time using instructional material than anyone else (Gall, 1981). (See the note below for guidance on accessing this out-of-print resource.)4
Several other authors report on prescriptive course materials selection processes or report on processes they have created or use. Prosser offers a summary of text readability analysis processes, prominent in the literature in the 1970s and 80s, namely using SMOG (Simple Measure of Gobbledygook) readability and the cloze test (Prosser, 1978). Heye offers a tool and process for evaluation of textbooks for nursing that enabled her school to include input from faculty members not initially involved in course material selection. Implementation of this process eliminated the need for supplementation of a main outdated text, reduced costs to students, and resulted in the use of materials that included updated health care developments (Heye, Jordan, Taylor Harden, & Edwards, 1987). Novotny provided a checklist for selection of nursing textbooks and provided guidance in assigning textbooks and journal reading assignments (Novotny, 2011).
Several scholars suggest value in having different levels of review. Lawrence summarized suggestions that the best of textbook evaluation schemes adopt a “leveled” approach: an initial overview of the strengths and weaknesses of the book with regard to design and structure, sequence, visual attractiveness, and availability of ancillary materials, and a further evaluation which is more detailed and determines whether text, skills and activities meet syllabus and learner needs (Lawrence, 2011). Kato affirms multipart approaches, indicating that textbook evaluation conversations should consist of pre-use evaluation, in-use evaluation, and post-use evaluation (Kato, 2014). Arnold’s research adds the insight that faculty valued being part of (textbook) pre-publication review (Arnold, 1989). Multiple authors cited a need for more instructor training and knowledge regarding course material selection (Gall, 1981; Stein, Steuen, Carnine & Long, 2001).
Course Materials, Pedagogy, and Levels of Instructor Expertise
Open education advocates and librarians can benefit from understanding the intended role or purpose of a text within a course. Texts may be adopted as a course reference, because textbook adoption is expected even though the textbook is not well integrated into the course, to aid students in building a resource collection, for ease in scaffolding the course or countering an instructor’s self-perceived deficiencies (Lawrence, 2011, p. 7, Confrey & Stohl, 2004, p. 43-46), or a combination of these reasons. In theory, course material selection should support course objectives, instructor pedagogies, and efficacious student learning habits. New instructors or instructors with new courses are more likely to adopt “book in a box” course materials but as they become comfortable with the course or less risk averse to changing the course away from parts that are not working, they may become more open to alternate pedagogies and curricular materials. It is into this dynamic environment that the open education advocate steps. The open education advocate or librarian may encounter a wide range of instructor comfort or discomfort with teaching and learning processes. Some instructors may be experimenting with incremental or major course design changes. Others may be content with limited investment in teaching or feel obligated to focus most of their energies on research endeavors. The librarian may also observe the impact of the institution or department’s politics and practices, governance and budgeting constraints, relative importance of career advancement via tenure and promotion, and individual instructors’ tolerance of risk, comfort, and perceived available support; each of these factors can and do influence student learning outcomes, selection of pedagogical processes, course materials, an instructor’s decision to go without traditional or emerging course materials, or an instructor’s openness to experiment with open pedagogical approaches. Beyond pressures related to an instructor’s career advancement, the relationship between instructor risk tolerance, comfort, and support, pedagogical understanding and openness to pedagogical and assessment methods, and beliefs regarding the purpose of course materials should not be understated.
Usage and types of course materials have changed over time due to educational philosophies, legal environments, cultural expectations, availability of trained educators, and commercial and technological changes. The earliest and most traditional course materials were printed textbooks and readers for children, designed to lead to literacy using catechism (question and answer) as their instructional mode. In the late 19th century, changing educational philosophies, the increased availability of trained teachers, and orientation toward deductive approaches and generalized morals in response to high immigration resulted in changes in curriculum resources (Wakefield, 1998).5 One hundred years later, and in the scope of higher education we see continued evolution of educational philosophies, development of cultures of tenure-track and adjunct faculty, an increased proportion of the population expected to engage in higher education, and impacts of technological change on course materials and instructional practices. Print resources are supplemented or replaced by digital course materials and systems. Not dismissing persistent digital divide issues, course materials and learning processes are now embedded in closed learning management systems, blogs and wikis, ebooks, online discussion boards, online homework systems, adaptive learning and intelligent tutors, student-driven platforms for authoring, game-based learning, and all manner of tools, clickers, and software systems. All bring pedagogical assumptions, some evidence-based. Regardless, many are adopted for classroom use.
Technology-enhanced learning resources represent some of the most creative, interesting, useful, and potentially responsive but constantly changing options within learning spaces. Many provide student metrics, allowing instructors a view of student time on task, theoretical opportunities for early interventions, and a research platform in which to start to learn what works and what does not work. Some offer freemium services, with more advanced premium services available at a fee. Open source projects are also present in the mix, some with an open business model (where content costs nothing) and in which services are rented on a subscription basis. The options are constantly changing. Current and new instructors with limited prior exposure to digital instructional methods or constantly changing digital learning environments are likely to be overwhelmed and feel disrupted when changes are foisted on them—such as the change of an enterprise-wide learning management system or techno-pedagogical changes such as flipping a classroom or converting a course to a blended or online format, which are willingly undertaken to improve a course which is otherwise not working, or for department, institutional, or financial reasons. Instructors at research institutions may lack adequate incentives—or support—to envision or achieve these types of changes in their classrooms (Gregory & Lodge, 2015). While there are many reasons to experiment with emerging technologies, some choose not to but regularly update their course notes and are perhaps less engaged by new technologies. For those who embrace new technologies, there are several potential downsides: needing time to teach a new tool, neglect of student privacy,6 and setting students up to game a system rather than engage in deep learning and authentic reflection.
While this chapter does not cover in depth selection methods for educational technologies including software programs, audience response clickers, homework software access codes, or other electronic ancillary tools, sometimes thought of as instructor conveniences and sometimes thought of as student aids,7 I do want to note that implementation of educational technology tools seems to be growing. I have observed two main responses: instructors who select materials based on research evidence are often slow to adopt such tools when their effectiveness is insufficiently documented, and instructors attempting to manage very large courses tend to adopt them quickly out of convenience if not survival; sometimes they are abandoned just as quickly.
Incentives Influencing Design and Selection of Course Materials
To the innocent bystander, the presumed aim of course materials in mediated instruction within higher education is student learning. As discussed above, this goal can be muddled by various incentives. Several influential factors still remain:
- Perceived quality (sometimes signaled by a trusted brand name)
- Author authority/accuracy and currency of content
- Reliable scope, sequence, or structure for instructors and students to follow
- Perceived fit for the student’s level of expertise
- Perceived fit with instructor’s methods of teaching
- Use of emerging technology (this factor can encourage or discourage, depending on instructor comfort)
- Time savings for faculty (including pre-made lecture slides and assessments)
- The selector’s valuation of meaningful promised student analytics8
- Authoritative resource for student reference now and in the future (Arnold, 1989)
- Departmental/institutional expectations or requirements regarding always assigning a text even if the text is not heavily used
For novice instructors, part-time adjuncts without preparation time, graduate teaching assistants, and faculty teaching a course for the first time, course resources fit best as a support structure for the instructor. Experienced instructors and those with a more comfortable grasp of teaching the content area are likely to not need to rely as heavily on course resources, may be more likely to teach with learning resources they developed themselves, might not require student acquisition of learning resources, but may still assign course materials for student benefit, because students expect it, or because assigning a text is just what you do.9 Sometimes, an instructor’s long-time habits dictate assigning a required textbook as a “resource” even when it will not be used very much in the course.
Of course, disciplinary differences in pedagogy and student needs come into play. Course materials in different disciplines may have quite different functions. For example: student learning activities in literature, foreign language, and biology differ quite a bit and affect the types of course materials selected. Students studying literature may focus primarily on reading and writing activities; students in foreign language experience a much greater emphasis on listening, speaking, and, at the lower levels, grammar and basic sentence construction. Students studying biology are involved in learning the scientific method, maintaining a lab notebook, experiments, and hands-on activities in a laboratory.
Since purposeful learning materials were developed, they have helped instructors solve complex teaching problems (Wakefield, 1998). A generous example is the instructor who selects course materials that fit the course learning outcomes and offer students helpful problem sets, real-life applications, case studies, or other examples that help students transfer knowledge to other domains. A more cynical example is the likely overworked or unsupported instructor, perhaps with too many students, who assigns course materials primarily for the instructor’s own benefit. Course materials, especially commercial ones “have been written, edited and marketed as teaching and learning aids” (Wakefield, 1998, p. 23) and are often interpreted by instructors as such. Required homework software access codes and classroom response tools or clickers primarily for instructor time savings in grading or as an expensive experiment in innovative teaching are a prime example. In my experience, I’ve seen these decisions justified by having to teach a very heavy course load, large classes, or the promise that the tools will make students who don’t complete their reading assignments engage with the materials. These tools unfortunately pass on the burdens of an instructor struggling with getting students to engage in course material and/or trying to manage interaction and assessment of a very large class directly to students, often in the form of multiple required learning resources such as clickers, quizzing or classroom interaction tools, print or electronic texts, and/or homework software access codes.
This conflict between instructor and student needs is not condemnation of instructors who make these decisions, but a reflection a common problem cited in economics and political science literature, called a principal–agent problem. A principal–agent problem features a decision-maker (the agent), in this case the instructor, who to varying degrees reflects (or doesn’t reflect) the values and interests of the person or people she represents (the principal), in this case the students. When the agent or instructor is motivated to act in his or her own interest to the detriment of the interests of the principal or students, economists identify “moral hazard” as an outcome (Eisenhardt, 1989). One may argue that the instructor is indeed in a difficult situation, often teaching as a non–tenure-track professor, without leverage, and in a somewhat impossible situation where implementing all sorts of tools is the only solution. Whether intended or not by the department which created such large courses or by the instructor, moral hazard, or “harm,” is likely to occur when an agent puts their own needs above those of their principal—or when instructors assign course materials too expensive for students to access. Students may be harmed by losing the freedom to take a class or a major because it is too expensive, by taking on additional debt, additional work hours, or at minimum by additional financial stress. Further, students may lose consistent and reliable access by sharing course materials, or by participating in peer-to-peer copyright infringement in the forms of digitizing, sharing, and/or downloading illegal copies of learning materials. Again, this is not a condemnation that instructors or departments in these types of situations are malicious actors, but an observation that care needs to be taken to proactively identify and remediate situations in which incentives encourage an agent to act in a way that may be harmful to the principal.
Introducing a Paradigm Shift
What can an open education advocate do? For starters, engaging faculty in conversation regarding their particular contexts, what they like or do not like about their course materials. What kind of content do they wish existed? What kind of content (including questions and other artifacts for assessment) could they or students create? What freedoms do they have to pilot or repeatedly create small quantities of content or assessments over long periods of time? What do they wish was happening in their class that isn’t? These can be tender topics, so trust and diplomacy is called for. Six open educational practices or values may scaffold instructors in their early and late attempts in openness: sharing, early drafting, supportive feedback, studying licenses, giving credit, and putting students at the center (West, 2017). Understanding open practices and values as a paradigm shift, and introducing, discussing the relative merits, supporting, and implementing each of these values can provide a clear focus for one’s activities and assist in navigating where to spend scarce time and resources.
Ideally, instructors will develop courses around course learning outcomes, mapping content, activities, and assessments to course learning outcomes. Instructors exhibiting this type of teaching tend to have a sufficient if not high level of mastery over their subject and a high level of comfort with regard to teaching. A deep interest in one’s discipline and care for one’s students, relevant and reflective professional development opportunities, practicing teaching improvements, and valuing instructional practices are paths to developing efficacious instruction. Instruction which increasingly prioritizes these types of practices strikes a different balance between instructor expertise, teaching methods, and critical selection and use of course materials.
Learning and working to understand the realities of one’s campus or campuses, campus cultures, policies, practices, values, pressures, motivators and incentives are the probably the hardest part of this work and take the most time, but are well worth the investment. Understanding course material evaluation and selection process will likely require a brief review of institutional policy regarding textbook or learning resource selection. Conversations with each of the departments on your campuses can be helpful. A call to each departmental administrative assistant or advisor with the following questions is a good place to start:
- Do the majority of your instructors assign required books?
- Are course materials selected by committee or individual instructors?
- Who are the point people regarding committee-selected course materials?
- What is the course material adoption schedule look like in your department?
- How does reporting of textbook adoptions (to the bookstore or other) work?
- I’m interested in learning more about how course materials are selected. Who else do you suggest I contact?
The registrar of your institution will be able to direct you to someone who can explain how your institution handles approvals for new or updated courses and whether there are requirements to list learning resources used in the course.
Liaison librarians may be aware of department-wide curriculum initiatives and needs. If your campus has a Center for Excellence in Teaching and Learning or instructional design support embedded in another unit, you may also be able to glean useful information about course design/redesign assistance and helpful insight regarding learning resource selection processes and motivations.
Your bookstore, if cooperative, may also be a useful source of information regarding textbook and other learning resource adoptions. Some helpful ideas for building a relationship with your bookstore can be found in Bell’s 2018 article.
As you gather information and build trust, think about what open resources and open practices might contribute to resolving stated problems in current departmental resource selection processes. Some academic librarians have gone as far as to contribute to and coordinate year-long textbook evaluation processes for selected high-enrollment courses within willing campus departments. For those instructors overwhelmed with large-scale changes toward open educational resources, piloting an open resource as an alternative text is an option, as are incremental changes to incorporate open pedagogical practices which replace one reading or assignment over a period of time. The Open Pedagogy Notebook is one place to look for or share examples of open pedagogical practices (DeRosa & Jhangiani, 2018). The text A Guide to Making Open Textbooks with Students (Mays, 2017) may also be a helpful resource.
Novel and Purpose-made Course Materials
Course materials include any discrete media, format, or system deployed in support of the learning process. Cost and copyright concerns notwithstanding, course materials can now be almost anything. Some materials and processes used in courses today were not designed to be used in courses: news and academic journal articles, movie clips, equipment designed for industry, household items, 3D printers, beach balls, Twitter, Wikipedia authoring, and so on. These items and processes are used outside of classrooms and have made their way into courses. This is a refreshing trend, as the application of these materials on teaching and learning may enrich students’ lives and help them to see the world around them as having potential for learning and exploration.
Purpose-built course materials are different than materials not specifically designed for learning. Textbooks, educational videos, workbooks, digital flashcards, lab environments, problem sets, online modules, interactive quizzes, clickers, educational apps, learning management systems, and various assessment and engagement tools are created specifically for learning and are most often purpose-built for educational contexts. They are intended to be consumed or acted upon by students in specific ways with specific outcomes in mind. Purpose-built learning resources always have embedded assumptions about what constitutes learning, how people learn, what learning is for, and how the system supports or facilitates that learning. Because educational technology is built by a wide variety of people, some systems may reflect sophisticated and well-conceived pedagogical philosophies; others might not. Rather than engaging with learning as a process, some may envision students primarily as containers for content provided by instructors as seen in this public domain illustration.
Interactive systems designed by those with expertise in various pedagogical philosophies may rely heavily on pedagogical philosophies of behaviorism, constructivism, cognitivism, and any number of other pedagogical approaches.10 Learning resources and approaches are not pedagogically neutral.
Even as learning resources have changed with the times, they continue to be marketed as “teaching and learning aids” to solve problems (Wakefield, 1998). For the most part in the United States, development of course materials and educational technologies is a for-profit endeavor. This raises some ethical issues. For-profit ed tech companies serve two or more masters: student learning, generating a profit for shareholders, developing their research base, capturing market share and so on. Competition between these factors may challenge the most ethically minded ed tech company to deviate from valuing student learning above other factors. It is certainly possible to imagine the existence of a company that sells learning resources of value without being overly swayed by a profit motive. However, this is very difficult to do without powerful and built-in accountability structures. Like any business, commercial publishers are responsible to their shareholders for financial gains, so the conflict between product quality for ultimate end users (e.g., instructors and students) vs. shareholders is often difficult to navigate. (Potential authors courted by publishers also face these conflicts in deciding whether or not to sign a publication agreement. They are encouraged by potential royalties and legitimately enjoy attention, respect, and relationships with publishers. They often transfer copyrights to the degree possible, limiting access to their work, and give up control to write the book they want to write.)
Commercial approaches also have an impact on the development of learning resources. Publishing industry veteran Beverlee Jobrack’s book about the K–12 textbook industry describes how commercial incentives shape the K–12 textbook publication process. Jobrack explores how market research, competitor analysis, and focus groups lead to the development of educational materials rather than educational research, rigorous study, and effectiveness of past use of course materials. Publishers rarely fund studies to understand the development of a subject and how it has been taught in the past, strengths and weaknesses of previously used materials, nor the educational research literature. In focus group sessions “publishers confirm that teachers rarely care about program effectiveness when weighted against a perceived useful design … and when curriculum specialists are in the room, they nearly always prefer research-based materials, but realize that it would be an upward battle for their teachers to accept them” (Jobrack, 2012, p. 62). As a result, textbook development focuses mainly on features that are appealing rather than effective. While disheartening, Jobrack’s observation that the development process for commercial textbooks focuses on aspects that appeal rather than being chosen for their effectiveness is an observation for open education advocates and instructors who develop or adapt open educational resources. At the end of the day, if effectiveness is more important than appeal, openly licensed resources focused on effectiveness should be different in important ways than those developed with appeal in mind.
Some faculty feel compelled out of habit to require a textbook even if it is not used very much in the course. Other faculty explore pedagogies as far away as possible from passive, consumable resources, some using Wikipedia assignments or creating a textbook as part of their course (DeRosa & Robinson, 2017). Others are implementing practices to encourage student agency, such as giving students flex or pink time (Baird, Kniola, Lewis & Fowler, 2015). Increasingly, instructors are seeing student engagement with the course and course content as the key to improve learning (Hunt et al., 2016)
A Way Forward?
Let’s return to the question posed early in this chapter: Where can an open education advocate, or simply someone that cares about teaching and learning, start to make a contribution if they are not the course material decision-maker? For open education advocates, the keys to addressing the course material adoption issues on campus rest in working to understand the distinct realities of campus and departmental contexts and cultures, gathering information, building trust among instructors, decision-makers, and others working to address course material and teaching-related issues on campus, introducing a new paradigm of values and open educational practices (West, 2017).
Academic librarians and instructional designers already do many things to model, champion, critique, invent, improve upon, and/or support open educational practices. These may include but are not limited to: open access authoring and publication, creating and building sustainable, Creative Commons-licensed editable curriculum materials, modeling pedagogies and web development strategies dependent upon openly licensed content and open source software, contributing to open source infrastructure, developing open and sustainable models of operation through collaborative networks, and implementing student-centric pedagogies which grant increased student agency or emphasize creation of artifacts which have value beyond the classroom.
Others contribute to and aid faculty, staff and students to interact with authored content in ethical and sustainable ways by creating, remixing, and sharing research outputs with open licenses. OER are just one of many possible ways to implement the ethic or concept of openness. Librarians may be engaged or desiring to be engaged in course material or learning resource initiatives at their academic institution, including organizing evaluation or selection of openly licensed or other course materials and course material formats.
Building new expertise helpful to processes where there is no or minimal expertise may have even more potential. A few examples from this brief overview of course material production and selection where open advocates could add value include: provide more support for faculty training in course material evaluation and selection, curate tools and methods for all effort levels of course material review, and when developing openly licensed course materials, focus on effectiveness more than appeal.
And finally, build trust. Everything runs on trust and, in an ideal world, accurate information, sharing, and trustworthy processes and systems. Course material selection decisions are based on trust in people, information, and/or processes. Accurate information, reliable services that provide needed information, support, logistics or somehow add value, and a willingness to listen, learn, and respond with integrity should greatly add to creating a way forward that keeps learners at the center, values transparency, requests and accepts constructive feedback, gives credit, and promotes sharing.
References
Advisory Committee on Student Financial Assistance. (2007). Turn the page: Making college textbooks more affordable. Washington, D.C. Retrieved from http://files.eric.ed.gov/fulltext/ED497026.pdf
Allen, I. E., Seaman, J. (2014) Opening the curriculum: Open educational resources in U.S. higher education. Babson Survey Research Group. Retrieved from https://www.onlinelearningsurvey.com/reports/openingthecurriculum2014.pdf
Allen, I. E., Seaman, J. (2016) Opening the textbook: Open educational resources in U.S. higher education, 2015–16. Babson Survey Research Group: Retrieved from http://www.onlinelearningsurvey.com/reports/openingthetextbook2016.pdf
Are College Textbooks Priced Fairly? Hearing before the Subcommittee on 21st Century Competitiveness of the Committee on Education and the Workforce, House, 108th Cong. 2. (2004). Retrieved from purl.access.gpo.gov/GPO/LPS56745
Arnold, D. (1989, November 2–5,). A discipline sensitive model of textbook selection criteria in the higher education faculty. Paper presented at the Annual Meeting of the Association for the Study of Higher Education, Atlanta, GA. Abstract retrieved from https://eric.ed.gov/?q=ED313985&id=ED313985
Baird, T. D., Kniola, D. J., Lewis, A. L., & Fowler, S. B. (2015). Pink time: Evidence of self -regulated learning and academic motivation among undergraduate students. Journal of geography, 114(4), 146–157. http://dx.doi.org/10.1080/00221341.2014.977334
Bell, S., (March 15, 2018). Ideas for building a better relationship with your campus bookstore. Library Journal. Retrieved from: https://lj.libraryjournal.com/2018/03/opinion/steven-bell/ideas-building-better-relationship-campus-bookstore-bell-tower
Berry, T., Cook, L., Hill, N., & Stevens, K. (2011). An exploratory analysis of textbook usage and study habits: Misperceptions and barriers to success. College Teaching 59, 31–39. http://dx.doi.org/10.1080/87567555.2010.509376
Confrey, J., & Stohl, V. (2004). Framework for evaluating curricular effectiveness. In J. Confrey, & V. Stohl (Eds.), On evaluating curricular effectiveness: Judging the quality of K-12 mathematics evaluations (pp. 36–64). Washington, D.C.: National Academies Press. Retrieved from https://www.nap.edu/read/11025/chapter/5
Czerwionka, L., & Gorokhovsky, B. (2015). Collaborative textbook selection: A case study leading to practical and theoretical considerations. L2 Journal, 7(2), 1–12. Retrieved from http://escholarship.org/uc/item/1sd802w7
DeRosa, R., & Jhangiani, R. (2018). Open pedagogy notebook. Retrieved from http://openpedagogy.org
DeRosa, R., & Robinson, S. (2017). From OER to open pedagogy: Harnessing the power of open. In R. S. Jhangiani, & R. Biswas-Diener (Eds.), Open: The philosophy and practices that are revolutionizing education and science (pp. 115–124). London: Ubiquity Press. Retrieved from https://doi.org/10.5334/bbc.i
Eisenhardt, K. M. (1989). Agency theory: An assessment and review. The Academy of Management Review, 14(1), 57–74. Retrieved from https://www.jstor.org/stable/258191
Florida Virtual Campus. (2012). 2012 faculty and administrator open educational resources survey. Retrieved from https://florida.theorangegrove.org/og/items/7976fe31-6282-9f81-6dcb-5ea0b6ca037b/1/
Gall, M. (1981). Handbook for evaluating and selecting curriculum materials. Boston: Allyn and Bacon.
Green, K. (2016). Going digital: Faculty perspectives on digital and OER course materials. The Campus Computing Survey, Independent College Bookstore Association. Retrieved from https://kenneth-green-pln7.squarespace.com/s/GOING-DIGITAL-2016-ICBA-Faculty-Survey_3.pdf
Gregory, M., & Lodge, J. (2015). Academic workload: The silent barrier to the implementation of technology-enhanced learning strategies in higher education, Distance Education, 36(2), 201–230. doi: 10.1080/01587919.2015.1055056
Heye, M. L., Jordan, L. E., Taylor Harden, J., & Edwards, M. J. (1987). A textbook selection process. Nurse Educator, 12(1), 14–18.
Hsu, C. H. C., & Lin, L. (1999). Hospitality marketing: Textbook selection and course content. Journal of Hospitality & Tourism Education, 11(1), 22–29. http://dx.doi.org/10.1080/10963758.1999.10685218
Hunt, K. A., Trent, M. N., Jackson, J. R., Marquis, J. M., Barrett-Williams, S., Gurvitch, R., & Metzler, M., (2016). The effect of content delivery media on student engagement and learning outcomes. The Journal of Effective Teaching, 16(1), 5–18. Retrieved from http://files.eric.ed.gov/fulltext/EJ1092702.pdf
Jhangiani, R. (2017, May 24). Factors the influence the selection of open (and commercial) educational resources. Presentation at the 2017 Open Textbook Summit, Vancouver, BC.
Jobrack, B. (2012). Tyranny of the textbook: An insider exposes how educational materials undermine reforms. Lanham: Roman & Littlefield.
Kato, S. (2014). Using analytic hierarchy process in textbook evaluation. TESOL Journal, 5(4), 678–697.
Knutson, K. (2017). US government textbook review. PS: Political Science & Politics, 50(2), 536–541. doi:10.1017/S1049096516003152
Landrum, E., & Hormel, L. (2002). Textbook selection: Balance between the pedagogy, the publisher, and the student. Teaching of Psychology, 29(3), 245–248.
Landrum, R. E. (2012). Selection of textbooks or readings for your course. In B. N. Schwartz & R. A. R. Gurung (Eds.), Evidence-based teaching for higher education (pp. 117–129). Washington, D.C.: American Psychological Association. http://dx.doi.org/10.1037/13745-000
Lawrence, W. P. W. (2011). Textbook evaluation: A framework for evaluating the fitness of the Hong Kong New Secondary School (NSS) curriculum (Master’s thesis). Retrieved from http://www.asian-efl-journal.com/Thesis/Thesis-Wong.pdf
Mays, E. (Ed.). (2017). A guide to making open textbooks with students. Retrieved from https://press.rebus.community/makingopentextbookswithstudents
McKernan, R., Skirko, T., & West, Q. (2015). Definition of open education. In R. McKernan, T. Skirko, & Q. West (Eds.), Librarians as open education advocates. Retrieved from https://openedadvocates.
pressbooks.com/chapter/definition-of-open-education
McMahan, C. (2013). Theory and evidence of switching costs in the market for college textbooks (Doctoral dissertation). Retrieved from http://scholar.colorado.edu/cgi/viewcontent.cgi?article=1039&context=econ_gradetds
Novotny, J. M. (2011). Textbook and reading assignment selection. In M. S. Quinn Griffin, & J. M. Novotny (Eds.), A nuts and bolts approach to teaching nursing (fourth edition). Springer. Retrieved from http://www.ovid.com/site/catalog/books/7878.jsp
Open Textbook Library. (n.d.). Open textbooks review criteria. Retrieved from https://open.umn.edu/opentextbooks/ReviewRubric.aspx
Peeters, M., Churchwell, M., Maura, L., Cappelletty, D., & Stone, G. (2010). A student-inclusive pharmacotherapeutics textbook selection process. Currents in Pharmacy Teaching and Learning, 2, 31–38. doi:10.1016/j.cptl.2009.12.004
Popken, B. (2015, August 2). College textbook prices have risen 1,041 percent since 1977. NBC News. Retrieved from https://www.nbcnews.com/feature/freshman-year/college-textbook-prices-have-risen-812-percent-1978-n399926
Prosser, D., & Bondavalli, B. (1978, March 14–16). A textbook selection process. Paper presented at the Annual Meeting of the Remedial/Developmental Studies in Post-Secondary Institutions, Chicago, IL, March 14-16, 1978. Abstract retrieved from https://eric.ed.gov/?id=ED174941
Smith, K., & DeRidder, J. (1997). The selection process for accounting textbooks: General criteria and publisher incentives—A survey. Issues in Accounting Education, 12(2), 367–384.
Stein, M., Steuen, C., Carnine, D., & Long, R. (2001). Textbook evaluation and adoption. Reading & Writing Quarterly 17, 5–23. Retrieved from http://dx.doi.org/10.1080/105735601455710
Tate, J. (1991). A study of the determinants in selecting a successful principles of economics textbook (Doctoral dissertation). Retrieved from http://jewlscholar.mtsu.edu/handle/mtsu/4116
U.S. Government Accountability Office. (2005). College textbooks: Enhanced offerings appear to drive recent price increases. Retrieved from purl.access.gpo.gov/GPO/LPS64226
Wakefield, J. F. (1998, June). A brief history of textbooks: Where have we been all these years? Paper presented at the meeting of Text and Academic Authors, St. Petersburg, FL. Abstract retrieved from https://eric.ed.gov/?id=ED419246
Walz, A. R. (2015, March 23). University libraries host open education week [Blog post]. Open@VT: Access to information at Virginia Tech. Retrieved from https://blogs.lt.vt.edu/openvt/2015/03/23/university-libraries-host-open-education-week-2015
West, Q. (2017). Librarians in the pursuit of open practices. In R. S. Jhangiani, & R. Biswas-Diener (Eds.), Open: The philosophy and practices that are revolutionizing education and science (pp. 139–146). London: Ubiquity Press. https://doi.org/10.5334/bbc.k
- While written for the US higher education sphere, some characteristics will be applicable to countries beyond the United States and/or to the K–12 environment, though both these groups differ enough in regulatory context, procedures (especially regarding state or local control or alignment to standards), and pedagogical practices that the reader will need to carefully consider their particular context. ↵
- Reports from this series are informally referenced as “the Babson report.” ↵
- See Virginia Tech Faculty Handbook, Section 9.4: Textbooks and other Instructional Materials http://provost.vt.edu/faculty_affairs/faculty_handbook/chapter09/chapter09.html ↵
- The Handbook for Evaluating and Selecting Curriculum Materials book is out of print. A digitized version is available electronically with permission of the copyright holder at: https://vtechworks.lib.vt.edu/handle/10919/79783 ↵
- A helpful summary of the history of curriculum can be found in McCulloch, G. (2016). History of the Curriculum. In Wyse, D., Hayward, L., and Pandya, J. (Eds.), The Sage Handbook of Curriculum, Pedagogy and Assessment (vol. 1, pp. 47–62). Thousand Oaks: Sage Publications, 2016. ↵
- See also: Meineke, B. (2018, March 27) Signing Students Up for Surveillance: Textbook publisher terms of use for data [blog post]. Retrieved from https://medium.com/@billymeinke/signing-students-up-for-surveillance-textbook-publisher-terms-of-use-for-data-24514fb7dbe4 ↵
- For a more detailed treatment of homework software access codes, see Seneck, E., Donoghue, R., O’Connor Grant, K., Steen, K. (2016). Access denied: The new face of the textbook monopoly. Washington, D.C.: Student Public Interest Research Groups. Retrieved from: http://www.studentpirgs.org/reports/sp/access-denied ↵
- Learning resources that collect usage metrics or interaction data also have a new type of audience: statisticians, researchers, administrators, and sometimes commercial actors who analyze data to better gauge student engagement (often without institutional permission) and to understand how systems are or aren’t being used. Vendors of this sort often aim to sell this data back to institutions if ownership and access to this data by the individuals or institution was not contractually negotiated. ↵
- Due to course changes and faculty not always complying with requirements to submit information about course material adoptions, it is difficult to quantify what percentage of faculty assign don’t assign course materials which students must acquire themselves. ↵
- For an excellent introduction to instructional design and principles therein, see Chapter 1: Introduction to Instructional Design by Gagne, R., Wager, W., Golas, K., and Keller, J. (2005). Principles of Instructional Design, 5th edition. Belmont, CA : Cengage. ↵