The $5 Textbook – Now For Less Than $5

From time to time I re-review the costs from various print-on-demand vendors to see if we can’t get the cost down a little further on our just-as-effective-as-$100-big-publisher-books $5 textbooks. Good news! CreateSpace, one of the first sites I reviewed this time around, can print our books (8.5×11, B&W, paperback, 250 pages) for $3.85. Add $0.40 per book for shipping, and the $5 dollar textbook is now a $4.25 textbook, delivered. What else will we find as we continue to review vendors in preparation for 2012-2013?

If you’re not familiar with the $5 textbook, these are digital textbooks that use an open license (a Creative Commons license, to be more specific) originally published by CK12. These books are free to adapt, revise, improve, and use in any format. The Open Education Group at BYU works with districts to help them develop their own custom versions of these high quality high school science textbooks (and, starting Winter 2012, high school math textbooks) that are individualized for their students’ specific needs. Where infrastructure allows, these books can be used digitally for no cost. For other settings, we work with print-on-demand vendors to provide printed versions of these books that cost about $5 each.

When we compare the Utah state CRT scores of students who use the $5 custom books with students who use traditional, expensive textbooks, we find no difference in the percentage of students who are proficient at end of year. That’s a savings of over 50% of textbook costs (when you buy one per student each year and give it to the student to keep forever, highlight in, take notes in, etc. – things they aren’t allowed to do in their traditional textbooks) for the same amount of learning. We have anecdotal evidence supporting the conclusion that when students use these books proactively – taking notes, highlighting, etc., the amount they learn increases. While this finding would agree with previous research, we need more data to be able to make this claim with certainty.

And what can a district do when it saves 50% on textbook costs? Well, textbook money can only be used for textbooks, unfortunately, so districts can’t turn these savings into increases in teaching staff or teacher salary. But there are still interesting things that can be done. As one example, these savings can be used to purchase hardware (like iPads) on which digital versions of open textbooks could be read. The digital versions of books can still be annotated, highlighted, etc., and students can keep their digital versions forever. And the digital versions of these books are completely free. In other words, one way to view the financial savings gained from using open textbooks is as a completely self-funded way of acquiring the hardware needed to transition an entire district from static print material to interactive, digital content. And that’s just one example – a district is only limited by its imagination.

So far about 4000 Utah high school students have used these open high school science textbooks, with the support of the Open Education Group at BYU, CK12, and the William and Flora Hewlett Foundation. This year almost the entire Nebo district is participating. If every high school science class in the state were to save 50% for the same (or better) learning outcomes, the annual statewide savings would approach $1.5M.

We’re hoping to “greatly expand” the program for next year, and should be able to make a specific announcement soon. Keep watching!

Efficacy Data Are In!

The Big Take Away:

Schools can save over 50% on textbook costs without negatively impacting student learning.

The Short Version: Simply substituting open textbooks for proprietary textbooks does not impact learning outcomes.

The Longer Version:
If there’s one thing this project has taught me about data, it’s that they’re messy. I knew this already, but I assumed that with our relatively small year one pilot group (n=7 teachers) things would be easier and cleaner. Instead, what we ended up with was the 2011 CRT (state standardized test) scores for each teacher (these scores are a percentage indicating what proportion of their students demonstrated proficiency on the exam as judged by the state), the 2010 scores for each teacher, and the 2009 scores for only four of the teachers. We had hoped for 2011 plus three years back for every teacher, but some of our teachers are new (no data beyond 2010), some have moved schools (“difficult” to get data beyond 2010), etc. Fortunately there doesn’t seem to be any hidden systematicity to our missing data.

So what did we find? Table 1 gives raw scores.

Teacher T Teacher U Teacher V Teacher W Teacher X Teacher Y Teacher Z
2009 64 N/A 54 59 100 N/A N/A
2010 69 62 44 59 99 88 89
2011 61 61 58 82 100 83 85

There are two straightforward ways of asking these data about the impact on student learning of substituting open textbooks for proprietary ones.

The first, noisier way is just to subtract the 2010 scores from the 2011 scores (remember, these scores are the percentage of students achieving proficiency). When we do that, we get a distribution that looks like this: -8% (i.e., 8% fewer students achieving proficiency), -5%, -4%, -1%, 1%, +14%, +23%. The mean of this distribution is +2.86% and the mode is -1%. By either measure of central tendency, there is almost nothing happening in this data.

The second, slightly more stable way of looking for the impact on student learning is to subtract either the average of the 2009 and 2010 scores (when both are available) or the 2010 scores otherwise from the 2011 scores. This gives a slightly better picture of what the “true” previous scores were. This method provides the following distribution: (-5.5%, -5%, -4%, -1%, +0.5%, +9%, +23%), which has a mean of +2.43% and a mode of -1%. Again, there is nothing to see here folks. These aren’t the droids you’re looking for. You can go about your business. Move along.

As a side note, I should point out that we’re keenly interested in what the teachers who saw 23% and 14% jumps did with their open textbooks last year. One of these teachers told me, “the betters students write in their textbooks more.” If this casual observation turns out to be true, and this particular change in pedagogy can be propagated broadly, perhaps we can see wide increases in proficiency scores. We’re looking at just what exactly students are doing with their books more closely this year (with 20+ teachers in this year’s group).

We’ll be running more sophisticated analysis next year with the larger data set, and collecting data on this for a few years to come to improve the stability of the findings, but for the first year pilot this is a fabulous outcome. The implications for students, schools, and districts are “large” indeed. A more formal writeup to come.

The $5 Textbook

We went through lots of pain and suffering last year trying to find the “right way” to print open textbooks – the way that makes them super affordable. We printed with different vendors, printed books whole and in sections, bought and stuffed three ring binders and tried paperback print on demand, etc. Some of these approaches were more expensive than traditional textbooks, as we explain in our upcoming article. But we also discovered the “killer app” – a process for localizing textbooks to meet local student needs and print them at the super low cost we were looking for.

How well does it work? Here’s the receipt from this year’s textbook purchase:

When you divide the total purchase price ($14,400 including shipping) by the total number of high school science textbooks we purchased (2690), you will discover that the average printing + shipping cost for one of our textbooks this year is:

$5.35.

Heck yea! This is what we’ve been looking for. Localized books, printed at scale, at ridiculously affordable prices, just as our online Open Textbook Cost Calculator predicted. Oh, and by the way, they’re not just less expensive – they also enable new pedagogies.

Effectiveness data will be forthcoming soon – how much science do you think the kids using $5 textbooks learn compared to kids whose schools adopt $100+ textbooks?

Cost paper finalized and submitted

The paper we’ve written outlining all the cost-related lessons we learned during the first phase of the Utah Open Textbooks project has been submitted to the International Review of Research in Open and Distance Learning! While you’re waiting for an opportunity to read the prose, you might enjoy interacting with the Open Textbooks Cost Calculator we created based on the lessons we learned.

We’ll be announcing information about Phase 2 of the UOT project in the coming weeks. Stay tuned!

UPDATE: Apparently open textbooks is just a little too far away from distance learning to be a good fit for IRRODL. Consequently, we’re rolling up the year two cost information together with year one efficacy data and submitting a new version of the paper elsewhere. More to come…

March Meeting

We had a great meeting with the Teachers in March. They reported that their students are loving the textbooks and many students from other classes are envying the textbooks. We’ve also finalized our cost analysis and are putting the finishing touches on a paper to publish about it so that everyone can benefit from what we’ve learned. Finally, David Wiley has put together a very cool calculator that estimates the cost of switching to open textbooks. Anyone can get online and try it out at http://opencontent.org/calculator/.

We asked our teachers if they find themselves doing anything differently because they are using open textbooks and they shared several good examples. One of our teachers said that having the textbooks the students can write in saves him a lot of time since they don’t have to go back and forth between the textbook and a worksheet and he doesn’t have to spend extra time preparing worksheets. One teacher said that she doesn’t have to have her tables scrubbed like she used to because the kids don’t doodle on the tables anymore, now they doodle in their textbooks (and the kids love that it is okay because the textbook belongs to them). Several of our teachers agreed that they present content in a different way because now the students can follow along in the textbook and it makes content presentation much easier. They also mentioned that when a student misses class, it is so much easier to get the student caught up–the teacher simply tells them which chapters they missed. Since the teachers didn’t use traditional textbooks as regularly as they do the open textbooks, the students weren’t able to follow along in their textbooks and a few chapters in the textbook wouldn’t help the student catch up with what they missed in class. One teacher mentioned that his students are learning much more from the science labs than they used to because the book now matches what they are doing in their lab.

When discussing how their students use the books, one teacher said that initially she thought that she would have to remind the students to highlight their books frequently but she has found that they grab the highlighters and mark up the books all on their own.

In the final analysis the costs proved more difficult to calculate than we originally thought. The reason is that we gave the teachers several choices and we used two different printers. But we were able to analyze them and discover that with the experience we’ve gained (which printers to work with and which ways to print it) people can potentially save money by using open source textbooks. But what we’re most excited about is the potential educational benefit. And we’ll have more information coming on that in the next few months.

For now, we’re going to be getting our results published and we have the calculator up for folks to play around with.

Quick Update

Things have been quiet this winter as our teachers have worked hard with their students and the BYU team has been working hard on several projects. We are nearing completion of a paper that addresses the cost portion of what we are studying. It has been interesting to dig into the literature and data about costs associated with OER textbooks and traditional textbooks. We’ve also learned a lot about the textbook adoption process, how school districts pay for their textbooks, and a lot of other good, nitty gritty information.

We’ve also become interested in teacher empowerment and how this project relates to the ongoing conversation about it. Teacher empowerment has been a significant part of educational reform discussions for a few decades and there have been some interesting conversations about curriculum development and teacher empowerment as well as how much an empowered teacher can strengthen a school and its students’ education.

When we’re finished with our analysis of the costs associated with printing textbooks in our OER pilot study, then we hope to delve a lot deeper into student learning and teacher empowerment as both topics are very interesting and relevant.

Checking in on textbooks

The week before Thanksgiving Tiffany and Shelley went to visit some teachers and see how the textbooks were working for the students. Two teachers were kind enough to let us come in and observe how students were using the textbooks and ask the students some questions.

The first class they visited had the option of using the textbook on an iPad or using the paper version we printed for them at the beginning of the year. That day the teacher was giving a lesson on highlighting and writing notes using the iPad. He showed the students how to do it, had them follow along and then had them look up specific genetics vocabulary words to highlight and make notes on. As he was showing students how to write a note in the margin of their digital textbook one of the students exclaimed in excitement, “I wish our regular textbooks could do this!” The teacher smiled and said “Oh they can.” He then described how you can take a highlighter and drag it across the page to highlight a section and then write a note in the margin.

As Shelley and Tiffany watched the students in both classes work and asked questions, they continually heard the other students echo the same sentiment. They kept saying how useful it was that they could write in their science textbooks and that they wished they could write in other textbooks too. Several of them talked about how it helped them group ideas (many students highlighted with multiple colors and assigned specific colors to specific ideas) and others talked about how it helped them work through difficult concepts.

Tiffany asked students what other courses they would like to have write-able textbooks in. Math was the overwhelming consensus with other science classes close behind. One student also mentioned how much it would help in her music theory class.

When Shelley went into the classroom, she had been skeptical that students would write in their textbooks and she was pleased to find that students were writing and marking up the textbooks a lot. And when she asked them if they were marking it up in response to teacher assignments, they gave her funny looks and explained that they did it on their own for their own learning.

For the next steps in the study, the BYU team will identify what constructs they want to measure and put together questions to get at those constructs. They’ll spend more time in the classrooms with students and teachers and get more information about how students are using the textbooks.

September Teacher Meeting

Last week we had a very exciting teacher meeting. Besides getting to see each other again, we talked about how the students have been responding to their textbooks, how technology is working in the classrooms, and what questions we are interested in asking the students and the parents about this project.

The students have responded well to their new textbooks. We discussed some of the pedagogical reasons that the teachers made the choices they did and it seems as if the students are excited to hear the new reading and learning strategies that the teachers have planned. One of the ideas we talked about is student ownership of the textbook and student ownership of learning. Do students feel more ownership when they get to write in and keep their own textbook? Do they feel more ownership of their learning when their book was customized for them and they get to further customize it by writing in it and highlighting it?

Tracy shared an experience with us that when she asked her students to answer the questions at the end of the chapter, one of her students voiced a concern that she hadn’t brought her notebook and she didn’t know where to write the answers. Tracy explained that the students were supposed to write their answers in the books–in the margins. She got stunned looks from students and it took them a few minutes to get used to the idea. Once students do get used to writing in their books, might they start taking notes in their books, tracking their thoughts, or asking their own questions?

Several of the teachers participating are having their students use the textbooks online–with PCs or iPads–and using online note-taking applications (i.e. diigo). Even though it has only been a few weeks, it seems as if the students are taking to the new technology well.

As we discussed what we are interested in knowing from students and parents, we discussed many of the specifics that we are interested in knowing.

  • How might online interactivity change the way students use a textbook?
  • Does online availability change the way parents are involved with student learning?
  • Does a smaller, more customized textbook change the way students perceive it and its contents?
  • Will the students engage in the textbook and in their learning on a deeper level since they have ownership of their textbooks?
  • In what ways are students using the textbook that they haven’t before?
  • Are students reading the textbook more this year than previous years?
  • Do students feel like this years textbook is more ‘useful’ than previous years’ textbooks?
  • For those students with no physical textbook, how do the parents feel about that?
  • For those students whose teacher highly customized and even wrote the textbook, how do parents feel about that?
  • Do the parents notice a higher level of student engagement with the textbook and the course?

These questions gave us a good idea of what our teachers are interested to know. As we get closer to our data gathering,  we will use these thoughts to craft the questions we want to ask and to learn more about how the open textbooks are affecting the schools.

Binder Stuffing

Today we stuffed 255 binders full of open science textbook material to deliver to some very happy teachers.

School is Starting and We’re Still Printing!

For some of our teachers school has just started and for others, it will begin in the next few days. Over the last few weeks we’ve been frantically trying to get everything printed on time but alas it hasn’t happened quite like we imagined. Several of our books are still out to the printers and most of them are already printed, sitting, and waiting for binders to arrive. It has been interesting to try and juggle all of the different printing options that we made available. We’ve printed and delivered “starter kits” for teachers to get going, and will be delivering completed books soon.

Some of the teachers decided to go with regular paper 3-hole punched and loaded into a 3-ring binder, and others chose to print a more traditional textbook-look by printing it paperback with a ‘perfect bind.’ Unfortunately there was some confusion about the technical terms in book binding and what exactly they meant. There were also unforeseen delays in ordering binders and in getting the manuscripts completely prepared. In the future, having fewer options (perhaps even dictating what kind of printing a teacher will get) could eliminate confusion and make the process go better. Furthermore, misunderstandings and disappointment is also less likely with fewer choices.

On the other hand, teachers make the choices they make for pedagogical reasons. It would be interesting to look at questions surrounding learning, pedagogy, and book binding. Do teachers and students use their textbooks differently depending on what form they take? Do they use a loose-leaf 3-ring binder textbook differently from one that is perfect-bound? What pedagogical goals are teachers considering when they make the decisions about how they want their books bound? What difference do they think it will make to the students and will it make a difference to the students in the end? –All interesting questions for further research.