Archives For no significant difference

Laptop

I purposely used a provocative title to highlight an intrinsic problem with the use of technology in education. We all too often use technology as a treatment, quick fix, or even a silver bullet when we attempt to apply a narrow technological solution to the complex problems we have in education. History repeatedly shows us that technology alone, or the hope that the application of technology, will radically transform the way we do education. Consider the following shortlist of predictions about technology that failed to deliver:

Schools have had a longstanding immunity against the introduction of new technologies. In 1922 Thomas Edison predicted that movies would replace textbooks. In 1945 one forecaster imagined radios as common as blackboards in classrooms. In the 1960s, B.F. Skinner predicted that teaching machines and programmed instruction would double the amount of information students could learn in a given time. Filmstrips and other audiovisual aids were fads thirty years ago, and the television, now seen as a supplier of brain candy, once had a sterling reputation as an education machine (Seidensticker, 2006, p. 103).

In the post Why AI Should Scare Some Educators and Not Others, I update these predictions by pointing to the failure of MOOCs and also point to the more recent AI predictions that many are promoting.

In the post Computers in Schools – Not Working…Yet I point to an OECD research report that shows adding technology (ICT) or computers in schools has not improved test scores. Rather than just give you the link to the 200+ page report I pulled some of the key information and quotes and summarized the highlights.

I am not alone in pointing to a long history of educators attempting to use simple or narrow applications of technology in an attempt to solve problems that require a much more complex solution.

In the post We Need More Autodidacts I explore Justin Reich’s (2020) article Failure to Disrupt: Why Technology Alone Can’t Transform Education. Reich’s article and this later published book point to the primary challenges that so many teachers have faced in moving fully online due to the Covid lock-downs. The challenge is not the technology; it is the fact that most students are not prepared to learn more independently or without direct instruction, close supervision, and control cannot be maintained as effectively in online learning. Reich also points to the fact that students who are more autodidactic have not been adversely impacted by forced online learning because these students are learners first who can learn more independently anywhere and at any time.

In this post, I also have links to Larry Cuban’s review of Reich’s article and links to Cuban’s book Oversold and Underused: Computers in the Classroom which offers an earlier version of Reich’s argument. Some of Cuban’s warnings on the empty promises of technology go back to the 70’s and 80’s so this is not a new idea. While Cuban is often referred to as a technology skeptic his examination of the data and conclusions are difficult to oppose.

Perhaps one of the most ardent skeptics of technology in education is Thomas L. Russell who’s book, “The No Significant Difference Phenomenon” (2001, IDECC, fifth edition), offers a fully indexed, comprehensive research bibliography of 355 research reports, summaries, and papers that document no significant differences (NSD) in student outcomes between alternate modes of education delivery. Russell’s book is difficult to get but you can review the No Significant Difference database at – https://detaresearch.org/research-support/no-significant-difference/

While Russell’s criticisms are well-founded, he doesn’t provide a perspective of how technology can be used to help to enhance learning.  Cuban does acknowledge the limited benefits in the use of technology but reasserts that many of the better implementations of technology use are not sustainable or don’t do much more than support for the traditional implementation of direct instruction. Similarly, Reich suggests that we need to help students become more autodidactic but doesn’t offer how to do this.

In contrast, I have been arguing for several decades how we can use technology to enhance learning. In many of the above posts, I point to how we can help learners become self-directed and independent learners or autodidacts. I have spent the last three decades exploring and researching this question and you will find that my site is filled with posts on learning how to learn. My most recent emphasis on the Learner’s Mindset is just the latest synthesis of how we can help learners change their thinking about learning and change their approach to learning without ignoring that we need to change the learning environment.

Technology is a powerful tool that can enhance learning but it can only do so if we focus on first creating significant learning environment where we give learners choice, ownership, and voice through authentic learning opportunities (CSLE+COVA). If we focus on learning first technology then can be used in practical ways to enhance learning. If we focus on the technology first the learning has to be fit into the limitations or constraints of the technology which we have seen just doesn’t work as well as the hype that precedes it.

You will find that my site is filled with posts on learning how to learn. To save you some time on searching my site consider the following posts as a starting point:

Reignite Your Learner’s Mindset
Change in Focus
Connecting dots vs collecting dots
CSLE+COVA
In pursuit of the better way – the learners mindset
DIY Mindset Requires a Learner’s Mindset
How to Grow a Growth Mindset
Assessment OF/FOR/AS Learning
To Own Your Learning You MUST Use Higher-Order or Deeper Thinking

References

Seidensticker, B. (2006). Future hype: The myths of technology change. San Fransico. CA: Berrett-Koehler Publishers

I have been working on finding ways to use technology to enhance learning since the early 1990’s so when I read the Students, Computers and Learning Making the Connection research report from the Organization for Economic Cooperation and Development (OCED) I was disappointed and also encouraged.

Disappointed – It Isn’t Working

After so many decades of working toward getting computers and related technology into our classrooms and school systems it is disappointing to see the research that shows:

Overall, the evidence from PISA, as well as from more rigorously designed evaluations, suggest that solely increasing access to computers for students, at home or at school, is unlikely to result in significant improvements in education outcomes. Furthermore, both PISA and the research evidence concur on the finding that the positive effects of computer use are specific-limited to certain outcomes, and to certain uses of computers. (OECD, 2015 p. 163)

While the report confirms that we have solved the acquisition problem of getting technology into our student’s classrooms it also reveals that:

…students who use computers very frequently at school do a lot worse in most learning outcomes, even after accounting for social background and student demographics (OECD 2015, p. 5).

The report’s authors admit that there are many questions that the report has left unanswered but perhaps the following statement may point to the core of the problem that we are seeing when we use technology in the wrong way:

If students use smartphones to copy and paste prefabricated answers into questions, it is unlikely to help them become smarter. If we want students to become smarter then a smartphone, we need to think harder about the pedagogies we are using to teach them. Technology can amplify great teaching but great technology cannot replace poor teaching (p. 6).

I was initially planning to cut the quote after “…pedagogies we are using” because I get annoyed with authors who are quick to blame teachers for the challenges we are facing in using technology to enhance learning. Most teachers are working tirelessly to improve their student’s lives but because they are mired in a system based on 19th & 20th-century practices when they add 21st-century technology to the mix it is no better than bolting a jet engine to a horse cart (Papert, 1993). Perhaps more troubling is that we are still using the 19th-century Thorndikian information transfer model and the recipe and regurgitation of information through a steady diet of standardized curriculum and testing. It doesn’t matter how much technology you add to this mix if you are using a digital worksheet, form, or test you are still simply asking your learner to regurgitate information.

We have known for a very long time that just adding technology to the classroom does not have any significant impact on learning. In the early 1990’s Thomas Russell and several other researchers pointed to the results of a meta-analysis of the research into technology use in distance education and found that there is no difference between technology-based instruction or classroom instruction (1999).

This no significant difference phenomenon is found in study after study. For example, in 1998 the ETS reported a negligible positive relationship between computer use and National Assessment of Educational Progress (NAEP) scores in math for 4th graders and a slightly more positive result for 8th graders (Wenglinsky, 1998). A more expansive multi-year study that involved hundreds of schools and thousands of students by the U.S. Department of Education (Dynarski, et al., 2007) found that “test scores were not significantly higher in classrooms using selected reading and mathematics software products” (p. xiii).

The research over the years confirms that substituting, augmenting or replacing (i.e. SAMR model) passive information transfer paper-based models with digital models of instruction does not improve the learning. Researchers like Hattie (2008) and Fullan (2015) have shown that focusing on the technology as a way to bring about change in the learning environment will not work – the focus needs to be on building the learning first and then using technology to enhance the learning.

What will work?

So if bolting technology onto our antiquated classroom and augmenting the 19th-century information transfer model of standardized curriculum and testing doesn’t work than what does? According to the OECD (2015) report:

Technology can support new pedagogies that focus on learners as active participants with tools for inquiry-based pedagogies and collaborative workspaces. For example, technology can enhance experiential learning, foster project-based and inquiry-based learning pedagogies, facilitate hands-on activities and cooperative learning (p. 6)

The OECD (2015) report also pointed to John Hattie’s research into what contributes to student achievement and confirms that:

Computers were more effective when they are used to extend study time and practice, used to give students control over the learning situation (pacing of material) and when used to support collaborative learning (p. 163).

Encouraging

So this finally leads me to explain why I am encouraged by the OECD report. When we look at the recommendations in the report like active learning, hands-on experience, student control and project-based learning it just confirms that giving learners choice, ownership, and voice through at authentic learning opportunities or what we have labeled the COVA approach can actually make a difference.

If we focus first on creating a significant learning environment in which we give our learners choice, ownership, and voice through at authentic learning opportunities then when we add technology to help with creation, communication, and collaboration we will be able to make a greater difference in our learner’s lives.

References

Dynarski, M., Agodini, R., Heaviside, S., Novak, T., Carey, N., Campuzano, L., … Sussex, W. (2007). Effectiveness of reading and mathematics software products findings from the first student cohort: report (p. 140). Washington, D.C.: U.S. Department of Education, Institute of Education Sciences,. Retrieved from https://ies.ed.gov/ncee/pdf/20074005.pdf

Fullan, M., & Quinn, J. (2015). Coherence: The right drivers in action for schools, districts, and systems. Thousand Oaks, CA: Corwin Press.

Hattie, J. (2008). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge.

OECD (2015), Students, Computers and Learning: Making the Connection, OECD Publishing, Paris.
http://dx.doi.org/10.1787/9789264239555-en

Papert, S. (1993). The children’s machine: Rethinking school in the age of the computer. Basic books.

Ruiz-Primo MA, Briggs D, Iverson H, Talbot R, Shepard LA. Impact of undergraduate science course innovations on learning. Science. 2011;331:1269–1270.

Russell, T. L. (1999). The no significant difference phenomenon: A comparative research annotated bibliography on technology for distance education: As reported in 355 research reports, summaries and papers. North Carolina State University.

Wenglinsky, H. (1998). Does it compute? The relationship between educational technology and student achievement in mathematics. Princeton, New Jersey: ETS Policy Information Center. Retrieved from https://www.ets.org/Media/Research/pdf/PICTECHNOLOG.pdf