Other course resources include media and reading that can be accessed within the weekly folders in the Classroom/Modules in BB.
The following is an example of the reading in each module. The BB reading list will always be the definitive list so only use this posted list as a starting point.
Module 1
Required Reading:
Bates, A.W. (2019). Teaching in a Digital Age: Guidelines for designing teaching and learning. https://opentextbc.ca/teachinginadigitalage/ Videos from this post are also required viewing in the Discussion section.
Harapnuik. D. (2020). Why I don’t use checklists, progress bars & other activity monitors. https://www.harapnuik.org/?p=8314 Videos from this post are also required viewing in the Discussion section.
Earl, L. M. (2012). Assessment as learning: Using classroom assessment to maximize student learning. Corwin Press.
Earl, L. M., & Manitoba School Programs Division. (2006). Rethinking classroom assessment with purpose in mind: Assessment for learning, assessment as learning, assessment of learning. Manitoba
Walking the Talk
Changing or improving the world one learner at a time is not an end but a process. Once you start this process it requires continual effort. Fortunately, it has a compounding effect, and small but consistent efforts will maintain and grow its impact.
I have been endeavoring to walk the talk in all aspects of my life for many decades. Whether it was the technology-related courses I developed in the early ’90s, my move into online learning at the University of Alberta in 1995, my related research into web-based instruction that went into my doctoral dissertation, or the dozens of online and blended learning courses that I have developed since then, I have always strived to apply all the theories, approaches and principles that I advocate in my own practice. A continual and iterative process of analysis and evaluation that leads to synthesis and creation is simply part of the learner’s mindset and is what I have been using in the development of courses for the new Applied Digital Learning (ADL) Master which is an update or revision of the Masters of Digital Learning and Leading (DLL) which I co-developed at Lamar University in 2014-2015. One of my goals for revising the DLL courses and converting them to ADL courses has been to strip away unnecessary information, activities, processes, or anything else that will impede the learner’s choice, ownership, and voice as they create their innovation plans and then create significant learning environment where their plans can be realized. Another goal is to point to how key foundational concepts like Applied Learning, Assessment Of/For/As Learning, Connecting the Dots Vs Collecting, the Dots, Change of Focus, CLSE, COVA, and the Learner’s Mindset will play a role in their growth and development.
Desiring the Quick Fix
Over the past several years my colleagues and I have observed and analyzed the tendency for many educators who come into the DLL program to look for a quick fix to innovation. They generally see technology as a tool that has a hyped potential for a quick fix so they often expect to be told what procedure, process, or product they should implement as part of their innovation plan. While the application or applying of a model or simulation may initially appear to be what they want when they try to apply these products or processes to their circumstance, they quickly find that this often doesn’t work. The educational technology (Edtech) literature for the past several decades is filled with examples of how the application of technology in a learning setting makes no significant difference and has little impact on learning outcomes and that the focus needs to be the learning, not the technology if we want to make a difference (Reich, 2020; Cuban, 2001; Russel, 1999; Wenglinsky, 1998). The research is clear. Edtech is not a quick fix or silver bullet (Thibodeaux, Harapnuik, Cummings, & Wooten, 2017) and the naive notion that one can implement it better than the last group that failed is continually repeated in all levels of classrooms across the nation. This is why the SAMR model or other quick fixes do not work (Harapnuik, 2017). Why does this thinking continually persist?
Start with a Change in Thinking about your Thinking
In analyzing this situation I looked at what type of thinking or level of thinking that was being used. According to the revised Bloom’s taxonomy when people are attempting to carry out a procedure or implement a process or apply an existing model to a new but similar situation they are using lower ordering thinking in their hopes of applying existing information to their situation. The category of Applying is at the top of the lower order thinking within Bloom’s taxonomy but it is still considered lower-order thinking and only facilitates information transfer because there is no analysis, evaluation, or creation which are at the higher-order and are essential to deeper learning.
The inverted Bloom’s taxonomy is one of my favorite perspectives because it combines the higher-order thinking into a continuum and reveals that analyzing, evaluating, and creating must be conducted in conjunction. In the Applying section, the notion of using information in a new but similar situation seems to fit what I was seeing in many of my students in the DLL program.
Because I practice what I preach, I continued to analyze and evaluate my ideas further before I created this post. I also went to the original or primary sources of the Bloom taxonomy (Anderson & Krathwohl, 2001) to make sure I wasn’t missing any key information in the dozens of abbreviated versions of Bloom’s taxonomy that a quick Google search revealed. While the summary in the inverted Bloom taxonomy was useful and it was compatible with many other summaries of Bloom’s taxonomy, you will find online the original perspective from Anderson and Krathwohl (2001) was much more effective in addressing my concerns.
Applying: Carrying out or using a procedure through executing or implementing. Applying is related and refers to situations where learned material is used through products like models, presentation, interviews, and simulations.
This summary confirms what I have seen with many students who just want to be told what procedure or model they need to execute or implement and believe that all they have to present an existing model to their colleagues, simulate the new approach, and their innovation process is complete. To be fair to many of these students, this is what they know and simply what their administrators, schools, districts, or other organizations ask them to do. This ongoing process of identifying a standard to be met, finding the approved or accepted procedure or process being used in the organization to meet this standard, and finally applying a standardized test or other information transfer confirmation tools to confirm that the standard has been met by the students is the norm. For rudimentary knowledge, simple situations, and information transfer this application process does work well and our education system has been relying on this model for over a century. As we move further into the digital information age we are realizing that our challenges are much more complex and require much more than doing what we have done in the past. To address these more significant challenges we need to move beyond applying existing information or processes in a new but similar fashion.
Moving to Higher Order Thinking
We need to move into analyzing, evaluating, and creating new solutions to ever-increasing challenges that we and our learners will face in the future. We also need to look beyond convenient summaries, quick fixes, or “Coles Notes” solutions and go back to primary sources to get the full picture. If we want to address the ever-increasing complexities in the challenges we face in the 21st Century then we must use higher-order thinking. We must continually analyze and evaluate what we are doing as we begin creating innovations that will enhance learning. Anderson and Krathwohl (2001) explanation of the following three higher thinking levels offers the best starting point for our own analysis, evaluation, and creation of a novel way of integrating these ideas.
Analyzing: Breaking material or concepts into parts, determining how the parts relate or interrelate to one another or to an overall structure or purpose. Mental actions include differentiating, organizing, and attributing as well as being able to distinguish between components.
Evaluating: Making judgments based on criteria and standards through checking and critiquing.
Creating – Putting elements together to form a novel coherent whole or make an original product.
Analyzing, Evaluating, and Creating Lead to Deeper Learning and Learner’s Mindset
While the inverted Bloom’s taxonomy is useful for helping us to see the linear relationship between analyzing, evaluating, and creating and also see how the higher-order thinking is separated from lower-order thinking, it doesn’t convey the interrelatedness between analyzing, evaluating, and creating. It also doesn’t show how the interrelation between analyzing, evaluating, and creating contributes to deeper learning.
The Venn diagram (Harapnuik, 2021) reveals how analyzing, evaluating, and creating come together and at that convergence point is where the learner engages in deeper learning and has then moved into the Learner’s Mindset.
This deeper learning and the adoption of a Learner’s Mindset is realized when you create a significant learning environment in which you give your learner’s choice, ownership, and voice through authentic learning opportunities (CSLE+COVA). I have been applying this approach in all the learning environments that I have created and most recently have applied this to the DLL and ADL programs as well as in the Provincial Instructor Diploma Program (PIDP).
In my grandiose goal of changing the world one learner at a time, I am sharing this approach with as many people that I can. It is my hope that you too will begin the ongoing process of analysis, evaluation, and creation. Through a continual and iterative process of analysis of your learning environment, the new concepts, theories, and ideas you are exploring combined with your goal of bringing learning innovation to your organization, you too can begin to explore and evaluate how best to synthesis your findings and ideas into an innovation plan which will create the changes you desire and prepare your learners for life.
Please remember that this is only one part of a bigger picture so explore the following:
Anderson, L. W., Krathwohl, D., & Bloom, B. S. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. Longman.
Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching and assessing: A Revision of bloom’s taxonomy of educational objectives (Abridge Edition). Addison.
Cuban, L. (2001). Oversold and underused: Computers in the classroom. Harvard university press.
Harapnuik, D.K. (2017). Reconsider the use of the SAMR model. [Blog]. Retrieved from https://www.harapnuik.org/?p=7235
Reich, J. (2020). Failure to disrupt: Why technology alone can’t transform education. Harvard University Press.
Russell, T. L. (1999). The no significant difference phenomenon: A comparative research annotated bibliography on technology for distance education: As reported in 355 research reports, summaries and papers. North Carolina State University.
Thibodeaux, T. N., Harapnuik, D. K., Cummings, C. D., & Wooten, R. (2017). Learning all the time and everywhere: Moving beyond the hype of the mobile learning quick fix. In Keengwe, J. S. (Eds.). Handbook of research on mobile technology, constructivism, and meaningful learning. Hershey, PA: IGI Global.
Wenglinsky, H. (1998). Does it compute? The relationship between educational technology and student achievement in mathematics. ETS Policy Information Center. https://www.ets.org/Media/Research/pdf/PICTECHNOLOG.pdf
Even though constructivist learning theorists for many decades promoted the benefits of self-directed learning or autodidactism it wasn’t until the COVID crisis of 2020 and the mass forced remote learning that most educators had realized that too many students were not suited or prepared to learn online. Why? Justin Reich (2020) points to research in his book, A Failure to Disrupt: Why Technology Alone Can’t Transform Education, which shows that the learners who are most successful in an online or blended environment that requires self-pacing and personal motivation are those who are already successful in school. These self-directed, self-motivated, and academically prepared learners will succeed in any learning environment because they know how to learn and assess the quality of their own work. The problem that we face is that the vast majority of students are dependent on their teachers to direct their learning and to administer standardized testing. If autodidactic learners are able to learn in any type of environment then we should be asking how do we help our learners become autodidacts and adopt a learner’s mindset. I have explored this notion further in the post, We Need More Autodidacts and the related Learner’s Mindset Discussion.
Our research in the Digital Learning and Leading (DLL) program at Lamar University, our experience in the School of Instructor Education at Vancouver Community college over the past several years, and several decades of related research and experience in a wide variety of learning environments have confirmed that if you create a significant learning environment where you give your learners choice, ownership, and voice through authentic learning opportunities (CSLE+COVA) you can incorporate assessment FOR/AS learning which can help shift a learner toward a learner’s mindset. We have also learned through our experience and research that incorporating feedforward or educative formative assessment will also help to continue that shift toward the learner’s mindset. By giving learners choice over most aspects of their learning experience and through the use of authentic learning opportunities and ePortfolios, our students over the past several years have incorporated many aspects of the assessment as learning perspective which are essential to the learner’s mindset.
Unfortunately, all too often there is a very different learning environment that our students experience in the courses and programs I have developed and instructed than the type of the learning environment that my students are able to create for their learners in their organizations. Finding the right balance between assessment of learning, assessment for learning, and assessment as learning is one more factor that plays a significant role in the learning environment. In much the same way that we have explored and differentiated the role of choice, ownership, and voice through authentic learning opportunities we have to do the same for assessment OF/FOR/AS learning.
Rather than add to the decades of literature on assessment OF/FOR/AS learning I will draw upon the key ideas and summarize the salient points that are most important to contributing to a significant learning environment.
For those who prefer a more typical written definition the New South Wales (Australia) Education Standards Authority (2017) provide a good summary of “assessment for, as, and of learning”
Assessment of learning assists teachers in using evidence of student learning to assess achievement against outcomes and standards. Sometimes referred to as ‘summative assessment’, it usually occurs at defined key points during a teaching work or at the end of a unit, term or semester, and may be used to rank or grade students. The effectiveness of assessment of learning for grading or ranking purposes depends on the validity, reliability, and weighting placed on any one task. Its effectiveness as an opportunity for learning depends on the nature and quality of the feedback.
Assessment for learning involves teachers using evidence about students’ knowledge, understanding, and skills to inform their teaching. Sometimes referred to as ‘formative assessment’, it usually occurs throughout the teaching and learning process to clarify student learning and understanding.
Assessment as learning occurs when students are their own assessors. Students monitor their own learning, ask questions and use a range of strategies to decide what they know and can do, and how to use assessment for new learning.
The following assessment OF/FOR/AS learning table is a compilation of from a wide variety of resources that goes a bit further than simple definitions (Chappuis et al., 2012; Fenwick & Parsons, 2009; McNamee & Chen, 2005; Rowe, 2012; Schraw, 2001; Sparks, 1999):
Assessment
Of Learning
For Learning
As Learning
Type
Summative
Formative
Formative
What
Teachers determine the progress or application of knowledge or skills against a standard.
Teachers and peers check progress and learning to help learners to determine how to improve.
Learner takes responsibility for their own learning and asks questions about their learning and the learning process and explores how to improve.
Who
Teacher
Teacher & Peers
Learner & Peers
How
Formal assessments used to collect evidence of student progress and may be used for achievement grading on grades.
Involves formal and informal assessment activities as part of learning and to inform the planning of future learning.
Learners use formal and informal feedback and self-assessment to help understand the next steps in learning.
When
Periodic report
Ongoing feedback
Continual reflection
Why
Ranking and reporting
Improve learning
Deeper learning and learning how to learn
Emphasis
Scoring, grades, and competition
Feedback, support, and collaboration
Collaboration, reflection, and self-evaluation
If we want to encourage our learners to become more autodidactic it would then seem reasonable to shift from assessment of learning to assessment for learning and ultimately get to assessment as learning. We see this perspective from Lorna Earl (2012) in her highly cited text Assessment as Learning: Using Classroom Assessment to Maximise Student Learning.
Earl’s assessment pyramids are featured in many different sources and her argument that the traditional assessment of learning is the dominant form of assessment is widely accepted. Even though she calls for a balance in the use of assessment of/for/as learning her revised assessment pyramid that replaces assessment of learning with assessment as learning as the base of the pyramid still doesn’t represent a realistic balance nor an effective way to incorporate assessment into the learning environment.
Rather than view assessment of/for/as learning as hierarchical it may be more effective to view assessment of/for/as learning more holistically as more of an interplay of assessment within the learning environment. The National Forum for the Enhancement of Teaching and Learning in Higher Education in Ireland (2017) offers a wonderful perspective on assessment of/for/as learning that emphasizes the interplay of the different types of assessment and the key roles that the assessment and the people involved play.
While some learning theorists may desire to craft a potential learning environment that uses assessment as learning, the reality we face, and that our learners face is not theoretical. We live in a world where we use credentialing exams and other forms of standardized testing and while we have seen a recent move toward implementing formative feedback most educators’ reality reveals that assessment of learning dominates. Moving toward assessment for learning and assessment as learning will only be possible if we look at the bigger picture. We need to help educators to recognize that we are not asking for a full pendulum swing away from assessment of learning to assessment as learning with assessment for learning somewhere in the middle. We are acknowledging that an interplay of all three is not only realistic it will be the most productive approach to improving the learning environment.
We must also acknowledge that our teaching and learning environment are dramatically influenced by the assessments we use. If we consider assessment of/for/as learning as an integral part of the learning environment and we look to fully integrate assessment as part of the learning process then we do our learners justice by helping them to experience a balance in the assessment of/for/as learning. If we model an integrated approach to assessment of/for/as learning then we will be equipping our learners so that they too can integrate assessment of/for/as learning into their own learning environments that they create for their learners.
While this more focused examination of assessment of/for/as learning may provide a novel perspective for some, we have been incorporating the assessment of/for/as learning inter-relationship in the creation of our significant learning environments and when we give learners choice, ownership and voice through authentic learning. This assessment as learning perspective is a practical way to move into what the researcher Mizerow would argue is transformational learning. Mizerow (2000 & 2010) argues that you do not learn things until you tell someone about what you have learned. The transformation to deeper learning happens in the reflective process and the sharing of your learning process with others.
The entire shift toward the learner’s mindset includes the shift toward assessment as learning and you and the following posts and video are a few examples of how we have been supporting and exploring how to help learners become self-directed or autodidactic.
Alberta Education. (2003). Types of classroom Assessment http://www.learnalberta.ca/content/mewa/html/assessment/types.html
Assessment OF/FOR/AS Learning. (2017, March). [National Forum]. The National Forum for the enhancement of teaching and learning in higher education. https://www.teachingandlearning.ie/our-priorities/student-success/assessment-of-for-as-learning/
Chappuis, J., Stiggins, R. J., Chappuis, S., & Arter, J. (2012). Classroom assessment for student learning: Doing it right-using it well. Pearson Upper Saddle River, NJ.
Earl, L. M. (2012). Assessment as learning: Using classroom assessment to maximize student learning. Corwin Press.
Earl, L. M., & Manitoba School Programs Division. (2006). Rethinking classroom assessment with purpose in mind: Assessment for learning, assessment as learning, assessment of learning. Manitoba
Education, Citizenship and Youth. https://www.edu.gov.mb.ca/k12/assess/wncp/index.html
Fenwick, T. J., & Parsons, J. (2009). The art of evaluation: A resource for educators and trainers. Thompson Educational Publishing.
McNamee, G. D., & Chen, J.-Q. (2005). Dissolving the Line between assessment and teaching. Educational Leadership, 63(3), 72–76.
Mezirow, J. (2000). Learning as transformation: Critical perspectives on a theory in progress. Jossey-Bass Publishers. San Francisco, CA.
National Forum for the Enhancement of Teaching and Learning in Higher Education. (2017, March 30). Expanding our Understanding of Assessment and Feedback in Irish Higher Education. Retrieved from https://www.teachingandlearning.ie/publication/expanding-our-understanding-of-assessment-and-feedback-in-irish-higher-education/.
NSW Education Standards Authority. (n.d.). Assessment For, As and of Learning. Retrieved December 7, 2020, from https://educationstandards.nsw.edu.au/wps/portal/nesa/k-10/understanding-the-curriculum/assessment/approaches
Rowe, J. (2012). Assessment as learning—ETEC 510. http://etec.ctlt.ubc.ca/510wiki/Assessment_as_Learning
Schraw, G. (2001). Promoting general metacognitive awareness. In Metacognition in learning and instruction (pp. 3–16). Springer.
Sparks, D. (1999). Assessment without victims: An interview with Rick Stiggins. Journal of Staff Development, 20, 54–56.
We want to remind you all that your synchronous session should be the place where you build relationships, develop community, and invite your learners into engagement. This is not the place to deliver information or content. Ideally, your synchronous session should last no longer than 30 minutes and the mini-lessons component should be 10-15 minutes at most. The last 15 minutes is simply feedback/feedforward from the participants within the PL course who comment on the delivery of the lesson for the benefit of the person who shared it. This last 15 minutes is also a time when folks connect, discuss, contribute their ideas, etc. and perhaps explore how they could apply ideas from the mini-lesson in their classes. When you do a mini-lesson sync session they should be short, concise, focused, and highly interactive. The mini-lesson isn’t where you deliver content; this is where you engage your learners, through breakout rooms, polling, discussion, and collaboration. Remember – content should be reserved for the asynchronous session. Yes, you will be relaying information in your sync session but you want to do so through an engaging collaborative process.
One more thing to remember. The subject of your session is entirely up to you. If you feel more comfortable doing a session on scrapbooking, BBQ, a workout, or other personal interests, please feel free to do this. You will want to focus on the process of engaging your participants and setting this up where the session is collaborative and not used as a content delivery method, so choose something that you are very passionate about and have some fun with this opportunity. If you are diving right in and creating a synchronous session for your class, we welcome you to practice your synchronous sessions with each other, especially if you will be using your session sometime soon.
The following are the links to articles, blog post, YouTube videos, TED Talks, and books that were used or referenced in a variety of talks and workshops on Online Learning and the Online Blended Learning – Learning Lab:
Links to Authentic Learning & CSLE+COVA posts:
I have been advocating authentic learning or project-based learning and creating significant learning environments for decades both professionally and personally. Talking the talk as an academic takes on a much more significant perspective when you walk the walk in your personal life.
The CLSE+COVA section of this site is also a great starting place to see how to create a significant learning environment by giving your learners choice, ownership, and voice through authentic learning opportunities
