Transcending the status quo: How do we know we’ve arrived?
by Dr. Sonny Magana
“Evidence matters. Implementing evidence-based practices matters more. Evaluating the impact from implementing evidence-based practices matters most.” –John Hattie
If you are reading this final post, then you have likely read my previous posts in this article series. As such, you hopefully have a clearer idea of the evidence underpinning the unhappy state of technology use in education (Part 1), how we arrived at this ill-chosen status quo (Part 2), the desired future state of education (Part 3), and how we might achieve it (Part 4). The purpose of this post is to offer some thoughts and guidance to help determine if we’ve indeed arrived at the future state of education that would be considered highly desirable.
However, an actual point of arrival at such a lofty destination is an artifice. It’s a myth. There is no “final attainment,” no proverbial mountain top from which one can rest on one’s pedagogical laurels and proclaim, “I’ve made it!” Letting go of the myth of final attainment is the first step into the much larger world of mastery.
Such a philosophical approach demands a shift from professional development to organizational development. Educators have received professional development focused on building technology skills for four decades, with alarmingly little impact to show for the effort. A key factor contributing to the disappointing results of teacher training on technology rests with the transfer;. In contrast, much of the research on teacher training focuses on skill acquisition. Few studies have measured transfer effects from the training room to the classroom. Helping teachers transfer newly gained skills into their practices holds great promise for improving instructional quality and student achievement. Joyce and Showers (1988) report:
“In studies that have asked the transfer question (e.g., did participants use new skills in the classroom, did they use them appropriately, did they integrate new skills with existing repertoire, was their long-term retention of the products of training), several findings emerge. First, the gradual addition of training elements does not appear to impact transfer noticeably (ES [effect size] of .00 for information or theory; theory plus demonstration; theory, demonstration, and feedback; ES of .39 for theory, demonstration, practice, and feedback). However, a large and dramatic increase in the transfer of training—ES 1.68—occurs when in-class coaching is added to an initial training experience comprised of theory explanation, demonstration, and practice with feedback. (pp. 71-72).”
These findings strongly suggest how important it is for organizations to leverage system-wide support, leadership, and ongoing instructional coaching during the implementation phase. Implementing evidence-based practices is a team sport. This shift is necessary to ensure that all teachers in a learning system transfer new evidence-based knowledge and strategies into their classroom practices.
Finally, it is important to continuously evaluate the impact of implementing evidence-based methods. This is particularly true when building collective efficacy with educational technology use. Learning systems would benefit from using the T3 Framework for innovation to guide this process. The first step is to assess the current level of technology use within the three stages of the T3 Framework— T1: Translational Technology Use, T2: Transformational Technology Use, and T3: Transcendent Technology Use.
It would also be helpful for teachers to use a proficiency scale to reflect on their current levels of technology use on the T3 Framework (see Figure 1.0). To be actionable, proficiency scales should be clear, precise, and contain only three competence points. Adding additional stages makes such scales less usable as a tool for reflection-in-action during instruction. We can agilely reflect upon our efficacy using a simple scale such as (1) Beginning, (2) Developing, and (3) Mastering. Using this nominal scale in the aggregate, teachers across whole schools, districts, regions, or states can more accurately self-assess their current use of technology, providing a clearer picture of the here and now.
With these incremental stages in mind, teachers can more accurately establish meaningful growth goals and track their progress with elements in the T3 Framework. Evaluating the impact of evidence-based practices ideally includes instructional staff, coaches, and building leaders to evaluate impact and provide sufficient guidance and resources as needed to ensure continuous growth towards mastery.
- Village Voice – To Fight Institutional Racism, Teachers Are Going Back to School
- EdScoop – Colorado partners with video platform for interactive professional development
- Education World – Study: Teachers Feel Left Out of the Conversation When It Comes to PD