Christine Redecker & Øystein Johannessen (2013) Changing Assessment — Towards a New Assessment Paradigm Using ICT, European Journal of Education, Vol. 48, No. 1, 2013
This article argues for a paradigm shift in the use and deployment of Information and Communication Technologies (ICT) in assessment. While there is still a need to advance in the development of emerging technological solutions to support embedded assessment, such as Learning Analytics, and integrated assessment formats, the more pressing task is to make the conceptual shift between traditional and 21st century testing and develop (e-)Assessment pedagogies, frameworks, formats and approaches that reﬂect the core competences needed for life in the 21st century, supported by coherent policies for embedding and implementing eAssessment in daily educational practice.
Read Full Text
Angel del Blanco, Javier Torrente, Pablo Moreno-Ger, Baltasar Fernández-Manjón (2011) Enhancing Adaptive Learning and Assessment in Virtual Learning Environments with Educational Games, Intelligent Learning Systems and Advancements in Computer-Aided Instruction: Emerging Studies
The rising acceptance of Virtual Learning Environments (VLE) in the e- Learning field poses new challenges such as producing student-centered courses which can be automatically tailored to each student’s needs. For this purpose digital games can be used, taking advantage of their flexibility (good video games always try to adapt to different players) and capabilities to stealthily track players’ activity, either for producing an accurate user model or enhancing the overall assessment capabilities of the system. In this chapter we discuss the integration of digital games in Virtual Learning Environments and the need of standards that allow the interoperable communication of games and VLE. We also present a middle-ware architecture to integrate video games in VLEs that addresses the technical barriers posed by the integration. We present a case study with the implementation of the architecture in the <e-Adventure> game authoring platform, along with three examples of video game integration in educational settings.
Read Full Text
Whitelock, Denise; Gilbert, Lester and Gale, Veronica (2011). Technology Enhanced Assessment and Feedback: How is evidence-based literature informing practice? In: 2011 International Computer Assisted Assessment (CAA) Conference, Research into e-Assessment, 05-06 July 2011, Southampton.
This desktop research commissioned by the Higher Education Academy set out to consult with the academic community about which references on assessment and feedback with technology enhancement were most useful to practitioners. While all the recommended publications may be characterised as reputable and the majority were peer-reviewed (67.7%), only a minority provided quantitative data (28.2%), of which relatively few provided appropriate experimental designs or statistical analysis (18.5%). The majority of publications were practitioner-led case studies. The references that were recommended to us are clearly having an impact on current practice and are found valuable by practitioners. The key messages from these sources are consistent and often give detailed and practical guidance for other academics. We found that most of the recommended literature focused on the goals that technology enhancement can enable assessment and feedback to meet and how assessment and feedback can be designed to make best use of the technology.
Read Full Text
Rollins, R. L. (2012) Assessing the Understanding and Use of Differentiated Instruction: A Comparison of Novice and Experienced Technology Education Teachers, A dissertation submitted to the Graduate Faculty of North Carolina State University in partial fulfillment of the requirements for the Degree of Doctor of Education.
The primary purpose of this quantitative online study was to assess the extent to which Technology Education teachers in the state of North Carolina understand and use differentiated instructional components. Additionally, this study examined the differences between novice and experienced TED teachers’ understanding and use of differentiated instructional components. Differentiated instruction is a philosophy which governs practices for addressing the needs of academically diverse students within the classroom. Modifications are made to the content, process, products and learning environment. Data collected from 127 Technology Education teachers were organized, analyzed, and summarized using descriptive statistics. The findings suggest that TED teachers collectively understand and use differentiated instructional components. However, as it relates to years of teaching experience, novice and experienced statistically differed in their understanding of content differentiation, process differentiation, and product differentiation. Additionally, TED novice teachers reported using the component of product differentiation the least.
Read Full Text
Judi Harris, Neal Grandgenett, Mark Hofer (2010) Testing a TPACK-Based Technology Integration Assessment Rubric,
Although there is ever-increasing emphasis on integrating technology in teaching, there are few well-tested and refined assessments to measure the quality of this integration. The few measures that are available tend to favor constructivist approaches to teaching, and thus do not accurately assess the quality of technology integration across a range of different teaching approaches. We have developed a more “pedagogically inclusive” instrument that reflects key TPACK concepts and that has proven to be both reliable and valid in two successive rounds of testing. Five TPACK experts also confirmed the instrument’s construct and face validities. We offer this new rubric to help teacher educators to more accurately assess the quality of technology integration in lesson plans, and suggest exploring its use in project and unit plans.
Read Full Text
Bram PYNOO, Jo TONDEUR, Johan VAN BRAAK, Wouter DUYCK, Bart SIJNAVEd, Philippe DUYCK (2011) Assessing teachers’ acceptance of educational technologies: Beware for the congruency between user acceptance and actual use, T. Hirashima et al. (Eds.) (2011). Proceedings of the 19th International Conference on Computers in Education. Chiang Mai, Thailand: Asia-Pacific Society for Computers in Education
In this study, we investigated the extent to which self-reported measures for user acceptance (attitude, behavioral intention, self-reported frequency of use), added to the prediction of several aspects of use of a portal for education. Data from 835 teachers was collected: questionnaire “acceptance” data on one occasion and five parameters for observed use (number of logins, downloads, uploads, page views, and reactions) were extracted on two occasions from the portal database. We found that the self-reported measures for acceptance primarily predicted search behavior (monthly number of logins, downloads and page views), and not share behavior (monthly number of uploads and reactions). So, researchers aiming to assess teachers’ acceptance of a technology to contribute information, should adjust their measures for user acceptance so that these correspond with the targeted actual behavior.
Read Full Text
Megan Oakleaf (2008) Dangers and Opportunities: A Conceptual Map of Information Literacy Assessment Approaches, Libraries and the Academy, Vol. 8, No. 3 (2008), pp. 233–253.
The culture of assessment in higher education requires academic librarians to demonstrate the impact of information literacy instruction on student learning. As a result, many librarians seek to gain knowledge about the information literacy assessment approaches available to them. This article identifies three major assessment approaches: (1) fixed-choice tests, (2) performance assessments, and (3) rubrics. It maps the theoretical and educational assumptions on which these options are grounded and charts the dangers and opportunities of each assessment approach.
Read Full Text
Jennifer Groff (2008) A Framework for Addressing Challenges to Classroom Technology Use, AACE Journal (2008) Volume: 16, Issue: 1
Creating effective learning environments with technology remains a challenge for teachers. Despite the tremendous push for educators to integrate technology into their classrooms, many have yet to do so and struggle to find consistent success with technology-based instruction. The challenges to effective technology integration have been well documented in the literature. In this article we present a comprehensive review of the literature on the challenges associated with effective technology integration in the classroom and the ways in which they interact with one another. Based on this review we have developed a framework, the Individualized Inventory for Integrating Instructional Innovations (i5), to help teachers predict the likelihood of success of technology-based projects in the classroom and identify potential barriers that can hinder their technology integration efforts. Identifying potential barriers upfront can empower teachers to seek solutions early in the process, thereby increasing the likelihood of experiencing success with technology integration.
Read Full Text
Sonia Livingstone (2011) Media literacy: Ambitions, policies and measures, COST, September 2011
Theoretical and pedagogic ambitions for media literacy among audiences are often huge, with the promotion of media literacy heralding the promise of empowerment, critical literacy, democratic engagement and participatory culture in a thoroughly mediated world. But historically, these ambitions for media literacy have often foundered in the face of insufficient resources, policy commitment and problems of measurement. The measurement problems are attracting renewed interest now that Europe’s Digital Agenda demands a digitally literate citizenry, and now that the Audiovisual Media Services Directive demands three-yearly reporting on improvements in media literacy by all EU member states.
Read Full Text
Vanderlinde, B. R., Braak, J. V., Windt, V. D., Tondeur, J., Hermans, R., & Sinnaeve, I. (2008). Technology Curriculum and Planning for Technology in Schools: The Flemish case. TechTrends, 52(2), 23-26.
As a significant step in the consolidation of the importance of technology in education, the Flemish Government recently (September 2007) introduced a formal technology curriculum for schools. This compulsory curriculum replaces already existing but non-binding technology guidelines and is an important action in the Flemish policy of educational technology support. The introduction of a technology curriculum brings educational technology in schools to a turning point: Technology is no longer considered as being dependent on teachers’ individual efforts or willingness, but is becoming compulsory at the school level. The Flemish educational technology curriculum is written in terms of attainment targets. These targets are minimum objectives concerning the knowledge, insight, skills, and attitudes the government regards as necessary for and attainable by pupils at different educational levels. The formulation of a compulsory technology curriculum opens new perspectives for Flemish schools when working on putting technology into practice. Schools are challenged to translate the technology curriculum into concrete teaching and learning activities. For this purpose, they can use the online tool PICTOS (Planning for ICT on School) to establish their school-based technology plan. This article discusses the five design principles which, at the same time, act as characteristics of PICTOS
Read Full Text
(2010). Educational Research and Innovation Inspired by Technology, Driven by Pedagogy: A Systemic Approach to Technology-Based School Innovations. SourceOECD Education Skills, 2010(27), 164. OECD – Organisation for Economic Co-operation and Development
This report highlights key issues to facilitate understanding of how a systemic approach to technology-based school innovations can contribute to quality education for all while promoting a more equal and effective education system. It focuses on the novel concept of systemic innovation, as well as presenting the emerging opportunities to generate innovations that stem from Web 2.0 and the important investments and efforts that have gone into the development and promotion of digital resources. It also shows alternative ways to monitor, assess and scale up technology-based innovations. Some country cases, as well as fresh and alternative research frameworks, are presented.Today, sufficient return on public investments in education and the ability to innovate are more important than ever. This was the conclusion of the international conference on “The School of Tomorrow, Today” organised by the OECD Centre for Educational Research and Innovation with the support of the Secretariat of Education of the State Santa Catarina (Brazil), in November 2009. The conference and this resulting report share the overall goal of addressing the issue of how education systems achieve technology-based innovations.
Preview Full Text
David L Silvernail, Dorothy Small, Leanne Walker, Richard L Wilson, Sarah E Wintle (2008) Using Technology in Helping Students Achieve 21st Century Skills: A Pilot Study, Center for Education Policy Applied Research and Evaluation (2008) Publisher: Center for Education Policy, Applied Research, and Evaluation. University of Southern Maine.
As everyone enters the 21st Century there is a great deal of discussion in business and education circles alike about the type of skills the youth will need to survive and thrive in this century. At the same time, there is little known today about the level of 21st Century skills students currently have. Educational Testing Service (ETS) has begun to address this issue by developing a 75-minute scenario-based test to measure high school senior and college freshmen students’ Information and Communication Technology (ICT) Literacy skills; skills defined by ETS as, “the ability of post-secondary students to: define, access, manage, integrate, evaluate, create, and communicate information in a technological environment”. During the spring of 2006, ETS offered high schools and universities across the country the opportunity to take an early version of the assessment. One of those high schools was Skowhegan Area High School (SAHS) in Maine School Administrative District 54 (MSAD 54). The results suggested that the work Skowhegan has been doing preparing students for the 21st Century is showing some progress. The pilot study presented in this paper demonstrates the potential impact of interventions specifically designed to address 21st Century Skills. It also demonstrates the importance and feasibility of systematically developing curriculum interventions and collecting and analyzing impact data.
Read Full Text
Andrade, D., & Ferreira, S. (2011). Models and instruments for assessing Technology Enhanced Learning Environments in higher education. Quality,24(April), 1-10. eLearning Papers
Technology Enhanced Learning Environments (TELE) are seen as a fundamental support in teaching reengineering, and may support a more effective approach to constructive educational philosophies. The evaluation of TELE, as a means of certifying its quality, is giving rise to several initiatives and European experiences. However, the mechanisms for defining quality parameters vary according to different contexts. If assessment aims to function as a management tool, it should seek specific criteria and indicators that would allow it to respond to questions of well-defined contexts. In this study, which stems from a literature review, we present basic guidelines for TELE continuous assessment (as a management tool). Throughout this article the importance of ongoing, in-context evaluation is emphasized. Models, methods and tools to collect data that permit institutions to develop a properly contextualized assessment process are presented.
Read Full Text
Ching, G. S. (2009). Implications of an experimental information technology curriculum for elementary students. Computers & Education, 53(2), 419-428.
The information technology (IT) of today forms an integral part of everyday living, thus the nurture of children’s IT awareness early in life is crucial. Young children have an innate curiosity for IT which suggests that in the school environment it can easily be integrated with other subjects in thematic and interdisciplinary curriculum. This quasi-experimental study used the Technology Foundation Standards for Students of the International Society for Technology in Education (ISTE) project on National Educational Technology Standards (NETS) as the basis to design a thematic and interdisciplinary IT curriculum for elementary students. A total of 1273 elementary students and 12 computer teachers were separated into either a control or experimental group. After one academic year, students’ final scores in English, mathematics, science, social studies, and art were gathered and compared. Statistical analysis indicated that there were significant differences in the experimental group’s academic scores. Findings also suggested that an interdisciplinary curriculum design opened opportunity for collaborative work and cohesiveness among faculty. Further longitudinal studies are recommended to examine the long-term implications of a thematic and interdisciplinary IT curriculum design.
Read Full Text