Saturday, 8 April 2023

THINK OF ALTERNATIVE ASSESSMENT AS A WAY OF PROMOTING STUDENT-CENTERED LEARNING

 The EMVITET project focuses on student-centered learning. To do so, one can reflect on teaching methods but also think of alternative assessment. The table below show the difference between traditional assessment that is teacher-centered and alternative assessment that are more student centered.

In this page, we introduce various alternative assessment by illustrate what they are and how they can contribute more to students-centered learning & teaching.

https://edulearn2change.com/article-assessment-for-learning-key-principles-strategies/

Designing Open book exams

by Manish Malik, School of Energy and Electronic Engineering, University of Portsmouth, U.K.

One of the key things to consider in open book exams is that it focuses on reasoning, conceptualisation and problem solving. Testing factual knowledge that is at the end of a google search should be avoided. 

Multi-choice questions and Open book exams

Using multi-choice questions that invoke reasoning, for example where there are options that present a cognitive conflict in the minds of the students can help differentiate someone who simply is googling for an answer or someone who can use reasoning to eliminate some of the options. 

Another thing to consider when writing these multi-choice questions is that they have rich context i.e. the question requires students to use several data points from say a figure, table, graph etc or within the question that makes it specific such that students are not able to just google the answer (Cade et al., 2018). The key is to make them use the information as opposed to memorising or referring to it.

Designing questions that have open text answer in Open book exams

Here too, making the context rich would reduce the possibility of a quick google search to come up with an answer. Selecting a scenario and asking the students to identify the problem in the scenario, identifying ways to address the problem through researching, choosing one solution that they think would be best suited for the problem and suggesting implementation plan for it and stating test procedures and plans to evaluate the solution with the users of the technical solution will allow assessing their learning and critical skills as opposed to recall and retrieving information on the web.

Using calculation based questions in Open book exams

When responding electronically, it may be seen as tricky for students to write complex equations and show step by step working when solving multi-variable equations to work out values of target variables asked in the exam question. Particularly, when they have limited time to answer the questions if they are being asked to submit handwritten solutions  electronically by scanning hand written solutions. In such cases, a solution here could be to use Moodle text box type questions to get the students to type in the answers but provide them with a numbered and exhaustive formulae sheet. By asking them to state which equation number,  from the formulae sheet, they are using to work out the value of a target variable and also state the values they used for the variables in the equation, that they know from the question or worked out in a previous step, would allow them to show the input and the output as well as the selection of the correct equation for solving the question. This way they can just type in the moodle text box their answers to complex calculations without the need to show all the steps and write out difficult/lengthy equations or having to scan handwritten answers. 

Students may be a bit apprehensive about this, so allowing them to do a mock test and giving generic feedback on common problems and approaches students take will help here. Drawing diagrams is also not possible in this method and it should be kept in mind. 

Differences between ‘in class with a cheat sheet’ and ‘at home’ open book exams:

Some prefer the “Cheat sheet” approach to open book exams but that is more relevant when we have face to face exams in a classroom.  Here students are asked to organise a 1 or 2 page “cheat sheet” which they can use in the exams. In the current coronavirus situation the cheat sheet becomes the entire internet with the additional ability to search it as they will take the exam “at home”. Therefore, there is little to be gained in assuming this style of open book exams unless it uses the same principles as above in addition to the cheat sheet approach.

False sense of confidence in students and other challenges with Open book exams

Studies suggest that the term open book exam makes students feel less anxious about the exam as they tend to believe that they will be able to do well with all the knowledge availables to them. They will spend up to 33% less time preparing for these exams. They may also spend more time looking for answers than formulating one.

Strategies to increase difficulty and limit cheating

  1. Students can work only one question at a time and cannot access completed questions.

  2. Limit the period in which the exam should be submitted to 60% more than a normal closed book exam.

  3. Random number generator used in MCQs.

Rethinking assessment (in a participatory digital world) - Sharing innovative assessment in Higher Education

Assessment is an essential component in the learning and teaching environment and should promote learning as well as measure or certify outcomes (Clements & Cord 2013). There have been significant changes in the approaches to teaching and learning in higher education with the advent of MOOCs, flipped classroom approaches, the introduction of informal learning spaces, the gamification of learning and the expectation of more flexible modes of delivery. User-centred approaches to assessment involving authentic assessment tasks are now being discussed more often in the context of e-assessment. This special edition captures some of the recent investigations in e-assessment that move us beyond the traditional selected response formats of multiple-choice tests, short answer, fill-in-the-blanks, true-false, and matching. Higher-level cognitive and affective skills cannot readily be assessed using traditional selected response formats and more authentic e-assessments are being proposed.

  • Interactive Oral Assessment; an authentic and integral alternative to examination

  • Concrete examples of diverse authentic /alternative assessments 

  • Creative Assignment Ideas for Teaching at a Distance/f-t-f (most of forms can be perfectly used in science disciplines) 

PEER-ASSESSMENT: FOCUS ON STIMULATING GOOD QUALITY FEEDBACK

 


DETAILS

PEER-ASSESSMENT: FOCUS ON STIMULATING GOOD QUALITY FEEDBACK

https://twitter.com/Mr_Bunker_edu/status/243793486430732288

Improve the design of peer assessment
Think about one peer-assessment you have organized and Reflect on the following question to see whether you have consciously deal with the aspects that mentioned:

• What is the objective of the peer feedback exercises?

• What needs to be reviewed by peer?

• Which evaluation criteria need to be used when giving feedback?

• How did you group the students? How many reviews did they receive and how many did they have to do themselves?

• What was  the timing? 

o When does the task have be submitted for reviewing? 

o When did they know what to review? 

o How much time was there for reviewing? 

o Was there a time scheduled to process the feedback?

• How did the assignments be collected and divided between the reviewers? How did peer feedback be transmitted to the recipients? Did the students have to organise this by themselves or did the teacher collect and then redistribute the assignments? Or did this be done through an electronic platform?

• How did you lead the feedback session? How did you make sure that students give constructive feedback?

• Did the giving of peer feedback be evaluated? And how did this be done?

By think through aforementioned question, do you recognize certain aspects you could change to make a more thorough design of the  peer-assessment ? Please write your thoughts down.

It is important to properly prepare the students for peer feedback. The list below can be of assistance:

• Clarify why you will use peer feedback and what you expect the students will learn from it.

• Describe how the process will go (e.g. via a timeline) and what you expect and when.

• Establish the evaluation criteria with your students. When it is not possible to do so, make sure the criteria is very well communicated with your students. You can explain them from the beginning of the task, organize an exercise session on how to use these criteria to assess work. It will be idea to do such an exercise together with students at least once on an example.

• Illustrate how peer feedback works, show them how feedback can be formulated based on the criteria. Depict what is considered good or weak feedback, by taking feedback examples from given assignments and linking them to the evaluation criteria. Ask questions that will motivate the recipient of the feedback to better process the work or make the proper suggestions or alternatives.

• Help the students develop their feedback skills. More so, calibrating of the feedback (try-outs, testing of own peer feedback compared to what is expected) can be crucial and can happen through several methods:

o Discuss the evaluation criteria and link them to examples of peer feedback.

o Go over peer feedback examples.

o Ask students to give peer feedback on a group example and have them compare and discuss it in groups.

CONTINUOUS ASSESSMENT TO SUPPORT LEARNING

 https://slideplayer.com/slide/13404138/

Continuous assessment

Evaluating the learning process or the progress of the student at regular intervals during the academic year , to see to what extent he / she has already achieved the learning objectives of your course. With continuous evaluations you can activate students in the meantime and encourage them to be busy with the learning content during the semester. For example, the interim  feedback for the students can have a positive effect on later evaluations.

How to organize continuous assessment

In continuous evaluation, both summative and formative objectives often come together. Finding a balance in this is not always an easy exercise: too much focus on one can have negative consequences for the other. Therefore, use permanent evaluation mainly to encourage and support student learning, from the so-called  “learning-oriented evaluation” perspective. (Hernández, 2012) .

Ask yourself the following questions when choosing an appropriate permanent evaluation variant:

- Which learning objectives do I pursue? Why do I want to implement permanent evaluation, what do I want to achieve with it? Do I mainly want to activate students? Do I mainly want to give feedback? 

- Which teaching methods do I use and how do they tie in with the permanent evaluation?

- Which evaluation methods are in line with the working methods used? Do I only have the goal of evaluating summatively or am I mainly looking for a formative way to guide the learning process?

- How will I give students feedback ? How will I ensure that students get started with feedback? 

- Do I assign scores to the evaluations? If so, how do these scores relate to the final score? Does every evaluation weigh equally? Are there any bonus points to be earned? Or do I wish to work with pass / fail?

- Which context and boundary factors can I consider? 

- Have my students already been confronted with continuous evaluation in other OPOs? In what shape? 

- What is the size of my student group?

- Am I alone or do I have a didactic team?

- What degree of independence can I expect from the student group? 

- What technical limitations / possibilities are there with regard to computer facilities, classrooms,…

- What possibilities are there with regard to the time use of the students? What other activities are expected from students? Can I make contact time available? 

How often do I want to conduct a permanent evaluation? 

In her review, Bruijns (2014) concludes that one or two interim tests are sufficient to achieve a positive effect on a student's performance. Ensure a balance between test moments and moments when students have time to independently process the learning material so that activation does not lead to stress. 

Forms of continuous assessment

In principle, all forms of evaluation can also be used for continuous evaluation. Determine which learning objectives you want to evaluate and what purpose the permanent evaluation serves to make a choice. Below are some options:

- Assessment of tasks and assignments

- Intermediate (electronic) tests and exercises

- Preparation and processing of contact moments

- Cooperation during contact moments: such as active listening of the students, asking and answering questions, presenting, participating in group discussions, and so on. 

- Contributions to an electronic discussion forum

- (E) Portfolio

USING ASSESSMENT TO SUPPORT & ASSESS LEARNING

 


DETAILS

USING ASSESSMENT TO SUPPORT & ASSESS LEARNING

https://edulearn2change.com/article-assessment-for-learning-key-principles-strategies/

In the EMVITET project, assessment is no longer seen as a final teaching & learning stage in which teachers evaluate students’ performance. Instead, assessment is considered as a powerful tool to support and give constructive feedback via competence-based assessment. To maximize the supportive function of assessment, we call for teachers’ attention on adopting authentic assessmentusing formative assessment,  organize continuous assessment (e.g. using eportfolio) and specially provide constructive feedback to students and allow them to use the feedback to redo their work. We also include a Field-tested Learning Assessment Guide for Science, Math, Engineering and Technology Instructors and an infographic on how to promote students’ academic Integrity through assessment.

When we think hard on how to organize assessment as learning, we shall also not forget about peer and self-assessment. Teachers are not the only ones that use assessment. If we want students to become the driver of their learning and gain life-long learning ability, we have to ensure the development of students’ peer and self-assessment ability. This page offers more detailed info concerning peer assessment.

Moreover, to create student-centered learning, one can do so by reflecting on existing assessment practice but also think of alternative assessments. In this page, we introduce various alternative assessments by illustrating what they are and how they can contribute to students-centered learning & teaching.


Using authentic assessment

What is it?

A form of assessment in which students are asked to perform real-world tasks that demonstrate meaningful application of essential knowledge and skills -- Jon Mueller

"...Engaging and worthy problems or questions of importance, in which students must use knowledge to fashion performances effectively and creatively. The tasks are either replicas of or analogous to the kinds of problems faced by adult citizens and consumers or professionals in the field." -- Grant Wiggins -- (Wiggins, 1993, p. 229).

"Performance assessments call upon the examinee to demonstrate specific skills and competencies, that is, to apply the skills and knowledge they have mastered." -- Richard J. Stiggins -- (Stiggins, 1987, p. 34).

Why use authentic assessment? 

The question "Why use authentic assessment?" is not meant to suggest that you have to choose between traditional assessments such as tests and more authentic or performance assessments. Often, teachers use a mix of traditional and authentic assessments to serve different purposes. For Emvitet teachers, as the project goal is to enable them to design and implement competence based and student centred learning to match the needs of Industry revolution 4.0, being able to design and implement authentic assessment is essential because such assessment is truly competence oriented. If you are interested to know the potential benefit of choosing authentic assessments for certain types of judgments and why authentic assessments have become more popular in recent years. Please read more

Explore the authentic assessment toolkit to design diverse authentic assessment

Using formative assessment

The purpose of formative assessment tasks and activities is to provide the teacher with a window into students’ cognitive processes. Formative assessments allow students to show their thinking and allow teachers a way to see and gauge students’ cognitive processes. Hence it is essential for student-centered learning. Read the guide

Organizing continuous assessment

Evaluating the learning process or the progress of the student at regular intervals during the academic year , to see to what extent he / she has already achieved the learning objectives of your course. With continuous evaluations you can activate students in the meantime and encourage them to be busy with the learning content during the semester. For example, the interim  feedback for the students can have a positive effect on later evaluations. Read the guide

Continuous assessment can also be realized using eportfolio 

This ebook gives explanations and examples on how to do it.

Assessment can support learning when there is constructive feedback and students have the opportunities to use the feedback to redo their work. Below are the tips for ensuring constructive feedback to students:

  1. The principles of providing feedback to students

  2. A listing of practical feedback methods for both coursework and exams

  3. Suggestions for cutting back on marking and feedback work load

  4. The main points of Bath’s Quality Assurance expectations regarding assessment

  5. feedback to students

  6. References for further information

Tips for effectively use of assessment for supporting and assessing learning

Engaging students in assessment design

Many of the approaches available to staff provide opportunities for students to contribute to the assessment design, development and quality assurance processes.  For example, students can:

- help to design guidance that is clear, meaningful and meaningful and effective;

- advise you about particular difficulties that their peers might have in complying with requirements that might not be obvious to the assessment designers;

- provide feedback on formats and approaches that require technologies and applications that students may not have at home (good broadband, exclusive use of laptops, the correct software, quiet places to work etc.;

- advise on appropriate modes and timings for feedback.

In this DCU infographic, it illustrated how students can be partners in assessment. 

Field-tested Learning Assessment Guide for Science, Math, Engineering and Technology Instructors

Academic Integrity principles for Assessment 

TIPS TO PROMOTE INTERACTIONS ONLINE

 

TIPS TO PROMOTE INTERACTIONS ONLINE

by KULeuven

One of the expected learning outcomes of the EMVITET project is that teachers engaged in the project can gain sufficient knowledge and skills to run online courses effectively.  A major challenge in online education is the great distance that arises between teachers and students and between students. How can you respond to this as a teacher?

Two important concepts here are dialogue and structure. You can bridge the distance with your students by building a good balance between the degree of dialogue and structure in the online component of your course. You take into account the autonomy that you can expect from your students. 

Student-content interaction

In a context without direct contact with students, it is important to pay attention to this form of interaction. It is important to encourage students to process information with a critical eye, to broaden their perspective, to build up knowledge, and then to apply it. On this page you will find some tips that can help you as a teacher.

HOW DO YOU DO THAT?

1. Activate the knowledge of your students

It is important to build on existing knowledge. It is indispensable for gaining new insights.

2. Give clear, structured and challenging instructions

A good structure and a solid understanding of the objective are important for students.

How can you approach this?

Tip 1: Gerard van den Boom of the Open University of the Netherlands wrote a white paper entitled ‘Ontwerpen met modellen’ [Designing with models]. There are different variations in presenting learning material. For instance, the structure of a task-based learning package can be as follows:

  • - Introduce the task (in form of text or voice or video). 

A clear and challenging instruction contains not only a description on “what is needed to be done” but also an explicit statement of the instructional intention (why it is important to fully engage) and an explanation on the level of mental activities expected. Rubrics and example work can be given to further illustrate the learning focus and expected performance level.

- Provide core tasks that the learner must carry out making use of the source-materials: modelling/ explanation, examples, assignments

- Wrap up the task (students can make a summary and post it on a forum, where teachers’ summary can be pre-set as a feedback to be shown after students submit theirs).

Tip 2: Give or request brief interim summaries when closing a learning phase/subject topic. You can do this with short videos, podcasts, infographics, mind maps, or regular written summaries. These can be made by students or by you.

3. Teach students effective learning methods

Encourage students to improve their learning methods. In this way, students process the lesson contents better than that they merely go through a text and highlight certain topics. It is important to prevent procrastination among students. This way you avoid waiting until just before the exam to start learning.

How can you do this?

In this blog, the authors discuss a few strategies and correctly point out that not all strategies are suitable for all types of content. They also stress that it’s important to teach learners about these strategies.

Obviously, many of these strategies can be used without learning technology, but usually using a learning technology makes the process more efficient.

4. Alternate with exercises

“During practice, variability is usually key. By alternating between different types of practice and different types of content, learners can learn to use various problem-solving strategies. Variety is the spice of learning!”

This goes beyond varying in content or format (video, text, podcast, ...). You will encourage students to put their acquired knowledge into practice in many ways. This encourages students to reflect on the lesson content at a deeper level. This is conducive to long-term learning.

• Alternating similar types of practice

• Switching between worked examples, partially completed worked (out) examples, complete problems, and goal free assignments.

• Alternating between various productive practice types

• Switching between individual work, peer learning in pairs, and collaborating in small groups.

Online you can find various overviews of tools:

• Edshelf: Find the right educational tools for your needs (filter tools in various ways).

• Padagogy Wheel (hundreds of apps, aligned with Bloom’s taxonomy, learning activities, and phases of the SAMR model.)

• Tools Directory Centre for Learning and Performance Technologies (many tools, categorised, with short descriptions).

Student-learning environment interaction

Students interact online within a learning environment. This interaction can take place asynchronously or synchronously. For the asynchronous learning environment, we are talking about all functionalities within the learning management system (LMS) you are using (e.g. google classroom, Moodle, etc.).

HOW DO YOU DO THIS ASYNCHRONOUS?

Your learning management system (LMS) offers a range of functionalities to create and realize different online activating formats for your students within your course. The learning environment shall offer an activating, attractive and structured learning climate:

- Structure: use a well thought-out start page that shows the structure of your course. 

- Use learning modules instead of folders and map out a structured learning path. Use communicated learning goals. 

- Use icons to offer the different types of learning material and to create a recognizable table of contents

- Use discussion forums with learning opportunities. Provide clear instructions. 

- Let students reflect and learn from others. 

- Exploit the potential of blogs. 

- Press regularly to keep your finger on the pulse. 

- Give formative exercises to your students. 

- Use knowledge clips with guiding questions.

Student-teacher interaction

This form of interaction is about the dialogue between you and your student group. In other words: how can you as a teacher interact with your students in an online learning environment where face-to-face contact is not available?

HOW DO YOU DO THIS?

1. Communicate your enthusiasm from a distance

This is an important aspect in online learning environments. Taking lessons remotely in front of a screen, without contact with fellow students, is tiring. If you involve students in your dynamics, you can influence their willingness to actively participate. For example, even the tone of your voice can already have an impact on the motivation of your students.

2. Interact with individual students

Indicate to your students how they can contact you with individual questions: by mail, by phone, a question hour via eg chat, are you still available online after class, ...?

Do you work during your contact hour with work moments, individually or in a group? Tell students how they can address you with questions, for example via the chat in google hangout?

Individual questions that come back regularly can be fed back throughout the group.

3. Interact in online classes

Ask for reactions, short input,… in online lessons. This way you activate students remotely during the contact moment..

4. Create interaction in asynchronous teaching moments

Even if you do not organize a synchronous contact moment, you can build in interaction with your students. 

How can you do that?

- Ask questions using mentimeter or other similar tools: have students vote on a multiple choice question or ask them to formulate an answer to a statement.

- What questions do students still have with a chapter or topic? Let them send it in by mail, post it on a discussion forum or send it in as an assignment in LMS

5. Keep your finger on the pulse: are your students with you?

In an online learning environment, it is less easy to see whether your students are with you. Have they understood the subject matter? Do they get started with what you offer online in knowledge clips, assignments or exercises? How can you keep track of this from a distance?

Student-student interaction

This type involves the online interaction between students, one-on-one or in a group setting. In a face-to-face setting, this interaction often happens spontaneously: students ask each other a question about the subject matter, give comments during class or spontaneously discuss how to approach an exercise. In an online environment, this is less obvious because of the distance. As a teacher, you need to incorporate these interaction moments (even) more consciously into your lessons and allocate sufficient time for them. This can be done in both synchronous and asynchronous settings.

HOW DO YOU DO THIS?

1. Short moments of interaction

Even incorporating brief moments of interaction into your lesson can already help to increase engagement and reduce the emotional distance.

How can this work?

- Let students respond to each other's comments, answers and proposals in a synchronous lesson via Zoom function of voting or via chat.

- Whirling moments or short discussions in breakout groups during synchronous lessons.

- Reflecting on each other's views in an online discussion forum by explicitly providing criteria (quantitative and qualitative) for reactions.

 

2. Online working methods that stimulate interaction

In addition to these small interaction moments, you can also choose work forms in which the interaction between students is a central element. Students usually spend some time on this. So keep this in mind when planning your lesson or assignment.

You can do this in different ways.

a. Think pair share during a synchronous lesson

Present a question or statement to the students during your lesson and ask them to explicitly write down their ideas or answers for themselves. Then let them exchange thoughts about this in small groups of two or three (via break-out rooms) and provide plenary feedback. This can be done verbally, but in large groups it is best to do this via chat, poll or another tool such as padlet.

b. Online Jigsaw

In this form of group work, students work in subgroups (expert groups) to acquire knowledge and expertise on a particular topic. They bring in what they have gained in this first subgroup in a (newly composed) subgroup (home groups).

You can also provide synchronous moments for the group moments, whereby you can divide the groups into the break-out rooms. You can also communicate the group composition to the students via Toledo, after which they have to organize themselves online. It is best to set deadlines by which the discussion in the subgroups must be completed and have them submit the results or propose them (whether or not linked to a plenary moment).

c. Online peer instruction

This method starts with offering a question or statement during a synchronous lesson. Students initially answer individually (eg via a poll). Afterwards, the students discuss in groups in a break-out room about their given answer or vision. Finally, you bring the students back to the main room, after which you again submit the same question or statement. After the answers (which may differ slightly from the first result) you can give additional explanation if you wish.

d. Teamwork

You can also give group work to students online. You can communicate the group layout and the assignment in your Toledo course, or during a synchronous lesson. Groups can organize themselves. Give clear instructions and clarify where students can go with questions. It's nice if you also provide students with suggestions of tools they can use for collaboration, such as Skype for Business or Zoom for exchange, and collaboration tools like Google Docs or Google Sheets.

You can also choose to provide time and (virtual) space where the students can work on their assignment or paper, for example in Blackboard Collaborate where you prepare a few break-out groups so that students can go here themselves. You can also use these moments to solve questions or ambiguities, for example by providing a plenary question room or visiting the various break-out rooms yourself.

Extra variant: Student observation

In this additional variant of student-student interaction, the student does not actively participate in the interaction, but observes other students who interact with each other. Although the student does not participate in the interaction himself, this form of learning can be interesting because there is more room to stand still, reflect critically and look with a meta view at what is going on between the other students.

This can be done in small (break-out or not) groups, where you give the observer a clear assignment, such as being able to answer certain reflection questions, giving feedback to fellow students, expressing reflections that arise, etc. make a changing role.

You can also apply this variant in a large group, for example through a debate or discussion that is followed on the basis of the fishbowl principle. In this working method, a few students are appointed who conduct the discussion (with or without assigned characters and opinions). The other students are spectators and listen to the discussion, possibly focused on a certain character or opinion. Switches can be entered at set times, with spectators taking the place in the discussion and continuing where the previous one has stopped or was stuck.