Tests' Effectiveness
This entry is about Brown's Language
Assessment Principles and Classroom Practices, chapter 2.
Do we teachers pay attention to the
effectiveness of the exams we apply? In some cases, teachers -especially
those who teach at English institutes- must create or design the tests. We
probably do not even give a second look to the test we just designed for our
students before handing it in because we might think our test is good. But it
is not only important to take care of the exam. Also, external factors, or even
students’ personal issues play a role in the development of a good or a bad
exam. Brown (2000) proposes five criteria
for "testing a test". They are: practicality, reliability, validity,
authenticity, and washback. In this entry, I'm going to focus on
reliability.
One of the factors that can make a test
unreliable is Student-Related Reliability. Sometimes we do not take into account
the fact that one student is sick, or is having family issues, or
is just too nervous when it comes to taking an exam. The deal is that
sometimes we do not even notice it. These factors can affect prominently a
student's performance in an exam. What can we do in those cases? I remember
this was one of the matters we were discussing in the previous assessment
class. One of my classmates proposed a good alternative. It was to apply the
test again, in another time and when the student's condition was better. But
then, will we evaluate that student with the same criteria? Will the rest
of the students accept this? How can we know if the student was really
sick or not? How can we be really fair with all of the students?
The test reliability is another important
factor. The exam should be as clear as possible and here, the appropriate
instruction plays and important role. If the test's instructions are not understandable enough it would be difficult to our students to do the right things. Time
also counts. There are many students -I have to say that sometimes it was
my case- that freak out when they know how much time they have for the test and
then, when time is running out they start writing whatever comes to their
minds, even nonsense. This applies mostly for writing tests. Thus, giving the
students clear instructions of the test might also avoid this problem of time
to happen.
When the students are in the middle of an
exam, there are factors that will not let them concentrate, such as music or
people chatting around the classroom. In my own experience, I am a person
who needs total silence when taking a test. I think this may cause a
student not to have a good performance in an exam. But how do we teachers deal
with that? How do we teachers take that into account?
I think a teacher should not be biased. A
way to avoid this is to make the evaluation criteria clear to the students,
thus they know what exactly they must focus on and how they are going to be
evaluated. I do not think judging a student by their class behavior is fair.
We can evaluate the student’s performance in classes, but the test is something
apart.
There are other factors that should be
taken into account when evaluating how effective a test is. Of course there
will never be the excellent conditions, or there will always be students who
are feeling bad, or the devices might not work for all the students –in a
listening test, for instance-. This is why we teachers should be prepared for
those things, and learning from our mistakes is a positive result of experience.
If you want to answer some
of the questions in this post, feel free to do it. It would be enriching for my
current and future teaching experience.
Hi Carolina. When you said that we as teachers do not have a way to know for sure to what extent our students are having problems outside the classroom. I agree sometimes it may be made up. But, in a previous experience I had, I saw the importance on academic circles of creating community, so there was one, the trust between the parts (teachers, parents, students) and the respect between each other. I personally think that we as teachers should try to get to know our students more and create a relationship so learning can happen in an environment full of trust. I would like to know your point of view regarding this.
ReplyDeleteThanks!
But, what if it there is not even a chance to get to know our students? if external factors such as family problems or personal matters impede that we as teachers, intervene in the student's process, maybe because they do not trust you or simply, do not want to. We should take into account that we are not allowed to interferenot in all cases, either X or Y reason. In that case we have to conform and resign ourselves to guide and assess our students only regarding their class performance and tests, taking into account that despite we trY to go beyond this, there are other factors that do not concern us, and in which we are limited to express our view.
ReplyDeleteHi Zulma and Andrea. Thank you for commenting my post^^
ReplyDeleteI liked your opinion, Zulma and it’s true. Creating an environment full of trust is very important, and it depends on you, somehow. If you let this to happen maybe you can have a wider vision of your students and not just what you see in the classroom. I liked Andrea’s point of view too (maybe a little more realistic, I think). Even if we really want it, there are times in which we really cannot interfere much. Even if we try the hardest to establish a good relationship with your students based on trust and respect, not all the students are the same and not all may trust you at the same way as other more extroverted students would do. Moreover, there are some parents that help to create that barrier. Even some schools give that limit. They don’t let us to be friendly or to establish a closer relationship with our students. It’s a matter of institutes’ policies and sometimes we can do something but other times we cannot.
Cool post Caro, very down to earth! I would say that even in places where we are, as teachers, limited in terms of getting close to students, we can find a way to do it. For me, it depends on you as a teacher. Somehow, you need create a confidence environment between you and your students, so they can feel free to tell you if they are having any issue that could affect the class performance, but at the same time I want to point out that even when confidence is given, limits have to be set in order to avoid crossing the line between what is to do with the class and to you as teacher and their private lives.
ReplyDeleteOf course, Rocio. Actually I always do that with my students. I try to create a good atmosphere so that they can trust me and have a good relationship, not only with me but also among the students. I have never had problems with that but I was speaking generally, taking into account that in some countries, teachers are not allowed to have closer relations with their students. I'm not talking about the kind of lovers’ relationship, but even friendship or just hanging out is prohibited. Actually this situation happens here in some private institutes. They probably think that if the students need someone to rely on, that's the psychologist’s job, not the teacher’s. Despite such belief is not accurate, it's one of the realities we must face as teachers.
Delete