Supervisory Styles: Managing Teacher Assessment and Development

 

Submitted by: Colin Fry

Date: January 1996

 

                   Contents

 

1 Introduction

 

2 The context of my supervisory practice

 

3 An informal self-evaluation: Developing a focus for study

 

4 Theoretical Descriptions of Teacher Supervision

 

5 Post Observation Meetings; Supervision in practice

 

6 Conclusions

 

Bibliography

 

Appendix 1 & 2

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

1] Introduction

 

The primary aim of this essay is my personal development as a supervisor . In the process of completing it I hope to gain;

1) A better theoretical understanding of the choices open to supervisors in the role they play.

2) A better understanding about how to combine assessment with the individuals needs of my tutees.

 

2] The Context of My Supervisory Practice

 


2.1] In September 1995 I was appointed to the position of Trainer at The Preparatory School, Eastern Mediterranean University (EMU). In the post I am one of five tutors responsible for the education and training of thirty teachers who work at the school. Nineteen teachers are recent graduates and are following a new teacher programme. Eleven teachers are taking the Certificate For Overseas Teachers of English (COTE) which is moderated by the University of Cambridge Local Examinations Syndicate (UCLES) and the Royal Society of Arts (RSA). 


 

2.2] The COTE course is for teachers of English working outside the UK whose native language is not English. Teachers are required to have completed at least 300 hours of classroom experience and their standard of English should be at least Cambridge First Certificate level. In practice course participants have taught for a minimum of one academic year full time and their standard of English tends to be high due to Cyprus’s past links with Britain. EMU teachers would also have attended  in-service training courses. There are several teachers whose first language is English  and have spent part of their lives in the UK.

 

2.3] Part of the course requires attendance at weekly training sessions on Methodology and Language Development. The training sessions last 4 hours and are normally presented by one of the tutors. A further requirement is the completion of 4 written assignments of around 1500 words. The essays are assessed and graded jointly by the 5 tutors according to the COTE grading criteria. This involves assessing not only content but also language.

 

They also have to have completed;

1) 8 Peer observations - these are structured observations and can include teachers outside the course.

2) 6 Observed Lessons - 4 of which are formally assessed.

The observed lessons and accompanying lesson plans are graded by one or two tutors again in line with COTE criteria. An external Moderator validates the final grading of lessons and checks a representative sample assignments.

 

2.4] As a trainer I share in the delivery of formal training sessions and I am responsible for 2 tutees. This last aspect of my job would fall within Wallace’s definition (1991 p.107) of a supervisor

"“anyone who has, as a substantial element in his or her professional remit, the duty of monitoring and improving the quality of teaching done by other colleagues in a given education situation".”

More specifically it would come within the scope of what Wallace terms “clinical supervision” being concerned with what happens in the classroom.

 

Taking the my supervisory responsibilities as  a whole they consist of meeting with tutees to;

 

1) Discuss drafts of assignments

2) Discuss the results of Peer Observations

3) Discuss drafts of lesson plans relating to observed lessons.

4) Observe lessons. Officially, this has 3 stages

a) a pre-observation meeting

b) the observed lesson itself

c) a post observation meeting where the tutee gives their assessment of the lesson they taught and discusses points with the observer. In their post observation statement  they are required to select an area of teaching they wish to develop and identify how and when they will do this. The observer’s written comments are given to the tutee after the completion of the meeting and would take into account the tutee’s perception of what had happened in the lesson. The comments would include strengths and weaknesses as well as areas to work on.

 

Formal grades are not given. There are several reasons for this. Firstly, the grades might change due to external  moderation. Secondly, it avoids disputes between observers and tutees that would potentially damage their long term relationship.

 

In order to share standards with the tutee I produced two checklists (see Appendix 1). The first  dealt with lesson plans and the second with methodology assignments. The checklist was derived from COTE sources and discussions with other tutors.

 

3.0] An informal self-evaluation; Identifying a focus for study

 

3.1] I have five years experience as an advice worker in an advice bureau and have trained people in interview skills. Therefore I am fairly confident in structuring interviews and listening to people. I am familiar with the interview model described by Edge(1992), and  with a range of questioning techniques. Through working in a self access centre I have experience of academic counselling. Having taught a range of levels in similar institutions  I think I  have some knowledge of the classroom problems and types of students my tutees face. As I continue to teach EFL classes eight hours a week , I am a colleague with my tutees in some meetings and  am aware of the institutional constraints they work under. This helps me to be sensitive to “what is feasible”. Although it would be  true to say what is feasible for me is not necessarily true for my tutees.

However, one distinction between my current position and previous ones is the long term relationship with the tutee which lasts for an academic year. Also the requirement to not only assist the person I am working with develop but also assess them is new to me.

 

3.2] On this point there is some disagreement in the literature on supervision whether these functions can be combined. For Duff(1988 p.130) there should be no distinction between observation for training and development and observation for assessment. In his context he sees assessment as formative, feeding into the teacher's development. In contrast, Kennedy(1993 p.163) says the roles of assessor and counsellor cannot realistically be combined. Observation for development is also felt to be separate by Wajnryb (1992 p.2) who states that observation for assessment;

“"is usually value based, directive, externally imposed, and coloured by factors not necessarily related to learning".”

 

For this reason I have chosen to study what happens in post observation meetings with my COTE tutees and those of other COTE tutors. There are several reasons for choosing this  meeting  as a focus of study;

1) On grounds of practicality the post observation meeting are scheduled which enables me to find out when they take place.

2) The meeting is one point where the teacher’s work is discussed after assessment has taken place. In other meetings such as working on draft assignments tutors there is no assessment to inform the tutee of.

 

There are potentially several sources of conflict such as;

1) Role conflict - participants having a different expectations and understandings of they should be doing

2) Goal conflict - differing ideas of what the teacher needs to develop and when. This could happen as a COTE assessment is a global assessment so many issues are raised by one observation.

3) There is also a personal conflict I experience in believing assessment criteria and assessment procedures should be open and public and the need to focus on the teacher's personal development. This is an extension of goal conflict, in that if assessments were given, the focus of the meeting could easily revolve around the " mark" rather than the teacher's teaching. In one sense this essay is about  how I can manage this conflict.

These things have to be considered  also in relation to maintaining a constructive working relationship.

 

 

 

 

 

 

4] Descriptions of Teacher Supervision

 

4.1] Gebhard identifies 6 supervisory models. They are;

a) Directive Supervision

b) Alternative Supervision

c) Collaborative Supervision

d) Non-Directive Supervision

e) Creative Supervision

f) Self-Help Explorative Supervision

 

4.2] Directive supervision has the characteristics of the supervisor telling the teacher what to do and how it should be done. The supervisor then evaluates how well it was done. In this model the supervisor has a “monopoly” on truth being the possessor of the criteria of what makes “good” teaching. Freeman(1990 p.108)states the aim of “directive intervention is to improve the student teacher’s performance according to educator’s criteria”.

 

Gebhard suggests for some teachers there is a destructive aspect to this relationship. It results in a lowering of self-esteem and puts their decision making abilities in doubt. The status of the supervisor is reinforced and, being prescriptive, decision making is retained by the supervisor. However, he also acknowledges that some teachers doubt their supervisor’s qualifications for the job if they are not given direction.

 

4.3] In Alternative Supervision the supervisor’s role is to generate options with the teacher who then makes the evaluation  as to their effectiveness. The alternatives should be offered  non-judgementally by the supervisor. Basing his ideas on Fanselow, Gebhard suggests a technique of teachers doing the opposite of what they normally do. The teacher would then experiment and evaluate how it went. How does this role fit with the supervisor as assessor? This is not specified by Gebhard but it is possible to imagine revising the assessment criteria to include examining how the teacher experiments.

 

4.4] The idea of supervision as a counselling process moves nearer with Collaborative Supervision. Here teaching as a problem solving process with the supervisor having the intention of working with the teacher and sharing ideas. Contrasting  stylised versions of prescriptive (which I identify with Gebhard’s Directive model) and collaborative approaches Wallace (p.110) produces the table below.

 

The surveys discussed by Wallace lead him to conclude that while prescription has  benefits for  trainees a more collaborative approach  is likely to encourage the long term professional development  of the teacher(p.116).

 

Classic prescriptive approach

Classic collaborative approach

1. Supervisor as authority figure

1. Supervisor as colleague

2. Supervisor as only source of expertise

2. Supervisor and trainee or teacher as co-sharers of expertise

3. Supervisor judges

3. Supervisor understands

4. Supervisor applies a “blueprint” of how lesson ought to be taught

4. Supervisor has no blueprint: accepts lesson in terms of what trainee or teacher is attempting to do

5. Supervisor talks: trainee listens

5. Supervisor considers listening as important as talking

6. Supervisor attempts to preserve authority and mystique

6. Supervisor attempts to help trainee or teacher develop autonomy, through practice in reflection and self-evaluation

 

 

4.6] Gebhard’s fourth model is Nondirective Supervision. This is derived from counselling  with Freeman(1982)  making clear reference to Carl Roger’s work (1961) from which he quotes as saying the counsellor (the supervisor) should ask;

“How can I provide a relationship which this person may use for his own personal growth?” (p.32)

Thus the aim is to understand the teacher rather than judge. Decision making and responsibility remain with the teacher who has the freedom to express and clarify ideas. Within this model there is also the possibility of challenging the teacher in terms of the supervisor giving their perspective (see Freeman p.25). However, for some teachers this model may not be appropriate particularly if they expect more direction.

 

4.7] Creative supervision as described by Gebhard implies the supervisor takes a flexible  approach to supervision. The supervisor can combine behaviours from different models and draw from a wide range of resources. Supervision can also be displaced to other sources such as a resource centre.

 

4.8] The final model Gebhard offers is named Self-Help- explorative supervision. As an extension of creative supervision the supervisor becomes a participant with the teacher in exploring and describing the teaching process.

  

A more detailed account of a supervisory process is provided by Bowers(1987). He describes the supervisor as a counsellor in the post observation phase. He distinguishes between training as skill giving, prescribed and performed with a group whereas counselling is individually specified and may be remedial in nature.

H.O.R.A.C.E. is the acronym proposed by Bowers to describe the process of teacher counselling. It stands for Hear, Observe, Record, Analyse, Consider and Evaluate. Hearing in this context means listening to the teacher's view of the lesson and Observe refers to entering the teacher's class to watch them teach. Record stand for how what happens in the lesson is transcribed. Bowers recommends that observations be focused, with the following step being to analyse them. This gives us the A in H.O.R.A.C.E.. The next steps are to consider what was possible in the lesson and in this light evaluate. According to Bowers(p.151) evaluation should be selective rather than comprehensive. Teacher's performance can be considered in relation to three areas. They are;

1) In individual terms - the teacher is assessed in terms of what the teacher says they are trying to do.

2) In system terms - the aims and objectives of the institution

3) In professional terms - the teacher is assessed with reference to "the profession" or what is currently considered to be good practice. In my context this is derived from the COTE checklist (see appendix) and discussion with other tutors and moderators.

 

 

The supervisor-teacher relationship is considered from another point of view by Elliott and Calderhead(1994)p.172.

 

High

Support

Low

Support

High

Challenge

 

 

Novice grows through

development of new knowledge and images

Novice withdraws from the mentoring relationship with no growth possible

Low

Challenge

 

 

Novice becomes confirmed in pre-existing images of teaching

Novice is not encouraged to consider or reflect on knowledge and images

 

Thus for the teacher to develop there must be an appropriate combination of challenge and support.

  

5] Post Observation Meetings

5.1]Preparing to Observe Post Observations Meetings

Having gained the consent of participants that I would be allowed to observe their meetings, I constructed three documents to help me ( See Appendix 2).The first form was a count coding or tally system as suggested in Bowers(p.146) to focus on the supervisor's verbal behaviour and use of documents such as lesson plans. I choose four broad categories to categorise by. They are;

 

Directive/Evaluative Behaviour

Non-Directive/Accepting

Alternatives/Given Non-judgementally

Collaborative

The option of Other was also used.

 

Examples of each behaviour are;

Directive/Evaluative Behaviour

"Pay closer attention to what the students are saying."

"You need to be aware of how much you use Turkish."

"That's fine."

Non-Directive/Accepting

"You felt the lesson went well." (Reflecting the tutee's feeling)

"What is the most important thing for you?"

I class this as non-directive in the context that the tutor does not know the answer to the question and does not require a choice.

Alternatives-Given non-judgementally

"One option would be to get the students to write on an acetate"

Collaborative

"How could you ensure everyone in the group wrote?"

"What would have happened if you had used the questions before listening?"

 

I classified these questions as collaborative. They were not non-directive in context as the tutor had a reason for asking the question and would supply the answer if the tutee did not. Neither is it purely directive as the student knowledge/vales are explored.

 

 

I also used an audio tape to record the sessions to allow me to review and classify statements again if ambiguous. In a more precise study it would have enabled me to time more exactly the talking time of the participants. I decided to observe as well as use a tape recorder as it would enable me to see how documents were used and possibly identify important non-verbal behaviour.

I administered questionnaires after the meeting in order to get additional information about the participants roles and perceptions.  

 

 

5.2] Post Observation Number 1

This post observation meeting took place in my office between myself and one of my tutees and lasted about 25 minutes. I felt uneasy conducting this interview for several reasons. Firstly, the fact of using a different tape recorder than I had planned unsettled me. Whereas I had wanted to use a machine with a condenser microphone, only one with a more obtrusive external microphone was available. Secondly, having seen the lesson plan prior to the observation I felt I would be repeating myself. I also wondered if I should have discussed things in more detail at the planning stage. The tutee was also nervous because of the microphone and when invited to give her evaluation of her lesson  read from her post observation sheet like a speech. However, things did settle down.

According to my tutee the best description of the tutors was colleagues, then educators and assessors with the role of trainer being least suitable. She thought that her main role in the meeting was to get the evaluation and  analyse the lesson. The least important aspect of the meeting was to identify areas to develop. The best description of the meeting for her was discussing alternatives. In stating how she benefited from the meeting she said she felt comfortable and understood her weak points. She thought it would help her prepare better lesson plans.

During the meeting I referred to the tutee’s lesson plan to compare what happened with what was planned. I used comments I added to my observation notes to discuss each stage of the lesson. The post observation focused on communicative use of language  and providing a context for grammar practice which were weak areas according to COTE criteria. I used communicative criteria which I had discussed with the tutee previously.

According to my count coding I used 19 directive /evaluative statements, 9 non-directive statements, 1 alternative statement and 2 collaborative statements.

I was unhappy about the use of so many directive/evaluative statements for several reasons. Generally, it places the tutee in the position of having to justify their actions or accepting the tutor’s comments usually with a short response. I did not feel it would be constructive for  the long term relationship between me and my tutee. Another part of the meeting I wished to develop is moving the tutee beyond “identifying weak points” to getting the tutee to be more specific in how, what and when she plans to do something about these areas.

Comments from the tutee included the wish for more directive guidance at the lesson planning stage prior to the observation.

 

5.3] Post Observation Number 2

 

In this observation there was gap between how the participants saw the role of the tutor. The tutee thought the best description of the COTE tutors was as assessors, whereas as the tutor saw this as least important and rated the colleague role most highly. They both ranked the educator and trainer roles in third and second place respectively.

The tutee didn't feel it was important to explain how the lesson went but the tutor felt it was most important to get the tutee's view of the lesson. They agreed on the ranking of analysing the lesson which they rated as second least important. The tutee felt it was most important to get the tutor's evaluation and identify areas to develop.

The tutor felt the meeting was directive although the tutee thought alternatives were also included.

The comment by the tutee about the meeting was that she felt discouraged. She had lost confidence and felt the basis of one hour's teaching was artificial. The tutor was also unhappy about the post observation meeting and stated that she would like to have conducted the meeting in a different manner. She had decided to be directive  as the tutee had a highly positive view of the lesson which the tutor felt needed to be challenged. The tutor was also unhappy about the amount of time she spoke in the meetings generally with her tutees.

The tutor did not make any explicit reference to COTE criteria and referred to her observation notes which she did not seem to share with the tutee. According to my count coding there were 25 directive/evaluative questions or statements, 2 non-directive and accepting statements with 2 use of alternatives given non-judgementally. The tutor also make a contract with the tutee to review materials for communicative content at an agreed date.

 

Due to the tutor’s unhappiness with the meeting, we discussed it afterwards. I suggested she make her comments though the form of open questions to explore the tutee's ideas. The tutor did this and reported there was an increase in teacher talking time.

 

5.4] Post Observation Meeting Number 3

 

I taped the post observation meeting with my second tutee which took place in my  shared office. After listening to Post Observation 1 I decided to change my technique and use my record of the lesson observed to pose open questions rather than make comments. For example;

"What would latecomers have done?"

"How could you ensure everyone in the group wrote?"

My tutee stated that the most important role of the tutor was as an educator, followed by assessor , colleague and finally trainer. Most importantly, for the tutee was to analyse the lesson with the tutor, identify areas to develop and plan how to do it. Explaining how the lesson went and the tutor’s evaluation  were less important. She thought the best description of the meeting included non-directive, alternative and collaborative elements.

My categorisation showed 13 directive responses, 10 collaborative responses, 5 non-directive responses and 3 alternative responses. By posing questions I had increased the tutee’s talking time  and enabled her to come up with her own answers. I felt the meeting was also more relaxed in atmosphere. On the tape there were pauses which indicated thinking by the tutee.  

 

5.5] Post Observation Meeting Number 4

 

This interview took place in the tutor’s office and lasted approximately twenty minutes. Both participants rated the role of the tutor as educator and assessor highly. Despite this there was no explicit reference to COTE assessment criteria in the meeting. Both participants also rated the tutor’s training role less highly and the tutee rated the description of the tutor as colleague as the least applicable.

 

Analysing the lesson was ranked as the most important task in the meeting by both the tutor and tutee. For the tutee receiving the tutor’s evaluation was next in importance whereas the tutor thought planning how the tutee developed was very important. Both saw the meeting as collaborative and the tutor thought there were non-directive elements to it. From my observation I identified 18 directive responses, 3 non-directive responses and 24 collaborative responses. The directive responses were often in the form of positive feedback. Evaluations of a critical nature tended to be descriptive statements. The tutor used her observation notes to guide the discussion. She checked her understanding of the lesson by recounting it to the tutee who then elaborated on it and was invited to comment on it. Having established some areas were problematic the tutor then asked “What would do if you taught this lesson again?”. This enabled the tutee to demonstrate what she knew and encouraged her to reflect.                                        

 

5.6] Post Observation Meeting Number 5

 

To increase the number of  post observation meetings and tutors I  observed  I included an interview with a new teacher not on the COTE course.

 

The tutor in this observation combines his role of tutor with that of manager in the school  which reinforces his status as tutor. The teacher whose lesson was observed was a recent graduate with ten weeks teaching experience. During that time he would have received some training in basic teaching skills. The meeting took place in the tutor’s office which is normally a busy place due to his managerial role. However, due to my presence and the tape recorder the door was locked.

 

Both participants saw the role of the tutor as an educator as being most important However, the tutor felt it was more important to be a colleague than a trainer. This contrasts with the teacher who rated the trainer aspect as very important and gave least importance to the colleague role. Neither rated assessment as important .

 

The interview discussed the context of a reading lesson with the tutor initiating and attempting to close the session. During the  meeting the tutor explored the teacher’s view of reading, vocabulary teaching and grouping. Areas were identified by the tutor that the teacher needed to work on. The tutor attempted to close the interview with “Well, that’s it.” to which the tutee made a specific request for the tutor’s opinion about his “weak points”. The tutor responded by summarising the interview and promising written comments.

 

My record of this interview was that it combined directive and collaborative aspects. Both participants thought it contained directive elements. But while the tutee thought it was best described as directive the tutor felt there were collaborative and alternatives elements. My view of the alternatives given is that they were given non-judgmentally but were directive.

 

Listening to the tape again it was noticeable that the directive/ evaluative responses were;

1) Mainly in the form of positive feedback.

2) Shorter in length than the collaborative responses. For example,

“It didn’t show. Well done.”

“It worked fine. Really.”

“That worked excellently.”

3) Comments that could be construed as negative or threatening were descriptive which enabled the tutee to evaluate or explain further.

“Your face seemed very serious.”

 

From the questionnaire the tutor revealed his own agenda of wishing to encourage the teacher who had been observed for the first time. Generally there was broad agreement between the participants about the stages of the meeting  and the results of the meeting.

 

6] Conclusion

 

6.1] As stated in 3.2] part of the motivation for the essay was a desire felt that assessment procedures and assessment criteria open. In order to adopt a collaborative approach as recommended by Wallace and as a personal preference I feel these must be open to the tutee. Then the tutor and the tutee can work together as tutee adopts these standards as their goals and exercises a degree of ownership of these standards.

 

6.2] The survey of the Post Observation Meetings revealed the focus of the meeting was the teacher's lesson. It was assessed and analysed with regard to the teacher's intention and with regard to "professional standards". Directive feedback of a comprehensive nature can be demoralising and is not suitable for this meeting. In order for the assessment to be useful, it needs to be focused.

 

6.3] I think the solution to my dilemma is to split knowledge of the assessment criteria from the Post Observation Meeting. The adoption of the assessment criteria as their standard of performance by the tutee must be a long term goal or a end of course behaviour, whereas analysis of particular lessons and forming development plans should be short term ones. As part of this process I scheduled a separate meeting with my tutees to discuss their idea of a good lesson and generated a checklist with which they can assess their lesson plans. I plan to revise the early checklists with the COTE group working as a whole to produce their own assessment criteria.

 

 

 

 

 

 

 

 

 

 

Bibliography

Allwright, D., Bailey, K. M. (1991) Focus on the Language Classroom Cambridge; Cambridge University Press

Bamber, B. (1987) “Training the Trainers” in Bowers, R. (ed.) (1987)

Bowers, R. (1987) “Developing Perceptions of the Classroom” in Bowers, R. (ed.) (1987)

Bowers, R. (ed.) (1987) Language Teacher Education: An Integrated Programme for E.F.L Teacher Training London: Modern English Publications

Edge, J. (1992) Cooperative Development Harlow: Longman Group

Freeman, D. (1982) “Observing Teachers: Three Approaches to In-Service Training and Development” TESOL Quarterly 16,21-28

Freeman, D. (1990) “Intervening in Practice Teaching” in Richards, J.C. & Nunan, D. (eds.) (1990)

Gaies, S. &  Bowers, R. (1990) “Clinical Supervision of Language Teaching: the Supervisor as Trainer and Educator” in Richards, J.C. & Nunan, D. (eds.) (1990)

Gebhard, J. G. (1984) “Models of Supervision: Choices” in Richards, J.C. & Nunan, D. (eds.) (1990)

Kennedy, J. (1993) “Meeting the needs of teacher trainees on teaching practice” ELT Journal Vol. 47/2

McIntyre, D., Hagger, H. & Wilkin, M. (eds.)(1993) Mentoring London: Kogan Page

Rogers, C. (1961) On becoming a person. Boston; Houghton Mifflin

Richards, J.C. & Nunan, D. (eds.) (1990) Second Language Teacher Education Cambridge: Cambridge University Press

Wallace, M.J. (1991) Training Foreign Language Teachers - A Reflective Approach Cambridge: Cambridge University Press

Wajnryb, R. (1992) Classroom Observation Tasks Cambridge: Cambridge University Press

Wright, T. (1987) Roles of Teachers & Learners  Oxford: Oxford University Press