Recommendations for Future Study Groups

From January to July, 1997, the members of the Virginia Assessment Study Group had three opportunities to formally evaluate the project. Members received evaluation forms following the first meeting and at the end of our work in July. We also evaluated the project with a view to forming future study groups.

Based on our discussions and our written evaluations, we can make 3 recommendations concerning the formation of future study groups.

1. Clarify the purpose and objectives of the project and adhere to them.
2. Group members by interest or instructional setting, and as much as possible, by locality. Develop a strong network of communication between group members.
3. Provide compensation commensurate with the work requirements.

Recommendation 1: Clarify the purpose and objectives of the project and adhere to them.

I realized at our first session that our study group would not focus on the original questions [on the application]. Once we decided to "capture the reality of our current assessment practices," my expectations changed accordingly. Our data collection and narratives followed suit. I am, however, concerned about how useful this information will be to other practitioners.

My original expectation was not met at all. I had thought we would be field testing a new assessment -- maybe a new/different STEPS or standardized tool. Once our three questions were established, I was interested in them as they related to me and my students, but I did find it hard to let go of my original expectations.

[There was] confusion on the part of participants as to the group's purpose and some resentment that a few stated goals from the application were not considered in the study.

I would recommend a more clearly defined purpose from the beginning. This would help to prevent misconceptions and wasted time.

Recommendation 2: Group members by interest or instructional setting, and as much as possible, by locality. Develop a strong network of communication between group members.

I wonder if consensus might be reached sooner if the practitioners involved in the group come from similar settings.

Identify goals and objectives before the groups are picked. Let people sign up for or pick the goals of interest to them.

A list of study topics to choose from would be great!

Recommendation 3: Provide compensation commensurate with the work requirements.

Assessment Study Group Members averaged 100 hours on this project. This included time spent reading, attending group meetings, in travel, e-mail and phone conversations, collecting data, reporting, and (for some) presenting at VAILL, a summer staff development conference.

I am interested in continuing with the study group, but realistically there would have to be adequate compensation.

I was amazed at the amount of time I spend at home doing adult ducation "stuff." I knew scoring, recording, and analyzing formal assessment instruments took time, but I hadn't realized how much time!