Writing Program Assessment
Assessing Student Learning with an Equity Lens
Over the last six years, we have collected and analyzed 2000+ pieces of first-year student writing. We believe that this is the largest archive of student writing ever collected on our campus. And we believe it has much to tell us about how students experience their first year of college and develop as college writers. As importantly, with this archive, we've taken an approach to assessment that is asset-based and improvement-oriented. Such an approach helps us build richer understandings of students' literacy experiences and supports principles of antiracism and linguistic justice.
Our Method
Beginning with teacher expertise and student writing, we partnered with Writing Program faculty to identify core curricular values and to design a reflection-centered assignment for program assessment. Over the next several years, we invited teachers to interpret student learning via those assignments in an assessment community of practice (CoP). We crafted SF State Writing Program-specific threshold concepts that cut across our curricula, and built learning maps for each concept. Each learning map centers what students told us in their reflections about their experiences and learning as writers, including what West-Puckett, Caswell and Banks call “sideways paths” — the detours and seemingly unrelated stops that learners often take.
Learning maps thus consist primarily of a synthesis of students’ own descriptions of their learning trajectories, married with teachers’ descriptions of typical students’ progress. In our learning maps, we focus on understandings (Adler-Kassner and Wardle) rather than judgments about the quality of students’ writing or their “mastery” of outcomes (Gallagher). What have we discovered in our assessment so far? Among many findings related to first-year retention and writing development (see reports below), we are uncovering how students think about their own writing, as well as the affective dimensions of their experiences as writers in school.
Click on one of our seven threshold concepts to reveal the learning map for each concept, which describes students’ learning from emerging to meta-understanding. The learning maps document students’ possible progress across their entire undergraduate journeys, with students attaining meta-understandings in or even after their GWAR class. Maps are meant to be descriptive and non-linear, allowing for the sideways pathways evoked by the image at the top of this page.
Rubrics list criteria that are often framed in deficit language ("thorough; adequate; minimal; basic"). They locate failure in teachers and students rather than in institutions and systems. They lead readers to judge rather than interpret students' writing and learning. And they too often focus our attention on end goals, obscuring the learning that happens along the way.
Unlike rubrics, our learning maps encourage teachers to use thick descriptions to analyze students’ writing. They help us avoid the white language supremacy that is often encoded in traditional assessment materials, and enable us instead to take a rhetorical and critical approach — for example, we have a threshold concept focused on language, culture and power, rather than the more traditional learning outcome focused on grammatical correctness.
To learn more about how rubrics (especially generalized rubrics) are often steeped in colonizing ideology that privileges White Mainstream English (WME) while further marginalizing the voices of students, we recommend the work of linguistic scholar April Baker-Bell, as well as scholarship on decolonizing assessment (see this MSU guide).
Seven Threshold Concepts
- Emerging Understanding
- Has not been given opportunities to bring voice, self, experience, or identity to their writing in school (e.g. has been taught to avoid using “I”; has been taught to focus on performing tasks over making meaning; has not been given opportunities to connect writing to their own goals).
- Developing Understanding
- Recognizes that they can use their voice, self, experience, or identity in their writing in school (e.g. uses “I” in personal or reflective writing, or to express understanding or explore difficulties; has been taught that some assignments allow for “creativity” but most do not).
- Moving Toward Understanding
- Understands the importance of bringing voice, self, experience, or identity to their academic writing and uses this connection to engage or direct their education (e.g., connects self to inquiry topics; uses writing purposefully to gain self-knowledge).
- Understanding
- Understands and can analyze the importance of bringing voice, self, experience, or identity to their academic writing (e.g. not only expresses their own interest/connection to topic, but draws the reader in as well; makes and analyzes connections between self and writing/topic).
- Meta-understanding:
- Articulates how they take an active role in using writing to connect aspects of their selves/lives; situates their identity in the discourse around the topic (e.g, connects lived experiences, interests and reflection to the topic and the audience).
- Emerging Understanding
- Has not been given opportunities to use processes of drafting, feedback, collaboration, or revision (e.g. may struggle to bring ideas to the page; brainstorming and drafting are difficult; may write too little). Revision is limited, or school writing experiences may have drained the needed confidence to make choices without direct teacher instruction.
- Developing Understanding
- Recognizes the importance of drafting, feedback, collaboration, and revision (eg. can generate and brainstorm lots of ideas, but may still revise only when prompted or write shorty before due date).
- Moving Toward Understanding
- Understands and articulates the relationship between writing processes and successful writing (e.g. may use various strategies for drafting; reflects on/uses feedback from teachers and peers; notices that writing improves with revision).
- Understanding
- Analyzes how writing processes influence final result; analyzes feedback and revises actively (e.g. revises globally as well as locally, focusing on sharpening/clarifying ideas/purpose as well as improving organization and sentences).
- Meta-understanding
- Articulates how/shows evidence of how feedback and revision have improved or changed their writing and thinking.
- Emerging Understanding
- Has been taught to see audience, purpose, and genre in unidimensional terms or solely in terms of the teacher/assignment/grade (e.g. and thus writes for the teacher or grade). Relies on school formulas, formats, or prompts. Believes there is one way to write.
- Developing Understanding
- Recognizes that there are many different types of writing, and audiences may vary in their response; recognizes that writing should have a purpose; recognizes that there is not one correct way to write.
- Moving Toward Understanding
- Understands that audience, purpose and genre are context-specific and complex; budding awareness that genres both constrain and enable meaning and form.
- Understanding
- Articulates how they analyze aspects of audience, genre, and purpose in order to achieve rhetorical goals (e.g. may experiment with new genres; uses understanding of genre to attempt to reach audiences beyond the teacher).
- Meta-understanding
- Articulates how they use understanding of audience, genre and purpose to achieve rhetorical goals (e.g Is able to transform genres to suit their own purpose; addresses professional/disciplinary audiences).
- Emerging Understanding
- Has been taught to rely on teachers for evaluation or reflection rather than self or peers (e.g. has had limited opportunities to see how academic habits of mind support learning, reading, and writing.).
- Developing Understanding
- Begins reflecting and thinking about their own thinking; budding awareness of how academic habits of mind support learning, reading, and writing.
- Moving Toward Understanding
- Explores and practices reflection which improves thinking and writing; understands and can self-evaluate their own habits of mind and where they need to grow in terms of writing.
- Understanding
- Reflects (and/or articulates how they reflected) on their own thinking, reading, and writing; questions their own thinking; expresses curiosity, risk-taking, openness; consistently uses habits of mind to aid and deepen learning.
- Meta-understanding
- Can critically analyze how they use metacognition and habits of mind to accomplish writing goals; actively uses habits of mind to improve writing.
- Emerging Understanding
- Has been taught to read transactionally for “knowledge reporting” or “quote-mining,” and thus may not yet incorporate readings or other texts in their own writing.
- Developing Understanding
- Draws on readings that have impacted their thinking; raises substantive questions about texts.
- Moving Toward Understanding
- Explores and practices how reading involves knowledge-transformation, rereading, and attention to contexts; grapples with difficulty even when not prompted.
- Understanding
- Articulates how they transform knowledge gained from reading; uses questions to deepen analysis of texts; considers context to deepen analysis.
- Meta-understanding
- Reads critically and analytically; reflects on how reading and re-reading affect understanding.