JHMS Literacy Coach: FA and Feedback Bonanza - Notes from 2 ASCD Magazines and 2 Webinars

Articles Read:

"The Bridge Between Today's Lesson and Tomorrow's" by Carol Ann Tomlinson
"The Right Questions, The Right Way" by Dylan Wiliam
"Thoughtful Assessment with the Learner in Mind" by Jan Chappuis
"Formative Assessment in Seven Good Moves" by Brent Duckor
"Student-Owned Homework - By using homework for practice in self-assessment and complex thinking skills, we can put students in charge of the learning process." by Cathy Vatterott
"The Problem with Penalties - Punitive policies - where for not brushing your teet or for incomplete homework - are not very effective. Positive guidelines work better." by Myron Dueck
"How We Drive Students to Cheat - Instead of bemoaning the fact that students cheat, we need to ask how our instructional practices may be encouraging them to do it." by Cris Tovani
"7 Keys to Effective Feedback" by Grant Wiggins (ASCD Sept 2012)
"Know Thy Impact - teachers give a lot of feedback, and not all of it is good. Here's how to ensure you're giving students powerful feedback they can use." by John Hattie (ASCD Sept 2013)
"Preventing Feedback Fizzle" by Susan Brookhart
"Feedback Part of a System" by Dylan Wiliam
"How am I Doing?" Jan Chappuis
"Making Time For Feedback" by Douglas Fisher and Nancy Frey
"Feedback Is a Two-Way Street" by Cris Tovani
"What do we say when a child says, "Look at My Drawing" by Maja Wilson
"How do Know what Students Know" by William Himmele and Persida Himmele (webinar)
Learning in the Fast Lane by Suzy Pepper Rollins (webinar link)

"Making Time for Feedback" by Douglas Fisher and Nancy FreyPD around Formative Assessment:

How to build teacher knowledge of different students' learning progressions, in relation to different topics and different levels of background knowledge, is one of the most important formative assessment challenges. (This can be done by L@SW.) ... Research shows us that formative assessment makes a different not only for student outcomes but also for principals and teachers looking to build stronger relationships in their schools and classrooms. (4)

Great Quotes:

Because teaching is too complex to invite perfection, even the best teachers will miss the mark on some days, but in general, teachers who use sound formative assessment (hit the mark more often!) (1)
"Yet when it comes to academic learning, we seem to discount the importance of that freedom for learnings to design their own methods, that forgiveness of form and grace, and that acceptance of failure. We often forget to appreciate the inform desire for mastery or to trust a child's self-knowledge of how to get there. And so we prescribe one method of learning, assign one task as homework, and simply require students to comply." (5)
You don't know it....YET. (1, 3, 4, 5)
Skill vs Will - students who cheat lack something. Usually they lack a sense of the relevance of what they're learning, or know-how, or timely feedback. (7)
Thinking is messy. As educators, we have to decide what we value and then match our instructional and assessment practices to those beliefs. (7)
Remember, that "no time to give and use feedback" actually means "no time to cause learning." (8)
Children do not need prizes or praise, but engagement and relationship - with other people and with the work they are doing. (15)
- Research - kids given a book with a book mark at page 250. 1 group - when get to page 250, prize. other group - when get to page 250, talk about the book with adults of your choice. Prize group - read to page 250 and no further. Adult conversation - read more, were more engaged and finished the book.

What is Formative Assessment:

a window into teaching and learning (17)
the bridge or causeway between today's lesson and tomorrow's (1)
Paradigm Shift: Hattie identifies that teacher's willingness to seek disconfirming evidence - to actively look for evidence of those parts of the learning that need additional focus - as the most crucial factors in helping each student learn. If they all get it, it's time to push! (3)
- feedback thrives in conditions of error or not knowing - not in environments where we already know and understand. Thus, teachers need to welcome error and misunderstanding in their classrooms.
Formative Assessment is made up of a sequence of moves that invite a positive, ongoing relationship between teachers and their students. those moves: asking effective questions, giving students adequate time to think and respond, and asking probing follow-up questions that deepen student understanding. (4)
- IN the formative assessment-driven classroom, everyone is consciously engaged in practices that promote further learning, as opposed to those that merely assess students achievement (4)
Formate assessment is more than a march toward the known. It's a process for uncovering deeper understanding, which means having access to evidence about what students are thinking. (4)
a two-way conversation between student and teacher. It provides an opportunity for students to think and talk about their learning and for the teacher to get inside their heads. (5)
- When students have the chance to tell me what they need, they empower me to revise and rethink my instruction. ~Cris Tovani (14)
- "It was only when I discovered that feedback was most powerful when it was from the student to the teacher that I started to understand it better." ~John Hattie, Visible Thinking
- "Can you tell me about this?" is the first question to ask... Try to figure out intentions and ally yourself with the student... (15)

Formative Assessment requires:

Help student understand the role of FA (1)
- FA helps students learn and that immediate perfection should not be their goal....Sustained effort and mindful attention to progress feed success (1)
- Sample message:
  - When we're mastering new things, it's important to feel safe making mistakes. Mistakes are how we figure out how to get better at what we are doing. They help us understand our thinking. Therefore, many assessments in this class will not be graded. We'll analyze the assessments so we can make improvements in our work, but they won't go into the grade book. When you've had time to practice, then we'll talk about tests and grades. (1)
- Establish norms and routine for inviting student participation, especially for students who aren't familiar with assessment practices outside the normal experience of "doing school." ... culture shock may students experience when they're expected to learn in this new and perhaps puzzling manner (4)
- Students will not accurately self-assess until we establish that mistakes in learning are necessary and acceptable. (5)
Begin with clear KUDs:
- Standards Walls (17)
- Learning Targets and Success Criteria and Performance of Understanding (that matches your LT/SC) (10)
- Pre-assessment provides a dipstick check - gives teachers a reasonable approximation of who may experience difficulty, who may show early mastery, and who may bring misunderstanding to the unit. (1)
- Assessment forms an image of a student's emergent development. (1)
- Assessing thoughtfully means making sure we teach students how to accomplish the rigor embedded in our standards before we hold them accountable for having mastered that rigor. ... When we take the standard apart and classify each part according to the type of learning it calls for, we can more clearly see what we need to teach. Do my students understand the concept? What guidelines can I provide? What practice will they need? Do they understand what to look for? (3)
- Create authenticity of work - giving students an audience to whom they can demonstrate their learning is another way to create authenticity (7)
- What is the process behind the thinking that is required? How do you make that accessible for all students? (7) The power of the teaching and learning is not in the right answer, but in the ability to teach students so they can get to the right answer independently.
Make room for student differences. DO THE WORK!!
- Why are students getting the answers right or wrong - careful analysis is necessary (3)
- Posing good questions means your questions invite or elicit a range of student responses. ... An effective question sizes up the context for learning, has a purpose related to the lesson and unit plan, and, ideally, is related to larger essential questions in the discipline. (4)
- IDeas from Learning in the Fast Lane (17):
Provide instructive feedback (Inviting Students to Learn by Jenny Edwards)
- Dylan William argues that feedback can double the rate of learning.
- Overwhelming research that, when done right, feedback is likely the most effective tool educators have. Grant Wiggins urges, "Less teaching, more feedback." or "Giving good feedback is good teaching - and the key to achieving greater learning."
  - less feedback that comes from you (self and peer)
  - more tangible feedback designed into the performance itself
- Feedback needs to help students understand what to do to improve the next time around - what are their particular steps int he learning process? (1)
  - use words that suggest the student is an active learner and will make decisions about how to go forward - "What were you thinking when you decided....? What strategy will you choose?"
- The best feedback practices must be specific, addressable, timely, ongoing, and content-rich (4)
- Feedback should invite deeper reflection (4)
  - Did feedback result in a better _____? (15)
  - Did feedback support the student's healthy view of him/herself as an _____? (15)
  - Did this feedback results in an understanding of what it means to ___ that the student can take with him/her and use from year to year? (15)
- Finding Time for Feedback (13):
  - Focus on ERRORS not the actual mistake - gives the knowledge to avoid the mistake in the future (mistake VS error in not checking your work)- errors are a lack of knowledge:
    - Factual Errors
    - Procedural Errors
    - Transformation Errors - incorrectly apply information to a new situation
    - Misconception Errors -
  - Identify the pattern of errors - individual, small group, whole class? Chart the information
    - The teacher does not identify every error found. ...Instead, we conduct an error analysis and determine areas of instructional need. We look for a pattern of errors, not isolated or anomalous ones.
    - Global vs targeted errors (if most, teach all (unless you are sure)!)
  - Reteach differently and include prompts and/or cues
  - Lots of sources beyond the teacher (13 and 17)
Make Feedback user-friendly
- Student must understand the feedback if it is going to work (9)
- Feedback must result in student thinking about how to improve - the ideal is to elicit a cognitive response from the learning not an emotional one (1)
- The best feedback describes what the students has done and helps the student decide what to do next. Good feedback not only motivates, but also transfers a sense of agency to the learner.
  - "I don't know how you will do this - I'm excited to see the direction you take."
  - Once you note a problem and discuss it, there are a dozen ways you could work around it. Frame possible solutions and then leave it in the student's lap (15).
- Feedback is not
  - praise
    - students welcome praise - even want/demand it (9)
    - If praise it combined with feedback, only praise is considered. (9)
    - Bottom line - give praise for other things, feedback about learning. (9)
  - judgement
  - inference
  - a grade or number on a rubric
- Three levels of Feedback (9)
  - Task Feedback: clarifies what a student needs to do to improve his or her performance of that task
    - Your learning goal was to ___. You ____. Then you ____. You did ______, but you ____(observations of what worked and didn't. neutral) Please _____ and then ____.
  - Process Feedback: describes the processes underlying or ralted to tasks such as strategies students might use to detect or learn from errors, cues for seeking information, or ways to establish relationships among ideas.
    - You're _____ and you've tried _____. Can you see how this is not helping? Perhaps you could ____, _____, and _____.
    - I asked you to ____. I saw you do ____, but I didn't see _____. Could you try that?
    - Any "compliment" should be around a controllable factor - you didn't give up OR you asked questions until you understood OR you were patient with your learning...
  - Self-regulation Feedback: describes how learners can monitor, direct, and regulate their own actions as they work toward the learning goal.
    - I'm impressed you _____ when you became stuck on ____. But in this case, that strategy didn't help, did it? What else could you do? (student) Great, try that and tell me how it works.
    - You checked your work and found out you got the wrong answer. Any idea why you got it wrong? What strategy did you use? Can you think of a different strategy to try? How will you know if your answer is correct?
- Feedback only works if it passes CARE (6) :
  - Care - evokes concern on the part of the learner
  - Aim - aligns with the ultimate objectives
  - Reduction - reduces the undesireable behavior
  - Empowerment - learner has control over the factors that lead to the mistake and are capable of understanding the situation and feedback. (6)
- 7 Keys (8):
  - Goal-referenced
    - Frame: The point of the ____ task is for you to _____. So when you look over your work, ask yourself _____?
    - Frame: As you _____ today, remember that the aim is to _____. This means you will need to ______. Self-assess your work against ____.
  - Tangible and Transparent
    - Point out evidence FIRST.
      - Ex: Did you hit the ball? NO - (feedback will be more welcome)
      - If evidence isn't clear, video or audio tape it
  - Actionable
    - carefully observe and comment on what is observable and then provide actions to take.
    - Effective feedback is given DURING the learning - there is still time to act on it. (12)
  - User-friendly (specific and personalized)
    - Be cautious of highly technical feedback and/or too much feedback
    - Effective feedback does not do the thinking for the student. "When teachers provide students with more guidance than they need, feedback doesn't deepen learning." (12)
    - Imagine and describe the student's intentions is a way of framing the feedback so that it is accepted. By labeling the student's confusion as "interesting" they are more likely to be interested as well (15).
    - Normalize confusion/mistakes - all writers find, express, clarify and shape their writing (15)
  - Timely
    - Means they have the opportunity to use it to improve their work
    - Use: technology, peer review, small group work
    - Know when NO feedback is best...sometimes feedback can paralyze a student if they are in the flow or haven't worked on the task long enough. (15)
  - Ongoing
    - Effective feedback addresses partial understanding. ... Feedback can only build on learning; if the learning isn't there, the feedback isn't going to move it forward. (12)
  - Consistent
    - This requires alignment across teachers and staff - "students have to be trained to be consistent the same way we train teachers, using the same exemplars and rubrics."
Assess persistently
- A great teacher is a habitual student of his/her students. ...the teacher is constantly watching what students do, looking for clues about their learning progress, and asking for input from students about their status. ... They are taking notes on what they see and hear in order to analyze and find trends that further inform instruction. (1)
Engage Students with Formative Assessment
- Students benefit from examining their own work in light of rubrics that align tightly with content goals and point toward quality of content, process, and product - or in comparison to models of high-quality work that are just a bit above the student's current level of performance. They benefit from providing feedback on peer's work, as long as the feedback is guided by clear criteria and a process that enables them to provide useful suggestions. (1)
- Students need to be involved in thoughtfully examining teacher feedback, asking questions when the feedback is not clear, and developing plans that specify how they will use that feedback to benefit their own academic growth. (1)
  - Assessment Dialogue Form:
    - My Opinion - My strengths are... What I think I need to work on ...
    - Feedback - Strengths.... Work on ....
    - My Plan - What I will do now...
- We must teach students how to receive feedback so that they see what they know (their strengths) and what they don't know (their gaps) and engage more deeply in seeking feedback or additional learning. (9)
- Goal to hear students say:
  - Here are 4 goals I'm working on right now. In this piece of work, here's evidence that I'm competent with the first and 3rd goals. If we look at my work from a month ago and then at this most recent piece, I can show you evidence of my progress with the second toal. I can also tell you two things I"m going to work on this week to make sure I become more confident and more skilled in working with the 4th goal. (1)
- Students respond to feedback in 8 ways (11):
  - By changing behavior: increased effort OR exerting less effort
  - By modifying the goal: reduce aspiration OR increase aspiration
  - By abandoning the goal: decide the goal is too hard OR the goal is too easy
  - By rejecting the feedback: ignoring it OR missing it
Look for patterns:
- The goal is to ... find patterns in the students' work that point the way to planning classroom instruction that both moves students along a learning continuum and is management.
Plan instruction around content requirements and student needs
- Formative Assessment > Pacing Guides and unit plans
  - We must ensure that our pacing guides accommodate the teaching and learning needs that our diagnostic assessments have identified (3)
  - When we blast through the curriculum, we model for students that they can rush through it, too. We reduce the opportunities to support students in their learning, so they internalize that it's OK to not really understand and still move on. They become more willing to accept learning at that level.
- there is little point in spending time on formative assessment unless it leads to modifications of teaching and learning plans. In other words, formative assessment is a means to design instruction that's a better fit for students needs, not an end in itself. (1)
- It is wasteful of time, resources, and learner potential not to make instructional plans based on that understanding (1)
- It is important to know the type of problem that is standing in the way of mastery so that we can plan appropriate next-step instruction (3).
  - Errors due to incomplete understanding -> Teachers can introduce the new information immediately or when it becomes developmentally appropriate (be patient until then)
  - Errors due to flaws in reasoning ->
    - Think carefully about the type of reasoning involved and then help students recognize typical errors for that particular pattern of reasoning.
    - Teachers should help students understand the salient features of the pattern of reasoning and let them examine examples of flaws so they can more easily recognize them before the students begin practicing with the pattern of reasoning in the context of the given subject.
    - Teachers can give students time to analyze examples of typical flaws as well as examples of good reasoning before asking them to practice the reasoning again themselves.
  - Errors due to misconceptions -> Basically students have learned or internalized something that they believe to be correct but that isn't. The lesson must dislodge them. Misconceptions are stubborn.
    - Create an awareness of the misconception by providing students with an experience - demonstration or reading passage - that runs counter to the misconception. Ask questions - Where does this experience contradict what you think is right? Finally, have students explain why the misconception is incorrect.
- Only spend time on formative assessments if you are going to use them to plan instruction. If not, they are a waste of time. (3)
Repeat the process

Questioning - all notes from article #2 unless noted:

Questioning is key to formative assessment (4)
Paradigm Shift:
- The whole idea that students should always answer teachers' questions correctly is actually rather odd. If the students are answering every one of the teacher's questions correctly, the teacher is surely wasting the students' time. If the questions are not causing students to struggle and think, they are probably not worth asking. As i say to students, "Mistakes are evidence that the questions I asked are tough enough to make you smarter." Of course, the best teachers have always said that making mistakes is OK, but recent research has shown that making mistakes in learning is actually better than not making mistakes.
  - Misconceptions and students' prior knowledge are at the very heart of the learning process in a formative assessment-driven classroom. If teachers don't create a space for students to express both their understandings and their misunderstandings, students who are too embarrassed to express a potentially incorrect answer will simply remain silent. ... By failing to tag responses that evoke those misconceptions, teachers reduce the power of formative assessment to uncover difficult learning steps along the way. A teacher needs to know where kids get stuck and why. (4)
  - STudents arent' expected to find the "right answers" to the questions; they are expected to share the well-informed perspectives and understandings they have gained from the unit of study AND to learn from other who may have differing ideas/understandings (7)
- Questioning should...make students' voices louder and teachers' hearing better.
Participation is not voluntary.
- If it is, assessment data is only based on the volunteers.
NO Hands Up
- "No hands up is the most significant thing a teacher can do. (2)"
- Randomization devise:
  - Equity Sticks
  - Technology - app Renaye showed
- All-Student Response Systems
  - Ex: White boards, fingers, Index Cards, Exit tickets, clickers
  - Anonymous - trends VS Names - grouping
  - Time --> quick write/draw --> inside outside circle (bounce to outside)
  - Strategies:
    - The Ripple Effect (16)
    - Chalkboard Splash (16)
    - Debate Team Carousel (My opinion / After reading classmates responses, new idea / After reading classmates responses, aguement against my idea / Final opinion)
    - PIcture Notes / Picture - Pause - Points = (Illustrations of article, Illustration most important to remember or main idea / Caption) Interesting - while drawing they clarified ideas (16)
- Sequence: ask question, PTT, randomly call on students
Statements instead of Questions:
- Make a statement that students are expected to respond to or expand on.
PAUSE:
- We all need time to process information, to "transfer files" from our short-term to our long-term memory and back again. Processing speed varies according to the nature of the information we're asked to process and our degree of familiarity with it. (4)
  - Wait time
  - Protocols for participation: think-pair-share, journal entries
  - Pausing requires preparation (stop watch)
- The goal of pausing is to slow the process down (4)
Responses to answers:
- Bounce - probe student responses
  - Probing suggests there's always more to know and say (4)
  - Probing is about collecting more substantial evidence to make decisions about what to teach, reteach, or even preteach for a particular group of students.
  - Bouncing creates a larger feedback loop - you are depending upon more students to plan for next instruction.
- "I'm confused by what you are saying."
PLAN questions:
- Goal: questions should elicit evidence of student thinking so that we can give useful feedback. YOu can't give useful feedback without finding out what's going wrong in the first place.
- Plan for instructional traction: Do the wrong answers give us information about what problems further instruction should address? If the item doesn't have any diagnostic power, further planning is necessary (3).
- If we pose thoughtful questions and give students an audience for their learning, they're less likely to feel that what we're teaching is a waste of time - and they won't be so inclined to cheat (or not participate). (7)

Grading:

Students make decisions every day about who they are as learners, whether to try, and whether they're good at specific subjects or school in general on the basis of what we do in response to their assignments and assessments. ... If students receive a grade on their practice work, those who don't do well will tend to conclude that they aren't very good at a task or subject. ... (our goal is to communicate) ...They aren't good at it ... YET. Grading too soon in the learning process can lead students to the damaging inference that being good means not having to try and that if you have to try, you aren't smart in the subject. (3)
Assessing thoughtfully means giving students sufficient time and opportunity to practice and improve through further instruction and feedback before holding them accountable for having mastered the learning target. (3)
once we remove the threat of the bad grade, we free students to embrace the struggle that is necessary for deeper learning (5)
Why grading doesn't work (6):
- students don't care about the 0
- makes behavior and compliance more important than learning
- grades can sabotage the accuracy of existing grades leaving students overconfident or frustrated.
- grades more aligned to socio economic factors (poverty, violence, utilities/space, low self-esteem, negative school views (student and family)) than effort or ability.
- Effort grades: "Years of graded homework results may teach students that giving the impression of exerting effort yields a better grade than does actually striving to learn. ... effort grades are likely including a variable that is neither accurate nor asked for by governing education authorities."
Instead of low grades, give Incompletes and Interventions - incompletes stand until the assignment is completed and if incomplete, one or more interventions must be used.

Homework - all quotes from article #5 unless otherwise noted.

Because the new standards call for deep thinking and application of complex knowledge, ...they must be developed and constructed in ways that are meaningful to the learner. To reach that goal, we must change our mind-set and overhaul the practice of homework.
- shift to demonstrating complex and sophisticated learning. So rote practice is out; task complexity is in.
- the focus is on learning, not working...
- shift how we see mistakes:
  - must reinforce the mind-set that struggle andpersistence are part of the learning process.
Homework is a way to obtain formative feedback about learning
- student self-diagnose their level of understanding of the homework - place themselves in groups according to their needs, complete a checklist, write a learning goal, complete an exit ticket from the day's learning, etc.
- Time spent learning requirements: study checklist, rubric, writing samples
- Time to track your own progress toward mastery / update reflections and data folders / set goals
Alternatives to routine homework"
- In-class quizzes (David) - hints of what you COULD study, students track quizzes, can re-take, use quiz scores to group
- Personalized Projects - choice, purpose, ownership (planning sheet: www.ascd.org/e10314dueck1)

Wednesday, April 23, 2014

FA and Feedback Bonanza - Notes from 2 ASCD Magazines and 2 Webinars

No comments:

Post a Comment

JHMS Literacy Coach

Topics Available:

Best Sites:

Search This Blog