Feedback During eLearning

I’m a couple weeks into summer and have had time to thin about the last couple months of the school year. After analyzing it a bit, I’ve come to the conclusion that feedback was one of the major challenges during eLearning.

Feedback in an actual classroom is much different compared to feedback during eLearning. I should say emergency eLearning because the plans were thrown together with very limited transition time. It’s much different when you’re able to sit and talk with a student about misconceptions. In person feedback is more effective as you can use non-verbals, see reactions, have students explain their reasoning, and make multiple attempts within a short period of time. The biggest difference is in how quickly students are able to use the feedback while in person. In the digital realm, I found myself giving feedback and a student using it much later in the day or sometimes multiple days later. Some students would respond quickly and others wouldn’t even see it for days. Part of this was due to the platform that we were using. I found that the effectiveness of the feedback was a tipping point when introducing new content and students were still having a challenging time applying the skills. Students that understood the concept and/or had help from a parent at home were able to move on and those that didn’t had trouble keeping up.

Soon after moving to eLearning I ended up developing a draft key to help with the feedback. This was made more as of a communication method to tell students that I received their work and if corrections were needed. SeeSaw allowed me to write in the comment section and that’s where I put the feedback. I wrote about some of this earlier in the year here.

√ Meets expectations
∆ Try again (and then I added feedback)

I mainly used these as they’re shortcut keys on my computer and I could quickly type them into the comment field. If a student received less than 100% they’d get a ∆. Over time my feedback turned into questions or I referred students back to the directions.

Some of the question/comment stems are below.

  • The directions state …
  • Have you considered …
  • Can you explain why you …
  • Is volume measured in …
  • How does your work show …
  • Check what I circled …
  • It looks like ____ might be missing
  • Why did you use ____ operation
  • Why did you round …

Obviously the written feedback depends on the task. Many of the tasks came out of our district’s adopted resource, but others were Google Form or from Desmos. Another factor to consider is how receptive students are to the feedback. Most students were receptive and resubmitted with a “I forgot/ I didn’t see that / That makes sense now / Thanks! / I’ll remember that next time …” Other students would say, “It’s right, I checked it / I didn’t forget anything.” In those cases I’d kindly remind them to check again or notate on the student response where additional information is needed. There were times where I gave audio feedback and that worked for a few of the students. Some students would respond to this immediately, while I had to remind others to review the feedback and resubmit.

As we inch closer to the new year I’m looking at modifying this system. Teachers and students might (as of 6/20) be in the classroom to start the year with masks and there’s a possibility that some of the instruction will be online.

So far this summer has been full of non-school reading and yard work. It’s great to recharge and get outside. While doing this I’m keeping in mind what needs to be done when we return in August.

Week 3 of eLearning

Screen Shot 2020-04-09 at 7.12.09 PM

My class finished up their third week of eLearning today.  Tomorrow is a scheduled non-school attendance day so today ends the school week.  I think most teachers are still figuring out how to balance and cope with what’s changed over the past couple weeks.  A historical event is playing out before our eyes and the learning environment for our students (and us) has significantly changed.  Even with all this being said, I believe we (using the collective educator we) are making progress. We’re adapting, learning new skills and attempting to reach students through a different medium.  I believe Llana’s Tweet sums up my thoughts fairly well.

Since student work is now being turned in digitally teachers now return the work in the same manner. Right now students complete assignments and return them through SeeSaw (at least at the k-5 level in my district).  The assignments take many different forms.  Some of the them are digital while others are pulled from district adopted resources.  Most of the assignments include some type of written response or visual model.  Assignments are sent out once a day and students send them back to the teacher completed. Once a student’s finished assignment hits the teacher’s SeeSaw inbox the teacher has the option to accept the work, send the work back, or add comments.  Usually teachers add a comment about the work and send it back to the student. Here’s where the feedback/analysis comes in.  Take these two different examples.

Screen Shot 2020-04-09 at 6.46.31 PM       Screen Shot 2020-04-09 at 6.47.56 PM

With limited information available, a couple questions come through my mind when taking a look at both of these responses.

  • Does the student understand the question?
  • What made the student decide on using multiplication?
  • Why did one student use 40 and the other 3.5?
  • Did one student forget to move the decimal point?
  • Which student has a better understanding of the concept?

Identifying misconceptions and offering feedback based on that analysis is becoming more of the norm with eLearning. This is part of the regular classroom experience, but is emphasized even more now as contact is limited. Asking the student for more information and/or a well planned question to encourage the student to rethink their answer might help here. Giving feedback through digital means isn’t a simple task.  It takes thoughtful consideration and thankfully I’ve had the student more 3/4 of the year so that helps frame some of my own thinking.  As I contemplate how to give feedback in a more meaningful way, I’m planning on using a coding key for SeeSaw activities.

Screen Shot 2020-04-09 at 7.03.55 PM

This is similar to the NY–M retake sheets that I used during non-learning days.  I’m hoping this is helpful (along with the feedback!) as we continue into week 4 next Monday.  Enjoy the weekend everyone!

Feedback and Reflection Opportunities

Screen Shot 2019-10-19 at 8.48.12 AM

Over the past few years I’ve emphasized the use of student feedback, reflection and goal setting in my classroom.  Trying to find an adequate balance for this has been a challenge.  This school year I’m looking at different mediums in which students can reflect on their math progress.  Reflecting on individual progress and determining where students are at in the progression can lead to powerful outcomes.  This year I’m looking at different ways to encourage students to make more meaningful reflections that lead to actionable goals.


Math journals

Each student has a math journal.  These journals take the form of a 70 count spiral notebooks. The journals are primarily used to reflect on assessment performance.  My class has eight unit assessments per grade level and there’s a reflection sheet designated for each one.  I’ve written about the different sheets and journals: (1)(2)(3).  Students then complete the sheet and bring their test along with their reflection to the teacher to review.  At that point the teacher and students work together to develop a math goal for the next unit.

Peers

Students work together often in my class.  I use a randomizer and group students so they tend to have different partners daily.  After they complete a task I give the students a couple minutes to discuss with their partner the effort level and challenge of a particular assignment.  I tend to use a timer and encourage students to be honest in the process.  Hearing how other students feel about the effort and challenge level can help students be more aware of the struggle that is part of the process.  Certainly not all, but I’ve seen some students thrive with this type of reflection.

Independent

Before students complete a project teachers give a sheet indicating the criteria for success. This looks like a checklist with statement indicating what’s needed to meet the expectation of a particular assignments.  As students complete each component they reflect on whether they’ve met the criteria and place a check.  Students will attach the criteria for success sheet to their assignment

Digital Platform

Along with the criteria for success, students may submit a project to a digital platform like SeeSaw or Canvas. Other students in the class are randomly selected to give feedback on other projects.  Students follow a prompt that asks whether a student has met the criteria for success or not.  They then re-check the work and ask a question or provide a positive comment about the work.  After the comments are submitted, the original poster reviews the comment, reflects and responds to the question or comment.


 

Each one of these mediums has pros and cons.  I’m finding that the classroom environment plays a major role in how comfortable students are in sharing their thoughts with the class.  Some students are much more willing to independently reflect and speak with the teachers than others.  I find that students take more of an ownership role when they analyze their own performance in context and make steps to improve.  Bypassing the “I’m good at math” or “I’m bad at math” type of thinking can be a challenge, but providing ample opportunities to reflect can move students away from generalizing and be more specific about their analysis.

The next step in my process is to take these reflection opportunities and transition it to meaningful individual goal setting.

More on Math Feedback

Screen Shot 2019-01-16 at 7.21.00 PM.png

Last night I was fortunate to attend ICTM’s chat on feedback.  It was a productive chat and Anne had some great questions cued up for us.  I came away with a few new tools that I need to research.  Chats like these are motivating as the frigid cold of the midwest is ever-present this time of the year and new ideas can spark my planning process.

Teachers know that student feedback is important – it’s everywhere in schools.  It’s on every teacher evaluation tool that I’ve experienced. ASCD describes it as “Basically, feedback is information about how we are doing in our efforts to reach a goal.”  Teachers give feedback all the time – most without even labeling it specifically as feedback.

The chat was still on my mind this morning as my colleagues and I were having a conversation about math units.  After reviewing multiple student papers, I started thinking about feedback in more detail.  Specifically, I started thinking about how feedback takes on different forms and the tools that are used to give that feedback can vary from class to class.  In all cases that I’ve come across, educators want students to actually USE the feedback.

Technology can be used for this although the reliability of the feedback might not match the need.  I’ve also seen cases where the automated feedback is disregarded by students in an effort to score more points.  It depends on what’s needed.  In some cases, a quick verbal prompt might be the feedback that’s needed.  For others, a conversation with a partner can help students identify misconceptions or spur thought.

Let’s take this problem:

Screen Shot 2019-01-16 at 6.37.18 PM.png

This particular students was able to identify the rule and complete everything but the bottom problem.  Being able to anticipate misconceptions can lead to better student feedback. There are a few questions that I might have before approaching the student and giving feedback.

  • How can this student divide 14 by 7, but still have trouble with the bottom problem?
  • Does this student think of “divide by two” as half of the in?
  • Was this a simple mistake?

Or here’s another one:

screen shot 2019-01-16 at 6.55.58 pm

  • I notice that there isn’t any work or model here
  • Did the student notice that the denominators weren’t equal?
  • What strategy was used here?
  • Was this a simple mistake?

Last one:

Screen Shot 2019-01-16 at 7.01.29 PM.png

  • Did the student miscount the boxes?
  • Is the students missing pieces? (yes, this has happened before)
  • How did the student get 6 as the numerator?

In all of these cases a simple mistake is probable.  I’m working with K-6th grade math this year and sometimes rushing leads to simple mistakes.  I try (as much as I can) to limit that option when deciding to give feedback.  In all three of the cases I could ask the student to recheck their work.  Some students will, while others won’t.  I could also write on their paper a statement or question about wondering what strategy they used.  I could also have the students meet with a peer and discuss the problem in more detail.

There are so many ways to communicate feedback and it’s not a simple issue.  Some students are more responsive to written feedback, while other students want to have a conversation with another peer to discuss their strategies.  As students get older the type of feedback also changes.  Many of my upper elementary students prefer a brief comment on a paper or a quick underline, question mark, or specific arrow to help them move towards a goal.  Having a 1:1 feedback conversation with a student is my number one option because then I can see how receptive they are and answer any follow-up questions.  If you don’t have time to do that with every kid (who does?) then you use other options.

There are a ton (I mean a TON) of apps out there that “help” students along their math learning journey. I tend to be a bit caution when deciding to use them in the classroom. Is the feedback appropriate for their needs?  Is the feedback helping them in their efforts to reach a goal?  In some cases it may, but I think it’s worthwhile consider the ways in which feedback is given.

A simple mistake or something more?

Screen Shot 2018-02-18 at 1.19.07 PM.png

I’m grading tests this weekend.  My third grade group just finished up an assessment on fractions and multiplication.  It’s been about a 1-2 month journey full of investigations on this particular topic.  Many formative checkpoints were planned along the way and the unit assessment was scheduled for last week.

While reviewing the student work, I’ll sometimes write questions or direct students to a part of the question that would’ve made their answer more complete.  There are moments of pride and moments where simple mistakes drive me a bit crazy.  You see, there are only eight units with my new resource, so the assessments influence grade reporting quite significantly.

After grading the assessments, I have student analyze their results.  They comb through the test and look at how each question aligns with certain skills.  They also determine if a missed question was a fixable mistake.  I want students to be able to recognize when this occurs and fix them when they can.

Screen Shot 2018-02-18 at 1.27.14 PM
File

In my experience, 9/10 times students believe that the reason they missed a question was because it was a fixable mistake.  That’s not always the case.  There’s a certain amount of self-reflection and humility that’s involved in this process. Being able to be a bit more honest and communicating what a simple mistake is and what it isn’t might be in order before the next assessment.  So, what steps do students take if a missed questions isn’t a fixable mistake?  It’s one step in the right direction to admit that it isn’t fixable, but then what happens next?  Do students and teachers have plan for this, or do we move on to the next unit?

So, was it a simple mistake or something more?  This question comes up more often than not while I’m grading student work or reflecting back on a class conversation.  Some of the answers are more positive than others.  A simple calculation error can vastly impact an answer, but it may be a simple mistake and the student has a solid conceptual understanding of that skill.  But, a number model that doesn’t match the problem tells me that the student might not be certain about the operation that needs to be completed. Was the simple mistake putting the wrong operation sign in the number model?  I guess you could go down many different paths here.

The question type can influence how well and thorough a student responds. Some questions are quite poor in giving educators quality feedback to help inform instruction.  Right off the top of my head, multiple-choice and true/false questions fit that bill.  They sure are easy to grade by human or a machine.  Hooray!  But, they don’t give me quality feedback that I can use immediately.

This also has me wondering about the quality of the assessments that are given.  Measuring how proficient a student is on a particular concept doesn’t always have to come from standardized or unit assessment results. Classroom observations and formative checkpoints are beneficial and give teachers insights to what students are thinking. I want to make students’ math thinking visible.  Whether that’s using technology or not, making that thinking visible puts the teacher in a  better position. From what I observe, some of the best math task questions are open-ended and tend to have a written component where students are asked to explain their thinking.  The quality of the question and openness of the answer helps educators dig deeper into how and what students are thinking.  I think that’s why teachers are always looking out for better math tasks that help students demonstrate their understanding more accurately.

How do you help students determine if a mistake was simple or something more?

Google Forms and Presentations

Google Forms

My 3-5th grade classes are finishing up their math genius hour projects this week.  Fittingly, it’s the last the week of school so we made it just in time!  I have two days to fit in 15 project presentations.  This last round of projects lasted around two months and the final projects will soon be revealed.

Students created questions, found a math connection, researched and are presenting this week.  During the last two years students present their projects and the audience asks questions about the topic. This technique seemed to work but I tended to have the same students ask the presenter questions.  Around five or so of the same students asked the presenters questions.  In a class of 25 that’s not ideal.  It was great that the students were asking questions, but five or fewer was disappointing.  Bottom line – the audience wasn’t as engaged as they should be.  So this year I decided to give the audience more of a voice in the process during genius hour presentations.  This actually stemmed from a class that I took this spring about using Google tools in the classroom.

One of the assignments required students to create a Google Form that could be used in class.  My first thought was to create a student rubric for presentations.  I decided to create my own after dabbling around the Internet for a few examples. Initially the form was going to be used by the teacher to evaluate presentations.  After starting the form I changed my thinking.  I thought about possibly having all of my students use the same form to evaluate the presenter.  The genius hour feedback form was built from that idea. Click the image below for the form.

Feedback Form

This week my students have been using the form to evaluate their peers.  Students are asked to present their projects while the audience listens.  At the very end (not at the beginning as some students want to get a head start) students take an iPad and scan a QR code to access the Google Form.  Individual students evaluate the speaker and submit their response.  It’s not confidential as students have to pick themselves (the evaluator) and the presenter.  I tell the students that this information will not be revealed to the presenter.  So far it’s been working well.  The last presentation took less than 2 minute to collect 21 feedback submissions.  Another bonus is that you can have a class conversation about the overall quality of the presentations.

Data

I then export the file to Excel, hide the evaluator column and then print out the sheet for the student.  The student is then able to reflect on the data at a later time.

Photo May 31, 1 38 29 PM

The form needs some work as I’m thinking of making some of the questions more clear.  I’d also like to add a section on the form where students can ask the presenter questions.

Student Reflections and Assessments

Reflecting

This past week my third grade class took their third unit assessment.  This particular unit focused on computation of single-digit numbers, data analysis and order of operation procedures.  While grading the assessments I started to identify a few patterns in the student responses.  Specific problems were missed more often than others.  This isn’t an anomaly on assessments, but these particular problems stood out.  One skill area that seemed to jump out to me dealt with the skills of being able to identify the median, mode and range of a set of data.  These skills were introduced during the first few weeks of school and the class hasn’t revisited them in some time.  Also, I found that students were having trouble identifying the differences between factors and multiples. Some of the student responses mixed up the terms while others seemed like guesses. Both of these skill are necessary moving forward as the third grade class explores prime and composite numbers next.  A colleague and I and came up with a limited list of reasons why we thought the problems were missed.

1.) Students aren’t yet able to apply their understanding of the skill

2.) The question on the test was confusing

3.) Students made a simple mistake

Optimistically, I’d like to say that most of the mistakes fall into category two or three. I don’t think this was the case with this particular assessment.  After looking over the class results I concluded that most students that missed skill-associated problems fell into category one.  In addition to not grasping a full understanding, I felt like students were not given enough time to practice the newly learned concepts.

I believe students should be given additional opportunities to show understanding.  Coming from that thought line, I decided to have students reflect on their assessment results in their math journal.  I’ve done this in the past but I wanted to also include an addition to the process.

Screen Shot 2015-10-24 at 9.56.59 AM

After completing the page above students reflected on their performance in relation to the expectation. Students were then given a list of four problems.  The problems were similar to the most missed skills on the assessment.  Students were asked to pick three of the problems to complete.  Students were encouraged to pick skills that were missed or topics that they felt needed strengthening.

After both sheets were completed, students brought their math journals up to me and we had a brief 1:1 conference. This time is so valuable. The student and I identified skill areas that showcased strengths and areas that needed strengthening.  We then reviewed the responses to the questions on the reflection sheet.  I spent around 2-3 minutes with each student.

Students were then asked to work independently on another assignment that I planned for the day.  Overall, I thought this reflection process has helped students become self-assessors.  Students have a better understanding of their own skill level in relation to the expectation.  I plan on using this strategy a bit more as the year progresses.

Beginning the Year with Math Journals

Math JournalingLast Monday marked the first day of my 2015-16 school year. It’s been an amazing week but I’m glad the weekend is here. Yesterday my school had its annual PTO picnic and I now have some time to write. I feel like I need time to process and reflect on the whirlwind of events that’ve happened over the past week.

Last Tuesday I planned on giving student their journals. Before passing them out I decided to cover a few ground expectations. I had a discussion with the students about what the journal will be used for. In the past, students used the journal to reflect on different assessment results.  This year I want to add more goals related to journal use. Primarily, the journal will be used by and for the student to reflect on math experiences and answer prompts. I told the students that I’d be writing feedback or ask questions related to their journal responses throughout the year. Most students were relieved when I said that the journal wouldn’t be graded. I indicated that it may be used during parent/teacher conferences or to show growth over the year. The students didn’t seem to have a problem with that. I ended the brief conversation reiterating that the journal was for them.

One of my priorities this year is to have students write more in math class. I read a book this summer that exposed me to research related to connections between the brain and math.  In particular, I found that students need adequate time to process and rehearse mathematical information for it to be retained.  I feel as though newly acquired math concepts can be processed through reflections and the writing process.  I intend to have students explain their thinking and view of certain mathematical concepts. I’d also like to give students time to process what they’ve been experiencing and document those events. I feel like students, just like adults, need time to process and reflect.I feel like the math journaling process can lead to the rehearsal of math concepts. In a sense, students are practicing what they’ve been learning and personalizing it through their journal writing.

So, this week all the grade levels that I teach had an opportunity to start their math journals. All classes participated in the Marshmallow Challenge and that event related to their first journal entry

Tell me about your marshmallow challenge experience.

The first response was more geared towards helping students recognize the teamwork involved as the classroom was, and currently is, building a community of learners. The second journal entries were content specific

How do arrays help me multiply?

What’s the difference between rays and line segments?

Students gave me a variety of responses. Some were lengthy with many pictures, while others barely scratched the two sentence mark.

arrays

Visual model

ArraysRegardless of the length, I’m finding that some of the students’ math understanding is revealed in their writing and pictures. I’ve already been able to find misunderstandings through student journal entries that might have taken longer to expose using other means. Also, writing feedback to the students gives me an opportunity to extend understanding by asking questions that lead students to question their responses. This year I’m attempting to use math journals more regularly and so far (only 5 days) we’re off to a decent start.  At some point I’d like to have student complete a journal prompt related to how they use my feedback in their journals.

Feedback Opportunities

feedback-01

Last week I took part in a Twitter conversation about student feedback. The discussion evolved into why direct feedback is often more efficient than vague “good job” teacher responses. Most of us agreed that feedback and exploration is often the cornerstone in having students recognize misconceptions and build mathematical understanding. That feedback is so essential and is a vital ingredient in the learning process.  The conversation had me thinking of the different feedback opportunities that exist in and out of the classroom.

Everyone receives feedback. In a school setting that feedback can come in the form of a supervisor, team, students and so many others.  Beyond this, I receive feedback when I forget to shut my car door or leave the lights on. A loud beep blasts out of the speaker and I need to go back and fix the problem. When creating a document and I forget to save before exiting I receive a “do you want to save” message. Absolutely I want to save, and the feedback (or reminder) gives me an opportunity to do so. I could give other examples but the point is that feedback comes in forms that might not be associated with classroom use.

I feel as though giving students feedback is intentionally setting the stage for student improvement. What happens if the student doesn’t utilize that feedback?  What good is the feedback if it sits on the paper? I feel like this happens more often than I would like to admit.

Giving students multiple opportunities to utilize feedback can lead to action.  That action may lead students to make changes in how they approach problems and concepts.  Although the teacher is one of the main feedback systems, it shouldn’t and isn’t the only option. While thinking of feedback, I started to brainstorm some possible feedback systems that can aid in the learning process.  I can picture these systems being used to give feedback after some type of formative assessment or instruction.


Teacher – The teacher is one of the best feedback tools in the classroom. Fielding student questions, clarifying  and anticipating next steps all play a role in how a teacher responds with feedback. Teachers all around the world offer feedback, so much that it becomes part of their daily lives.  The feedback from teachers can be observed in written or verbal form.

Students – Peer editing and group work can be powerful. Of course, modeling and front loading needs to occur before this becomes an amazing tool. When students discuss answers with each other it opens up a door for feedback. Students can explain their reasoning and be critical friends in the process. Group work provides opportunities for students to become better at explaining their mathematical thinking and processes. Hearing how other students explain their thinking can lead students to an explanation that might not have been perceived before.

Math Classroom Conversations – Math class conversations can be beneficial to all involved.  This also takes modeling before becoming a positive aspect of the classroom experience.  Asking open-ended math questions and having students respond can lead students to ask additional questions.  Feedback can be provided during this entire process while students construct understandings. Classroom conversations often involve some type of whole group question, group response and feedback.

Games – Math games can provide students with a low-risk opportunity to practice skills and show their understanding. I find that when students use math games they engage socially, think strategically and practice skills in the process. Board, card, dice and app games all provide feedback in different ways. Feedback is given in how the other students react to each other, how the answer is revealed and in the scoring element. Math games open up a door of possibilities and adds some competitiveness. Apps have helped revolutionize this idea. Kahoot and Socrative have gaming elements that provide students with additional feedback that can be used to inform instructional decisions.

Adaptive Software – No, this shouldn’t be the only method of feedback. Keeping that in mind, the feedback given through adaptive software can be be helpful to a point. Regardless of the adapted score or level, this type of feedback might not be tailored to the individual student.  Although adaptive apps/software is a field that’s improving (as tech startups hire education professionals), this type of feedback isn’t as accurate as some of the other methods above.


How do you give feedback opportunities in the classroom?

 

 

Addressing Misconceptions

misconceptions-01

Students in third grade are exploring measurement this week. As students progress through the unit I feel as though they are becoming more efficient in converting Metric units. Near the end of the class today students started debating the differences between US Customary and Metric. The class than started completing an activity where they had to measure different insect lengths.  Students worked in groups to accomplish this task.

During this time I traveled to each group and intentionally eavesdropped on the conversations. Students asked me questions and I listened and asked questions back.  I then moved on to the next group. I wanted the students to work together and persevere. Some students started to talk about the measurement of different objects around the room.  I especially paid close attention to the questions that students were asking each other. This was a great opportunity to check-in on some of the misconceptions that were flying around the room.  I jotted down some of the conversations as the students came back to the large group.

We had around five minutes left in class to review the questions that I noted. I wrote the questions that I heard on the whiteboard.  I was able to clarify some of the responses and answer other questions. This time was definitely worthwhile. The students seemed to appreciate the time as well. During our next group activity I’d like to do something similar, but not completely rely on my less-than-stellar eavesdropping skills. Instead, I’m thinking of having the students periodically use Post-it notes to ask questions. This could turn into a “wonder wall” type of activity. The students could then place the questions in a bin and we can review them throughout the unit. I think this type activity is one way to proactively address misconceptions and answer questions as students grow in their mathematical understanding.

%d bloggers like this: