Extract from here about analysing your own teaching:
So: How to start designing a study of your own teaching: Some quick and easy steps…
Define your question. Keep it small. Something along the lines of: Does this technique work? Then ask: how does the question connect to course objectives and assignments you’re already using? Is there something in your syllabus and course design you’re currently doing you can draw upon?
Do some reading. Tap into your network. What have other people done that you can use? Is there anyone on your campus you can team up with or ask for advice? One of my preliminary steps was to host a Twitter #engchat session on discussion in teaching. This gave me some great ideas.
Brainstorm ways you would know whether the thing you’re doing works…or not. Again, how are you using assignments currently that might be useful here? Could you look at different aspects of assignments you’ve already designed? Are there other things you could look at: not just tests or essays but class discussion, one-on-one time with students in the office? Consider asking different questions of the student artifacts you collect every semester, not just did they learn and what, but how, where’s the evidence, where are the gaps.
How will you create ways to collect data? Formal writing? More metacognitive/reflective writing? Video classroom work? Create transcripts of discussions or office meetings? Use a message board/blog/wiki? Focus groups? Interviews or a surveys? A mix might yield more robust data and give you a multi-faceted perspective on how your students are learning. I usually look to my students’ written work for evidence of learning, but I think I might be able to do more.
How will you analyze the collected data to answer your question? If a content analysis of some of your artifacts—written, video, transcripts of class discussion—would yield some interesting stuff, see if you can get access and training on nVivo. Are there students in methods courses who could help with coding and analysis? You can also do an analysis yourself: think about categories that show up in artifacts or transcripts. For instance, maybe you want to look for words that indicate confidence with material or shifts in critical thinking, or use by students of specialized vocabulary that reveals disciplinary mastery. I’ve been thinking about ways to capture the classroom dynamic, the network of interactions, and then connecting that to the knowledge that gets generated during discussion.
This leads to a pretty important logistical/bureaucratic/ethical necessity: If you’re studying student learning and there’s any chance you’ll go public, you will almost certainly need approval from your school’s Institutional Review Board (IRB). In fact, you should probably talk to your IRB anyway just to make sure your work here is ethical. A number of disciplines have formulated best practices for working with human subjects, as you can see from this bibliography put together by the Conference on College Composition and Communication; your institution will most likely have a committee charged with reviewing applications. You may need IRB approval to seek grants, and it might affect other aspects of your planning and timeline especially as you’re designing your course and assignments, so talk to your reps.
Visit your campus faculty development office, if you’ve got one. The first thing I did was sit down with the Director of our Office of Pedagogical Support. He was encouraging, helped me frame my research question, and assisted me with looking at what I’m already doing to get started with data collection. This person may also be able to help you connect with other faculty, and should you decide to expand for publication or presentation, s/he may be able to suggest venues.