tag:blogger.com,1999:blog-10239046055138855942024-03-14T15:47:41.482+08:00PhD rambleAnonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.comBlogger17125tag:blogger.com,1999:blog-1023904605513885594.post-18604011264768853982015-04-11T21:46:00.003+08:002015-04-11T21:46:38.187+08:00A reflection on my confirmation panelBecause I teach reflection, I've been trying to consciously practise it myself. Before today, I'd only managed to write one for my PhD ePortfolio (which would make it by my own standards a very poor Learning ePortfolio). But after my confirmation panel, I was determined to write another one, since it was such a critical event.<br />
<div>
<br /></div>
<div>
As usual I was more long-winded than I had planned to be. I could have written even more (there are just so many ISSUES), but thankfully I managed to stop myself after 1200+ words. If you'd like to read it, it's <a href="https://sites.google.com/site/hsiaoyunphd/thesis" target="_blank">here</a>.</div>
Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-80401106309638987892015-04-03T23:34:00.000+08:002015-04-03T23:34:45.695+08:00Levelled up (but the joy is fleeting)Wow last entry dated end September 2014! Quite horrifying how slow my progress has been. Since then I've finished my confirmation document, which entailed transcribing and analysing 2 interviews. 12000 words in 5 months is not great. I passed my confirmation (yay) but I'm really going to have to move faster if I don't want to lose momentum and motivation.<br />
<br />
My plan is to do data analysis (which includes transcribing) for a couple of months before I start writing in earnest. I know that my plan to finish the first draft this December is rather too ambitious. While the panel was very encouraging, this has been a beast of a project and I have no doubt it will continue to be this way. Conventional wisdom seems to be that qualitative studies are easier but I am absolutely convinced now that this is not true at all. Data collection was hard, and now data analysis seems even harder. By the time I try to write about it all in earnest no doubt I'll be tearing my hair out!<br />
<br />
In the meantime, I will be presenting on this study for the first time at the 2nd ALAA conference on 2 May. I should also try to get an article written and submitted this year. I need a topic and a target journal, preferably open access, but I have absolutely no ideas right now.<br />
<br />
I'm teaching even less this semester, and I hope to make up for the shortfall in income by conducting workshops etc. This way I hope less time gets sucked up by marking (worst use of time) and I get to develop myself in new and frankly more lucrative ways. I hate to be so pragmatic but every hour is precious. The goal is to rely increasingly less on teaching university courses as I move closer to graduation. Even though the 'adjunct' situation doesn't seem as bad here as in the US and some other countries, I don't want it to define my career. I'm dubious about being a full-time academic in Singapore, and positions elsewhere are scarce. Wanting to specialise in assessment makes it harder, not easier, no matter what colleagues tell me. I'll be missing out on the privilege of conducting research under the aegis of a university, but the 'independent academic' route seems to be the best for now. There is, of course, NO tried-and-tested formula to doing this. (I'm obviously a masochist, I know.) Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-42679530341147313002014-09-28T12:37:00.000+08:002014-09-28T12:37:47.510+08:00Light at the end of the data collection tunnel (is an oncoming train)Goodness, it's already nearly October. I meant to blog about my research woes earlier (as usual) but it was hard to muster up the motivation and energy.<br />
<br />
I've just finished what I think should be my last class observation, since the kids are taking their end-of-year exams. I'm not expecting to have anything worth observing post-exams and before they break for the holidays. This period I think is more usefully spent gathering some data from the students before they forget everything that's happened this year. Right now, I'm undecided if I should run focus group or individual interviews, or some combination that includes a questionnaire before I speak to them face-to-face. It's a concern that they might not be ready or able to share their thoughts with me, for various reasons.<br />
<br />
It seems quite amazing that I've already spent so many hours collecting data, particularly observing the lessons. I thought I was pretty prepared for the process, but nobody told me how demanding it could be physically. It seems that I am always trying to play catchup writing my fieldnotes after each observation. The audio recordings are a boon, because they help me flesh out my jottings, which despite my best efforts tend to be more impressionistic. It also takes a bit of effort to make sure everything is organised neatly and backed up regularly. No huge disasters so far, but I am still behind! I've got 3 periods worth of fieldnotes to write and 2 teacher interviews to summarise. The heaviest marking load of the semester (undergraduate essays) has also just come in, which is both a distraction and a burden. I'm not somebody with a great deal of stamina, so upping my productivity is always a struggle. (There are also family obligations that I cannot and don't want to neglect -- I won't allow my PhD to be that all-consuming.)<br />
<br />
It doesn't help that I have a lingering paranoia that there'll be nothing of interest in my data, though obviously this cannot be true (and isn't -- there's definitely something there). Maybe it's more doubt that I missed something important in the data collection process, and haven't got what it takes to <i>see</i> the significance of what I've collected (I've run out of interesting things to include in my conceptual memos). The terror of qualitative data analysis just isn't dealt with sufficiently in the literature! I've been reading whatever I can get my hands on, but you don't know how comforting the apparent certainties of quantitative analysis are until you are confronted by the relative <i>vagueness</i> of qualitative analysis. I'm simultaneously comforted by the knowledge that there's no one right way to do things, and alarmed that there's no one right way to do things. Argh.<br />
<br />
Then there's my confirmation document. I have an extremely broad outline set up, with things written for previous assignments that I want to include, but they can't be included as is, and there's also some data analysis that I need to include. Thinking about how I've fallen behind in my writing schedule is another source of anxiety. I don't write poorly (I think), and once I get started can often churn out a lot. But getting started is always hard. It might seem paradoxical, but I've always thought that my writing muscles are just weak, and that by writing via blogging more regularly I can build up my stamina and make getting started that more effortless with time. I also want to blog more regularly as part of my plan to establish myself as someone (I hesitate to say 'expert') that people can turn to for help and advice on assessment issues, but that's another story for another day.<br />
<br />
Time to end this post before I ramble on any further. I'll be back.Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-76069516415284669632014-07-02T21:12:00.001+08:002014-07-02T21:14:04.706+08:00Data collection. Finally! For real!Haven't posted for awhile now. Since my last post, I've spent a lot of time waiting for ethics clearance from Lancaster, and then getting approval from MOE as well. By the time I got the green light, the school was in the middle of Term 2, making it very difficult for me to start data collection.<br />
<div>
<br /></div>
<div>
So I waited, using the time I had to work on my interview guide with L's guidance. His idea was that I should interview the teachers before I did my observation, so that I had a good idea of what they've done and plan to do. I was also supposed to start working on my confirmation document (due end 2014) but what with everything happening at home, I just didn't have the free time to write (nor the mood, to be honest). </div>
<div>
<br /></div>
<div>
The new school semester has just started, and to date I've interviewed both teachers, and issued information sheets and consent forms to their classes. I've also collected various relevant documents. Going by their timetable and mine, it's likely that I won't be able to do any observation until I return from the UK in late July. </div>
<div>
<br /></div>
<div>
I'm sure I'll have more than enough data by confirmation. The question is if I'll have enough time to transcribe, analyse and write? In addition to data collection and actual work (which I'm scaling back this coming semester). As excited as I am to really get my teeth into this project, part of me wonders what Murphy's Law has got up its sleeve for me.</div>
<div>
<br /></div>
<div>
Will be in Lancaster next week to meet L, attend the department 40th anniversary event and postgrad conference, and then Wales and London the week after for a short holiday. I probably haven't got the discipline to actually get anything done during these 2 weeks! Just hope things at home are uneventful while I'm away and I can buckle down when I get back. </div>
Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-65073079703913536752014-01-31T14:04:00.000+08:002014-01-31T14:04:02.285+08:00I'm officially in Year 3, and coursework is OVERI see that I missed quite a few weeks there -- I'm so lazy! So the new semester has started, and with fewer hours of teaching than I'd anticipated. Without the additional pressure of assignment deadlines, I'm feeling quite free. Must remind self not to be lazy.<div>
<br /></div>
<div>
This is not forgetting that I have to set the wheels in motion for data collection. Unfortunately, the whole process with permission seeking (MOE) and then ethics clearance (Lancaster) is confusing and convoluted, and I'm probably not as thick-skinned in pushing things ahead as I ought to be. As I write this, I'm waiting for MOE to issue what they call in-principle approval so that I can apply for ethics approval from Lancaster. Only when ethics has been cleared can I get <i>official </i>approval from MOE. This really needs to be on a FAQ somewhere so that others don't end up running round in circles like me. I don't know what luck I have in getting everything settled by mid March.</div>
<div>
<br /></div>
<div>
My last 2 assignments were returned later than I'd expected, and while waiting I was working myself up to a state of paranoia. I had sleepless nights thinking that I might have failed the modules?! Of course I didn't. But even though I had half-expected it, the feedback was kind of demoralising. Of course, I'm a student and am still relatively unskilled at this stuff, but it seems that I haven't improved much since my first assignment. I don't know if the nature of the assignments is such that I find it difficult to produce better papers, or that I genuinely haven't come far, and so will really struggle when I write my thesis. I guess I'll find out. </div>
Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-54736008365758277502013-12-08T23:21:00.000+08:002013-12-08T23:21:25.979+08:00A school, finally (maybe)Good news: I think I finally found a school that could be my research site, though I have yet to get the nod from my supervisor.<br />
<br />
Bad news: Apparently getting permission from MOE and ethics clearance from Lancaster could take 3 months or more. My aim is to have my confirmation panel while I'm in Lancaster in July, but I might not be able to collect enough data for that. Which means I'll have to do it via Skype (confirmation is supposed to happen within 36 months of starting part-time study, and I don't really want to fly down again in December). Not ideal. Ugh.<br />
<br />
Regardless, I hope this school meets with L's approval, and I can get the paperwork started before 2014 begins.<br />
<br />
In the meantime, I'm finishing up preparations for my new ePortfolio course by working on my own eportfolios (a general <a href="https://sites.google.com/site/hsiaoyuneportfolio/" target="_blank">career one</a> and a <a href="https://sites.google.com/site/hsiaoyunphd/" target="_blank">PhD one</a>) and also the course <a href="https://sites.google.com/site/cor201efolio/" target="_blank">Google Site</a>. Reflecting on the courses I've taught since leaving NIE as a full-timer, it seems that only this one will be somewhat related to my research interests. I will probably get the chance to run assessment workshops for the school I end up collaborating with, but I wonder if I'll ever get to actually teach a course on it? Theoretically this is a good niche to specialise in (everyone says so), but I remain doubtful there's a market for it in Singapore. Will I find my alt-ac career here? Another 'why am I doing this again' moment.Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-61559582430295217212013-11-29T22:44:00.001+08:002013-11-29T22:44:38.866+08:00Still alive (and sane)Not sure how I did it, but I miraculously survived the semester. I survived 16.5h of teaching a week and an insane amount of marking, a course development project, and 3 assignment deadlines (>12.5k words in total). It was very hard going, but I think it helped me to 'level up' in terms of productivity. Certainly I had to exercise very strong self-discipline because missing one deadline was potentially disastrous for everything else. I'm a born procrastinator so it's a particular achievement not to have missed any (important) deadlines. It looks like my workload next semester could be similar or worse, but at least without the assignment deadlines. <div>
<br /></div>
<div>
It does make me worry that without externally imposed deadlines, I may not be very productive with regard to my PhD. Many of my assignments helped me to get my reading and thinking done, for which I'm quite grateful. With this latest batch of essays, my ideas have achieved a new clarity, though I wouldn't dare say they've finished 'baking' (when do they ever?)</div>
<div>
<br /></div>
<div>
I'm on a lot firmer ground with regard to methodology now. If nothing else, I think the methodology modules have been very good for me. Methodology is interesting and important to me, and I want my study to be solid in that aspect. I also think I've now got a deeper understanding of assessment issues and digital literacies (which was my last paper). With practice theory, I've also found I think the 'missing link' between assessment practices and literacy practices. It was very fuzzy and unconvincing before. When I jumped on practice theory (Schatzki, Reckwitz and later Shove, Pantzar & Watson), I thought that it was a better fit for talking about assessment practices though maybe not so for literacy practices, since that already has a strong tradition going. Lo and behold, I see Reckwitz popping up in Lankshear & Knobel's New Literacies (though new to this 3rd edition I think). Which just goes to show my knowledge of the lit isn't what it should be yet, though I am making new connections as I progress. </div>
<div>
<br /></div>
<div>
As much as I'd learnt from writing my assignments, finishing my coursework does allow me to read more specifically for my PhD rather than to fulfil assignment requirements. With my last 2 5k word papers, I learnt how to use Citavi. It is exactly what I wanted Mendeley et al. to be, in that it not only manages my references, but also helps me to organise, make sense of and synthesise literature. I could have done with Citavi with previous lit heavy papers, like the Qual one on Rasch.</div>
<div>
<br /></div>
<div>
Now that I have some free time, I have some things to accomplish before the new semester starts:</div>
<div>
<ol>
<li>Catch up on reading, not only the lit that's directly related to my PhD, but also the peripheral stuff that could help with my writing and career. Practice theory is at the top of my lit list.</li>
<li>Focus on getting access to a school. This is actually quite urgent but I've put it on the backburner this semester and am trying hard not to panic now.</li>
<li>Develop my own ePortfolio as a means of reflecting on my progress (which this blog is also meant to do). I think it would help me personally as well as model ePortfolio keeping to my Reflection & ePortfolio students in the new semester.</li>
</ol>
<div>
I'm going to try to blog more frequently, if only to update on my progress.</div>
</div>
Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-80522525290766627332013-10-04T11:51:00.001+08:002013-10-04T11:51:13.162+08:00Pragmatic epistemology, possiblyBored and unmotivated this morning after sleeping in. (Yesterday was my killer 8h Thursday, so I felt justified.) Things to do today include marking (I spread it out as thinly as I can while still meeting deadlines) and working on my Qual paper on case study. <div>
<br /></div>
<div>
While thinking of ways to procrastinate, I suddenly remembered this blog. I'm sure it only counts as semi-procrastination! </div>
<div>
<br /></div>
<div>
So while working on my Classroom Research paper I recalled L's suggestion of Pragmatism, because I was (still am) troubled by this theoretical framework thing. I'm reading up on Pragmatism, after watching a series of YouTube videos (yay YT!) on the basics of the philosophy and deciding that it might be a good fit. It doesn't seem to conflict with the approach I described in my previous post. Using Crotty's (1998) framework for theoretical frameworks (LOL), maybe I could put it this way:</div>
<div>
<br /></div>
<div>
<span style="color: #0b5394;">Epistemology: Pragmatism</span></div>
<div>
<span style="color: #0b5394;">Theoretical perspective: Social practice</span></div>
<div>
<span style="color: #0b5394;">Methodology: Ethnographic case study</span></div>
<div>
<span style="color: #0b5394;">Methods: Participant observation, interviews, focus group discussions, document analysis, questionnaire (maybe)</span></div>
<div>
<br /></div>
<div>
But Pragmatism is of course more complex than as few YT videos can explain. I have to delve into the scary rabbit hole of philosophy, while I wrangle that case study paper.</div>
<div>
<br /></div>
Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-25606267181800821432013-09-27T12:40:00.002+08:002013-09-27T12:40:37.118+08:00Post-post-pre-confirmation thoughts<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;">I really should have blogged after the July residential since that was a pretty major milestone -- my pre-confirmation panel. The panel threw me off-balance (to say the least) and I was pretty lost for at least a few days but by the time I left Lancaster I did have some sense of the new direction I was going to move in. </span><br />
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;">While in London I just wanted to have fun (which I did) but from the moment I landed in Singapore it has been work, work, work. I didn't work much last semester because semesters here clash with the Jan residential, so I've been trying to make up for it this semester. As a result I probably took on too many jobs -- I'm currently teaching at NIE, NUS, SIM University and NAFA, in addition to some course development work and miscellaneous workshops. This has also made it hard for me to chase up schools for access; I'm hoping to do that at the end of the year which is school vacation in Singapore.</span><br />
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;">I worked out an overly ambitious schedule, according to which I should have started the 2nd of the 3 assignments due this semester. Which I haven't of course. I count myself lucky to be able to finish the first (and the shortest at 2.5k words) before the 30 September deadline. In the course of writing this paper, I've had some time to think about my research. In my post-panel report, I wrote that I was looking into practice theory instead, specifically Reckwitz's (2002). This is something which I found and put aside previously, and I think now it could work for me. I'm not sure, especially after the panel, if the literacies practices paradigm really works for me, and Lave and Wenger's CoP isn't quite it either. </span><br />
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;">While at the Lancaster campus bookshop, I came across Shove, Pantzar and Watson’s (2012) book "The Dynamics of Social Practice: Everyday life and how it changes" and found it very interesting. Prof Elizabeth Shove is from the Sociology department at Lancaster, and the authors have adapted Reckwitz's framework, which is more complex, into something more streamlined and usable. They analyse practices based on the three elements of materials, competences and meanings. I like that they approach this with the aim of changing practices, not just describing them.</span><br />
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;">My methodological approach as it stands now is primarily case study, with an ethnographic perspective. I've read up further on ethnography and participant observation for the paper, and feel better prepared to explain how I'm taking up the ethnographic perspective without actually doing ethnography. In exploring ethnography, I discovered that there is a strong mixed methods tradition, which I wasn't aware of before. I guess this further explains the considerable overlap between case study and ethnography. This is useful to know if I end up administering a questionnaire. </span><br />
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;">I know many people find coursework a drag, but I'm really grateful for it, especially at this point. I think a solid methodological foundation is important for research. Not to say that I believe that epistemologies and paradigms are unshakeable; I tried that and I think <i>that</i> view doesn't really work for language assessment. Maybe pragmatism really is my epistemology. </span><br />
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;">I also think I've got a more precise notion of the research gap I'm trying to fill now. Not only is there insufficient research into the classroom-based, social and digital aspects of language assessment, but what there is currently also tends to focus on assessment tools and frameworks, which on their own don't seem to have much of an impact on assessment reform. So I'm arguing that this is why there's a need to look at things from a social practice viewpoint, which has been done in general ed assessment but not in language assessment.</span><br />
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Helvetica Neue, Arial, Helvetica, sans-serif;">This feels like a move forward for me, but that's what I feel every time there's a change in my thinking, so it might just be an illusion :P</span>Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-17540377590328826432013-04-12T22:57:00.000+08:002013-04-12T22:59:32.414+08:00To-do list, as of 12 April 2013<br />
<ol>
<li>Flesh out HK preso for pre-confirmation: 'A few days prior to the meeting of the panel, students should provide the supervisor and other member of the panel with a written document briefly outlining their work and progress in the last year (including planned Research Questions, data, data collection and data analysis) and pointing out any issues which they consider have impeded their progress (3-4 pages).' </li>
<li>Finish reading Understanding digital literacies: A practical introduction.</li>
<li>Sort out literature (spreadsheet, Zotero) -- what's the best way?</li>
<li>Find at least 2 schools -- follow up on possible candidates.</li>
<li>Design draft questionnaire for students (for MOE application).</li>
<li>Work on ethics and permissions docs.</li>
</ol>
Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-66921147696324749302013-04-12T22:35:00.002+08:002013-04-12T22:47:40.392+08:00Misc stuff to follow up, as of 12 April 2013From CR forum exchange with D:<br />
Could the conventional concept of a construct could also be challenged if it assumes a theoretical perspective of 'practice' rather than 'skill'?<br />
<br />
Case studies with ethnographic perspective? According to U on DL forum: 'Call it taking an ethnographic perspective - in the sense that you seek the emic perspective, look at things in context/as situated, so you share something with ethnography, but doing it in a more condensed and probably less 'deep' way. Lots of people these days speak about their research being ethnographic, but that doesn't mean it is ethnography in the sense anthropologists define it. Often what they do is qualitative research or case study research.'<br />
<br />
Or multi-sited ethnography? U: 'The issue is that the research questions might lead you into different directions, requiring you to look in different places, hence multi-sited. These directions might not be physical or virtual places, but rather issues or questions - hence more abstract.'Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-40815245680233439702013-04-12T22:20:00.003+08:002013-04-12T22:39:03.157+08:00HK presentation (Feb 2013)On the last lesson of the Classroom Language Assessment module, I presented my latest research plan to the class. L says it can be developed into research plan for pre-upgrade in July.<br />
<br />
<div>
<iframe allowfullscreen="true" frameborder="0" height="389" mozallowfullscreen="true" src="https://docs.google.com/presentation/d/1zXnDWcLOOsVW07G707JpT4MXEOxqOY_XeihFZB7kDFE/embed?start=false&loop=false&delayms=3000" webkitallowfullscreen="true" width="480"></iframe></div>
<br />
Notes:<br />
<br />
<b>BACKGROUND </b><br />
Hot topics in educational research but not so much in language assessment<br />
Issues are LINKED<br />
Issues central to lifelong learning (self-assessment, SDL, learner autonomy) and to preparing us for this age of exponential changes<br />
<br />
<b>RATIONALE </b><br />
Increasing importance of ICT in teaching & learning<br />
Singapore MOE's 3rd Masterplan for ICT in Education:<br />
'...enrich and transform the learning environments of our students and equip them with the critical competencies and dispositions to succeed in a knowledge economy.'<br />
'Strengthening integration of ICT into Curriculum, Assessment and Pedagogy'<br />
<br />
Future Schools testbeds for innovation<br />
<br />
New syllabus acknowledges multimodal literacies, e.g. Writing and Representing, not just writing.<br />
Doc mentions 'visual elements', 'multimodal texts', 'experiment with the use of sound, imagery and language', 'use a range of technologies'.<br />
<br />
Importance of 21st C skills, e.g. various digital literacies (c.f. critical competencies & dispositions)<br />
Singapore is a founding member of ATC21S (Assessment & Teaching of 21st C Skills)<br />
<br />
How it's being assessed and WHAT is being assessed (i.e. the construct) important<br />
<br />
<b>METHODOLOGY </b><br />
Literacies & assessment as social situated practices - must be considered along other social & cultural practices<br />
Literacies (multiple) not as skills but as activities<br />
Skills view does not capture the diversity and complexity of people’s reading and writing activities in everyday life<br />
Think about all the kinds of writing you do everyday, esp tech-mediated<br />
<br />
Assessment practices also not neutral, but also shape and are shaped by society & culture<br />
<br />
"A ‘practice’ (Praktik) is a routinized type of behaviour which consists of several elements, interconnected to one other: forms of bodily activities, forms of mental activities, ‘things’ and their use, a background know-ledge in the form of understanding, know-how, states of emotion and motivational knowledge." Reckwitz (2002)Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-55441818435328505302013-04-12T22:11:00.001+08:002013-04-12T22:38:47.100+08:00Notes from Feb 2013 HK meetingsNew RQs foregrounding e-assessment:<br />
<br />
RQ1. What role does ICT play in the assessment practices of EL teachers in Singapore secondary schools?<br />
RQ2. How do they balance formative and summative e-assessment in the classroom?<br />
RQ3. What are the factors that enable and inhibit their use of formative e-assessment?<br />
<br />
To be considered:<br />
<ul>
<li>Refocus on digital writing instead (because e-assessment difficult to rationalise for research).</li>
<li>Rationalise digital writing research from literacy practices perspective, 21st c edtech development in last 5 years</li>
<li>Literacies and assessment as social practices, not skills</li>
<li>Challenges to construct of writing.</li>
<li>Instead of including formative/summative in RQ, refer to them simply as practices.</li>
<li>Grounded Theory -- Lincoln and Guba (1984)?</li>
<li>Theory of Planned Behaviour TPB -- Azjen (social psychologist)</li>
<li>Innovation Theory as an orientating theory (?) to start with</li>
<li>Paul Gruba on e-assessment and blended learning</li>
</ul>
Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-38581025159713564092013-04-12T21:32:00.001+08:002013-04-12T22:38:38.376+08:00Notes from Jan 2013 ResidentialMy RQs at this date:<br />
<br />
RQ1. What are the assessment practices of EL teachers in Singapore secondary schools actively engaged in integrating ICT in teaching and learning?<br />
<br />
RQ2. How do they balance formative and summative assessment in the classroom?<br />
<br />
RQ3. What are the factors that enable and inhabit their use of formative assessment?<br />
<br />
RQ4. What role does ICT play in their (formative) assessment practices?<br />
<br />
New focus on e-assessment (mostly writing) requires definition:<br />
<br />
<ul>
<li>MOE?</li>
<li>Research literature?</li>
<li>What about e-portfolios?</li>
</ul>
<br />
Consider infrastructure and resources as factors.<br />
<br />
Consider literature on curriculum reform, particularly those studies which are concerned with situational or environmental analysis (essentially, those studies that look at factors which enable and inhibit). Also innovation theory in ELT (see Markee's book).Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-65488426798092663572013-04-12T21:18:00.000+08:002013-04-12T22:38:24.202+08:00Notes from July 2012 Residential<b>July 2012 Residential</b><br />
<br />
<u>Meeting 1</u><br />
<br />
Explore the ethnographic approach in language assessment (e.g. Hill & McNamara, 2012)<br />
<span style="line-height: 1.428571em;">Consider what sort of participant schools would suit</span><br />
<span style="line-height: 1.428571em;">Read up on </span><br />
<ul>
<li><span style="line-height: 1.428571em;">Case studies (see Yin)</span></li>
</ul>
<ul>
<li>Situated Literacies ed. Barton</li>
</ul>
<ul>
<li>Assessment literacy</li>
</ul>
<ul>
<li>Teachers' understanding of formative assessment</li>
</ul>
<ul>
<li>Teacher cognition (Borg, 2003)</li>
</ul>
<ul>
<li>Definitions of formative assessment</li>
</ul>
<u><br /></u>
<u>Meeting 2</u><br />
<u><br /></u>Fulcher's focus on PRINCIPLES is important and would apply to informal assessment<br />
Should decide what to foreground and background in study<br />
Could use formative vs summative CBA as a lens through which to examine factors which inhibit or enable formative assessment (e.g. learner autonomy, exam-driven culture, assessment literacy)<br />
Follow up on:<br />
<ul>
<li><span style="line-height: 1.428571em;">Classroom-based Language Assessment </span></li>
</ul>
<ul>
<li><span style="line-height: 1.428571em;">Kathryn Hill's research</span></li>
</ul>
<ul>
<li><span style="line-height: 1.428571em;">2013 Language Testing special issue on Assessment Literacy</span></li>
</ul>
<u><br /></u>
<u>Meeting 3</u><br />
<u><br /></u>Tentative RQs:<br />
RQ1. What are the assessment practices of EL teachers in Singapore?<br />
RQ2. How do they balance formative and summative assessment in the classroom?<br />
RQ3. What are the factors that enable and inhibit their use of formative assessment?<br />
Should not bring factors I'm interested into the RQs (e.g. washback), but choose one as a focus RQ, e.g. assessment literacy, because it can make a considerable contribution to PD?<br />
<br />
<span style="line-height: 1.428571em;">Framework for CBA: TIERNEY 2006</span>Changing practices: influences in classroom assessment<br />
Model missing resources and materials (ready made)<br />
Note mediating sources - variables<br />
<br />
Follow up:<br />
<ul>
<li><span style="line-height: 1.428571em;">Black and Wiliam on formative assessment</span></li>
</ul>
<ul>
<li><span style="line-height: 1.428571em;">Van lier</span></li>
</ul>
<ul>
<li><span style="line-height: 1.428571em;">Focus on formative - precise end point (narrow to writing? Digital writing?) in order to include all influences</span></li>
</ul>
<ul>
<li><span style="line-height: 1.428571em;">Use model to analyse data?</span></li>
</ul>
<ul>
<li><span style="line-height: 1.428571em;">Ethnographic methods for classroom research</span></li>
</ul>
Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-37924264619871767772013-04-12T21:00:00.000+08:002013-04-13T11:59:05.399+08:00My original proposal<b>B. Your Research</b><br /><br /><i>B1. What is your proposed area of research?</i><br />Language testing. Specifically the testing of non-traditional digital writing skills, as defined by researchers in the field of multiliteracies (New London Group, 1996). The context is secondary school English language education in Singapore.<br /><br /><i>B2. Within this area, what would you like to investigate? Please include at least one possible research question here.</i><ol>
<li>How can a given construct of non-traditional digital writing skills be operationalised in terms of assessment criteria and rating scales? </li>
<li>In the operational test, to what extent do the individual criteria distinguish between test-takers who score different grades? </li>
<li>Are raters experienced in the assessment of traditional writing skills able to use the new criteria consistently and reliably? </li>
<li>Does the use of such a test result in desired washback; that is, improvements in the instruction of non-traditional writing skills? </li>
</ol>
<br /><i>B3. What are your reasons for choosing this proposed research project? (These might be theoretical, professional or both.)</i><br />The nature of literacy has changed with the advent of affordable computing devices and higher internet speeds. These new forms of literacy are fast becoming essential in modern society. However, mainstream education continues to lag behind research in this area. This is despite the strong push by education authorities in many countries, such as Singapore, to integrate ICT into their literacy programmes. <br /><br />In Singapore’s assessment-driven education system, this problem could be attributed to the traditional assessment practices still dominant here. Crucially, the high-stakes Singapore-Cambridge General Certificate of Education (Ordinary Level) Examination for English Language, taken by secondary school students in their final year, remain very much a traditional language test. Therefore, assessment practices would have to take the lead in changing the status quo. <br /><br />However, research in the assessment of multiliteracies has been limited to date. My research aims to fill the gap in a way that is immediately applicable in the context of Singapore schools. This is in line with Singapore’s role as one of the five founding countries of the Assessment and Teaching of 21st Century Skills project (ATC21S). <br /><br /><i>B4. Do you have ideas about the sort of data you might need for your research?</i><ol>
<li>Test-takers’ scripts from a new test of non-traditional digital writing. </li>
<li>Double-rated scripts by teacher-raters. </li>
<li>Think-aloud protocol (concurrent or retrospective) data from teacher-raters. </li>
</ol>
<br /><i>B5. How might you collect this data? Do you already have access to it? (N.B. Do not list here books you will read or have read.)</i><br />The participants will be teachers and pupils from a secondary school in Singapore who are also participating in a study that aims to identify similarities between the skills involved in traditional pen-and-paper writing and non-traditional digital writing.Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0tag:blogger.com,1999:blog-1023904605513885594.post-91469751037629455722013-04-12T20:58:00.001+08:002013-04-12T20:58:42.822+08:00Why this blogFor a long time now I've considered putting down thoughts, etc. related to my PhD studies in some way, in a kind of journal. As usual I've procrastinated and procrastinated.<br />
<br />
Let's hope I can keep this up!Anonymoushttp://www.blogger.com/profile/06558439446890525468noreply@blogger.com0Singapore1.352083 103.819836000000010.84410599999999991 103.174389 1.8600599999999998 104.46528300000001