Skip to main content

Week 10: Reflection Post

I'm going to do my reflection post a bit early this time because I have a few more assignments to complete before the end of the week. I think the main thing that's on my mind now, coming to the end of the course is the question of evaluation: How do we evaluate a produsage-centered course? Do we evaluate it like how we would an instructional course? Using Kirkpatrick's 4 levels of evaluation:

Level 1 - Trainee sentiments of the course.

  • I would imagine that this would examine:
    • Metrics examining platforms' usability.
    • Metrics examining instructor proficiency and helpfulness.
    • Metrics examining effectiveness of material.
    • Metrics examining relevance of material.
  • Largely survey-based I think on a usual likert scale.
Level 2 - Trainee Proficiency
  • This would probably examine:
    • Trainee's understanding of civil military relations.
    • Trainee's understanding of military law.
    • Trainee's understanding of just war doctrine and application of Jus ad bellum. 
  • This could come in the form of quick quizzes and a review of the groups' defence of their actions in the role-playing game. 
Level 3 - Actual improvement in job performance in the field
  • This would probably examine:
    • Number of infractions in the field.
    • Case studies.
    • Reported offences.
  • This could either be a data collection effort, plowing all the post-patrol, combat reports, disciplinary reports or another survey with colleagues and superiors on the effectiveness of the individual post-training. I think the latter will be tricky to do though, due to the fact that people generally tend to cover up war crimes. 
Level 4 - Does this improvement in CMR proficiency lead to greater mission effectiveness in the military organization?
  • I would imagine the main determinant would be to examine the compliance and support of the military's actions among the local population.
  • This would probably be an anonymous survey with qualitative interviews done to support the findings. 

Comments

Post a Comment

Popular posts from this blog

I'm back - Part 2 of 2

Building on what I mentioned in the last post on developing a community of practice for investment. I can think of just a few ideas, based on my reading of the subject. Essentially, I would argue that the community requires at least three main elements. Firstly, a common agreement or set of guidelines that dictate expectations on investment advice shared in the community can help to make clear two things - the possibility of success or profit as a result of said investment (namely that no investment is comes without risk) and, the expectation of adherence of advice between investors (namely, only you decide what you invest in - do not wildly trust others).  Secondly, a method of arbitration and moderation of disputes and information posted in the community. I would imagine that this is necessary to ensure that (1) fake news is not posted in the community that could harm it and, (2) to help ascertain veracity in disputes between investors/ members of the community. The main issue of...
Post a Comment
Read more

Building a Shared Knowledge Base for your Organization!

On that train of thought - talking about knowledge sharing here - I've been trying to compile a list of articles to do with developing a community knowledge base. Now in my previous post, I was talking about knowledge sharing in an organization that does not have the infrastructure for a thriving internet community. This post is really to share two articles I found regarding the creation of a shared knowledge base. The first, I found on a blog called quandora that talks about the 5 benefits of knowledge sharing within an organization.  Here is the website: https://www.quandora.com/5-benefits-knowledge-sharing-organization/ As a summary, the five benefits are: Re-use the organization's best problem-solving experiences.  Improve decision-making. Increase growth and innovation. Improve customer service. Reduce the loss of tacit knowledge. Now the second article is more detailed, pertaining to a specific case - building self-service for customer support.  Here is the website:...
Post a Comment
Read more

Data analytics - My repository of useful knowledge

Hey all! I still have knowledge sharing withdrawal so here's another knowledge repository that I am slowly crafting on data analysis and the like. So here we go! 1. Why Big data? http://www.industriuscfo.com/7-benefits-using-big-data/ https://www.forbes.com/sites/forbestechcouncil/2019/11/06/five-benefits-of-big-data-analytics-and-how-companies-can-get-started/#2dfc29ef17e4 https://www.sas.com/en_sg/insights/analytics/big-data-analytics.html https://www.dataversity.net/many-benefits-big-data-company/ https://www.newgenapps.com/blog/importance-benefits-competitive-advantage-big-data/ Potential reading list for big data -  https://solutionsreview.com/data-management/top-25-best-big-data-books-on-amazon-you-should-read/ 2. Examples of Big data done right https://intellipaat.com/blog/7-big-data-examples-application-of-big-data-in-real-life/ https://builtin.com/big-data/big-data-examples-applications https://www.datapine.com/blog/big-data-examples-in-real-life/ 3. P...
3 comments
Read more