Friday, April 20, 2007

Blog 6

What is learning?
As I read the information for this week and thought about what we have covered so far in this class and what I know from other classes I put the information together in a new way for me. I think that learning occurs when a person can understand, use, or do something they couldn’t before. In educational terms it might be said that learning is a change in cognitive state. It is important to note that this is a process that occurs within the learner, although it is driven by events or stimuli that are external to the learner. Learning objectives express a desired final outcome. The purpose of assessment is to see if this outcome has been attained. One way to think about this is that there is an initial state and a final (goal) state. The initial state is the starting point and the final state occurs when you can understand, use, or do something you couldn’t at the initial state. Summative assessment looks at the final state but it does not address what occurs between the initial and final states. Formative assessment looks at the progress toward the final state. In my cognition class, I learned that problem solving is described as searching a problem space, which consists of an initial and a goal state. The goal state (problem solution) is reached when a path is found between these two states. The more direct the path between one state and the other, the more expertise is acquired. It occurred to me that there is a striking similarity between this and the definition I came up with for learning. What this says to me is that learning and problem solving are basically the same thing. Learning is a constant process of problem solving by searching for a path to some desired goal state. That means that if the only thing you assess is the final (goal) state, you are discounting a series of cognitive gains. Even if the goal state is not reached, progress may have been made and, more importantly, learning has most likely occurred. This is why formative assessment is critical and why judging learning in schools by summative achievement tests is so seriously flawed. The implication for online learning is that assessing learning requires more than the instructor throwing the information out on the web for the students to gather up. There must be a careful and ongoing analysis of the progress the student is making toward the final outcome. This analysis determines the amount of scaffolding that is needed to allow the students to carve a path toward the final desired outcome, keeping in mind that the path is not always the same for every learner.

What does quality mean in online learning?
Given the definition of learning I have described, I would say that quality online learning involves more than just the achievement of learning objectives, although learning objectives are very important in structuring a learning program. Quality instruction is grounded in quality design. This means that the instruction should meet learner needs, consider the learning context, match appropriate cognitive strategies with specific outcomes, and assess learning based on these specific outcomes. If these conditions are met, it can be said that quality instruction is taking place. An additional quality consideration for online learning is the delivery system. The system should ensure accessibility, confidential and accurate record keeping, and provide appropriate resources and opportunities for interaction. All of these attributes should be considered as part of the quality assurance process of online learning.

Conceptual Framework for Evaluation Online Learning Quality
I think that the three presences described in Chapter 11 of Anderson and Elloumi (2004) make an ideal framework for the evaluation of online learning quality. The cognitive presence addresses the need to ensure that the context and instructional practices support and reflect learning theory. The social presence addresses the need for support and collaboration that is required according to social learning theory. The teaching presence places focus on the implementation of sound instructional practice and subject matter expertise. If the evaluation of online learning is viewed through this lens, it seems to me that all aspects of quality instruction will be considered. The structure might look something like this:
Cognitive
Objectives and outcomes are aligned
Delivery method matches outcomes
Ongoing formative assessment is part of the design
Content and process are integrated
Learning context is considered in instructional delivery
Appropriate scaffolding is provided
Social
Student needs are met with regard to learning environment
Opportunities for collaboration and communication are accessible
Discourse is encouraged and supported
Feedback opportunities are provided
Teaching
Instructor has adequate content knowledge
Opportunities for peer instruction are available
Strategies are implemented to encourage discourse and active learning
A collaborative environment is established in which learning is the norm

9 comments:

Anonymous said...

Janice, brilliant summary, I learned so much from reading your blog. The clarity of your writing and your ability to assimilate all this content is great. Thank you for your great work. Helen Thomas

MadSavery said...

Excellent point about the importance of formative assessment and the irrationality of only using summative evaluation to determine growth or knowledge gain. It is sad that our school systems are based on such archaic logic and unaligned good intentions. I loved your summary about what learning is and how you related it to problem solving. The idea of the beginning and goal state is right on! I like the idea of the three types of broad areas for evaluation of a learning community. They all do seem to overlap a bit, but all three are necessary for a quality online learning community.

Shelly Wright said...

Janis,

Your summary on learning and assessment, especially formative and summative, were very helpful to me, I think you are right also, because at each junture of this course, I feel as if I have learned what is ment for me to learn, but at the end when we have to put in all together in the design document, it was a lot harder than I thought it would be. I also really liked your framework for quality assessment, nice job on your blog. Thanks again for your insight

Unknown said...

Janis, re your comment " That means that if the only thing you assess is the final (goal) state, you are discounting a series of cognitive gains. Even if the goal state is not reached, progress may have been made and, more importantly, learning has most likely occurred." made me think that online courses can make it easier for instructors to do continuous formative assessment. That is, if the course makes use of discussion forums, chats, and blogs you have a continuous (text) record of student thinking and progress.

This also brings up the question of how much formative assessment does an instructor need to do, and how much time is reasonable for this? If Dr. Ge is reading and assessing every single thing we post she must be a superwoman!

Anonymous said...

Janis, I agree with you that 'quality instruction is grounded in quality design'. We, as designers, would always like to say that the importance lies in the design, but I think in this case, that is true. The quality of the outcome (learning) is directly dependent in the design. If we as designers don't effectively do our job, the instructors will have a difficult time doing their job.

Anonymous said...

Please pardon the duplicate post, I didn't log in and leave my name in the last comment.
------------------------------
Janis, I agree with you that 'quality instruction is grounded in quality design'. We, as designers, would always like to say that the importance lies in the design, but I think in this case, that is true. The quality of the outcome (learning) is directly dependent in the design. If we as designers don't effectively do our job, the instructors will have a difficult time doing their job.

Anonymous said...

I am so glad that you discussed summative assessment. I did not think of this in my design yet, and it is so true. Everyone, in ANY course, does not start out at the same level. Why do we look at the final state, instead of formative assessment like you have described? I realize it would be very hard to look at progress throughout the course. It would also involve the instructor and possible conflict of opinion. In other words, the instructor can say A is right and B is wrong. I wonder how you would measure this formative assessment...would every instructor see things differently? This is interesting and new to me- I will look into it before my design assessment is complete! Great job! Allison

davz said...

Janice, great take on quality of instruction. I completely agree with your vies.

JuleeaD said...

Janis, I found your discussion of the initial state and final state to be very helpful, especially when you spoke of what happens in between. Learning is a process and the formative assessment shows progress toward the final state of learning. Thanks for sharing your ideas and concepts. Julie