Sloan-C View
Perspectives in Quality Online Education
Volume 6 Issue 1 - January 2007
ISSN 1541-2806
Dedicated to the Highest Standards in Online Education

Issue Contents

Online Courses Lead the Way in Quality Assurance

Ron Legon
Executive Director, The Quality Matters Program
Provost Emeritus, The University of Baltimore

Paradoxically, while the rapid growth of online education has generated quality concerns, online instruction has actually advanced the art of quality assurance in higher education.

Of course, colleges and universities have always prided themselves on the quality of their efforts, but what has changed over time is the type of evidence that is regarded as conclusive indicators of quality.

In the mid-twentieth century, the main evidence used to substantiate educational quality was the caliber of admitted students, the credentials and accomplishments of the faculty, the size of the library, the endowment and the annual budget, and the condition of the physical plant. Today, we would refer to these indicators as "inputs" and, while by no means ignored or dismissed as irrelevant, they are increasingly relegated to a supporting role in the quest for credible evidence of institutional quality.

What has emerged in the past thirty years is a concern about "outcomes" and "outputs". Schools have always touted the success of their graduates, but now course completion rates, graduation rates, time to degree, and various forms of student satisfaction have become the new benchmarks of quality. This emphasis is evident, for example, in the recent report of the Spelling Commission [1].

Curiously, neither of these two approaches to quality assurance actually measures what occurs during the educational process. Instead, the "inputs" approach appears to reason that, with all these positive elements in place, students are bound to learn and have a good experience. Similarly, with "outcomes", if students are satisfied and most are graduating in reasonable time, then, what happened during the educational process must have been of high quality. In other words, both types of standards establish surrogates for the quality of the educational process itself.

There should be a third component to comprehensive quality assurance: measurement of the educational process itself, what actually happens in the classroom. As a study group for the North Central Commission put it in 2002, "...the accreditation process should not be about just "inputs" and/or "outcomes". We should also be focusing on teaching and learning activities or processes as a third area for assessment and improvement, and the appropriate uses of technology are one element within this area of assessment" [2].

Here the virtual classroom has a distinct advantage over the face-to-face classroom: The electronic record of an online course lays out the entire instructional strategy and learning process of the course as it unfolds, lesson by lesson and week by week.

Recognition of the abundant evidence for the assessment of online courses led to the creation of the Quality Matters™ Rubric [3] and other standards for evaluating online courses that would be far more difficult to apply to face-to-face courses. Peer reviewers of online courses are able judge how course objectives are accomplished through course materials, lessons, discussions, assignments, and assessments to a far greater extent than is possible in classroom-based courses. Furthermore, such reviews lead to specific peer-based advice on the improvement of online courses, thereby accomplishing one of the goals often used to justify assessment and quality assurance programs.

When we train faculty to apply the Quality Matters Rubric to online and hybrid courses, one of the most frequent comments we receive is that these standards appear relevant to all academic courses. This is quickly followed by the question "Why don't we use the QM Rubric to evaluate face-to-face instruction?" Perhaps we will one day, but, as noted above, the collection of all the relevant data would be far more difficult. In the matter of quality assurance, as in many other ways, it appears that virtual courses are more concrete, tangible and measurable, than face-to-face ones. It is hardly surprising that scores of institutions across the U.S. are incorporating the Quality Matters Rubric in their quality assurance programs for online education.

1. "A Test of Leadership; Charting the Future of U.S. Higher Education," p. 25, The Spelling Commission (September, 2006).
2. NCA Study Team Report: "The Impact of Technology in Learning and Teaching," March 2002, p. 12.
3. The Quality Matters Rubric was developed under a three-year grant to the MarylandOnline (MOL) consortium from the Fund for the Improvement of Postsecondary Education, 2003-2006. MOL is a not-for-profit association of higher education institutions in Maryland that continues to disseminate the Quality Matters Rubric, training and services on a subscription and fee for service basis.

(Join Sloan-C in our online workshop: Using the Quality Matters Rubric to Improve Your Online Course, February 21 - March 16 led by John Sener of Sener Learning Services and Christina Sax of the University of Maryland University College will host.)


Sloan-C Announces the Online Teaching Certificate Program

Teaching online can be overwhelming at first.

Teaching online IS different from face-to-face.

Online education offers capabilities that could even surpass face-to-face. But what are they?

How can you be sure that you are taking advantage of the capabilities of online education?

As a faculty member, the rewards of teaching online successfully can be numerous.

But how do you know if you are getting the most from your virtual classroom?

Anyone who teaches online needs first-hand experience as an online learner to better understand the online learning environment. The Sloan-C Online Teaching Certificate series proves unique in that faculty can take key learnings from the Getting Started and Quality Matters workshops, immediately apply these learnings in a laboratory environment, and receive feedback from both the faculty mentors and faculty peers.

Please visit the Sloan-C Certificate web site for more information.

NOTE: Does your institution have a College Pass? Institutions with college passes can pay only the certificate fee and use their pre-paid seats towards the 5 required workshops.


Sloan-C Online Teaching Certificate Series

The Sloan-C Online Teaching Certificate series launches this month, enabling faculty participants to acquire new skills in the design and implementation of their online courses, fine-tune their courses, receive guidance and feedback from leading online educators, and collaborate with faculty from all over the country. The series focuses on re-inventing teaching from on-ground to online education.

The cornerstone of the series is the "Effective Practices Laboratory". Offered concurrently with the foundation courses "Getting Started: Online Course Development Basics" and "Using the Quality Matters Rubric to Improve Your Online Course", the laboratory provides an environment whereby participants can investigate new methods of course design, and receive one-on-one mentoring from experienced online faculty representing a variety of higher education institutions.

Anyone who teaches online needs first-hand experience as an online learner to better understand the online learning environment. The Sloan-C Online Teaching Certificate series proves unique in that faculty can take key learnings from the Getting Started and Quality Matters workshops, immediately apply this learning in a laboratory environment, and receive feedback from both the faculty mentors and faculty peers.

The Effective Practices Laboratory also provides the opportunity to access and discuss sample courses currently being offered to online students. With the guidance of the faculty mentors, laboratory participants will explore diverse online classroom models from leading institutions. Laboratory participants will also gain experience in using different forms of asynchronous and synchronous applications in the foundation courses and the Effective Practices Laboratory.

The following faculty will be leading the first series, which begins on January 17th. (Subsequent series begin on April 25th and September 12th.)

  • Fabio Chacon, Coordinator of Instructional Design, SUNY Empire State College
  • Judith Effken, Assistant Professor in the College of Nursing, Arizona State University
  • Susan Ko, Executive Director, Center for Teaching and Learning, University of Maryland University College
  • Shari McCurdy, Associate Director, Office of Technology-Enhanced Learning, University of Illinois at Springfield
  • Joan McMahon,Transforming Leaders, Quality Matters master reviewer, formerly of Towson University
  • Christina Sax,Collegiate Professor of Biology and the Assistant Dean of Social, Behavioral, Natural, and Mathematical Sciences, University of Maryland University College
  • John Sener, Founder and Chief Learner for Sener Learning Services
  • Kaye Shelton, Director of Online Education; Asst Professor in Adult Education, Dallas Baptist University

Sign Up for 2007 Premium Membership

Key Benefits:

  • 20 coupons for $150 off any 2007 Sloan-C workshop of your choice ($3,000 value)
  • 10 coupons for $50 off registration for the Sloan-C International Conference on Asynchronous Learning Networks ($500 value)
  • Access to the ePremium Website:
    • PDF versions of all the publications in the Sloan-C Series
    • Archives to over 15 previously held online workshops
    • Discussion forums for key topics in online education and the Sloan-C community

Price: $945

Don't delay, register here.


Concept Mapping as a Dynamic Pedagogical Construct for Asynchronous and Synchronous Interactions

Concept maps have been used for many years as way of graphically organizing thoughts about concepts. Concept maps come in lots of different forms, typically of a "spider" type in which a central theme is surrounded by nodes that explain the theme or in a hierarchy in which a concept is decomposed. Other forms frequently used include flow charts, schematics and the like. Most maps are quite useful for assisting understanding of concepts, especially for visual learners. One can read details of concept maps in various publications. (e.g., see: Novak, Joseph D., Learning, Creating and Using Knowledge, Lawrence Erlbaum Associates, 1998).

Click here to continue reading this article.


Sign Up for the 2007 Sloan-C College Pass

How does it work?

  • 100 seats in all 2007 Sloan-C online workshops, along with 50 additional seats in select workshops
  • Transfer seats to any individual, not just your faculty and administrators
  • Sloan-C Premium Membership included!

Price: $3,495

Don't delay, register here.


What Does "Effective Practice" Mean?

A lively discussion ensued when a dean wrote to the Sloan-C listserv with this question about introducing faculty to online education:

The paradigm here is still heavily teacher-centered, so you can imagine the discussion when faculty are asked to engage in conversation about student-centered, active learning approaches to online teaching and learning. When we introduce faculty to best practices, several tell me well you know "best practices are always just a judgment call anyway." I am writing to you all for suggestions on how to engage faculty in a positive and constructive fashion that does not further alienate those who simply do not want to shift their teaching paradigm.

Excerpts from the listserv responses show the importance of this question:

-------------------------------------------------------------------------------------
I have found that faculty reacts better to the technology-integration issue when they are not approached with ideas and suggestions to change, but when they are involved from the perspective of their own teaching experience. I have seen much better results when I have asked them what they really like about their teaching practice, and learned what are their expectations of working in an online environment. Starting with reflection and moving into doing may prove more successful than showing what others do best and trying to convince them that they can do it too... when they may not be interested in changing at all.

Norma Scagnoli
University of Illinois at Urbana-Champaign

-------------------------------------------------------------------------------------
We have "Best Practices" workshops, meetings and discussions almost every month online and onsite, with full-time and adjunct faculty. They are not considered as practices that are best for everyone but as examples of what works for individual instructors.

Much of the time in these programs is spent in small groups organized by school, program or course with faculty sharing their ideas with those who are teaching in the same discipline. Most faculty are taking notes on these ideas planning to use (adapt) them in their own teaching. Faculty who share their ideas are reinforced by this response knowing that they are not only doing something well in their teaching but also contributing to the learning of other faculty.

The challenge is in finding a way to collect all these ideas and make them accessible to all faculty.

George Drops, Ph.D.
Professor, School of Business & Management
Director, Center for Teaching Excellence
National University

-------------------------------------------------------------------------------------
The distinction between "best practices" and "effective practices" is important here. This is why the Sloan-C practices are called "effective" instead of "best": because they make an attempt to describe effectiveness, i.e., provide a meaningful context, and because describing what's "best" really is a judgment call, especially in a field which is still growing and changing rapidly and thus involves innovation, risk taking, and working outside the box. So regarding your question, it depends on what it means to "ask" faculty to do something. Certainly if "ask" really means "make", then following a set of practices is limiting everything you list.

John Sener
Sener Learning Services

-------------------------------------------------------------------------------------
Yes, "best" or even "effective" practices can be used to limit how people think and work. But they can also save re-inventing the wheel and provide a useful starting point for newcomers.

ANY structure can be both a cage and a support... Sure, the CMS can be construed as content-centered, even hegemonic. But good teaching means providing students with a structure for how to manage new information or processes.

Not all structure is bad. Any tool can be used for both constructive and destructive purposes. It is healthy to problematize the concept of "best" or "effective" practices, but it can also be productive to make good use of the tools we have available. How do you know you're "working outside the box" if you aren't faced with a defined box? "The artist's job is to build a box and let the audience watch him escape from it."

Peg Wherry
Asst Head for Independent and Distance Learning
Academic Outreach
Office of Continuing Education
University of Illinois at Urbana-Champaign

-------------------------------------------------------------------------------------
I think it is a good question being asked, for it relates to the fluid nature of something called "best practice". I think we all understand that "best practices" evolve from particular paradigms, beliefs about teaching and learning, and philosophies of education.

We need to consider the concept of "best practices" as being non-neutral, historical, and benefiting certain arrangements and practices. I wonder if when an administration asks faculty to follow a set of practices named "best", it is limiting academic freedom, innovation, and risk taking, and in a real sense "working outside the box." So, my point is, there is a world of difference between the implications of "best" and "effective", except when "effective" leads to the "best", and the "best" is understood as being "effective".

Terms like "accountability", "efficiency" and "effectiveness" have deep roots in the history of education. We need to be watchful and critical/reflective when we use them.

Roberto Muffoletto
Coordinator: New Media & Global Education College of Education
Appalachian State University


Learn From the Experts - The Sloan-C 2007 Workshop Series

The new Sloan-C 2007 workshop schedule has been posted.

Getting Started: Online Course Development Basics - January 17 - Feb 9 (Registration Deadline is next Tuesday.)

Based on research and the Sloan-C effective practices, this workshop provides the foundation for designing and delivering online courses. Faculty gain enhanced pedagogical knowledge and learn effective strategies for creative, online classroom facilitation. During the three-week workshop, facilitators will review the benefits and challenges of online curriculum development and teaching and address the qualities of effective online education. The workshop is designed as an 'active' learning experience, enabling faculty to explore actual online courses in several disciplines and institutions. Additionally faculty will create a syllabus leading to the major outcome of the workshop: identifying the critical components necessary to complete the development of their online course.

Click here for details and registration.

Transforming Curriculum Development and Assessment Practices - February 7 - 16

In distance education, the risks of failure can be quite high. Pressured by mounting institutional and public scrutiny, requirements from accrediting organizations, a desire to increase enrollment, and operate more effectively, online educators are looking for curricular alignment and student assessment strategies that truly measure learning outcomes. This workshop offers new insights into practical curriculum development, evaluation methodologies, and online assessment strategies institutions can implement into their own programs. Facilitators represent for-profit and non-profit institutions.

Click here for details and registration.

Using the Quality Matters Rubric to Improve Your Online Course - February 21 - Mar 16

Recognizing quality is much like recognizing art - you know it when you see it, but everybody sees something different. And when it comes to online courses, your students, faculty, administrators, peers, and accrediting bodies may certainly not see what you do. In fact, they might not even know what to look for in assessing quality. Sloan-C announces an interactive online workshop focused on learning how to improve your online course(s). Learn how to use the rubric tool developed by the nationally recognized, FIPSE-funded Quality Matters (QM) project. The QM rubric provides a research-supported framework with annotations and examples for applying quality practices to specific course design standards. Affirm the strong areas in your course(s) and generate specific ideas for improvements. The QM rubric is the centerpiece of the QM process. Additionally, this course serves as a stepping stone for faculty interested in becoming certified course peer reviewers.

Click here for details and registration.

Copyright Compliance for Online Educators - March 21 - 30

As an online educator, you need to know how copyright affects you when using materials to supplement your online courses. You also need to know how your original works can be protected. In this workshop, Linda Enghagen, of the University of Massachusetts at Amherst, will take you through the key copyright issues that you and your colleagues should be aware of when preparing and delivering your online courses.

Click here for details and registration.


Sloan-C Quick Links

Membership - Join Sloan-C and enjoy added savings and access

Workshops - Tailored for faculty and administrators

Journal of Asynchronous Learning Networks (JALN) - The leading journal for online education

Survey Reports - Latest findings from our research

Publications - The state-of-the-art in online learning

Effective Practices - Learn what works best from the best

JobLine - Your next career step in higher education

College Pass - Dramatic group savings at Sloan-C workshops

Vendor Corner - Find the professional help to keep your online programs moving forward

Sloan-C Catalog - Listing of Sloan-C member online courses

Sloan-C Wiki - Meet colleagues to exchange ideas and questions

 

Featured Download

A Synthesis of Sloan-C Effective Practices

To support continuous improvement in the quality, scale and breadth of online education, the Sloan Consortium invites practitioners to share effective practices. This report synthesizes effective practices submitted by Sloan-C members that have been reviewed and are currently listed in the Sloan-C Effective Practices online collection on the Sloan-C Wiki. This synthesis groups effective practices according to solutions that contributors have provided to some frequently encountered questions.

Please download your free copy here.

 

Upcoming Sloan-C Workshops

January:

February:

March:

 

New FREE Resource for Blended Learning Educators- www.blendedteaching.org

Sloan-C has launched a new web site focused on Blended Learning. This is a free resource and we encourage you to invite your colleagues to join this growing community of blended learning educators.

Key Resource Just Added: A new section titled Blended Learning Contributed Resources has now been added to collect and share resources related to blended learning.

Go to www.blendedteaching.org today to take advantage of this free resource!

 

Keep in Touch

Know someone who'd like to receive the Sloan-C View? Feel free to forward it or have them sign up for the Sloan-C e-mail list at www.sloan-c.org.

  • We would love to hear from you. Please e-mail sloan-cview@sloan-c.org with any questions or comments.
  • If you know of, or are hosting, an event that should be listed on the Sloan-C View Calendar, please send the details of the event and url to sloan-cview@sloan-c.org.

The Sloan Consortium (Sloan-C), sponsored by the Alfred P. Sloan Foundation, is composed of institutions and organizations dedicated to continually improving the quality, scale, and breadth of their online programs, according to their own distinctive missions, so that education becomes a part of everyday life, accessible and affordable for anyone, anywhere, at any time, in a wide variety of disciplines.

The Sloan-C View is published by Sloan Consortium (Sloan-C™). Responsibility for the contents rests with the authors and not with Sloan-C™. Copyright ©2006 by Sloan-C™.

If you have a question or comment, would like to submit an article for publication, or would like to suggest an event to be listed on the Sloan-C View Calendar, please email sloan-cview@sloan-c.org. Materials in the Sloan-C View, unless otherwise noted, may be distributed freely for educational purposes. However, if any materials are redistributed they must retain the copyright notice and use the proper citation. Kindly send an email to sloan-cview@sloan-c.org indicating how you are using the material for distribution. Your privacy is important to us, you can view our privacy policy at www.sloan-c.org/aboutus/privacy.asp

The Sloan Consortium, Olin Way, Needham, MA 02492-1200