Scale

SCALE is the principle that enables institutions to offer their best educational value to learners and to achieve capacity enrollment. Institutional commitment to quality and finite resources require continuous improvement policies for developing and assessing cost-effectiveness measures and practices. The goal is to control costs so that tuition is affordable yet sufficient to meet development and maintenance costs -- and to provide a return on investment in startup and infrastructure. Metrics may compare the costs and benefits of delivery modes by discipline and educational level; faculty salary and workload; capital, physical plant and maintenance investments; equipment and communications technology costs; scalability options; and/or various learning processes and outcomes, such as satisfaction levels and retention rates. These types of comparison enable institutions to: develop better strategic plans for market demand and capture; achieve capacity enrollment; develop brand recognition; and secure long-term loyalty among current and prospective constituents. Practices for scale help to leverage key educational resources while offering new online learning opportunities to students and faculty.

Effective Practice Awards Submissions Due June 30

Submitted by janetmoore on May 27, 2010 - 1:06pm
New effective practices  submitted by June 30 are eligible for awards to be presented at the July 21, 2010 Emerging Technologies for Online Learning Symposium Awards Presentation Luncheon.
Thousands visit effective practices for innovative practices supported by eviden
$0.00
Volume, Issue - Date: 
Volume 16, Issue 1 - January
Author(s): 
Janet C. Moore
Oganization: 
The Sloan Consortium
Full article - Free: 
$0.00
Keywords: 
learning effectiveness, scale, institutional commitment, cost effectiveness, access, faculty satisfaction, student satisfaction, quality framework, innovation, impact, replicability
Abstract: 
Encouraging continuous improvement in the quality, scale and breadth of online education, the Sloan Consortium invites practitioners to share effective practices. This report synthesizes effective practices submitted by Sloan-C members to the online collection at http://www.sloanconsortium.org/effective as of December 2011. The synthesis includes links to detailed postings about practices, including the authors and their institutions.
$5.95
Volume, Issue - Date: 
Volume 15, Issue 4 - November 2011
Author(s): 
Stephen Marshall, University Teaching Development Centre, Victoria University of Wellington
$5.95
Keywords: 
organizational change, e-learning maturity model
Abstract: 

Technology and change are so closely related that the use of the word innovation seems synonymous with technology in many contexts, including that of higher education. This paper contends that university culture and existing capability constrain such innovation and to a large extent determine the nature and extent of organizational change. In the absence of strong leadership, technologies are simply used as vehicles to enable changes that are already intended or which reinforce the current identity. These contentions are supported by evidence from e-learning benchmarking activities carried out over the past five years in universities in the United States, the United Kingdom, Australia and New Zealand.

Tags:
$5.95
Volume, Issue - Date: 
Volume 15, Issue 4 - November 2011
Author(s): 
Martin Hall, University of Salford
Author(s): 
Mike Keppell, Charles Sturt University
Author(s): 
John Bourne, The Sloan Consortium
$5.95
Abstract: 

 This collection of papers contributes to a wide and ongoing strand of interest in alternative learning technologies: how are digitally-enabled ways of working transforming organizations? In ‘transformation’ we look for radical change, rather than just doing the same at a different scale. And in organizations we centre on educational institutions – across the full range of schooling, training, further and higher education – while recognizing that conventional boundaries are increasingly broken as different kinds of organizations invest in digitally-enabled learning.

Introducing the Sloan-C JALN Advisory Panels

Submitted by janetmoore on October 3, 2011 - 5:15pm
As an institutional and professional leadership organization dedicated to integrating online education into the mainstream of higher education, Sloan-C seeks to fully engage its members in developing content that reflects and directs the growth of educational quality, scale and breadth.
Collection: 
Student-Generated Content
Author Information
Author(s): 
Kristen Betts, Fred Loomis & William Lynch
Institution(s) or Organization(s) Where EP Occurred: 
Drexel University
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

Drexel University’s Master of Science in Higher Education Program (MSHE) has been offering online courses since Fall 2005. One of the innovative practices integrated throughout the curriculum includes optimizing authentic assessment and student generated content. This effective practice builds upon the concept of “real-world problems for real-world leaders.” Data collected from the 2011 MSHE Survey, which included 240 students with a 50% response rate, reveals the importance of an experiential curriculum in fulfilling the program’s mission and learning outcomes. When students were asked to rate their “Previous Skills” (prior to enrollment) to their “Current Skills,” the data showed a 43% increase in conducting research, 40% increase in developing Power Point (PPT), 39% increase in using new technologies, 30% increase in delivering PPT presentations, and an 18% increase in both writing and decision-making. Additionally, 30% of students shared that they had advanced in their current position or transitioned to a new position prior to graduation.

 

 

Description of the Effective Practice
Description of the Effective Practice: 

Linking to the Mission & Program Outcomes

The mission of the MSHE program focuses on preparing graduates with the knowledge, skills, and experience for career placement, advancement, transition or advanced studies within higher education or related areas (non-profit organizations, government agencies, corporations, etc.). Program outcomes include graduating higher education leaders who are effective communicators (oral/written), analytical problem solvers, evaluators, researchers, data driving decision-makers, and competent in optimizing technology and leading/working with teams. To proactively fulfill the mission and program learning outcomes, the MSHE program developed an experiential curriculum to actively engage students in their courses through real-life problem-based learning. Assignments integrate Authentic Assessment and Student Generated Content into most MSHE courses. However, for the purpose of this proposal, just one course (EDHE 606 Higher Education Career Development) will be discussed in which students use Authentic Assessment and Student Generated Content assignments twice during the 10-week quarter.

 

Building Upon Backwards Design

Backwards design is utilized in developing all MSHE assignments. Therefore, each assignment begins with identify the desired results that link to the weekly objectives, course outcomes, and program outcomes. Next, rubrics are developed to determine acceptable evidence of learning. Lastly, the instructions and deliverables are developed in detail with faculty and practitioners in higher education who provide real-life scenarios that higher education administrators are challenged with today.

In EDHE 606: Higher Education Career Development students are engaged in two assignments that integrate Authentic Assessment and Student Generated Content: (I) Job Application with ePortfolio and Mock Interview, and (II) Presentation to the Board of Trustees.

I. Job Application with ePortfolio and Mock Interview

Students begin this assignment by identifying a real job posted in the Chronicle of Higher Education, higheredjobs.com or another job-related website/executive search firm that would be considered as their next professional career step upon graduation (e.g., new career placement, advancement, or transition). Once students have identified the position, they must apply for it by submitting a formal cover letter, resume, and professional biography along with an ePortfolio. These materials are sent in through the LMS; however, the must be all tailored toward the institution for which the student is applying. Upon receipts of the application, students are sent an email from the instructor stating they are one of three finalists for the position, but, due to the economy and budget cuts, they will have to participate in a “live” synchronous interview through Wimba Classroom (now Collaborate). They are told they will have to present to a search committee and develop a PowerPoint™ presentation including: (a) a self-introduction, (b) highlights of their professional skills and experience, and (c) why they are the best candidates for the job. Students must respond to the instructor’s email within 48 hours or they lose points on the assignment. During the actual mock interview, there are two to three search committee members: (1) the instructor, (2) a specialist within the area for which the student is applying, and (3) a career advisor from Drexel’s Steinbright Career Development Center when available. Students are required take on the role of a real applicant and the search committee is required to conduct general research on each institution so they can ask specific questions relating to the position. Each interview is archived and committee members complete an actual search committee evaluation they send to the instructor. Student must send a “thank you note” to all search committee members within 48 hours or they lose points. Within 72 hours students receive the completed search committee evaluations and constructive feedback on the submitted application and the interview. This authentic assessment assignment optimizes the generation of student content that can be used for actual job applications (e.g., letter, bio, resume, PPT). The archived interview along with the ePortfolio provides exceptional materials for a follow up assignment that includes self-evaluation and reflective practice.

Once the interviewing process is complete and students have received all returned materials, including the archived interview with evaluations, they are then assigned a two-page reflective paper in which they must evaluate their own materials using the search committee evaluation form. The self-evaluation includes watching the interview and identifying what they see as their strengths and areas they can build upon or enhance for future interviews. As part of the self-evaluation and reflective practice, students need to constructively compare the feedback from the search committee to their own evaluation prior to submission. For the two-page paper, students are to reflect on the entire interview process including the position for which they applied, the content they generated, the feedback provided from the search committee, their strengths and areas for development, and their overall professional growth from the assignment. It should be noted that each time EDHE 606 is taught, many students actually begin apply for various positions and several are often hired or receive promotions.

II. Presentation to the Board of Trustees

In EDHE 606 students are assigned to groups of two or three. Each group is informed that they work within the Division of Human Resources with one person being assigned the role of Vice President and the other(s) member is assigned as an Associate Vice President or Director. The group is told the University’s President would like the Division of Human Resources to present to the Board of Trustees at an upcoming meeting. The Division is to identify the top emerging human resource management issue that should be on the University’s radar screen. Each group is to identify an issue and then develop a PPT for the presentation. Note: No groups can have the same topics so groups submit their topics as soon as they identify it. The President shares with the group that the Board of Trustees has very limited time for the presentation due to a full agenda so each group must pre-record their presentation in Wimba/Collaborate in case the Board is unable to have them present in person. Each group is required to record a 5-7 minute PPT presentation on their human resource management issue and highlight the reason it is an important issue as well as identify best practices for addressing the issue proactively as an institution. Students record their Board presentations in Wimba/Collaborate in Week 4 of the 10-week quarter. They then receive a grade and feedback from the instructor. Each group is carefully critiqued on their overall presentation, greeting to the Board, introduction of each member of their group, and the quality and detail of the PPT presentation. Each group member has to present part of the presentation.

In the Week 8 Discussion Board, students are assigned to take on the role of the Board of Trustees. They are told they need to prepare for an upcoming Board meeting by going into Wimba/Collaborate and watching the archived presentations on critical human resource topics. For this Discussion Board assignment, there are two parts. Part I - Students must identify what they believe to be the top three most critical Human Resource issues for the University based on the presentations. Within their post, they have to share the rationale for the selection of each of the three issues and provide examples of why they selected the three. Part II – Students are told to go back and watch their own group presentation. For this post, students must include a reflect and identify three things their group did exceptionally well and three things they would modify or change based on having watched the presentations of their peers and then their own presentation. It should be noted that the combination of Authentic Assessment and Student Generated Content provides students with unique opportunities to apply and actualize the knowledge and skills they are gaining in their courses. This effective practice also provides opportunities for students to reflect on their own work and work of their peers.

 

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

In April 2011, the MSHE Student Survey was distributed to 240 students enrolled in the program in spring Quarter 2011. A total of 120 students responded representing a 50 percent response rate. Of the respondents, 78% stated that MSHE Program was their first online education program in which they have been enrolled.

Highlights are provided below from (a) the 2011 MSHE Survey and (b) qualitative feedback comments by students who have been engaged in ARP assignments.

Top three reasons for enrolling in Drexel University’s MSHE Program

1.    National Reputation

2.    Flexibility

3.    Career advancement

Quality of MSHE Program:

·      56% of the students stated the online MSHE Program offers the same quality of courses than on-campus programs in which they had previously attended

·      34% of the students stated the online MSHE Program offers higher academic quality of courses than on-campus programs in which they had previously attended

Career Advancement/Transition

·      30 percent of students were promoted or transitioned to new positions while enrolled in the program

Previous Skills (prior to enrollment) & Current Skills

·      43% increase in conducting research

·      40% increase in developing Power Point (PPT)

·      39% increase in using new technologies

·      30% increase in delivering PPT presentations

·      18% increase in both writing and decision-making

Student Satisfaction:

·      90% percent of the students stated they are very satisfied and satisfied with the program

Recommend the MSHE Program:

·      95 percent of the students stated they would recommend the MSHE Program to individuals seeking to advance their career in higher education

·      89 percent stated they would recommend the MSHE Program to individuals seeking to transition into higher education

Student Comments from EDHE 606:

       One word comes to mind when reflecting upon the career and life lessons I have acquired during the past 10 weeks – invaluable.

       Unlike many of the courses I have taken so far, this course was specifically designed for me.   The knowledge and experience I gained in this course really gave me confidence that I currently possess the skills and I am prepared to enter into the higher education profession. 

       If I were to reflect on all I have learned in EDHE 606, I would need far more than two pages.  The practical knowledge I have gained will benefit me so much throughout my career.  Sometimes the things we need to learn as graduate students are the things we will use in the real world, and this course certainly proved that.

       The course material from EDHE 606: Higher Education Career Development has provided a wealth of information on topics useful in my own professional development through practical application of career assessment, networking, and professional development planning.  Throughout the past ten weeks, I have been privileged to engage in these activities both within the course for learning purposes and outside the course to advance my career

       This quarter has provided me with a working knowledge of how best to develop my professional goals and plan for the future.  Additionally, I have learned a variety of strengths and weaknesses as it concerns my resume, cover letter, interviewing technique, and behavioral tendencies.  Specifically, I feel confident in my career path but understand that there are a number of ways to go about garnering experience and to continually develop my competencies.

       As soon as I registered for Higher Education Career Development, I looked forward to learning the skills associated with making a seamless career transition into higher education from the business industry.  Even though I had garnered valuable work experience from Fortune 500 companies, I was unsure of how I could apply these skills and experiences cross-functionally.  After ten weeks of Higher Education Career Development, I can honestly say that I am exiting this quarter with much more information than from when I began this course. I look forward to applying this wealth of knowledge to future instances of employment and would like to keep in touch with professor to update her on my success in this field.

       Overall I found the course extremely beneficial to my career search. The mock interview was more rewarding than expected because I was asked real world questions that I would not have expected.  I am reflecting on those and trying to improve my answers, such as how I would handle management of a large staff, so that I can respond with confidence in the future.

 

How does this practice relate to pillars?: 

The integration of Authentic Assessment and Student Generated Content relates to all five pillars.

Learning Effectiveness – Students are engaged in real-life problem-based assignments in which they have to apply what they are learning in the classroom. The MSHE program uses a scaffolding approach to the curriculum so students gain skills, knowledge, and experience as part of a continuum of learning through their two years in the program.

Student Satisfaction – Formative and summative evaluation supports the fact that students are satisfied in their courses as well as with the program. Many students share that they are able to actualize the skills they learning in their place of employment beginning the first couple of weeks within the program.

Access – All assignments are developed so each student can engage in the assignments. For many of the group projects, students may be paired with a colleague who is serving in Iraq or lives in another time zone or another country. Students may be paired in a group with a student who has a disability. The assignment encourages groups to work collaboratively as they would in a real-world setting within teams and committees.

Scale – Student generated content supports the scaling of assignments within a course and throughout the program since faculty are not required to constantly create materials. Student generated content provides unique opportunities for students to learn from their own work and from their peers. Many students share throughout the program that they learn to welcome feedback and become more reflective of their own work in the program and their place of employment.

Faculty Satisfaction – MSHE faculty surveys indicate faculty are satisfied in their positions. It is also extremely rewarding for faculty when students in their courses receive promotions, are offered new jobs, transition successfully into higher education, and are accepted into doctoral degree programs.

 

Equipment necessary to implement Effective Practice: 

Authentic Assessment and Student Generated Content assignments do not require any additional equipment that would go beyond typical requirements for an online or blended degree program. Equipment necessary for the effective practices include: computer/laptop, microphone, camera for computer/laptop, speakers, and access to a phone if the student does not have a microphone or speakers.

 

Estimate the probable costs associated with this practice: 

As previously shared, the equipment required for Authentic Assessment and Student Generated Content assignments does not go beyond the typical requirements of online and blended degree programs. Therefore, the only costs associated with this practice would be associated with access to Collaborate (or a similar product). Blackboard provides a structured pricing model for access to one Collaborate classroom, if needed, with access to up to 200+ students depending upon the program. The cost of a Collaborate classroom can range from a couple of thousand dollars to just over five thousand dollars depending upon the access required for the number of students. Keep in mind that this one classroom can be optimized across a program. However, for institutions in which Wimba/Collaborate is already integrated into the Learning Management System, there are no additional costs. One of the greatest benefits of Authentic Assessment and Student Generated Content assignments is the optimization of the LMS.

 

References, supporting documents: 

Betts, K. S. (2010). Bringing work-integrated learning into the classroom through learning simulation. Journal of Cooperative Education & Internships, 44(1), 9-22. ISSN: 1933-2130. http://www.ceiainc.org/journal.asp?PageID=214

Betts, K., & Lynch, W. (2010). Online education: Meeting educational and workforce needs through flexible and quality degree programs. iJournal 24(72).  California Community Colleges. http://www.ijournalccc.com/articles/node/72

Betts, K. S. (2009). Charting new frontiers: A conceptual framework for online students in Drexel University’s master of science in higher education graduate co-op. Journal of Cooperative Education & Internships, 43(1), 17-31. ISSN: 1933-2130. http://www.ceiainc.org/journal.asp?PageID=214

Betts, K., Lewis, M., Dressler, A., & Svensson, L. (2009). Optimizing curricula and learning simulation to support a quinary career development model. Asian-Pacific Journal of Cooperative Education, 10(2), 99-119. ISSN: 1175-2882. http://apjce.org/volume_10/apjce_10_2_99_119.pdf

 

Contact(s) for this Effective Practice
Effective Practice Contact: 
Kristen Betts
Email this contact: 
kbetts@drexel.edu
Effective Practice Contact 2: 
Fred Loomis
Email contact 2: 
fdl23@drexel.edu
Effective Practice Contact 3: 
Bill Lynch
Email contact 3: 
wfl27@drexel.edu
Author Information
Author(s): 
Amber L. Vaill
Author(s): 
Peter A. Testori
Institution(s) or Organization(s) Where EP Occurred: 
Bay Path College
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

In order to ensure online learners are provided with the tools and skills they need to be successful, a proper orientation and ongoing support must be provided to all students. Bay Path College’s Center for Distributed Learning employs a dedicated Online Student Support Coordinator who is responsible for providing these services to online learners. This person provides integrated, single-point-of-contact support services and creates a proactive learning partnership with online students.

Description of the Effective Practice
Description of the Effective Practice: 

The level of training and support students receive from their educational institution can greatly affect their success in their courses and programs. At Bay Path College, we strive to provide an encouraging and supportive environment for all of our students. When we began offering fully online programs, it was clear that a comprehensive, accessible support system would be needed for our students and faculty. This need led to the establishment of the Center for Distributed Learning (CDL), an integrated IT and academic support organization on campus. To best meet the needs of new online students, the CDL developed an interactive student orientation course that is required of all online learners. When students are well-prepared, they tend to be more satisfied with their online learning experience, which translates to better retention rates and higher levels of student success. The orientation is facilitated and highly interactive, providing students with practice in using the LMS as well as information about how to be successful in an online learning environment.

To ensure that the ongoing support needs of our students are continually met, the position of Online Student Support Coordinator was created. This individual serves as the facilitator for the orientation course, and also acts as the first point of contact on campus for all online student support needs, creating a partnership with students to help them achieve their academic goals. This individual provides a wealth of support services including assistance with LMS-related technology support, assisting those who are struggling with online learning, and monitoring students as they transition from the orientation to their online courses, proactively assisting students where needed. Students can also rely on the Online Student Support Coordinator to answer other questions about the institution and point students in the right direction when they need other types of assistance, such as financial aid or registration questions. This allows the student to primarily interface with a single person for their support needs rather than having to keep track of whom to call for what type of assistance.

The combination of the orientation program and the services provided by the Online Student Support Coordinator has proven to be a valuable resource for the CDL. Since the Fall 2007 semester, nearly 1600 students have completed the Orientation to Online Learning course. A recent survey showed that 89% of students felt that the orientation experience was helpful in preparing them for their first online course. Our faculty also report greater student preparation in their online courses than they noted before the Online Student Support Coordinator position was created. This allows faculty to focus on the content of their courses, knowing there is a resource in place for students who need technical or online learning assistance. Online students also feel more connected to the campus; knowing that there is a “live” person they can call who will assist them with any questions or concerns they have throughout their time at the College. This helps alleviate the feeling of isolation from the campus community that can occur when students do not live within a close proximity to the campus.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

We are pleased with the successes we’ve seen to date with our efforts to support our online students. Surveys conducted by the Center for Distributed Learning indicate that faculty feel they can focus on the content of their course, rather than worry about the technology. They also feel that the Online Student Support Coordinator provides students with an ally who is there to assist them through any challenges they face from orientation to graduation. In comparing pre- and post-orientation survey data, our students indicate a 19% increase in their own perception of their readiness for online learning, and a 13% increase in their comfort level with using the LMS. Following completion of at least one online course, 92% of students felt they were highly successful in their first online course. Many of our students decide to go on and take additional online courses, and of those who do, 87% stated that the support services that are available to them at least somewhat influenced their decision to take additional online courses. Many of our online students (66%) also feel they are a part of the Bay Path campus community. In a recent survey, a student noted “I would have withdrawn from the course had he [the Online Student Support Coordinator] not been there to help me. I needed a great deal of help during the entire first month. He was patient, clear and available.” Surveys are conducted regularly in the Orientation course and the data is used to improve the program.

How does this practice relate to pillars?: 

This practices aligns with the Sloan pillars in many ways. In terms of access, this practice helps ensure that all students enter the online classroom prepared to learn. The orientation provides them with the skills they need to be successful, and the Online Student Support Coordinator provides the ongoing support that many students need. The program is scalable in that additional Coordinators can be added when growth and the number of students necessitates it. It is cost effective as the added tuition revenue generated far exceeds the additional salary costs that come with adding additional staff. Faculty and student satisfaction is high with this program. Faculty feel they have someone to assist their students with technical issues, and that there is someone else looking out for the well-being of their students. Students feel supported and feel like they are part of the campus community. They are prepared with the tools they need to transition to a new type of learning environment successfully, and this helps them reach their personal academic goals.

Estimate the probable costs associated with this practice: 

Following the initial development and implementation of the program, the only ongoing costs that are directly associated with this practice are the salaries for the Coordinators. The number of Coordinators will vary based on the number of online students at the institution and how much support those students need. Institutions with students that greatly take advantage of the Coordinator’s services will need to have a smaller student to coordinator ratio.

Contact(s) for this Effective Practice
Effective Practice Contact: 
Amber L. Vaill
Email this contact: 
availl@baypath.edu
Effective Practice Contact 2: 
Peter A. Testori
Email contact 2: 
ptestori@baypath.edu
Author Information
Author(s): 
Emily OConnor, Director of Library & Learning Resources
Author(s): 
Jennifer Stoker, Learning Center Manager
Author(s): 
BethMarie Gooding, Online Librarian
Author(s): 
Erin Lasley, Learning Center Manager
Institution(s) or Organization(s) Where EP Occurred: 
Rasmussen College
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

It is the mission of the Rasmussen College Librarians and Learning Centers Coordinators to provide a combined online and on-ground learning experience in which students gain an awareness of resources and opportunities for skill development. The objectives of each individual webinar are aimed at improving overall student success, while improving communication between students, faculty, and staff.

The ability to connect with students virtually is vital as our students come to rely on and expect information to be available in an online, asynchronous and synchronous, 24/7 accessible format. As a college with over twenty campuses in five states and a large online student population we sought to engage our learners with multiple live webinars occurring throughout the quarter. By leveraging the entirety of our library and learning center team across all campuses we are able to offer over forty diverse online live workshops utilizing the Wimba live classroom conferencing software. Our conferencing software allows live student interaction, assessment of learning through polling tools, and the capability to archive all of our workshops. Senecal and Gazda (2010), in synthesizing the work of Bower & Hedberg, (2010); Little, Passmore, & Schulllo,(2006); and McBrien, Jones & Cheng, (2009) found that preliminary data suggests that live online learning via webinars can increase student engagement through collaboration and contributions and improve overall student satisfaction. This method of connecting with students also allows for greater communication between the students, faculty, and staff of the school. Soulé (2008, p. 14) in Transforming School Communities emphasizes, "Web 2.0 tools are especially helpful in the three areas of transforming communications: advocacy, networking and collaboration." We strive to foster our student interaction within the Rasmussen community as we build our webinar series along with student opportunity to network with education professionals and their fellow students. In his theory of transactional distance, Moore (1997) argues that the distance between learners and teachers is less about the geographical location, but depends more on the interaction between learners and teachers, and the student's engagement in his/her own learning.

Through our Rasmussen College Library and Learning Center webinar series we are able to build a sense of community with our geographically dispersed student body. Enhanced virtual services allow comparable instruction when face-to-face service is not feasible. The results of piloting this webinar series since Fall of 2010 include a marked increase in the variety of workshops available to all students, ease of accessibility for online students with over 600 attendees in the first two quarters, and the enhancement of student engagement with fellow online students and with the team of library and learning center professionals.

Description of the Effective Practice
Description of the Effective Practice: 

The Library & Learning Centers team of Rasmussen College is comprised of librarians and learning center coordinators at each of our 22 physical campus locations, in addition to an Online Librarian and two Learning Center Managers who provide support for our students using online resources and services (over 80% of our seats are online).  In Fall Quarter, 2010, the team came together and developed a collaborative schedule of 30+ webinars on a variety of library & learning center topics, including study skills, research, academic writing, and citation style.  Two team members were assigned to each webinar: one to develop content or secure a speaker on the topic; the other to manage the webinar room (Wimba software) and track participation in the live session and subsequent links to the archive.  By collaborating to develop a set of webinars, we eliminated duplication of workshops at the physical campuses and provided flexible opportunities for our students to participate.  Workshops were marketed via on-campus advertisements, online advertisements, Facebook updates, e-mail announcements, and online Course announcements uploaded via instructors.

Content in Fall and Winter Quarter followed a standard webinar format, typically consisting of a presentation (designed in PowerPoint and uploaded in the webinar room), supplemental handouts sent to participants via e-mail, and live lecture/discussion.  Several speakers made use of the interactive tools available in the webinar room, such as polling, to engage participants and adminster formative assessment.  In Summer Quarter, two team members piloted the use of break-out rooms to create a group-work setting: students were asked to bring their assignments to the groups for constructive criticism and improvement.  It was also our first attempt at requesting advance sign-up for the webinars; and while few students signed up (less than 40 for each), over 50% of those who signed up did particupate.

As we progress into Fall Quarter, we have organized Webinars into tracks (Computer Skills, Career Skills, Research, Learning Skills, New Students, Math, Writing, APA, Finance & Budgeting) in the hopes of simplifying marketing for our faculty and directing specific tracks to the students who need them the most.  Additionally, we are exploring newer technology, including LibCal, to provide a place where students can see the workshops offered and register at the same time.  These efforts, combined with peer review and development of webinar presentation skills will elevate our webinars to improve student engagement and, ultimately, learning.

 

 

 

 

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

Effectiveness is measured by a combination of means:

Attendance - Attendance was counted in two ways: 1) Participants attending a live session; and 2) Individuals clicking on and watching the archive of the webinar session.  In Winter & Spring Quarters, we logged over 400 attendees, and are tracking over 200 participants thus far for Sumer Quarter.

Satisfaction - The teams built a satisfaction survey using Survey Monkey to rate specific components of content and presenter effectiveness, as well as overall effectiveness of the workshop in which the individual participated.  92.1% of attendees rated the workshop as "Excellent or Very Good", with only a 1.2% rating of "Fair or Poor".  Participants were also encouraged to provide comments:

"Keep on doing what you do because it was great and very helpful for students!"

"everything was what i needed to know on how to write a great paper."

"I really wish that this workshop was available to me in my first quarter not when I am almost done. This information is so helpful and useful I was amazed, almost made typing APA style papers EASY! I think this seminar should be for EVERY student in their first quarter just as much as in their last."

Peer Review - in Summer Quarter, our Library & Learning Center Assessment Committee developed a Peer Review rubric specifically for webinar evaluation.  Online instructors, deans, and team members participated in observing several workshops throughout the quarter, and then sent the feedback to the speaker and to the Director of Library & Learning Resources for documentation purposes.  While the rubric ratings & feedback are designed to help the presenter improve his/her technique for future webinars, the reviewer was also asked to rate whether or not the webinar should be offered in future quarters, and comment on proposed changes to format & content.

Formative Assessment/Work Product: Because student attendance is not mandated at webinars, nor tied to a specific course or assignment, formative assessment is difficult to implement and track.  However, several presenters had success using the "polling" tools in the webinar technology to gauge learner understanding of objectives.  Additionally, when we transitioned to the small-group work sessions on writing assignments, we were able to clearly denote which students were able to make changes to their content based on instruction during the webinar, and which had additional questions and required follow-up.  While this is our greatest challenge area, it is our goal to specifically improve and continue to integrate more opportunities for formative assessment into each webinar, as this is the most effective way to guage the quality of the webinar experience for the student.

Faculty Satisfaction: Our measures of faculty satisfaction (based on their perceptions of effectiveness related to students' classroom success) are anectdotal, at best.  We consult with faculty during the planning stage to garner suggestions for changes to webinars or additions; we also seek out faculty to serve as speakers.  Faculty feedback also drove the changes to our marketing for Fall Quarter, 2011: specifcally, the move to organizing and marketing webinars by track.

How does this practice relate to pillars?: 

Access: Whereas a traditional library or learning center workshop is campus based or limited to classroom participants, this Webinar Series is broadly accessible by all students, faculty & staff; is scheduled for student convenience; and is archived for later viewing for those unable to attend live.

Faculty Satisfaction: In this practice, the faculty in question are primarily librarians and learning center coordinators.  By collaborating jointly on a webinar series, librarians and learning center coordinators share responsibilities for creating and delivering instruction, rather than having to manage the responsibility individually.  Additionally, partnering to provide support during the live session allows the primary presenter to focus on instruction & engagement while the support presenter manages the room setup, technology, and attendance statistics.

Learning Effectiveness: 97.6% of students agree or strongly agree that workshop content will be useful for their class assignments; 90.5% of students agree or strongly agree that the workshop will be useful for the student's program or career.  Additionally, students who completed formative assessment during workshops showed evidence of understanding and integration of learning objectives into their knowledge base.

Scale: Because we are using a webinar tool, in-house speakers and content created by the library & learning center team, travel and resource production costs are nearly $0 per student.  As our enrollment grows, we can expand our webinar offerings or heavily market current offerings & archives to manage participation swell.

Student Satisfaction: As indicated in both webinar attendance and satisfaction survey results, the majority of our students are highly satisfied with the webinar content and the means that the content is delivered.

Equipment necessary to implement Effective Practice: 

Webinar Software (Wimba; WebEx; GoToWebinar; Adobe Connect)

Scheduling Database (Excel is a cost-effective organization & tracking tool)

Survey Tool (Survey Monkey)

Calendar/Registration Software (LibCal; useful but not required)

Estimate the probable costs associated with this practice: 

Webinar License costs vary by institution type and size.  There are some online tools that cost as little as $25 per month.

LibCal software is currently available in a free version.

All other tools for this webinar (beyond Human Resources) are free.

References, supporting documents: 

Senecal, J., & Gazda, R. (2010). Harmonizing the Virtual Choir: Interactive Synchronous Webinars for Online Education. Journal of Interactive Instruction Development, 21(3), 13-16. Retrieved from http://www.salt.org/salt.asp?ss=l&pn=publications

Soulé, H. (2008). Transforming School Communities. Learning & Leading with Technology, 36(1), 12-15. Retrieved from http://www.iste.org/learn/publications/journals.aspx

Contact(s) for this Effective Practice
Effective Practice Contact: 
Emily O'Connor
Email this contact: 
emily.oconnor@rasmussen.edu
Effective Practice Contact 2: 
BethMarie Gooding
Email contact 2: 
bethmarie.gooding@rasmussen.edu
Effective Practice Contact 3: 
Erin Lasley
Email contact 3: 
erin.lasley@rasmussen.edu
Award Winner: 
2011 Sloan-C Effective Practice Award
Author Information
Author(s): 
David Wicks
Author(s): 
Andrew Lumpe
Author(s): 
Henry Algera
Author(s): 
Kris Gritter
Author(s): 
Helen Barrett
Author(s): 
Janiess Sallee
Institution(s) or Organization(s) Where EP Occurred: 
Seattle Pacific University
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

 Web 2.0 technology, such as blogging, allows for locally developed, cost effective, and holistic alternative portfolio assessment systems. By enhancing critical reflection and fostering social interaction, blogging portfolios are seen as an integral learning tool for all students enrolled in a university program.

Description of the Effective Practice
Description of the Effective Practice: 

 As Ellis (2001) noted, metacognition is simply thinking about thinking. Metacognition in practice can serve as, "the critical revisiting of the learning process" (Georghiades, 2004, p. 171). Critical reflection, as a form of metacognition, occurs when learners construct their own narratives based on learning experiences and professional practice. As applied to professional practices, approaches that support the examination of beliefs that emerge from these practices promote the development of more flexible and intentional approaches to effective teaching and learning (Sockman & Sharma, 2008).  

 

Web 2.0 systems (O'Reilly, 2005), including blogs and social networks, are proposed as effective online vehicles for fostering critical reflection and feedback (Godwin-Jones, 2008). These systems can act as a form of an electronic portfolio (ePortfolio) which can serve the dual role of personal reflection and program evaluation (Barrett, 2009; Yang, 2009). Blog portfolios, or bPortfolios, are one form of electronic portfolios well suited for enhancing the professional learning of teachers (Lumpe, Wicks, & Williams 2011; Wicks, 2009; Tan, 2006). The following characteristics of bPortfolios enhance critical reflection: 

 

  1. Social interaction – Students share their learning reflections in an open format. 

  2. Developmental - The reverse chronological order of posts shows learning growth.  

  3. Organization - Categories and tags allow students to classify their reflections. 

  4. Autonomy - Students have ownership of their personal content management system.  

  5. Reflective - Students consider which standards are being addressed and what key words best describe the post.  

  6. Digital citizenship - Students practice using social media to enhance digital reputations (Chaplin, 2011). 

 

Barrett (2009) described how electronic portfolios can capture both the process and product of learning over time. The portfolio can be used as a workspace to document ongoing learning (process) and as a final showcase of achievements during a program (product). She proposes using blogging tools for such portfolios 

 

Up until 2009, Seattle Pacific University was using a commercially available electronic portfolio system. In addition to being rather costly, this system did not enhance aspects of critical reflection (see Chaplin’s list above), was cumbersome, and was perceived by students and faculty as a hoop to jump through in order to graduate. A more holistic approach that fostered both the process and product side of electronic portfolios was sought. A switch to bPortfolios using the freely available WordPress blogging tool (www.wordpress.comwas implemented by SPU’s School of Education beginning in 2009 

 

Programs using bPortfolios include the following: undergraduate teacher education, Masters of Arts in Teaching, Masters of Teaching Mathematics and Science, and Masters of Education in Curriculum and Instruction. Early during a degree or certification program, students sign up for a personal account on WordPress and set up a professional bPortfolio. The following screencasts are designed to help with bPortfolio setup: 4 Steps to Set up Your bPortfolio and 10 Questions about bPortfolios. 

 

bPortfolio Example 1

 

bPortfolio Example 2

bPortfolio Example 3

 

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

Since 2009, 113 bPortfolios were created by Curriculum and Instruction (C&I) Master’s degree students. These students are practicing K-12 teachers who already held teacher certification. On average, C&I students made 46 blog posts including formative course reflections and summative meta-reflections. For the students completing this program in 2011 (the first group required to maintain a bPortfolio), the bPortfolio passing rates ranged from 89 – 95% for each of the 12 program standards with the average overall passing rate being 93.1%.   

Since 2009, there were 236 bPortfolios created by teacher certification students from both graduate and undergraduate programs. On average, certification students made 95 blog posts including formative course reflections and summative meta-reflections. The number of reflective posts by certification students is twice the amount made by non-certification students possibly due to the high stakes nature of state standards for certification. In end of program evaluations, one student describes how the bPortfolio served as a holistic tool for documenting her growth.  

I felt that there was little duplication (of performance assessment data) as the bPortfolio is so much more comprehensible. The performance assessment material served as evidence in some of the bPortfolio sections, but the bPortfolio paints a more complete picture of our skills and experience. 

 

A research study on student use of bPortfolios tags was recently conducted (Lumpe, Wicks, & Williams, 2011). The most used blogs tags were compiled, and it was noted that they represented the key themes from the students' degree programs. Due to the high stakes nature of state standards, certification students made almost twice as many more blog posts than students in non-certification programs. Students averaged about 3 tags per post and used about 40 unique tags. Students self-annotated reflective posts with a wide variety of tags. The tags co-occurred and clustered together to annotate similar blog content. Tag phrase use can significantly predict group membership (certification vs. non-certification).

 

 

How does this practice relate to pillars?: 

 There is a strong interrelationship among the pillars of learning effectiveness (above), access, scale and student satisfaction.

Access. Since basic WordPress accounts are free of charge, all students are able to create and publish to their bPortfolio while enrolled in the School of Education. Students document their progress through a degree program by using their bPortfolio in numerous on-campus and online courses and/or during their field experiences. In this way, the bPortfolio is an integral learning tool for all students while enrolled. One particularly beneficial aspect is that students may then continue to maintain their site upon completion of the program as their individual accounts are not registered on a university server. In an online course discussion, one student describes why he likes having his work stored in the cloud (WordPress.com).
 
"I am glad that my work is in a central location and that I can build on it. I think I have old papers from my undergrad work, but they are stored away. Now, if I need to reference materials I used in this course, I can go right to my bPortfolio."
 
Scale. The university can focus its time and efforts on improving instruction and student support for the bPortfolio rather than allocate funds and personnel to web-hosting, software upgrades, and software support, etc. in the bPortfolio project. In this manner, the bPortfolio is a highly cost effective approach to supporting reflective practice.
 
Student Satisfaction. Faculty have been able to use student survey feedback to improve the bPortfolio experience for their students. As a result, student satisfaction in using bPortfolios continues to improve. Students in one graduate teacher certification program were asked to rate their overall satisfaction in using the bPortfolio on a scale of 1 (very dissatisfied) to 7 (very satisfied) upon completion of their one-year program.
 
Results indicate increased student satisfaction between the initial year of implementation (2009-2010; N=43) and the second year (2010-2011; N=40) on the following five aspects:
 
Aspect:
2009-2010
2010-2011
The usefulness of the bPortfolio site as a resource for feedback and professional growth.
4.372
5.205
The ease of maintaining a bPortfolio site on a regular basis.
4.395
5.526
The educational value of a regular blogging requirement in the certification program.
4.326
5.211
Using the bPortfolio as a communication tool with instructors, coordinators and fellow students.
3.860
4.725
The overall bPortfolio preparation and assessment process (e.g. drafting a meta-reflection, gathering evidence, receiving scores and feedback, etc.)
4.093
4.718
 
In an online course discussion, two students share their satisfaction with creating a bPortfolio. They also share how it helps them assess their learning and produce higher quality of work.
 
"I have really enjoyed posting each week on our bPortfolios. I have to say I thought I would hate it because this is my first ever experience in blogging of any kind. Having this bPortfolio has been a great way to share what I am learning and help me assess my own learning. Writing the blog each week has helped me get excited about what I am learning and is a great way to practice my summarizing skills. I hope to expand my use of the bPortfolio throughout these next two years at SPU. I vote yes for e-portfolios and classroom blogs to make learning more holistic and collaborative."
 
"We kept seeing over and over in our materials through out the course that students create better work when they know the public can see it. I agree that the use of bPortfolios, blogs, and other public tools motivate students to produce a more polished product. I also love that so many tools reference students assisting one another and contributing ideas. Education shouldn't be just a one directional practice with the teacher educating the students. Our educational institutions should allow learning from all direction."
 
 
Equipment necessary to implement Effective Practice: 

 Students only need access to a web browser and a freely available WordPress.com account. Faculty only need a browser to access student bPortfolios. 

 

Estimate the probable costs associated with this practice: 

Since WordPress accounts are free of charge, there are few costs involved. Students are charged a onetime $60 institutional fee to help cover the costs of ongoing training, support and portfolio assessment. 

References, supporting documents: 

 

References
 
Barrett, H. (2009, August 23). Balancing the Two Faces of E-Portfolios. Retrieved from
 
Chaplin, H. (2011, November 23). The future of reading and writing is collaborative. Retrieved from http://spotlight.macfound.org/featured-stories/entry/the-future-of-reading-and-writing-is-collaborative/
 
Ellis, A. K. (2001). Teaching, Learning, and Assessment Together: The Reflective Classroom. Poughkeepsie, NY: Eye on Education.
 
Georghiades, P. (2004). From the general to the situated: Three decades of metacognition. International Journal of Science Education, 26(3), 365-383.
 
Godwin-Jones, R. (2003). Blogs and wikis: Environments for on-line collaboration. Language Learning & Technology, 7(2), 12-16.
 
Lumpe, A.T., Wicks, D., & Williams, T. (July, 2011). bPortfolios: Blog Portfolios and Self-Tagging as Reflective Practice for Teachers. A paper presented at the Sloan-C International Symposium on Emerging Technology Applications for Online Learning, San Jose, California.
 
O'Reilly, T. (2005, September 9). What is web 2.0 - Design patterns and business models for the next generation of software. O'Reilly Media, Retrieved from http://oreilly.com/pub/a/web2/archive/what-is-web-20.html
 
Sockman, B. R., & Sharma, P. (2008). Struggling toward a transformative model of instruction: It’s not so easy! Teaching and Teacher Education, 24(4), 1070-1082.
 
Sun, A., & Datta, A. (2009). On Stability, Clarity, and Co-occurrence of Self-Tagging. A paper presented at the 2nd ACM International Conference on Web Search and Data Mining, Barcelona, Spain.
 
Tan, Ashley (2006). Does Scaffolded Blogging Promote Preservice Teacher Reflection? Examining the Relationships Between Learning Tool and Scaffolding in a Blended Learning Environment (unpublished doctoral dissertation). Indiana University, Bloomington , IN.
 
Wicks, D. (2009, April 17). Coining a new term - bPortfolios. David Wicks: Educational Technology. Retrieved 28 September, 2011 from https://dwicksspu.wordpress.com/2009/04/17/coining-a-new-term-bportfolios/
 
Yang, S.-H. (2009). Using Blogs to Enhance Critical Reflection and Community of Practice. Educational Technology & Society, 12 (2), 11–21.
 

 

Supporting Documents

The following screencasts were developed and recorded by the university's Instructional Technology Services department as training tools for students and faculty:
 
Faculty in the teacher certification programs developed their own blog to serve as a template for student organization of their own bPortfolios – http://spurescert.wordpress.com (2009-2011) and http://sputeacher.wordpress.com (2011-2012).
 
Faculty in the Curriculum and Instruction program developed a sample blog as a training tool for students as they set up their bPortfolios - http://spubportfolio.wordpress.com.
 
A brief executive summary of the bPortfolio process was developed by faculty and is used as a training document for both faculty and students - http://www.spu.edu/depts/soe/documents/bPortfolio-Executive-Summary.pdf.
 
A description, a scoring rubric used by faculty for evaluation, and a timeline of implementation of bPortfolios in teacher certification can be found on pages 79-83 of the Residency Teacher Certification Handbook - http://www.spu.edu/depts/soe/documents/2011-12ResCertHandbook.pdf.
 
Useful Links
Examples of Student bPortfolios
     http://hamiltonlauren.wordpress.com/ (Masters of Arts in Teaching student)
     http://susancarlsonsbportfolio.wordpress.com/(Curriculum and Instruction Master’s student)
     http://rollis1.wordpress.com (undergraduate teacher education student)
Contact(s) for this Effective Practice
Effective Practice Contact: 
David Wicks
Email this contact: 
dwicks@spu.edu
Effective Practice Contact 2: 
Andrew Lumpe
Email contact 2: 
lumpea@spu.edu
Effective Practice Contact 3: 
Henry Algera
Email contact 3: 
halgera@spu.edu