Scale

SCALE is the principle that enables institutions to offer their best educational value to learners and to achieve capacity enrollment. Institutional commitment to quality and finite resources require continuous improvement policies for developing and assessing cost-effectiveness measures and practices. The goal is to control costs so that tuition is affordable yet sufficient to meet development and maintenance costs -- and to provide a return on investment in startup and infrastructure. Metrics may compare the costs and benefits of delivery modes by discipline and educational level; faculty salary and workload; capital, physical plant and maintenance investments; equipment and communications technology costs; scalability options; and/or various learning processes and outcomes, such as satisfaction levels and retention rates. These types of comparison enable institutions to: develop better strategic plans for market demand and capture; achieve capacity enrollment; develop brand recognition; and secure long-term loyalty among current and prospective constituents. Practices for scale help to leverage key educational resources while offering new online learning opportunities to students and faculty.
Collection: 
Student-Generated Content
Author Information
Author(s): 
Dr. Kjrsten Keane
Author(s): 
Dr. Miriam Russell
Institution(s) or Organization(s) Where EP Occurred: 
SUNY Empire State College
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

A mentor and writing coach connected via Cloud Conferencing with a disabled student for a case study to complete a course writing assignment. Technical challenges, physical disabilities, and geographic distances impacted the process. Google Docs, an app in the Cloud, ultimately helped to reduce transactional distance and support positive collaboration, resulting in stronger writing skills and Cloud savvy.

Description of the Effective Practice
Description of the Effective Practice: 

The overall collaboration process focused on using Google to help the student self-edit. After seeking guidance and approval on content from mentor and coach through email and voice chat, the student used voice-to-text software to submit his drafts for review. The writing coach and mentor used Google Docs to highlight and comment on the student’s work, emphasizing his strengths. Their role was not to edit the document, but to encourage autonomy by highlighting problems like spelling or grammatical errors for him to fix on his own and notify the writing coach when complete. A conference call was then set up, involving two of the parties connecting via Google voice chat and the third participating using a speaker phone (cell or land line). This combination evolved after numerous technical glitches arose attempting a three-way Google voice chat. All team members could view the document online, make changes, and discuss them. Each participant had their own cursor to locate and edit discussed text, literally placing them on the same page making changes in full view of each other’s input. The process is comparable to having three people in the conferring in the same room, but with the ability to make changes in a single document that are automatically saved every few seconds.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

As a result of the Google-based collaboration, the student completed a rationale essay and degree plan ready for submission to the Office of Academic Review (OCAR). All degree plans and essays are reviewed by a faculty committee and given a complete technical review by OCAR staff in order to be approved. The student’s plan was ultimately approved.

The team learned to navigate technical hurdles and utilize many collaborative technologies offered in the Cloud. The skills that were introduced and in some cases mastered will be used by team members in future educational transactions. Ultimately, this case study is a story of how a disabled student struggled to find the best way to communicate at a distance with his mentor and writing coach. The emerging Cloud technology provided a vehicle for the student to gain writing skills, confidence and develop a strong relationship with his mentors.

All team members have been using the technology to collaborate with others personally and professionally since the initial collaboration, and the mentor and writing coach have started to collect data related to the impact of Google-based collaborations on the writing process. Possibilities for future studies include analysis of student-writing coach interactions as well as writing collaborations between colleagues in the Cloud.

How does this practice relate to pillars?: 

Access: Google services are offered free to anyone with a Google/Gmail account. They are easily accessed online in a format familiar to most Web users.

Faculty Satisfaction: The two faculty involved in the collaboration were pleased with the ability to connect with a student, decrease transactional distance, and improve writing skills in a free and familiar setting. They have been using the technology to collaborate in other ways (personally and professionally) since being introduced to Google Docs at the start of this case.

Learning Effectiveness: The student successfully completed the course writing assignment with guidance completely online. The mentor/coach guidance facilitated the student’s autonomy in his global choices of courses as well as the focus of his writing. The collaboration resulted in an essay that was ready for submission to the school’s Office of Academic Review and ultimately approved.

Scale: Free service with a Google/Gmail account.

Student Satisfaction: The student in our case introduced the technology, having benefitted from the capabilities offered there in the past. He was pleased to both inspire our use and have the assistance it offered to create his writing assignment independently while receiving clear guidance when needed. He continues to use the technology to work with other course instructors, his writing coach, friends, and family.

Equipment necessary to implement Effective Practice: 

● Email: originally institutional accounts were used, but eventually Gmail addresses were exchanged for the purposes of using Google technologies.
● ANGEL online learning platform: the institutional platform housed course information for Ian’s degree planning class and provided its own course mail communication option.
● Online degree planning resources: several institutional websites offer additional degree planning links and descriptions of the process.
● Cell phone: all team members exchanged and used cell phones to communicate at some point during the process.
● Land line phone: the mentor and writing coach each utilized a land line speaker phone at some point during the process to hear and contribute to the conversation on Google voice.
● Google voice: provided the means for two team members to verbally communicate without using a phone.
● Google chat: provided back-up verbal communication between one phone and one computer when Google voice seemed to have technical problems.
● Google Docs: provided advanced word processing capabilities, housed the main document, tracked edits and comments, and allowed all team members to view each other’s contributions.

Estimate the probable costs associated with this practice: 

Technology is free to access with a Google/Gmail account.

References, supporting documents: 

Bensen, R., & Samarawickrema, G. (2009). Addressing the context of e-learning: using transactional
distance theory to inform design. Distance Education, 30(1), 1-21.

Bukvova, H., Gilge, S., & Schopp, E. (2006). Enhancing the framework for virtual collaborative learning:
Comparison of two case studies. Working Papers on Information Systems (in Sprouts): http://sprouts.aisnet.org/606/1/2006_03_Bukvova_Gilge_Schoop_EDEN.pdf

Ghosh, U. (2011). Teaching with emotional intelligence in online courses. Sloan Consortium ,

Johnson, S. (Ed.). (2007). The neuroscience of the mentor- learner relationship. San Francisco:
Jossey-Bass.

Moore, M. G. (2007). The handbook of distance education (2 ed., pp. 89-198). Mahwah, NJ: Lawrence
Erlbaum Associates.

O'Hanlon, C. & Schaffhauser, D. (2011, November). Diving into the cloud. Campus
Technology, 25(3), 25-31.

Oliver, R., & Herrington, J., (2003). Exploring technology-mediated learning from a pedagogical perspective.
Journal of Interactive Learning Environments, 11(2), 111-126.

Roufaiel, N. (2009). The power of socratic art and online learning. Webinar, Center for Distance Learning,
SUNY Empire State College .

Other Comments: 

Revised version of earlier submission

Contact(s) for this Effective Practice
Effective Practice Contact: 
Kjrsten Keane
Email this contact: 
kjrsten.keane@esc.edu
Effective Practice Contact 2: 
Miriam Russell
Email contact 2: 
miriam.russell@esc.edu
Author Information
Author(s): 
Joyce M. Kincannon
Institution(s) or Organization(s) Where EP Occurred: 
Center for Teaching Excellence, Virginia Commonwealth University
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

The Online Learning Summit was the first of its kind for our campus. The Summit was a forum for identifying, sharing and discussing key issues about teaching and learning online. For a day, we invited the several cohorts of faculty who have been engaged in the Center’s programs to join other campus faculty experienced in teaching online to discover what they’ve learned to be effective practice. The event was planned to be the beginning of a knowledge exchange that is collaborative, interdisciplinary, and oriented to the improvement of practice. Before the Summit event, the eight position papers were posted at the Summit website so participants could read and comment ahead of time. During the Summit, the keynote speaker and eight faculty presented ideas about effective practice and then moderated a series of roundtable discussions with faculty participants. We ended the day with a reflection exercise about personal learning. We hope to continue the dialogue through a bi-weekly Online Showcase of courses through the academic year and plan the second conference for next Spring. http://wp.vcu.edu/online-learning-summit/

Description of the Effective Practice
Description of the Effective Practice: 

The uniqueness of this first online learning conference was its intent. We felt that even though many faculty had been teaching online for several years, there was no organizing office or unified policy around online teaching at our University except those within departments and programs. Our University is beginning to focus on online programs with support and mission. It was time to describe the nature of quality online teaching for our campus by our own people with experience. We wanted to give our faculty the opportunity to have a dialogue about quality online teaching among those who have been teaching and those who are beginning to teach in this environment. The basis of teaching online is building community. This conference was meant to begin building our own campus community of online practitioners by the simple means of sharing ideas around a table and a meal. The value of the conference is that the faculty were heard and their experience validated as important information to share. The questions posed for this first Summit were:

• What shifts in practice seem most important for those new to teaching online?

• How does instructor role and identity change as one begins to transition to the online environment?

• How are notions of “teaching online” reshaping expectations for faculty workload?

• What role should professional development play in preparing faculty to teach effectively online? • What resources are necessary to best support faculty members who are in the process of making the transition to online teaching?

• What constitutes effective teaching practice in the online environment?

• What role does / should digital technology play as an element constituting effective practice online?

• How should effective or exemplary online teaching practice be demonstrated and evaluated?

• What practices are essential for supporting online learning regardless of discipline or content?

The papers presented were responses to these questions from these faculty's personal teaching experience. After the positions were presented, we spent an hour discussing them at tables. The moderators took notes. These notes will be summarized as part of the proceedings and posted to the Summit website. These Proceedings and the papers will be available for print.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

The initial evidence of need was that registration was full with a wait list two weeks before the event. People apologized if they had to change their plans. Participants were asked by email to evaluate their Summit experience and make suggestions of ways to continue the dialogue through the following academic year and to improve the next Summit. Approximately a third of the participants responded. Some comments

“Thanks for time well spent – I feel enriched and enthusiastic about online teaching. Thanks also for feeding us and the coffee mug to take with us, too.” and

“It was a great chance for faculty from all different disciplines to get together and interact, which does not happen that often. Being able to spend time reflecting with those at our individual tables was a really good way to look at things from many perspectives."

 Brief notes from the table moderators:

-Online can be more social than Face-to-face

-Low participation if Discussion not graded

-Balance Content with interaction in the online setting

-Tension with students being self directed in an online course when they are paying 10-15 k to be directed and told

-Design for accessibility at the beginning

-Thinking about motivation for Online students (positive feedback for students)

-Support for technology use in teaching online is significant

-“Mind shift” for online is not obvious (new online practices are unclear)

-Building an Online Persona (who do you want to be online?)

-Online teaching is more challenging (increased availability)

**Required Training for faculty members teaching online. (Baseline, Universal Principles, Best Practices. The summary report of moderator notes and evaluation comments is being compiled for the Proceedings.

How does this practice relate to pillars?: 

Learning Effectiveness:

Sharing conversation among faculty focused on teaching experience will surface good ideas and lessons learned so that faculty learn from each other how to "take advantage of the unique characteristics of online environments." Faculty new to the online experience hear that online courses can be quality.

Scale and Faculty Satisfaction:

By supporting the event and a simple meal, the University commitment to faculty learning about effective online teaching was recognized. Bringing the keynote speaker with 15 years experience to speak about effective practice indicated a change in focus from the administration's perspective. Faculty are more willing to engage in faculty development events related to teaching online when their time commitment is recognized. Some departments noted attendance for the event to assure faculty were credited with being involved.

Equipment necessary to implement Effective Practice: 

The room we used seated 96 people at tables for 8 and was no rental cost since it was part of the Student Commons except for the technology support fee. The technology was the usual computer, projector, mics, and internet connection. People brought their own devices to follow along with Twitter.

Estimate the probable costs associated with this practice: 

We used a budget of $5000. The keynote fee and travel expenses plus the breakfast, snacks, and lunch for 96 people were the basic costs. We bought each participant a branded cup to remind them of their connection to this new online community. The event could be well done without the cost of a keynote. We could have gotten by with less cost if we had not offered the simple breakfast but we felt the food was well appreciated. The working lunch made it possible to keep the conversation going.

Contact(s) for this Effective Practice
Effective Practice Contact: 
Joyce M. Kincannon
Email this contact: 
jmkincannon@vcu.edu
Collection: 
Vendor EPs
Author Information
Author(s): 
Dr. Mark Sarver, eduKan
Author(s): 
Jeffrey Maynard, Biometric Signature ID
Institution(s) or Organization(s) Where EP Occurred: 
eduKan online course management for a consortium of 6 Colleges in Kansas - Pratt Community College, Barton Community College, Garden City Community College, Seward County Community College, Dodge City Community College and Colby Community College
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

eduKan manages the online courses for a consortium* of 6 colleges in Kansas and wanted to reduce proctoring costs and deter online cheating while meeting verification regulations for distance education as required by the Department of Education and their regional accrediting agency. Dr. Sarver worked with the team at Biometric Signature ID (BSI) and Pearson to pilot test BioSig-ID(TM) as part of the LearningStudio authentication process since BSI’s technology matched eduKan’s needs versus other webcam-based, hardware intensive technologies. The pilot ran from March-April, 2011 with 174 students from multiple classes using BioSig-ID(TM) to authenticate their identity 6 times before their final exam. There were 6,300 verifications and only 9 help desk calls during the trial period. eduKan conducted a survey after the pilot ended and found that 97% of the students preferred BioSig-ID(TM) to finding a proctor or driving to a facility for physical proctoring while 94% of them had a positive experience with the verification process. The final results of the pilot including the survey and cost analysis proved that the BSI technology would more than meet their goals. The faculty and administration were also very positive about their user experience making it a “win-win.” The outcome has been impressive and has allowed eduKan to achieve their goals of reduced costs, increased compliance, dramatically lower student fees to help gain a competitive advantage, and ensure academic integrity. eduKan now meets and exceeds the requirements for verification of online student identities and can be confident that the same student who submits assignments, takes exams, and earns a final grade is the same one who enrolled in that course and has received financial aid. *Pratt Community College, Barton Community College, Garden City Community College, Seward County Community College, Dodge City Community College and Colby Community College.

Description of the Effective Practice
Description of the Effective Practice: 

Since eduKan’s courses required physically proctored exams and other gradable events such as discussion/participation groups and quizzes, they wanted a technology that could be used for all gradable events and meet the online student’s needs by keeping the experience online. eduKan wanted to find an online student ID verification solution that would not limit them to a single point in time but allow them to make student verification a continuous process. eduKan also wanted to have the ability to challenge their student’s identity randomly during each course to ensure their Academic Integrity was not being compromised by growing their online course offering and enrollment as this verification process would also work to deter students from cheating online. eduKan rolled out the BSI solution to all of their online students in May 2011 as their student ID authentication system. BioSig-ID(TM) has now replaced most of their physical proctoring, is used for all other gradable events, ensures compliance, and provides random periodic challenges to the students to deter cheating. eduKan administrators and instructors can access BSI’s audit trail and reporting tool to review student verifications, monitor re-set requests, compare success ratios to identify and confirm any suspicious activity during the verification process. The use of BioSig-ID(TM) ensures eduKan’s compliance issues are met or exceeded today and for the foreseeable future.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

The results for this report were collected from May – December 2011 involving over 1800 students (eduKan now has over 4,500 students enrolled online using this technology while being managed by a staff of six employees). The outcome has been impressive and has allowed eduKan to achieve their goals of reduced costs, increased compliance, dramatically lowered student fees to help gain a competitive advantage, and ensured academic integrity. As a result of this technology innovation, eduKan is also now benefiting from: 1) Proctoring operational cost reduction by 80% in faculty / staff time and physical management expense by eliminating most physical proctoring (8,000 + hours on average / per year saved) 2) Eliminating proctoring costs for students - $38 per proctored exam / $380 per year average 3) A fixed fee for *unlimited* student ID authentications - under $15 per student per year 4) Ensuring our student's privacy with the only biometric that can be revoked and reissued 5) 94% positive user experience 6) Low support needs and ease of deployment to our growing student enrollments (of 25% a term) as BSI can be used on any system, tablet, smart phone, Android, Mac or PC, Flash or HTML5 without installing any additional software or hardware 7) 3rd party testing proving technology to be 99.97% accurate in keeping impostors out

How does this practice relate to pillars?: 

The outcome has been impressive and has allowed eduKan to achieve their goals of reduced costs, increased compliance, dramatically lowered student fees to help gain a competitive advantage, and ensured academic integrity.

*Access: *

eduKan is able to keep online, distance education "online" without creating further burdens for students and faculty as it relates to proctoring or student ID verification.

*Faculty Satisfaction:*

eduKan is able to keep the staff focused on managing student enrollments and proactively managing student ID verifications to ensure cheating is reduced and eliminated while keeping academic integrity preserved for their institution.

*Learning Effectiveness:*

eduKan will be able to provide more courses and keep fees low for their students and allow students to "learn" online day or night without having the burden of travel, time and un controlled expenses for proctored events; while protecting their privacy.

*Scale:*

The BSI software solution does not require any software or hardware installation on any users system and is compatible with all technologies students use to access the Internet and their Pearson LMS login from smart phones, tablets, laptops and desktops. It is very user friendly and does not have the same level of support other options require.

*Student Satisfaction: *

Students surveyed overwhelmingly preferred the BSI technology to physical proctoring and 98% had a positive experience in using the technology for ID verifications.

Equipment necessary to implement Effective Practice: 

The BSI software is currently available in Pearson LearningStudio, BlackBoard as a BuildingBlock, Moodle and Moodleroom LMS systems. The institution would work with BSI to turn on the capture / reporting database and use their "install-in-a-box" documentation and 3 minute "how-to" video to inform and educate staff and students, for the roll-out. No other hardware or software is required for students / users and can be used on any system, tablet, smart phone, Android, Mac or PC, Flash or HTML5.

Estimate the probable costs associated with this practice: 

Less than $20 per student per year for unlimited verifications. Compare to proctored exams at an estimated cost of $38 per exam and 8-10 exams a year.

References, supporting documents: 

Attached white paper and results from surveys.

Contact(s) for this Effective Practice
Effective Practice Contact: 
Mark Sarver, Ph.D
Email this contact: 
marks@edukan.org
Effective Practice Contact 2: 
Jeff Maynard
Email contact 2: 
jeff.maynard@biosig-id.com
Effective Practice Contact 3: 
Leslie Mason
Email contact 3: 
LeslieM@edukan.org
Author Information
Author(s): 
Dr. Jeff Stewart, Dr. Marti Venn, Dr. Barry Monk, and Dr. David Davis
Institution(s) or Organization(s) Where EP Occurred: 
Macon State College, Macon, GA
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

As institutions are being held more accountable for student retention, progression and graduation rates, administrators continue to seek ways to understand what factors are included in the on-going effort to increases rates in all three of these areas. The effective practice shows how one medium sized public institution (approximately 60 00 students) uses data analytics to improve student retention, progression, and graduation rates by driving decision making at the institutional level that pertains to budgeting, programs, and course retention. The practice looks at: * initial evidence * the decisions made based on the evidence * the preliminary results of the initiatives that were put into place * what changes were made based on these data after the implementation of the initiative

Description of the Effective Practice
Description of the Effective Practice: 

An example of the practice using the model of: * reviewing initial evidence * the decisions made based on the evidence * the preliminary results of the initiatives that were put into place * what changes were made based on these data after the implementation of the initiative is illustrated using a pilot project in MATH 1101 – Introduction of Mathematical Modeling where three primary areas of concern were addressed: 1) Attendance & Classroom Engagement 2) Unpreparedness of Students 3) Completion of Homework Seven section of MATH 1101 were part of the project in fall 2010 and 6 sections in spring 2011. Through the redesign of classroom lectures to make them more interactive and a homework management system, there has been an increase in the success rates for those sections and a decrease in withdrawal rates. Elements of the redesign of MATH 1101 have since been implemented in most sections of MATH 1101. It should be noted that this is but one example of how Macon State College is using data analytics for course redesign, program curriculum improvement, summplemental instruction, and to reengage student for degree completion.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

The evidence that is being used to show effectivness is the successful studnet completion data. The number (and percentage) of students successfully completing MATH 1101 has risen significantly and the number and percentage of students withdrawing from the course has decreased significantly as well.

How does this practice relate to pillars?: 

This practice is one that is scalable and can be done to the extent that resources are available. This practice is focused on learning effectiveness but also addresses student satisfaction as students have a more positive experience and are able to use different learning styles to achieve the same objectives for the course. Additionally, using data analytics provides a strong professional reflection opportunity for faculty who may be stuck in a rut in terms of teaching style or who are not getting the success from students that they are seeking. Using the data to change the way courses and content is delivered to determine what is more effective is a powerful professional development tool for all faculty members.

Equipment necessary to implement Effective Practice: 

Depending on the level in which the use of data analytics is used, very basic reporting from the student information system such as grade distributions for specific classes over a period of time is a starting point. As results are improved and resources are identified, the used of very powerful data analytic software can be implemented which allows an even deeper inspection into the data. For example, one may choose to look at specific sub-groups such as race, gender, remediation needs, etc as possible areas to identify success and then implement targeted initiatives aimed at improving specific group success.

Estimate the probable costs associated with this practice: 

Depending on the level in which the use of data analytics is used, very basic reporting from the student information system such as grade distributions for specific classes over a period of time is a starting point which would cost little as those data are easily obtained. As results are improved and resources are identified, the used of very powerful data analytic software can be implemented which allows an even deeper inspection into the data. For example, one may choose to look at specific sub-groups such as race, gender, remediation needs, etc as possible areas to identify success and then implement targeted initiatives aimed at improving specific group success. These data analytic software packages can cost $100,000 plus, but again provide very powerful tools for using data.

Contact(s) for this Effective Practice
Effective Practice Contact: 
Dr. Jeff Stewart
Email this contact: 
jeff.stewart@maconstate.edu
Effective Practice Contact 2: 
Dr. Marti Venn
Email contact 2: 
martha.venn@maconstate.edu
Author Information
Author(s): 
George Joeckel and Max Longhurst
Institution(s) or Organization(s) Where EP Occurred: 
Utah State University
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

The time and space separation inherent in online learning demands that students receive organized and accessible information at their first point of engagement: the course syllabus. The Faculty Assistance Center for Teaching (FACT) at Utah State University has developed an open-source tool that creates a syllabus in a native PDF format—Adobe Reader.

Description of the Effective Practice
Description of the Effective Practice: 

Users are guided step-by-step in populating six sections: information, course objectives, course resources, course activities, policies and grades. An example syllabus is provided to model content and design best practices. Users are assisted in the development of course objectives. The tool computes a points-based grading scale from provided grading component values. Campus policies and federal laws relevant to education can be incorporated into the tool to ensure that every learner is informed of her or his institutional and legal rights.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

FACT has adopted this tool for the development of syllabi for all new fully-online courses. The Regional Campus and Distance Education (RCDE) department will recommend this tool for all online instructors beginning Fall 2012. The Teacher Education and Leadership (TEAL) department has provided development resources based upon a faculty vote, and is using the tool to standardize the syllabi for its fully-online graduate-level Administrative/Supervisory Program. Several institutions have expressed an interest in piloting the open source version of the tool.

How does this practice relate to pillars?: 

Access

The developers chose to create this tool as an XML-based dynamic PDF (using Adobe LiveCycle Designer) for three main reasons:

• Adobe Reader is a free and ubiquitous software program 
• The tool operates on a local machine: no internet connection is needed; no browser version issues; runs on PCs and Macs
• Text-based PDF files are accessible to all students (508 compliance)

Learning Effectiveness

Research has demonstrated the importance of the syllabus as a learning aid. [1] By guiding the instructor through the creation of the syllabus, and by providing an example syllabus that models best practices in design and language, the tool creates a document that is specific to the needs of online learners.

Faculty Satisfaction

The tool incorporates a design framework developed for a specific context: higher education courses delivered via a learning management system. The Objectives-Resources-Activiites (OAR) model [2] is combined with three supporting sections--information, policies and grades--that instructors work through in six steps. Current users have particularly enjoyed the grading scale that is auto-generated based on the grading components that have been listed.

Student Satisfaction

Research has also indicated that the syllabus functions as a contract [3] and a communication tool [4]. The tool enables the adoption of a standardized format to promote a consistent and thorough framework for online learners. The example syllabus models policies related to instructor and student feedback, late work, information for students with disabilities, etc.

Scale

Enrollments in online courses at Utah State University continue to grow at double-digit rates each semester. As the number of students in each course rises, and as the diversity of the learning needs of online students continues to grow, the syllabus will face increased instructional demands. The PDF Syllabus Builder provides an effective method for disseminating and incorporating the best practices and standards being developed at all levels of the university.

Equipment necessary to implement Effective Practice: 

 

*** Download the PDF Syllabus Builder at: https://elearn.usu.edu/OAR/PDF_Syllabus_Builder_v1_beta.pdf *** 

The user must have a computer and a screen, with copy of Adobe Reader--a free program available at http://get.adobe.com/reader/--installed.

System requirements (from the Adobe website):

Windows - Intel® 1.3GHz or faster processor - Microsoft® Windows® XP Home, Professional, or Tablet PC Edition with Service Pack 3 (32 bit) or Service Pack 2 (64 bit); Windows Server® 2003 (32 bit and 64 bit; Service Pack - 2 required for 64 bit); Windows Server 2008 or 2008 R2 (32 bit and 64 bit); Windows Vista® Home Basic, Home Premium, Business, Ultimate, or Enterprise with Service Pack 2 - - (32 bit and 64 bit); Windows 7 Starter, Home Premium, Professional, Ultimate, or Enterprise (32 bit and 64 bit) - 256MB of RAM (512MB recommended) - 260MB of available hard-disk space - 1024x576 screen resolution - Microsoft Internet Explorer 7 or 8; Firefox 3.5 or 3.6

Mac - Intel processor - Mac OS X v10.5.8 or v10.6.4 - 512MB of RAM (1GB recommended) - 415MB of available hard-disk space - 800x600 screen resolution (1024x768 recommended) - Apple Safari 4 for Mac OS X v10.5.8 and v10.6.4; Safari 5.0.x for Mac OS X v10.6.4

Estimate the probable costs associated with this practice: 

The PDF Syllabus Builder is available at no charge through a Creative Commons Attribution-NonCommercial 3.0 Unported License. The LiveCycle Designer source files are available. An institution that chooses to modify the open source version may incur costs such as: the purchase of Adobe Acrobat Pro (which includes Livecycle Designer) and design and development expenses.

References, supporting documents: 

1. Parks, J.; Harris, M.B. (2002). "The purpose of a syllabus.". College Teaching 50 (2): 55–61.

2. Joeckel III, G.L.; Jeon, T.; Gardner, J. (2009). Instructional Challenges in Higher Education Online Courses Delivered Through A Learning Management System By Subject Matter Experts. In H. Song (Ed.), Distance Learning Technology, Current Instruction, and the Future of Education: Applications of Today, Practices of Tomorrow. New York, NY: Idea Group Publishing.

3. Slattery, J.M.; Carlson, J.F. (2005). "Preparing an effective syllabus: current best practices.". College Teaching 54 (4): 159–164.

4. Habanek, D.V. (2005). "An examination of the integrity of thesyllabus". College Teaching 53 (2): 62–64.

Other Comments: 
Contact(s) for this Effective Practice
Effective Practice Contact: 
George Joeckel
Email this contact: 
george.joeckel@usu.edu
Effective Practice Contact 2: 
Max Longhurst
Email contact 2: 
max.longhurst@usu.edu
Author Information
Author(s): 
Dr. Art Borgemenke
Author(s): 
Dr. Chuck Holt
Author(s): 
Dr. Wade Fush
Institution(s) or Organization(s) Where EP Occurred: 
Texas A&M University Commerce
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

This effective practice describes processes utilized by the faculty members of an Educational Administration Principal Preparation program in conceptualizing, developing and implementing a universal course shell (UCS) for all graduate degree/state specific certification courses. This effective instructional practice includes the rationale behind the faculty perceptions documenting the need for the UCS. Steps used to determine what components can be most effectively included in a universal course shell for use with a proprietary online course management system (CMS) are also described.

Description of the Effective Practice
Description of the Effective Practice: 

The UCS was developed and implemented to: Provide students participating in an accelerated online principal preparation program a more user-friendly experience by seeing consistent formatting across program courses. Maintain program alignment to state competency requirements and university content. Deliver consistent rigor by preventing course focus drift between multiple instructor course sections. Allow subject matter experts to concentrate resource utilization on developing methods of delivering concept content instead of course delivery.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

Texas A&M Commerce Educational Administration has seen a dramatic increase in first-time passers of the TExES Principal Certification Examination. The program passing rates are approaching 95%. The Texas A&M Commerce Educational Administration program has also experienced a phenominal growth since institution of the UCS. Enrollment rates since January 2012 have qradrupled indicating student interest and satisfaction in the program. The three authors have received students evaluations that consistently rank above University students evaluation averages.

How does this practice relate to pillars?: 

Learning Effectiveness - research demonstrates that clarity and consistency reduces student anxiety and increases student achievement. Scalability - reproduction of UCS enable adjunct and new faculty to be able to teach courses that maintain departmental standards and competency requirements. Student Satisfaction - students evaluations for courses using UCS increase student satisfaction and student outcomes.

Equipment necessary to implement Effective Practice: 

Access to consistent LMS and robust technical and instructional design support.

Estimate the probable costs associated with this practice: 

Once a consistent learning media platform is adopted by the institution, the costs for implementation or maintenance costs are minimal. Faculty collaboration to establish universal standards is all that is required.

References, supporting documents: 

Hines, C. V., Cruickshank, D.R., and Kennedy, J.J., (1985). Teacher Clarity and Its Relationship to Student Achievement and Satisfaction American Educational Research Journal. Vol. 22, No. 1, Spring, 1985

Contact(s) for this Effective Practice
Effective Practice Contact: 
Dr. Art Borgemenke
Email this contact: 
art.borgemenke@tamuc.edu
Effective Practice Contact 2: 
Dr. William Charles Holt
Email contact 2: 
chuck.holt@tamuc.edu
Effective Practice Contact 3: 
Dr. Wade Fish
Email contact 3: 
wade.fish@tamuc.edu
Award Winner: 
2012 Sloan-C Effective Practice Award
Author Information
Author(s): 
James May
Institution(s) or Organization(s) Where EP Occurred: 
Valencia College
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

 

In an effort to model the benefits of using smart devices and web 2.0 applications, I have added two things to this submission:

For Listeners: if you are an auditory learner and would rather listen to my effective practice submission as you read it, or while you are eating your lunch, I have provided the following link. I made this audio file of my submission using a smartphone application called SpeakIt. http://faculty.valenciacollege.edu/lab/sloanc.mp3

Learn More: if you like the ideas presented in this practice or would like to learn more about free and easy to use teaching technologies as I do, feel free to sign yourself up for future notifications of teacher tricks. Using Remind101 (you will learn more about this later) I have created a notification group for interested teachers who want to share ideas.

To be notified by email: send an email to tchrtricks@remind101.com

To be notified by SMS text: text @tchrtricks to the following number (832) 900-3652

Abstract

A recent college study “found that 95% of students bring their phones to class every day, 92% use their phones to text message during class time, and 10% admit they have texted during an exam on at least one occasion” (Tindell & Bohlander, 2012). I too have found related cellphone ubiquity within the ESL for Academic Purposes (EAP) program at Valencia College in Orlando, Florida. In a fall 2011 study (N = 447), 95% of students owned cellphones, and while 62% owned smartphones and 38% owned feature phones, 88% of respondents communicated via SMS text. In an effort to meet and teach students where they are and through the communication mediums they prefer, I have employed a variety of Web2.0 and smart device technologies and strategies in my classroom. The approach has allowed me to model transactive thinking and learning, employ brain based learning practices, better engage my students, and reduce textbook costs.

Description of the Effective Practice
Description of the Effective Practice: 

For years I have heard colleagues and friends bemoan the great change we are experiencing in higher education and society at large. “It is like we have awakened on a different planet, one where students are different, communication is different, entertainment is different, and even learning is different.” I have even seen some teachers employ practices that forbid the use of technology (laptops, smartphones & smart devices) in the classroom, and I have wondered…to what end? What greater benefit could this practice serve? I have heard colleagues say “I am just not a technology person,” and I have wondered what if my second language students told them “I am just not an English user.” From my perspective, when English teachers say “I am not a math person” or math teachers say “I am not a writer” it sends the wrong message to students. How are we modeling lifelong learning to students if we are quick to defend our lack of expertise in math, writing, or technology by dismissing these fields or worse, banning them, from our classrooms? Wouldn’t we better model to students a passion for lifelong learning if we embraced things we didn’t know and mentored new and effective ways to learn them? Following on that line of reasoning, I have embraced new practices in my classroom. I use smartphones, smart devices and a variety of Web 2.0 and smart device applications to facilitate learning. Here is a link to a Valencia produced video spot of me using smart devices with my students http://youtu.be/qRni2q8KN1w I have also found that this practice allows me to:

Better engage students: I start every semester by asking my students if they have a smartphone or smart device. I ask them how many of them use SMS text to communicate. To their surprise, I then tell them to take out their phones and devices and leave them on the desktops because we will be using them throughout the semester. Each day I try to work in problems to solve or I share apps or learning tricks utilizing various technologies. Anecdotally, I have found that by teaching and learning through these devices students have become more engaged in my classes. Students also come in wanting to share new technologies and resources they have found that have helped them learn.

Disseminate content: I use QR code, tiny URLs, and other links to share content with my students and other colleagues when I do faculty development. For example, on the first day of class, students download QR code scanners to their devices and immediately link to my syllabus via a QR code I project on the screen. The QR code takes them to the web-based document which downloads to their phone in seconds. I do the same with various handouts, readings, quizzes, and surveys throughout the semester. For students without smartphones, or phones with scanners, I give tiny URLs and embed links to content in Blackboard, our learning management system.

Provide On-Demand Learning: Also embedded in my Blackboard course is a folder called FAQ&How2 which holds On-Demand learning videos and screencasts that I have made for my students. For example, I require my writing students to scan documents using a document scanner in the writing center, so I have created a how2 video (a digital mashup of actual video and screencast) to show them how to use the resources in the lab to scan documents. They are able to watch the video instructions on their phone while they are attempting to scan the documents in the lab. After they have done this a few times, I share with them a variety of apps that would let them do the same thing with their phones. I also share with them the wonders of YouTube, Khan Academy, and a variety of other video On-Demand learning resources they can access through their phones.

Provide immediate feedback: I use cellphones to provide students with immediate visual feedback by using tools classroom response tools like Poll Everywhere and Socrative. These free tools allow students to text or click in their answers individually or in groups. Their answers are then graphed and projected anonymously to the entire class. This allows them to benefit from group think and spurs great conversations about why the answers are what they are and how we got to these answers, rather than simply what the answers are.

Assess learning: I also utilize smart devices and Google Forms to formatively assess students with what I see as the 21st century equivalent of Classroom Assessment Techniques (Angelo & Cross 1993). I have students use QR code or go to http://tinyurl.com/teachmeaskme to take a survey that asks them to either teach me back something they learned that day or ask me about something they had trouble with. Since I am using Google Forms, the responses are time stamped and arranged in a Google spreadsheet for me which allows me to see how a class went or more importantly how I can improve it. Model transactive thinking and learning beyond my classroom: Like it or not, the digital/millennial shift we are experiencing, has, for lack of a better analogy, brought us to a different planet. We, professors, are no longer the living stores of information. Everything we know and more is available via smartphone, and students have access to it for free if they know how to ask. We are no longer remembering things; we are remembering how to get to things (Sparrow, Liu, Wegner, 2011). Using smart phones and devices in my classroom allows me to model digital, transactive thinking and learning, best practices for finding information, and critical analysis, not only for content in my classroom, but for content beyond my classroom.

Sample list of smart device applications and resources I use with students:

Remind101, Google Docs, Google Forms, Google Goggles, SoftChalk, Camtasia, Poll Everywhere, SMS Text, Wiffiti, Socrative, YouTube, RSA Animate, Khan Academy, TED, QIK, Animoto, VoiceThread, Inigma, Genius Scan, Imagetotxt, speakit, hootsuite, posterous, iprompt, dropbox, and more.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

As a community college professor and EAP discipline chair, I am responsible for 11 other ESL instructors, and I teach 6 classes each semester. So, obviously, the amount of time I can afford to devote to classroom research is limited. However, I have found anecdotally and through student self-report what others have found, that students are engaged by these practices. For example, in my classroom I use free applications to turn smartphones and other devices into clicker systems (a.k.a. Classroom Response Systems). Researchers at the University of Wisconsin found that when clicker systems were used, 94 percent of responding faculty agreed or strongly agreed that clickers increased student engagement (Kaleta & Joosten, 2007). Moreover, this study found that 69 percent of the 2,684 student respondents agreed or strongly agreed that clickers led them to become engaged in class.

Beatty (2004) noted that “By providing frequent feedback about students' ongoing learning and confusions, it can help an instructor dynamically adjust her teaching to students' real, immediate, changing needs.” Again, I personally have found that these tools allow me to improve attentiveness and increase knowledge retention; Kaleta and Joosten’s (2007) echo these findings “53 percent of the student respondents agreed or strongly agreed with the claim clickers have been beneficial to their learning,” but smart devices allow for so much more. I can poll students anonymously, give instant results, confirm audience understanding and provide feedback, and gather data for reporting.

Beyond simulated clickers, I have found that smartphones and devices provide other tools to engage students, disseminate content and on-demand learning videos, provide immediate feedback, assess learning, and model transactive thinking and learning beyond my classroom. For example, as I mentioned earlier, Google Forms and smart devices can be leveraged to create 21st century Classroom Assessment Techniques (CATs). This practice allows for content and instruction that is learning centered, teacher directed, mutually beneficial, formative, context-specific, ongoing, etc. (Angelo and Cross 1993). Over time as I have developed more activities and content, I have also found myself becoming more open source (and thereby reducing material costs for my students. In fact, students in my classes no longer purchase texts). In modeling transactive thinking and learning, I have found a variety of open-source, creative commons licensed content that I can share with students (e.g. Carnegie Mellon’s Open Learning Innitiative, Cable Green’s work for the Washington State Community and Technical college, Salman Khan’s work through the Khan Academy, and the 48 hours of video content that continues to be uploaded to YouTube every hour of every day).

The visual and audio channels inherent in the digital content also allow me to edutain and employ brain rules; techniques which allow me to better engage students and enhance learning. For example, in John Medina’s book Brain Rules (2008), he outlines 12 rules that explain why and how our brains learn, but he supports his conclusions with numerous studies that have been published in peer-reviewed journals and successfully be replicated. For example, Brain Rule #4 is that we don’t pay attention to boring things. According to Medina, we as teachers have 10 minutes before attention starts to drift, but if we redesign our delivery of content to include activities using smartphones and other devices periodically throughout a class period, we can regain student attention and improve engagement and learning. As I mentioned above, as a community college professor, I haven’t had the time to empirically examine my practices, so instead I have built them upon the research and thinking of others. Attention is just one of the brain rules; the following link takes you to a three page PDF of research supporting this rule: http://www.brainrules.net/pdf/references_attention.pdf . The other brain rules are equally well supported (Sensory Integration, Vision, and Exploration); they also align themselves nicely to the use of smartphones in the classroom.

Using smartphones to gather longitudinal evidence of effectiveness: I would like to thank SloanC for this opportunity to think more deeply about how I assess my practices. This opportunity has given me a new idea (technically an exaptation of an idea); however, it is highly possible that others will want to employ this practice as well. In Steven Johnson’s book about innovation (2010) he discusses how innovations are often slow hunches of ideas that need time to collide with other ideas. Writing this paper has provided an opportunity for my ideas to collide. For a while now, I have been sitting on a Web2.0 technology called Remind101, which is essentially a free web-based SMS texting tool. It allows for me to create a class, students then text in and sign up for the class (the program keeps their phone numbers private, and allows them to sign in with a name). Once students have signed up, I can send the entire class a burst text message. I was originally going to use this to share class notes, new apps, videos, and technologies with my students long after they had left my class. However, this assignment has made me realize that I can use this same tool to longitudinally survey my students to identify how effectively the strategies I share with them are serving them in other college classes and beyond.

How does this practice relate to pillars?: 

 

Access – With nearly 500 million smartphones sold in 2011 and more projected this year, access is, or will be, ubiquitous (Mobithinking, 2012). Students and teachers will continue to have improved access to digital and video on-demand content and instruction through smart devices. Moreover, the strategies and tools that students learn are likely to be transferred to studies in other disciplines and used to assist lifelong learning thereby providing students and teachers access far beyond the classroom. Also, as content and training is established and disseminated freely, there is the possibility for reduced materials purchases, which could reduce course costs and open access to lower SES student populations.

Faculty Satisfaction – Colleagues who have adopted similar practices have anecdotally reported to me an increase in both student engagement and their own learning. They tend to find, like I have found, that as their students become hungry for learning technologies, they become hungry to find new ways to help students find learning technologies. They enjoy the ability to track student surveys and identify what is working in their classes. They also appreciate the ability to cheaply share content they have found or developed and reduce student costs.

Learning Effectiveness – Because students have access to content through their devices, learning can be customized. The learning path for each student can be individualized. For Example, FAQ&How2 allows for students to access the video on-demand learning that they require. This practice also employs elements of gaming theory to create a more engaging and compelling user experience. Students trained to use smart devices also have immediate access to course content and can track their efforts and performance continuously in the course.

Scale – Currently these practices are used in my classroom (and I know they are being used by others), but I don’t see why students and teachers at schools across the country or world could not employ these practices. I don’t see a limit to the scalability of this model.

Student Satisfaction – I have found my students to be quite satisfied with these techniques. Even my technophobes, who sometimes report frustration, still say things like “the world has changed and it is good that I am learning these tricks now before I go into the job market.” Moreover, I believe my students are satisfied because they retain empowerment, have a choice, and control what and how they access support. I believe they find the content rich, engaging and compelling. Another benefit for them is that this practice allows for gaming theory both in and out of my classroom. Students routinely report to me that my class is “so much more than an English class.” However, my favorite comment from a student came in response to a training video I made. “James, it is like you are right there with me teaching me.” Of course, this student was watching a Youtube video I had made for the entire class, but to her, it was like I was there with her in her room, in the lab, or wherever it was that she was working on her home learning assignment.

Equipment necessary to implement Effective Practice: 

Given that this is a Bring Your Own Technology (BYOT) model for the end user, all that may be required is WiFi connectivity. WiFi tends to have greater reliability than 3G and 4G networks. Content and strategies can be developed freely using a variety of free Web 2.0 technologies and free smart device applications. However, for those looking for more robust content development tools, I would recommend Techsmith’s Snagit for screencast-to-Youtube video on-demand creation and dissemination. I would also recommend SoftChalk for an all-around, user-friendly content development tool. 

Estimate the probable costs associated with this practice: 

This practice can be done with essentially no cost. However, if there is a desire to increase the rapidity with which this practice is diffused into a program, its costs would come from faculty development and training. However, with care and planning, institutions could leverage existing faculty development assets and campus instructional designers to develop video on-demand training for faculty. Then, following a train-the-trainer model, early adopters could be identified and trained to model best practices and share with/train others utilizing the existing video on-demand training modules as support. In a more perfect world, training videos would be developed, given creative commons license, and shared via the web with other institutions. This would allow for inter-collegiate rather than intra-collegiate faculty development. This is similar to the CASE Faculty-to-Faculty Development model a colleague and I proposed this year at NISOD 2012. For more information on this see http://teachertricks.org/?p=793

References, supporting documents: 

 

Angelo, T.A., & Cross, K.P. (1993). Classroom assessment techniques: A handbook for college teachers (2nd Edition). San Francisco, CA: Jossey-Bass.

Beatty, I. (2004). "Transforming Student Learning with Classroom Communication Systems," Educause Center for Applied Research Research Bulletin. Issue 3 (February 3, 2004), p. 5.

Johnson, S. (2010). Where good ideas come from: The natural history of innovation. New York: Riverhead Books.

Kaleta, R., & Joosten, T. (2007) "Student Response Systems: A University of Wisconsin System Study of Clickers," Educause Center for Applied Research Research Bulletin. Issue 10, May 8, 2007

Medina, J. (2008). Brain rules: 12 Principles for surviving and thriving at work, home, and school. Seattle: Pear Press.

Mobithinking. (2012). Global mobile statistics 2012 home: all the latest stats on mobile web, apps, marketing, advertising, subscribers and trends. Retrieved from http://mobithinking.com/mobile-marketing-tools/latest-mobile-stats

Sparrow, B., Liu, J., & Wegner, D. M. (2011). Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips. Science, 333(6043), 776-778. doi:10.1126/science.1207745

Tindell, D. R., & Bohlander, R. W. (2012). The Use and Abuse of Cell Phones and Text Messaging in the Classroom: A Survey of College Students. College Teaching, 60(1), 1-9. doi:10.1080/87567555.2011.604802

Recommended Sites, Web 2.0 Technologies, & Applications

http://teachertricks.org

https://www.remind101.com

http://www.khanacademy.org/

http://www.ted.com/

http://comment.rsablogs.org.uk/videos/

http://softchalk.com/

http://qik.com/

http://www.techsmith.com/snagit.html

http://www.polleverywhere.com/

http://animoto.com/

http://voicethread.com/

http://socrative.com/

http://www.google.com/mobile/goggles/#text

https://docs.google.com/#home

http://itunes.apple.com/us/app/i-nigma-qr-code-data-matrix/id388923203?mt=8

http://itunes.apple.com/us/app/genius-scan-pdf-scanner/id377672876?mt=8

http://itunes.apple.com/us/app/image-to-text-ocr/id431757093?mt=8

http://itunes.apple.com/us/app/speak-it!-text-to-speech/id308629295?mt=8

http://itunes.apple.com/us/app/hootsuite-for-twitter/id341249709?mt=8

http://itunes.apple.com/us/app/posterous/id394252521?mt=8

http://itunes.apple.com/us/app/ted/id376183339?mt=8

http://itunes.apple.com/us/app/i-prompt/id336844826?mt=8

http://itunes.apple.com/us/app/dropbox/id327630330?mt=8

Contact(s) for this Effective Practice
Effective Practice Contact: 
James May
Email this contact: 
jmay@valenciacollege.edu
Author Information
Author(s): 
Gregory Möller
Institution(s) or Organization(s) Where EP Occurred: 
University of Idaho
Institution(s) or Organization(s) Where EP Occurred: 
Washington State University
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

Applying the decades-old knowledge developed in the broadcast and film industry that can create compelling, informative, and engaging presentations, an emerging pedagogical approach that has demonstrated effectiveness is an online presentation style called “doculectures.” A doculecture is a PowerPoint-free cinematic presentation, formalized in content, and supported with media such as subject descriptive film, photographs, animations, music, and text. This new approach couples the information intensity of a university lecture with the audiovisual warmth and dynamics of a documentary film. Using HD and surround-sound optimized for headphones, a cinematic doculecture approach leverages our understanding of the cognitive neuroscience of learning and memory using dynamic imagery, sounds, virtual spacial effects, as well as opportunities for disfluency that promote deeper learning. A case study for the new pedagogy is found in the OER university course Principles of Sustainability

Description of the Effective Practice
Description of the Effective Practice: 

BACKGROUND

In an era where online videos are viewed billions of times each day, online education—especially asynchronous learning—is quality challenged by the practice of trying to translate the physical classroom experience onto a two dimensional screen using captured lecture videos. Often these videos are produced by simply placing a camera in the classroom or by delivering a class in a video technology enhanced classroom. While this hybrid approach has distinct advantages in increasing accessibility, and minimizing content development overhead and culture clash on the production and delivery-side for faculty and institutions, product quality is highly variable and often falls far short of the rich experience possible with effective live classroom delivery. Calling on the decades-old knowledge developed in the broadcast and film industry that can create compelling, informative, and engaging presentations, an emerging pedagogical approach that has demonstrated effectiveness is an online presentation style called “doculectures.” A doculecture is a PowerPoint-free cinematic presentation, formalized in content, and supported with media such as subject descriptive film, photographs, animations, music, and text. This new approach couples the information intensity of a university lecture with the audiovisual warmth and dynamics of a documentary film. Using HD and surround-sound optimized for headphones, a cinematic doculecture approach leverages our understanding of the cognitive neuroscience of learning and memory using dynamic imagery, sounds, virtual spacial effects, as well as opportunities for disfluency that promote deeper learning.

DOCULECTURE WORKFLOW

1)  Write a lecture as a formal referenced topic paper suitable for publication keeping in mind that one thousand words is approximately fifteen minutes of oral presentation. Traditional lecture materials such as presentation slides can be good resources to provide an outline for this paper. Target subtopic title breaks in the paper at least every three to five hundred words as this is key to formatting doculecture breaks and the effective learning practice using shorter packages of information that accommodate attention span. Effective use of examples and detailed explanations of subject-specific topics, like math formulas, are written out as if providing a detailed explanation in print.

2)  Preserve the original paper as a background and citation resource. Rewrite another copy of the paper, deleting in-text citations and translating to a more informal spoken word presentation that you will be “reading” from a teleprompter. For example, many will write the word “utilize” whereas the spoken version of the verb will be “use.” This “script”, like any lecture, can be modified to focus the introduction and the conclusion, adding intensity and vocal color like alliteration, power words, and inspirational words that help frame critical concepts and learning objectives. The script can now be practiced for flow and pronunciation, and edited appropriately. Hard to pronounce words like medical terminology can be easily spelled out phonetically for smooth prompting. Script breaks at natural thematic breaks, guided by the subtopics of the written work are critical for ease of taped presentation, production, and learning effectiveness, typically yielding three to eight minute segments separated by short five to ten-second low density cognitive pauses. What you load into a teleprompter does not have to be a word-for-word script and each presenter will have a variable degree of "prompting" need. A key concept is to use a prompter to maintain eye contact and thus connection with your students on the other side of the lens.  

3)  Format the doculecture script as a transcript and captioning resource to incorporate best practices for course access by people with disabilities. Copyright the work if appropriate and desired.

4)   Load script into an on-camera teleprompter and tape the presentation in a studio, classroom or on-location in a subject appropriate location. A static wide-shot, one camera, no-operator taping can produce a very nice work product especially if a monitor is used. A teleprompter operator produces the best product, tracking the natural pace of the presentation, although hand and foot-pedal remotes for the presenter are available. Use best practices when filming including: using a room without background noises; using an “infinity” white screen background sized for wide-screen production that will serve as a digital “chalkboard” in post-production; having presenter lighting appropriate to the location; avoiding close-up camera framing unless familiar with theater make-up (HD close-ups are cruel to most of us); using full body or three-quarter presenter framing, avoiding frame cut at body joints like knees or waist; adopting presenter framing with the esthetic photographic convention of “thirds”; repeating diction flubs and fails for later editing; avoiding lavaliere microphones if possible as they are mono and produce a flat artificial sound; using a boomed stereo shotgun microphone or dual left and right channel shotgun microphones for spacial dimensionality—stereo separation allows the instructor to walk through the student’s head via headphones while walking from one end of the white screen to the other; and following basic camera screen talent techniques such as expressive presentation and avoiding tight patterned clothing which can cause screen distortions for viewers. Practicing teleprompted presentations takes some time for those new to the technique, however once familiarity and comfort is developed, it is often less difficult than other modes of digital presentation and keeps content focused, tight, and confident—respecting the viewer’s task of learning and engaging them on a more human level.

5)  Encode the spoken lecture into a non-linear video editing (NLE) software system using wide-screen HD and stereo or 5.1 formats. Although there are many levels of video NLE available, using a software product that is appropriate to skill level and the quality of the desired output is best. Edit out spoken flubs and break the presentation into script segments inserting five-second sub-title transitions between each. Add on-screen text for information dense areas of the lecture as needed, and add text for core concepts such as definitions or formulas using reveal as necessary. Smart use of a background white screen during lecture taping includes standing to one side or another and allows the other portions of the screen to be used as a digital whiteboard for text, images, or animation during the presentation.

6)  Add sound score, targeting suitable background music and matching sound to the tempo and theme of the presentation. Use royalty-free music (RFM) that is freely distributed or available from low-cost RFM production sources. Avoid “high cognitive load” distracting scores and keep any background music level well below lecture vocals (by -20 to -30 dB). Adding music swells (subtle volume increases) can emphasize transitions and heighten attention to specific content. In addition, sound can be used as an imagery resource. For example, when talking about nature, background forest sounds can heighten attention and transport students into the subject matter and aid in learning. Over-use of background music can be distracting to some and background silence for some aspects of presentation can be equally powerful in the learning process. Be cautious about using overly epic, genre-specific, and somber music, but also recognize the power of well-chosen music to create interest, maintain student attention, and add to the potential for deeper learning. Maintain subject matter objectivity and avoid biasing the content with sounds or music that emote an opinion—such as ominous background music during the discussion of material on which you have a strong personal negative opinion. The key concept of background music is that it is in the “background.” Do not use popular music, recognizable vocals, non-RFM, or non-permissioned and non-licensed music that creates considerable legal liability unless you are informed and skilled in appropriate educational “fair-use” and ready to defend such use.         

7)  Add audio-visuals into the NLE to illustrate concepts and maintain student interest. As with any presentation, dynamic imagery can assist in effective teaching and learning. Target royalty-free and freely-shared HD film and images available from a variety of sources, or produce your own. During the collection for editing, document the source of the audio-visual resources and the sharing entity or artist for proper crediting and record-keeping. A developing resource is the thousands of talented amateur photographers and videographers posting on web sites willing to share their adventures and artistic talents for educational use. Instructor-produced photos and video are an important resource in typical low-budget productions. Royalty-free commercial stock video and photos are often worth the impact but can add to production cost. Use accent images, “B-roll” film, and illustrations to illustrate concepts, to mask editing breaks or to create viewer interest and connection to the program. Do not use popular or commercial images or film, non-RF, or non-permissioned and non-licensed images or film that create considerable legal liability unless you are informed and skilled in appropriate educational “fair-use” and ready to defend such use.        

8)  Use editing features in the NLE for some subtle audio and video transitions and effects. Best practices by professionals tend to limit fancy or distracting effects. Avoid beginner mistakes with excessive zooms, flashy transitions, and long dreamy dissolves. Simple dissolves in a fraction of a second will add crispness and yield a tighter more interesting and engaging presentation.

9)  Apply titling to the beginning and end of the doculecture using standard approaches of first conveying important information and secondly crediting all of the resources used in the production including any production assistance, scholarly references and image or film credits. Copyright the work if appropriate and desired. Consistent use of appropriately permissioned, licensed or self-produced work can yield a fully open educational resource if that is desired. Proof for quality and transcode into an HD video format recommended by hosting services for web delivery. Carefully proof the doculecture production before uploading and releasing to a public or private video hosting service.

10)  Build and moderate learning management system (LMS) interactive discussion forums using the array of available approaches to integrate and support the doculecture delivery, as this will provide learning support, potential for student-student and faculty-student interaction, and vital course content discussion. In a flipped class, use live sessions to discuss and demonstrate core concepts presented in an assigned doculecture.

11)  As typical for any course, bring in scholarly reading and writing to address course content deeper than what can be efficiently presented in a lecture. Incorporate a system of learning assessment and student feedback to support student mastery of the subject matter.

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

BACKGROUND

In the past two decades, the generations of online education have progressively advanced to include online course support websites offering digital learning resources, synchronous or asynchronous audio or video of class presentations, virtual learning environments, social media enhanced interaction, and hybrid or blended variants that attempt to deploy the best of each. Until recent improvements in broadly accessible high-quality video cameras, editing, and hosting resources, well-produced instructional video was only the product of large-budget professional operations. Coupling the desire for effective teaching by faculty and the need for high quality, effective learning resources by students, instructor-level production of digital video with the high information density that is a characteristic of a classroom presentation is now possible. While the learning curve of any new presentation technology can be steep for some, faculty should be encouraged by advances in production technology that worldwide have enabled hours of new video to be uploaded to the web every second. Social media and mobile learning are increasingly a part of student lives as well, and this presents a next-generation opportunity to deploy a learning platform that is entertaining, informative, and cutting-edge in assisting students in their achievement of academic goals.

For faculty, using new tools that pace the advancements of instructional technology is a recognized responsibility in their profession. Although skill sets and quality outcomes using any presentation technology are highly variable, video is a long-standing, recognized, and effective tool in instructional support. Many faculty are advanced practitioners of video use in a learning environment. By the nature of their profession, teachers are expected to be effective presenters and this is often preceded by adaptation to and adoption of new instructional technology.

SURMOUNTING THE LIVE CLASS TO ONLINE 2-D CHALLENGE WITH NEW MEDIA AND COGNITIVE NEUROSCIENCE

Teachers at all levels of instruction use “prompts” for their classroom presentations. These prompts routinely take the form of notes, bullets on PowerPoint slides, overheads, or other outlines or techniques that support an organized, effective delivery. As well, a live presentation enables a presenter to survey and interact with the class by scanning students for eye contact, attentiveness, and facial cues that feedback to the teacher that pace and delivery are appropriate for the complexity of the topic. The richness of a live classroom presentation is enabled by the human social connection and classroom community we can understand as “education with a pulse.” In the digital world of online pedagogy, education with a pulse has proven to be one of its greatest challenges.

Working on camera for an online course, “live classroom” prompts and feedbacks can fail for many presenters who are not exceptionally talented, charismatic, and experienced in the medium. The innate coldness and isolation of the medium and its distributed delivery thus can be magnified for students. The umms and ahhhs, pregnant pauses, and vocal tics—often repeated “comfort” words or phrases, of extemporaneous oral presentation—even for skilled classroom teachers—can be magnified to point of listener tedium and eventual attention loss and disengagement. For presentations recorded for web delivery only, direct use of live classroom techniques can yield ineffective and poor quality outcomes in student satisfaction and learning. In this case, the delivery distracts from the learning destination. Even the celebrated online TED lectures limit their presentations to six to eighteen minutes in recognition of this challenge.

Prompting using a camera-mounted teleprompter is a decades-old proven technique to engage an audience during broadcast presentation. The presenter-to-audience eye contact afforded by the technique simulates that found in live presentations, effectively establishing the human connection we feel “in real world”. While trained actors can memorize short bursts of dialogue, on-camera professional presenters doing long and often-complex oral presentations have found success in cue cards and teleprompters, and faculty doing camera work in teaching should take their “cue” from these professionals who know their medium well. Teachers trained and practiced in this technique can magnify their communication effectiveness when producing academic content for online access.

Doculectures use background music to aid in generating and maintaining student interest and attention during “high cognitive load” information intensive presentations. Kiger (1989) studied the effects of music load on reading-comprehension tasks and found that slow, soft, repetitive music with a low information load aided learning. Music’s impact on learning is confounded by numerous variables such a task complexity, an individual’s psychosocial characteristics, and the music itself (Doyle and Furnham, 2012). In film, musical soundtracks “can influence the interpretation, emotional impact, and remembering of film information” (Boltz, 2004). Cognition and emotion are critically linked, and mood induction by music can enhance empathy (Gilet, 2008). Our understanding of the role of emotion in “higher” cognition is an area of active study (Perlovsky, 2012). As well, using background cognition challenges can increase attention and add interest variation to learning challenges, for example straining to read an unfamiliar font or trying to have a conversation in a noisy environment. Research shows that this “disfluency—the subjective experience of difficulty associated with cognitive operations—leads to deeper processing” (Diemand-Yauman, Oppenheimer, and Vaughan, 2011).

Translation of existing course content to the doculecture format is direct and like any educational resource, updating will require effort. Retaining the video editing project file allows for facile insertion of updated content into a NLE project containing video, data and image files. Periodic updating of the lecture script and redelivery on camera makes a new lecture track that can be edited into the open project file, preserving all of the audio-visual elements in the previous production thus minimizing the overall effort. 

EVIDENCE OF STUDENT SATISFACTION AND QUALITY OF DOCULECTURE PEDAGOGY

The doculecture pedagogy has been fully deployed in the difficult and demanding upper division and graduate level conjoint OER course, Principles of Sustainability. The course has been formally delivered for two semesters to over seventy students in the 2011-12 academic year at the University of Idaho and Washington State University, in the Pacific Northwestern United States. The course has fifty segments containing about thirty hours of doculectures, and requires students to read over six hundred pages of textbook and scholarly readings, answer over two hundred review questions, participate in reflective discussion responding to segment prompts, write two or three analytical papers of twelve to twenty five pages, and complete a comprehensive final exam. Anonymous enrolled student course evaluations have been highly positive. Illustrative examples of student feedback when surveyed about the course include the following: "World class course.” “This class is amazingly well developed.” “Excellent combination of hard and soft sciences.” “Great use of the humanities to engage students.” “Made learning a lot of information engaging and easy.” “Preferred this course over my live courses.” “I retained much more than usual, and I believe this is because the delivery appeals to multiple learning styles.” “This instructor will leave a legacy of transforming education and expanding hard core distance learning to pop culture.” “I really like the real world relationships to the course materials.” “The relevant footage and information is outstanding.” “I'm not just saying this, but Principles of Sustainability is by FAR the best online course I've ever taken.” “The quality of the doculecture productions are impressive, and often make me feel like I'm watching a more academic version of a PBS show instead of a course lecture.” “I love this new way of learning.” “It's like being in the classroom only better.” “I feel connected, a part of the learning process.” “I cannot believe the quality of this University produced material - it looks like PBS or Discovery Channel.” “Amazing course.” “I am learning so much.” “The lectures are amazing.” and “It is like having a real class...”

Since its premiere in 2011, the Principles of Sustainability course and its doculectures have received two prestigious film industry awards. Students in the course are now invited partners in the PBS/Detroit Public Television “Corps of Discovery” research project, a joint venture in education and broadcasting designed to promote the central idea of worldwide sustainability and presenting a “case study for a new media singularity for sustainability—crossing institutional domains—where unbiased digital data and resources are rapidly researched and reviewed, supporting a broadcast outreach for national and international public engagement.” In addition, the Principles of Sustainability course website is already Google search rank number one for “sustainability course” and for “principles of sustainability,” a disciplinary significant term. Over 100 filmmakers and scholars across the globe, and numerous students, contributed to this course. Available on computers, smartphones, video game consoles, streaming media players, and IPTV (internet protocol TV), the Creative Commons 3.0 licensed doculectures are loaded almost 2000 times per week in 80+ countries by formal and informal learners.

Students are the direct beneficiary of better approaches to instruction. The rigorous quantitative assessment of a universal “better” in an arena of rapidly changing technology, and site or situation specific implementation differentials, is challenged—and makes global findings difficult to produce and re-produce. The rapid development and deployment of online education has led to a concomitant and now continual “culture shock” that is potentially disruptive of many of the proven models of effective pedagogy. One universal pedagogical truth is that “education with a pulse,” the close human interaction that binds the learning ecology of student and teacher—is as important in online education as it is in live instruction. As millennia of history in education have taught human civilization, teachers and institutions who recognize and understand this human dynamic will succeed, and those that do not will fail. Our successes will be manifest in the creative inspiration and learning success of our students, while our failure will waste the human potential and capacity of those who we presume to teach. We are called to succeed in this great work.

How does this practice relate to pillars?: 

When surveyed in anonymous course evaluations, two semesters of graduate and upper division students enrolled at two large universities and located in seven US states have expressed enthusiastic student satisfaction for the learning effectiveness of the doculecture approach deployed in Principles of Sustainability. These reviews demonstrate that the explicit use of new media targeting current knowledge in the cognitive neuroscience of learning and memory can be delivered in a style that our PBS/DTPV “Corps of Discovery” partners call “entertaining, informative and cutting-edge.” Elements of faculty satisfaction can be driven by the peer-review and wide OER distribution potential of doculectures in the domains of scholarship of creativity and scholarship of teaching, in addition to student satisfaction that are factors in promotion and tenure evaluation. The editing of course presentations afforded by doculecture production allows faculty to address lecture misspeaks and errors, and affords a pathway to routine content updating, thereby increasing quality of the work product and efficiency of course support activity. The coupling of this quality pathway and the demonstrated ability of a doculecture to engage students in a high load learning activity are critical factors in learning effectiveness

That students can call an online class “better” than a live class is a tour de force demonstration of the capability of new media to scale low-cost academic resources toward academic excellence in a demanding learning experience. The “education with a pulse” dynamic of doculectures allows students an emotional connection in a high-load cognitive experience, and frees faculty to interact “in real time” during reflective exercises and subject mastery assessments. Key institutional, faculty and student partnerships can develop from the collaborative assembly of educational resources and the ability to share talents, resources and educational objectives can scale and leverage available resources. Traceable academic integrity is maintained by scholarly scripting that builds from the referenced knowledge base of the peer-reviewed literature. Production of OER doculectures addresses the need and demand that knowledge is “free”, while marketing faculty and intuitional competencies, and simultaneously maintaining a rigorous system of enrolled student subject area assessment, accreditation of mastery, and credentialing that is the mission of institutions of learning.

The simultaneous provision of learning resources for students with disabilities through lecture scripting addresses a universal need to maintain broad access for online educational resources. The current provision of either SD or HD streamed video by hosting sites such as YouTube or Vimeo also addresses access that accommodates broadband quality. Support of doculecture broadcast by computers, smartphones, video game consoles, streaming media players, and IPTV (internet protocol TV) demonstrates a technology convergence that enables broad access, further enabling student academic goals. The use of proven film and broadcast techniques to establish audience connection can be likewise tasked to overcome the sometimes sterile and isolating environment of online education, thereby removing barriers to learning. 

Equipment necessary to implement Effective Practice: 

The Principles of Sustainability doculecture course was funded by an internal university Greening the Curriculum grant of $5000 that was used for a computer, software, and teleprompter. Instructor provided camera and microphones were used in an existing white screen studio on campus. Deployment of doculectures requires consumer to professional-grade video production technology including a video camera, microphones, teleprompter, video and image editing software, and a classroom or studio with sufficient lights and background noise control. No camera operator is needed if a monitor is used. Instructor editing of video (variable time @ 1 to 3X of a new PowerPoint presentation) keeps costs low and can enhance quality and product precision.

Estimate the probable costs associated with this practice: 

Suitable multi-user technology costs are estimated at:

HD video camera and tripod @ $1000 - $6000

Quality shotgun microphones and boom (2, or 1 stereo) @ $600 - $3000

Video workstation computer @ $2,000 - $3,500

Video and image editing (NLE) software @ $200 - $1200 (academic pricing)

Light kit (if needed) @ $1000 (variable)

Infinity white screen @ $100 (DIY) - $1000

Teleprompter @ $100 (DIY) - $1,200

HDTV Monitor @ $300

Editing headphones @ $100

 

Production support resource costs are estimated at:

Royalty free music @ free to variable cost

Royalty free film @ free to variable cost

Royalty free images @ free to variable cost

Instructor time @ variable cost

Production assistance time @ variable cost


The use, provision, and accessibility of institutional-level video professional production support resources is highly variable and this can be reflected in cost basis.

References, supporting documents: 

Boltz, M.G. (2004). The cognitive processing of film and musical soundtracks. Memory & Cognition, 32 (7), 1194-1205.

Diemand-Yauman, C., Oppenheimer, D.M., and Vaughan, E.B. (2011). Fortune favors the Bold (and the Italicized): Effects of disfluency on educational outcomes. Cognition, 118 (1), 111-115.

Doyle, M. and Furnham, A. (2012). The distracting effects of music on the cognitive test performance of creative and non-creative individuals. Thinking Skills and Creativity, 7, 1-7.

Gilet, A.L. (2008). Mood induction procedures: A critical review. Encephale-Revue de Psychiatrie Clinique Biologique et Therapeutique, 34 (3), 233-239.

Kiger, D. (1989). Effects of music information load on a reading-comprehension task. Perceptual and Motor Skills, 69, 531 – 534.

Perlovsky, L. (2012). Emotions of "higher" cognition. The Behavioral and Brain Sciences, 35 (3), 157-158.

 

Contact(s) for this Effective Practice
Effective Practice Contact: 
Professor Greg Möller
Email this contact: 
gmoller@uidaho.edu
Author Information
Author(s): 
Jennifer Redd
Institution(s) or Organization(s) Where EP Occurred: 
San José State University
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

San José State University developed an instructional design process to engage faculty members in a learning community during the online course development process. Through the use of synchronous and asynchronous sessions housed in a learning management system, faculty members participated in a learning community with others, who were also developing an online course. The learning community served dual purposes: to provide faculty members with a peer support network and to display and showcase the effectiveness a learning community can have in the online environment.

 

Description of the Effective Practice
Description of the Effective Practice: 

San José State University’s mission is to enrich the lives of its students, to transmit knowledge to its students along with the necessary skills for applying it in the service of our society, and to expand the base of knowledge through research and scholarship. With a geographic location in Silicon Valley, the demand of technological innovation as it relates to the potential benefits for multicultural and global students define a purpose for the development of high quality online courses. The university supports the use of a learning management system (LMS) for teaching and learning online. Approximately, 55% of the faculty members were using the LMS in Fall 2011 and this process intended to help increase this percentage.

The objective of this practice was to assist faculty members in the design and development of an engaging and interactive online course that enhances the experience of the student learners. In order to encourage faculty members to participate in the development of an online course, a request for proposals was distributed to all faculty members. The request encouraged faculty members from a variety of disciplines and at varying technological competencies to develop or redevelop one of their courses in an online format. The proposed courses would involve the design, development, and eventual delivery of an innovative and engaging online based course utilizing the Desire2Learn learning management system. Selections involved the use of a rubric with a double evaluation of each submission. The areas covered included the following:

·      State the title and number associated with your course.

·      Is this course part of the General Education (GE) program?

·      How many students are typically enrolled in one section of this course?

·      Describe your experience with online courses and instructional technologies as an instructor.

·      Describe your experiences with online courses as a student.

·      Why are you interested in developing your course online?

·      Technology skill level (expert or novice)

·      Do you commit to the requirements of the various phases?

·      Proposal overall sections (strongly disagree, disagree, neutral, agree, strongly agree)

·      Proposal presentation – organized, logical, and easy to follow (5-point scale poor to excellent)

·      Proposal content – all areas addressed with adequate detail (5-point scale poor to excellent)

·      Course demand (5-point scale not important to very important)

·      Overall rank (5-point scale poor to excellent)

·      Overall quality (5-point scale poor to excellent)

·      Recommendation for participation (yes, no, not sure)

·      Comments

·      All components required were submitted and correctly formatted (including a copy of the proposed syllabus)

The implementation of a faculty learning community in the design and development process was intended to provide faculty members with another tier of support. Cox (2004) explains that a faculty learning community consists of faculty across disciplines that collaborate and actively engage in a curriculum to enhance their current level of knowledge. The development of a community occurs through cooperation and participation toward a common goal (Misanchuk & Anderson, 2001). In this case, the collaboration activities surrounded a particular topic: developing an online course. The use of a learning community allowed for faculty members to have multiple avenues of support: large group, small group, and individual (one-on-one consultations with an instructional designer).
The learning community allowed faculty members the opportunity to discuss with each other on a variety of educationally related topics, such as accessibility, assessment, copyright, and multimedia. The project began with a face-to-face session that provided an introduction and some technical information to all of the participants. Following this session, faculty participants provided a textual introduction to their peers using the online discussion board. The participants where then grouped with a partner of a differing technology skill level (e.g. novice and expert) and provided an audio message that described if in an elevator for 30 seconds, how would you describe your course and your teaching philosophy? Throughout the next four months, participants participated in the online discussions and met via an Elluminate session. Throughout this entire time period, participants regularly met with an instructional designer. Participants had deliverables throughout the design and development process to assist them in the completion of their course. A final component involved the completion of a rubric (remixed version of the California State University, Chico Rubric for Online Instruction) by a peer to provide feedback as to the aspects of the course that were emerging, effective and exemplary (See Appendix A). The conclusion of the project involved a survey and interview where the instructional designer met with the faculty member to discuss his/her experiences.

 

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

The goal of the project was to assist faculty members in the development of an effective online course. The development of an effective online course was measured and assessed via multiple tools. Throughout the development process, faculty members completed progress reports to indicate certain deliverables were completed. Also, the learning community provided feedback to one another. Their discussions were captured using the discussion board as well as though a synchronous web-conferencing session. Further data will be gathered related to the effectiveness of the development of the online course and the learning community support through a survey and interview. Providing a supportive community construct to aid faculty members in their own online course construction may have (1) permitted them to feel adequate support and a sense of belonging and (2) exemplified a model with which they might utilize in their own online course developed. 

How does this practice relate to pillars?: 

The implementation of a program of this nature allows faculty members access to a peer network of support at they develop a high quality online course. When encouraging faculty participation, it is important to communicate to them they will be part of and have access to a faculty learning community as they design and develop their online course. The faculty learning community is part of a larger project of developing an online course. The learning effectiveness can be measured by the successful completion of the development of an online course. The quality level of this course will be achieved and measured through rubrics, deliverables, and participation in the learning community activities. The scale of a project of this nature is unbounded. This type of project could be run at the department level, college level, or university level.

Equipment necessary to implement Effective Practice: 

The only equipment necessary for this project is a computer with an Internet connection.

Estimate the probable costs associated with this practice: 

The cost of a project can vary. The faculty participants after completion of designing, developing, and teaching the courses were and/or will be compensated with $1500. When recreating or implementing a program of this nature, the cost can vary depending on the budget of the school. The use of a learning community, for example, in a department where multiple courses are going to be put online may not require a monetary incentive, but with help provide an additional tier of support that will be instrumental in increasing the quality of the course developed. Also, encouraging faculty members who are interested in participating and acknowledging up front the support structure they will be provided with will be helpful as they embark together toward the common goal of developing a high quality online course.

References, supporting documents: 

California State University, Chico. (2009). Rubric for online instruction. Retrieved from, http://www.csuchico.edu/celt/roi/.

Cox, M. D. (2004). Introduction to faculty learning communities. In M. D. Cox & L. Richlin (Eds.), Building faculty learning communities (pp. 5-23). New Directions for Teaching and Learning: No. 97, San Francisco: Jossey-Bass. 

Misanchuk, M., & Anderson, T. (2001). Building community in an online learning environment: Communication, cooperation and collaboration. Retrieved from, http://www.mtsu.edu/~itconf/proceed01/19.html 

 

Contact(s) for this Effective Practice
Effective Practice Contact: 
Jennifer Redd
Email this contact: 
jennifer.redd@sjsu.edu
Author Information
Author(s): 
Liz Wallace
Author(s): 
Melissa Burgess
Author(s): 
Phil Ice
Institution(s) or Organization(s) Where EP Occurred: 
American Public University System
Effective Practice Abstract/Summary
Abstract/Summary of Effective Practice: 

 American Public University System (APUS) developed the Text Analytics for Surveys Model to analyze qualitative nontraditional student data related to retention and progression. By using this innovative model, APUS was able to effectively and efficiently analyze large amounts of qualitative data.

 

Description of the Effective Practice
Description of the Effective Practice: 

 Recognizing the importance of postsecondary student retention and progression in online environments, the American Public University System (APUS) routinely examines student retention and progression through a tripartite methodological lens using (1) descriptive, (2) inferential, and (3) exploratory data. APUS also collects volumes of explanatory (qualitative) data that cannot be efficiently analyzed using traditional qualitative methodologies given the exceedingly high volume of student replies (over 5,000 per month). At best random sampling provides a cursory overview that is little more than anecdotal in nature.

Toward addressing this issue, APUS developed the Text Analytics for Surveys Model--an innovative approach to assessing qualitative data related to nontraditional student retention and progression. The Model is framed by the Community of Inquiry (CoI) Framework (Garrison, Anderson, Archer, 2000), whereby keywords and phrases related to subcategories of the CoI Presences (social, teaching, and cognitive) are identified and entered into the Model. The CoI Framework is a process model of learning in online and blended educational environments and is grounded in a collaborative constructivist view of higher education (Dewey, 1933) that assumes effective online learning requires the development of a community of learners to support meaningful inquiry and deep learning.

Although libraries exist for text analytics, they are not specific to the CoI Framework or higher education. This implementation leverages the exiting business rules for text analytics against the CoI Framework. The end product is a rich, explanatory modeling system that provides clarity into APUS’s wealth of quantitative analyses.

 

Supporting Information for this Effective Practice
Evidence of Effectiveness: 

 Evidence of Effectiveness: Using qualitative end-of-course survey data based on the CoI Framework (CoI), the Text Analytics for Surveys model was framed from the results of an initial pilot study, (n = 428), and then further validated in the current study (n = 219). Results from the pilot study not only informed further refinement of the model prior to the current study, it provided baseline criteria for data selection using the Text Analytics for Surveys Model. Data from a two month sample were collected and entered into the IBM/SPSS Text Analytics for Surveys model. Results from the text analysis model were compared to the results of data that were analyzed using traditional qualitative coding methods. Accuracy of 81% was established, thereby evidencing and supporting the model’s effectiveness and efficiency. As this technique moves toward full implementation, APUS is empowered to address causality through examination of triangulated quantitative and qualitative data.

Innovation: The Text Analytics for Surveys model presents an innovative solution toward effectively and efficiently analyzing large amounts of qualitative data related to student retention and progression. Although libraries exist for text analytics, they are not specific to the Community of Inquiry Framework or higher education. Replicability: The practice can be replicated and implemented easily in a variety of learning environments. Potential impact: The Text Analytics for Surveys model is a simple solution toward analyzing retention and progression-related student data based upon the CoI Framework, therefore would undoubtedly gain the attention of postsecondary institutions who wish to analyze their own qualitative data to inform and improving student retention and progression efforts. Scope: The Text Analytics for Surveys model demonstrates strong interrelationships with several other pillars including learning, scale, access, and faculty and student satisfaction.

 

 

How does this practice relate to pillars?: 

 The Text Analytics for Surveys model most closely relates to the Sloan-C student satisfaction, faculty satisfaction, and learning effectiveness pillars. The Model relates student satisfaction as the APUS End-of-Course Survey provides the opportunity for students to communicate (quantitatively and qualitatively) their satisfaction on various components of the course. The Model relates to faculty satisfaction as the qualitative student responses from the APUS End-of-Course Survey will help pinpoint areas and course components of concern, so that instructors can modify their course design. From a learnng effectivenes perspective, the addition of explanatory qualitative data helps isolate and remediate areas of pedagogical concern on a timely basis.

 

Equipment necessary to implement Effective Practice: 

 SPSS Statistics Survey and Text Analytics for Modular

 

Estimate the probable costs associated with this practice: 

 Although there are the upfront costs of SPSS software (approximately $10,000), once the keywords and phrases relating to the CoI are identified and entered into the system, there is no need for modifications. Skilled coders and qualitative researchers will also be needed to build the libraries for analysis. It is estimated that 100 hours of preparatory work would be required.

 

References, supporting documents: 

 Anderson, T., Rourke, L., Garrison, D. R., & Archer, W. (2001). Assessing teaching presence in a computer conferencing environment. Journal of Asynchronous Learning Networks, 5 (2).

Arbaugh, J.B., Cleveland-Innes, M., Diaz, S.R., Garrison, D.R., Ice, P., Richardson, & Swan, K.P. (2008). Developing a community of inquiry instrument: Testing a measure of the Community of Inquiry framework using a multi-institutional sample. The Internet and higher Education, 11(3-4), 133-136.

Council for Higher Education Accreditation. (2010c). Recognition policy and procedures. Washington, DC: Council for Higher Education Accreditation.

Clark, (2011). Blog http://donaldclarkplanb.blogspot.com/2011/11/educations-slow-learner-lessons-from.html

Dewey, J. (1933). How we think. Boston: D.C. Health.

Eaton, J. (2010). Accreditation and the federal future of higher education. Academe, 96(5), 21-24. [Online] Retrieved from http://www.aaup.org/AAUP/pubsres/academe/2010/SO/feat/eato.htm

Garrison, D. R. (2009). Communities of inquiry in online learning: Social, teaching and cognitive presence. In C. Howard et al. (Eds.), Encyclopedia of distance and online learning (2nd ed., pp. 352-355). Hershey, PA: IGI Global.

Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2-3), 87-105

Garrison, D. R., Anderson, T., Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing in distance education. American Journal of Distance Education, 15(1).

Lowe J. (1998). Jack Welch speaks. New York: Wiley; 1998.

Meacham, J. A., & Gaff, Jerry, G. (2006). Learning goals in mission statements: implications for educational leadership. Liberal Education, 92(1), 6-13.

Rozycki, E. G. (2004). Mission and vision in education. Educational Horizons, 82, pp. 94-98.

 

Contact(s) for this Effective Practice
Effective Practice Contact: 
Phil Ice
Email this contact: 
pice@apus.edu
Effective Practice Contact 2: 
Melissa Burgess
Email contact 2: 
mburgess@apus.edu
Effective Practice Contact 3: 
Liz Wallace
Email contact 3: 
ewallace@apus.edu