EDTEC 561 Measuring the Impact of Technology on Learning (3): Prepares teachers to evaluate the effects of technology use. Prerequisite: EDPSY 421 or equivalent and AEE 521 or equivalent.
Overview
This course is designed to prepare teachers and other educators to use basic quantitative methods to assess the effects of a variety of technology-related innovations in their own classrooms and schools. Using the skills and perspectives acquired in this course, you will be able to move on to EDTEC 566, and EDTEC 567 where you will design and develop implementation/evaluation projects to examine the effectiveness of technology enhanced learning experiences in your classroom or school. EDTEC 561 was designed for students who expect to enroll in EDTEC 566 and EDTEC 567. I sometimes make adjustments to this syllabus for students who will not be taking EDTEC 566 or 567. If you have been admitted to the course with that understanding, be sure to remind me of your status by course e-mail.
Course Objectives
Course content is organized by five themes; problem identification, assessment, problem theory, research design, and Scholarship and Research integrity. The activities of the themes are intended to help you build skills that will enable you to identify an instructional problem in your professional context and think about that problem in a way that will make you more likely to be able to use technology effectively to address the problem. The fifth theme, Scholarship and Research integrity (SARI), is a requirement of all graduate students who will collect data from research subjects. Since you will be collecting and evaluating data from implementation/evaluation projects, you will need to meet this requirement.
-
Objectives for the Problem identification and Assessment Themes
Identify an instructional problem that you can address using a technology-based strategy. Problem identification includes;- using Robert Gagné's hierarchy of intellectual skill to classify cognitive complexity of the problem
- using item analysis of test results to determine the difficulty of the problem
- creating a prerequisite analysis of the problem
- developing and administering a pilot assessment to determine the scope of the problem on the prerequisite analysis
- use the prerequisite analysis and pilot assessment results to construct a criterion assessment that can be used to evaluate the instructional effectiveness of your technology-based instructional strategy
-
discuss the validity of your assessment and estimate it's reliability.
-
Objectives for the Problem Theory Theme
Use current learning theories to explain the cognitive demands of your instructional problem- Use information processing and schema theory to describe the cognitive processes that need to be addressed for learning to occur in your problem area.
- Use Penn State library resources to locate articles in peer reviewed journals that will increase you theoretical understanding of your problem.
- Use your theoretical understanding of your problem area to describe the essential elements of an instructional strategy that will promote learning in your problem area.
- using item analysis of test results to determine the difficulty of the problem
-
-
Objectives for the Research Design Theme
Use instructional design principles that will help you to evaluate the effectiveness of instructional strategies intended to improve learning in your problem area.- Use Bransford's adaptation of the Tetrahedral Model to identify possible interactions among learner characteristics, content, the instructional strategy, and the assessment.
- Use statistical t-tests to evaluate the consistency/congruence of sets of assessment data with instructional content, and the effects of the instructional strategy on information processing, and identify variables that can confound your results.
-
Complete a tetrahedral analysis of an instructional strategy in your problem area.
-
Objectives for the Scholarship and Research integrity (SARI) Theme
- Complete modules on the Responsible Conduct if Research in the CITI site
- Discuss themes of RCR as it related to your work in evaluating the effectiveness of technology-based instructional strategies in your professional context.
- Complete IRB module in CITI site.
-
Discuss IRB issues as they relate to your work with students .
Required Course Materials
The following are required materials you need to purchase:
-
Nitko, A. J. & Brookhart, S. M. (2007). Educational Assessment of Students, 5th Edition, Pearson. Inexpensive copies of this book can be purchase through used book sellers such as Amazon. ISBN: 9780131719255
- Gagné, E. D., Yekovich, C. W., & Yekovich, F. R. (1993). The Cognitive Psychology of School Learning, 2nd edition, Longman. Note; This text is not available through the regular World Campus bookstore. Inexpensive copies can be purchase through used book sellers such as Amazon. ISBN: 9780673464163
This course also requires that you access Penn State library materials specifically reserved for this course. To access these materials, click on the Library Reserves link under the Resources tab. The following materials have been reserved:
- Creating high-quality learning environments: guidelines from research on how people learn. Bransford, John et al.
- Four points to remember: a tetrahedral model of memory experiments. Jenkins, James J.
- Varieties of Learning: Intellectual skills and strategies. Gagné, R. et al.
Additional materials:
- You will need access to the Spreadsheet program Microsoft Excel.
- You will need educational psychology and statistics textbooks for reference as you will be expected to apply knowledge gained in these prerequisite courses.
- Additional readings, exercises, self-assessments, etc. are listed for each lesson in the Course Schedule.
Library Resources
Many of the University Libraries resources can be utilized from a distance. Through the Libraries website, you can
- access magazine, journal, and newspaper articles online using library databases;
- borrow materials and have them delivered to your doorstep—or even your desktop;
- get research help via email, chat, or phone using the Ask a Librarian service; and
- much more.
You must have an active Penn State Access Account to take full advantage of the Libraries' resources and service. The Off-Campus Users page has additional information about these free services.
Technical Requirements
| Operating System | Windows Vista, Windows 7, Windows 8*; Mac OS X 10.5 or higher *Windows 8 support excludes the tablet only RT version |
|---|---|
| Processor | 2 GHz or higher |
| Memory | 1 GB of RAM |
| Hard Drive Space | 20 GB free disk space |
| Browser | We recommend the latest ANGEL-supported version of Firefox or
Internet Explorer. To determine if your browser fits this criterion,
and for advice on downloading a supported version,
please refer to the following ITS knowledge base article: Supported Browsers and Recommended Computers.
Note: Cookies, Java, and JavaScript must be enabled. Pop-up blockers should be configured to permit new windows from Penn State websites. Due to nonstandard handling of CSS, JavaScript and caching, older versions of Internet Explorer (such as IE 6 or earlier) do not work with our courses. |
| Plug-ins | Adobe Reader [Download from Adobe]
Flash Player (v7.0 or later) [Download from Adobe] |
| Additional Software | Microsoft Office (2007 or later) |
| Internet Connection | Broadband (cable or DSL) connection required |
| Printer | Access to graphics-capable printer |
| DVD-ROM | Required |
| Sound Card, Microphone, and Speakers | Required |
| Monitor | Capable of at least 1024 x 768 resolution |
If you need technical assistance at any point during the course, please contact the Service Desk.
For registration, advising, disability services, help with materials, exams, general problem solving, visit World Campus Student Services!
Course Schedule
The schedule below outlines the topics we will be covering in this course, along with the associated time frames and assignments. Information for Modules 1 and 2 are provided at the opening of the course.
- Course length: 13 weeks
|
Module Number/ |
Problem Identification | Assessment | Problem Theory | Research Design | SARI |
|---|---|---|---|---|---|
|
Module 1 3 pts. |
Problem ID 1 Select research setting and identify potential problems (2 pts) |
SARI 1 Introduction (1 pt) |
|||
|
Module 2 12 pts. |
Problem ID 2
Problem ID 3 |
Assessment 1
|
|||
|
Module 3 12 pts. |
Problem ID 4 Prerequisite analysis of your problem (6 pts) |
Assessment 2 |
SARI 2 Research Misconduct (1 pt) |
||
|
Module 4 12 pts. |
Problem ID 5 The pilot assessment (6 pts) |
Problem Theory 1
|
|
||
|
Module 5 12 pts. |
Problem ID 6 Administer your pilot assessment (6 pts) |
Problem Theory 2
|
SARI 3 |
||
|
Module 6 12 pts. |
Assessment 3
|
Problem Theory 3
|
SARI 5 |
||
|
Module 7 12 pts. |
Problem Theory 4
|
SARI 6 |
|||
|
Module 8 12 pts. |
Problem Theory 5 Finding and using professional literature to deepen your practical and theoretical understanding of your problem (7 pts) |
Research Design 1 |
SARI 7 |
||
|
Module 9 12 pts. |
Problem Theory 6 Apply literature readings to your instructional problem (6 pts) |
Research Design 3 Consistency/congruency of content and assessment. (5 pts) |
SARI 8 |
||
|
Module 10 12 pts. |
|
Problem Theory 7 |
Research Design 4 Consistency/congruency of content and strategy (5 pts) |
SARI 9 Review Reflections 1-3 (1 pt) |
|
|
Module 11 12 pts. |
Problem ID 7 |
Research Design 5 Consistency/congruency of strategy and assessment. (5 pts) |
SARI 10 Review Reflections 4-6 (1 pt) |
||
|
Module 12 12 pts. |
Research Design 6 Interactions of learner variables and tetrahedral analysis of your problem (5 pts) |
SARI 11 Wrap up RCR discussion (2 pt) SARI 12 Complete CITI IRB training, begin IRB discussion (5 pts) |
|||
|
Module 13 12 pts. |
Problem Theory 8 Apply literature readings and tetrahedral analysis to your instructional problem (10 pts) |
SARI 13 Complete participation in IRB discussion (2 pts) |
Formal instruction will end on the last day of class. Provided that you have an active Penn State Access Account userid and password, you will continue to be able to access the course materials for one year from the day the course began (with the exception of library reserves).
Grading
Course grades will be determined on the following basis:
The total points for the course will be approximately 147. Grades will be determined by converting total points earned for activities to the percentage of total possible points for the course. The resulting percentage will be converted to a letter grade using the following scale.
However, many of the activities in this course are competency based which means pass fail. You will either earn full points or no points for this type of activity. In cases where no points are assigned to an activity, you will need to redo the activity until the work has been judged to demonstrate sufficient understanding to move on to the next activity. When you move on, you will receive a point deduction from the initial possible points for that activity.
Since you are developing essential research skills which you will use in the remainder of the program, all assignments must be completed to be eligible to receive a grade for the course. If ALL assignments are not completed at the end of the course, the best grade you can receive will be a C. This grade will indicate that you have not completely prepared for EDTEC 566 and EDTEC 567.
Once you have completed all of the assignments, your letter grade will be calculated using the table below.
| Letter Grade | Percentage |
|---|---|
| A | 92-100 |
| A- | 90-91 |
| B+ | 88-89 |
| B | 82-87 |
| B- | 80-81 |
| C+ | 78-79 |
| C | 72-77 |
| D | 61-71 |
| F | <60 |
Assignments Due
Modules are designed to begin at 8:00 a.m. eastern time each Wednesday. Assignments submitted after 8:00 a.m. the following Wednesday mornings are considered late. If you have circumstances that interfere with submitting an assignment on time, please contact your instructor BEFORE the due data. Assignments not submitted by the time work has been checked will receive a point deduction unless arrangement are made prior to the due date or special circumstances exist.
Please refer to the University Registrar's information about University grading policies.
If, for reasons beyond the student's control, a student is prevented from completing a course within the prescribed time, the grade in that course may be deferred with the concurrence of the instructor. The symbol DF appears on the student's transcript until the course has been completed. Non-emergency permission for filing a deferred grade must be requested by the student before the beginning of the final examination period. In an emergency situation, an instructor can approve a deferred grade after the final exam period has started. Under emergency conditions during which the instructor is unavailable, authorization is required from one of the following: the dean of the college in which the candidate is enrolled; the executive director of the Division of Undergraduate Studies if the student is enrolled in that division or is a provisional student; or the campus chancellor of the student's associated Penn State campus.
For additional information please refer to the Deferring a Grade page.
Academic Integrity
According to Penn State policy G-9: Academic Integrity (for undergraduate students in undergraduate courses) and policy GCAC-805 Academic Integrity (for graduate students and undergraduate students in graduate courses), an academic integrity violation is “an intentional, unintentional, or attempted violation of course or assessment policies to gain an academic advantage or to advantage or disadvantage another student academically.” Unless your instructor tells you otherwise, you must complete all course work entirely on your own, using only sources that have been permitted by your instructor, and you may not assist other students with papers, quizzes, exams, or other assessments. If your instructor allows you to use ideas, images, or word phrases created by another person (e.g., from Course Hero or Chegg) or by generative technology, such as ChatGPT, you must identify their source. You may not submit false or fabricated information, use the same academic work for credit in multiple courses, or share instructional content. Students with questions about academic integrity should ask their instructor before submitting work.
Students facing allegations of academic misconduct may not drop/withdraw from the affected course unless they are cleared of wrongdoing (see G-9: Academic Integrity or GCAC-805 Academic Integrity as appropriate). Attempted drops will be prevented or reversed, and students will be expected to complete course work and meet course deadlines. Students who are found responsible for academic integrity violations face academic outcomes, which can be severe, and put themselves at jeopardy for other outcomes which may include ineligibility for Dean’s List, pass/fail elections, and grade forgiveness. Students may also face consequences from their home/major program and/or The Schreyer Honors College.
How Academic Integrity Violations Are Handled
World Campus students are expected to act with civility and personal
integrity; respect other students' dignity, rights, and property; and help
create and maintain an environment in which all can succeed through the
fruits of their own efforts. An environment of academic integrity is
requisite to respect for oneself and others, as well as a civil community.
In cases where academic integrity is questioned, procedures allow a student to accept or contest/appeal the allegation. If a student chooses to contest/appeal the allegation, the case will then be managed by the respective school, college or campus Academic Integrity Committee. Review procedures may vary by college, campus, or school, but all follow the aforementioned policies.
All academic integrity violations are referred to the Office of Student Accountability and Conflict Response, which may assign an educational intervention and/or apply a Formal Warning, Conduct Probation, Suspension, or Expulsion.
Information about Penn State's academic integrity policy is included in the information that students receive upon enrolling in a course. To obtain that information in advance of enrolling in a course, please contact us by going to the Contacts & Help page.
Accommodating Disabilities
Penn State welcomes students with disabilities into the University’s educational programs. Every Penn State campus has an office for students with disabilities, including World Campus. The Disabilities and Accommodations section of the Chaiken Center for Student Success website provides World Campus students with information regarding how to request accommodations, documentation guidelines and eligibility, and appeals and complaints. For additional information, please visit the University's Student Disability Resources website.
In order to receive consideration for reasonable accommodations, you must contact the appropriate disability services office at the campus where you are officially enrolled, participate in an intake interview, and provide documentation. If the documentation supports your request for reasonable accommodations, your campus's disability services office will provide you with an accommodation letter. Please share this letter with your instructors and discuss the accommodations with them as early in your courses as possible. You must follow this process for every semester that you request accommodations.
Students with disabilities participating in internship, practicum, student teaching, or other experiential learning opportunities as part of their degree requirements may also be eligible for reasonable accommodations to ensure equal access and opportunity. These accommodations are determined through an interactive process involving the student, their University supervisor, and the site supervisor. Student Disability Resources can assist students with identifying potential barriers, facilitating accommodation requests, and coordinating with University supervisors to promote inclusive learning experiences.
Additional Policies
For information about additional policies regarding Penn State Access Accounts; credit by examination; course tuition, fees, and refund schedules; and drops and withdrawals, please see the World Campus Student Center website.
Disclaimer: Please note that the specifics of this Course Syllabus are subject to change, and you will be responsible for abiding by any such changes. Your instructor will notify you of any changes.
