Training Course on Assessment and Evaluation in Education for Measurement Specialists

Course Outline

Module 1: Foundations of Educational Measurement and Psychometrics

ü  Defining educational measurement and its purpose

ü  Key concepts: constructs, variables, levels of measurement

ü  Overview of psychometrics as a field

ü  The role of measurement specialists in education

ü  Ethical principles in educational assessment

ü  Practical Session: Identifying Measurement Scales for Various Educational Data Points

 

Module 2: Classical Test Theory (CTT) and Reliability

ü  True score theory and error in measurement

ü  Concepts of reliability: test-retest, internal consistency, inter-rater

ü  Calculating reliability coefficients (e.g., Cronbach's Alpha, Kuder-Richardson)

ü  Standard Error of Measurement (SEM) and its application

ü  Strategies for improving test reliability

ü  Practical Session: Calculating and Interpreting Reliability Coefficients for Sample Data

 

Module 3: Validity in Educational Assessment

ü  Defining validity: content, criterion-related, construct validity

ü  Evidence for validity: internal structure, response processes, consequences of testing

ü  Threats to validity in assessment design

ü  Relationship between reliability and validity

ü  Validity arguments and their construction

ü  Practical Session: Developing a Validity Argument for a New Educational Assessment

 

Module 4: Item Response Theory (IRT) and Modern Test Theory

ü  Introduction to IRT models (e.g., Rasch model, 2-parameter logistic model)

ü  Item Characteristic Curves (ICCs) and their interpretation

ü  Advantages of IRT over CTT (e.g., item banking, adaptive testing)

ü  Estimating item parameters and person abilities

ü  Applications of IRT in large-scale assessment

ü  Practical Session: Interpreting Item Characteristic Curves from IRT Analysis Software

 

Module 5: Test Development Process and Item Analysis

ü  Steps in designing a high-stakes assessment (test blueprinting)

ü  Writing effective test items (multiple-choice, constructed response, performance-based)

ü  Item analysis: difficulty, discrimination, distractor analysis

ü  Pilot testing and field testing procedures

ü  Assembling and equating test forms

ü  Practical Session: Conducting Item Analysis on a Set of Test Questions

 

Module 6: Fairness, Bias, and Accessibility in Assessment

ü  Concepts of fairness in assessment (e.g., equity, comparability)

ü  Identifying and mitigating assessment bias (e.g., differential item functioning - DIF)

ü  Designing accessible assessments for diverse learners

ü  Accommodations and modifications for students with disabilities

ü  Cultural relevance and linguistic considerations in assessment

ü  Practical Session: Reviewing Test Items for Potential Bias and Accessibility Issues

 

Module 7: Scaling, Scoring, and Reporting Assessment Results

ü  Raw scores, standard scores, and norm-referenced interpretations

ü  Criterion-referenced and domain-referenced scoring

ü  Developing effective score reports for various stakeholders

ü  Communicating assessment results clearly and responsibly

ü  Setting performance standards and cut scores

ü  Practical Session: Creating a Sample Score Report for a Standardized Test

 

Module 8: Educational Program Evaluation Models and Designs

ü  Types of evaluation: formative, summative, process, outcome

ü  Logic models for program planning and evaluation

ü  Designing evaluation studies (experimental, quasi-experimental, non-experimental)

ü  Data collection methods for program evaluation

ü  Reporting evaluation findings and making recommendations

ü  Practical Session: Developing a Logic Model for an Educational Intervention Program

 

Module 9: Advanced Statistical Analysis for Assessment Data

ü  Regression analysis and its applications in educational measurement

ü  Factor analysis for understanding test dimensionality

ü  Structural Equation Modeling (SEM) for complex relationships

ü  Longitudinal data analysis in educational contexts

ü  Using statistical software (e.g., R, SPSS, SAS) for data analysis

ü  Practical Session: Conducting a Basic Regression Analysis Using Educational Dataset

 

Module 10: Policy Implications and Ethical Considerations in Measurement

ü  The use and misuse of assessment data in educational policy

ü  High-stakes testing and its consequences

ü  Privacy and security of assessment data

ü  Ethical guidelines for assessment professionals (e.g., AERA, NCME standards)

ü  The role of measurement specialists in advocating for sound assessment practices

ü  Practical Session: Debating the Ethical Implications of Using High-Stakes Tests for Accountability

Admission Criteria

ü  Participants should be reasonably proficient in English. 

ü  Applicants must live up to Phoenix Center for Policy, Research and Training admission criteria.

Terms and Conditions

1. Discounts: Organizations sponsoring Four Participants will have the 5th attend Free
2. What is catered for by the Course Fees: Fees cater for all requirements for the training – Learning materials, Lunches, Teas, Snacks and Certification. All participants will additionally cater for their travel and accommodation expenses, visa application, insurance, and other personal expenses.
3. Certificate Awarded: Participants are awarded Certificates of Participation at the end of the training.
4. The program content shown here is for guidance purposes only. Our continuous course improvement process may lead to changes in topics and course structure.
5. Approval of Course: Our Programs are NITA Approved. Participating organizations can therefore claim reimbursement on fees paid in accordance with NITA Rules.

Booking for Training

Simply send an email to the Training Officer on training@phoenixtrainingcenter.com and we will send you a registration form. We advise you to book early to avoid missing a seat to this training.

Or call us on +254720272325 / +254737296202

Payment Options

We provide 3 payment options, choose one for your convenience, and kindly make payments at least 5 days before the Training start date to reserve your seat:

1. Groups of 5 People and Above – Cheque Payments to: Phoenix Center for Policy, Research and Training Limited should be paid in advance, 5 days to the training.
2. Invoice: We can send a bill directly to you or your company.
3. Deposit directly into Bank Account (Account details provided upon request)

Cancellation Policy

1. Payment for all courses includes a registration fee, which is non-refundable, and equals 15% of the total sum of the course fee.
2. Participants may cancel attendance 14 days or more prior to the training commencement date.
3. No refunds will be made 14 days or less before the training commencement date. However, participants who are unable to attend may opt to attend a similar training course at a later date or send a substitute participant provided the participation criteria have been met.

Tailor Made Courses

This training course can also be customized for your institution upon request for a minimum of 5 participants. You can have it conducted at our Training Centre or at a convenient location.

For further inquiries, please contact us on Tel: +254720272325 / +254737296202 or Email training@phoenixtrainingcenter.com

Accommodation and Airport Transfer

Accommodation and Airport Transfer is arranged upon request and at extra cost. For reservations contact the Training Officer on Email: training@phoenixtrainingcenter.com or on Tel: +254720272325 / +254737296202