The 'Criterion Problem'

Let's review this from PSYCH 281 (lesson 4, page. 3):

"Criteria are evaluative standards that can be used as yardsticks for measuring [work]. Criteria are important for many decisions in organizations. We rely on these standards and measures to appraise employees' performance, validate selection devices and training programs, and make decisions about pay and promotion. Poor criteria beget poor organizational decisions...

Unfortunately, developing and measuring criteria well is a long-standing challenge for I/O psychologists. Researchers have been writing about this difficulty, called "the criterion problem," for decades (e.g., Flanagan, 1956; Austin & Villanova, 1992).

Why is it difficult to determine standards of performance? First, performance behavior is very complex and dynamic. It changes over time. Second, performance behavior is multidimensional. Third, no single criterion measures performance perfectly. In order to address this difficulty, more than one criterion can be used, but then decisions about how to combine and weight the individual criteria within the composite criterion create additional complexity. Lastly, criteria may differ across organizations. For example, performance related to communicating with customers may be focused on in a service industry, while production numbers may be measured in a manufacturing job.

Note: A composite criterion is a weighted combination of multiple criteria that results in a singular index of performance." For example, weekly activities are weighted most heavily in this class, accounting for almost half of your total grade, while the quizzes account for less than 30%.