In Defense of Validity Generalization...

Since Frank Schmidt and John Hunter published their classic paper in 1977, the concept of validity generalization has become almost universally accepted within the field of I-O psychology. However, there have been reports over the past several months that OFCCP has become increasingly resistant to validity arguments based upon meta-analytic validity generalization and has suggested that local validation studies be carried out when cognitive ability tests are used. In part, OFCCP's concerns seem to center around the fact that the notion of meta-analytic validity generalization does not appear in the Uniform Guidelines, which were drafted in 1978.

In an attempt to make the ATP membership and others in the I-O community aware of this issue, Jim Sharf of Employment Risk Advisors was kind enough to share two documents. The first is a letter that Jim wrote to the EEOC where he argues that the sections of the Uniform Guidelines which address "situational specificity" and "single group validity" are obsolete. The second is an open letter to OFCCP authored by David Copus, a well-known employment law attorney, who provides a very extensive review of the history of validity generalization and argues how the reliance of the Uniform Guidelines on the concept of "situational specificity" is dated and renders them inconsistent with current thinking in the field.

Read more!

EEOC Uniform Guidelines to Stay As Is

The EEOC has opted to leave the Uniform Guidelines as they currently are for at least the next three years. Specifically, the EEOC gave notice of its "intent to submit the Uniform Guidelines on Employee Selection Procedures (UGESP or Uniform Guidelines) without change, to the Office of Management and Budget (OMB) for a three-year approval under the Paperwork Reduction Act of 1995 (PRA)."

Additionally, the EEOC is not going to provide additional on the questions which were outlined in 2004 in relation to the definition of an "applicant." Specifically,

EEOC does not intend to finalize the five additional Questions and Answers that include clarification of the definition of ‘‘applicant.’’ However, employers still must ensure that they are complying with the requirements of UGESP.

Read more!

Civil Service Testing in China

Here is an interesting article outlining the history of the civil service examination system in China. The author argues that this may be one of China's most important contributions. Unfortunately, but not surprisingly, it appears that disgruntled test takers and cheating were of concern at least 1000 years ago just as they are today.

Read more!

Dilbert the Inquisitor

The New York Times takes a humorous look at pre-employment testing and assessment...
Read more!

EEOC Proposed Rulemaking on ADEA

In an update courtesy of David Arnold, ATP General Counsel, the Equal Employment Opportunity Commission (EEOC) has issued a notice of proposed rulemaking to address issues related to the United States Supreme Court's decision in Smith v. City of Jackson. The Court ruled that disparate impact claims are cognizable under the Age Discrimination in Employment Act (ADEA) but that liability is precluded when the impact is attributable to a reasonable factor other than age. Current EEOC regulations interpret the ADEA as prohibiting an employment practice that has a disparate impact on individuals within the protected age group unless it is justified as a business necessity. EEOC is proposing a change in rules to accommodate this Court ruling.
Read more!

On the International Front...

Those interested in global issues related to testing may want to take a look at the International Testing Commission website. Information about the organization and its goals are outlined as well as is information about ITC 2008 International Conference to be held July 14-16, 2008 in Liverpool, UK.

Also, Eric Shepherd, immediate Past Chair of the European Division of ATP (E-ATP) has created a wiki with information about the division and its goals. (For those not familiar, a wiki is a collaborative workspace that enables members to both comment and update a web site's content.)

Read more!

On Faking...

The issue of job candidates attempting to present themselves in a favorable light has long been of concern to those working in the area of personnel selection. The issue is quite complex from both a theoretical and practical perspective.

For example,
a recent study in Human Performance looked at the efficacy of warning applicants about faking on a personality inventory. 464 participants completed personality instruments in either a “warned” or “unwarned” condition. While subjects in the warned condition had lower mean scores on some scales, it did not increase the convergent validity between self and other ratings.

In thinking about job candidates “faking good,” it is also important to remember that job seekers will may attempt to present themselves favorably in selection tasks beyond psychometric assessment. For example, Julia Levashina and Michael Campion have been exploring the role of faking in employment interviews. In a recent study, they report that over 90% of undergraduate job candidates admit to attempting to present themselves in a way that enhances their attractiveness to employers.

Another interesting finding is that follow-up questioning increases faking. They write:

We hypothesized the opposite effect by assuming that probing would be a response verification mechanism that would inhibit faking. Informal debriefing with participants revealed that follow-up questioning was perceived not as response verification but rather as a cue signaling what types of answers were important and critical.

Read more!