6.1 Method
6.1.1 Materials
Two main kinds of materials were used in this project.
The Everyday Situational Judgment Inventory. The Everyday Situational-Judgment
Inventory (ESJI) consists of descriptions of various situations encountered by many
people. After each situation, there are 8 options for handling the situation. For each
option listed, participants were asked to rate the quality of the option on a 1 (low) to 9
(high) Likert scale, where the anchor points were 1=extremely bad, 3=somewhat bad,
5=neither bad nor good, 7=somewhat good, and 9=extremely good. Participants were
asked to select the number corresponding to their judgment, and to write it in the
blank preceding each option. Participants were told that there was no one "right" answer—that
the options were simply things that people might do in the situations described.
An example of an item is as follows:
You've been assigned to work on a project for a day with a fellow employee whom you
really dislike. He is rude, lazy, and rarely does a proper job. What would be the best thing for you
to do?
- Tell the worker that you think he is worthless.
- Warn the worker that, if he is not "on his toes" today, you will complain to the supervisor.
- Avoid all conversation and eye contact with the other worker.
- Be polite to the other worker and try to maintain as business-like a manner as
possible so that hopefully he will follow your example for the day.
- Tell your supervisor that you refuse to work with this man.
- The project is going to be impossible to accomplish with this worker, so you may as
well not even try — you can always blame your bad work partner.
- See if you can convince one of your friends to take your place and work with this employee.
- Demand a raise from your supervisor; you should not have to tolerate these conditions.
Participants were given as much time as they needed to finish the inventory.
Scoring for the ESJI was done in three ways:
- Profile matching (d2). For each of the 30 problems, a given respondent's responses were
compared to the averaged (prototypical) responses to that problem. The following
specific scoring procedure was used. For a given option, the difference between the
participant's response and the sample-mean response was computed and squared.
Squared differences were summed across the 8 options and averaged. Then the square
root of this average was computed. The same procedure was repeated for each of the 30
items. Total score was the sum of these values.
- Rank-order correlation between individuals and mean profile (ρ). For this measure, the
rank orders of the responses for the mean profile of responses to a given item were
correlated with the rank orders of the responses for an individual's profile of responses
for that item. Thus, 8 observations for an individual were correlated with 8 observations
for the mean profile. This analysis yielded a rank-order correlation (rho, or ρ) for each
item. These correlations were averaged across the 30 problems.
- Dichotomized responses based on significance of ρ. Dichotomized scores were created for
each of the 30 items by assigning the item a score of 1 if the ρ value for that item was
statistically significant and a 0 otherwise. In other words, the respondent got credit (1)
if the respondent'ys item response pattern rank-order correlated significantly with the
averaged item response pattern.
|