6. Conclusions

Based on research in the field of problem solving, this framework presents an assessment rationale for a meaningful subset of problem-solving skills, i.e. analytical problem-solving skills. Based on this rationale a set of assessment instruments was developed and further refined in the development process outlined in chapter 4, ranging from first draft scenarios to well-established projects which proved to "work" in a multinational pilot study. The assessment yields one scale for problem-solving skills with four competency levels:

1. Content related reasoning
2. Evaluating
3. Ordering/Integrating
4. Critical Thinking

The empirical results of the pilot study show conclusive results: All tested projects yielded very good empirical results and, with slight modifications, may be used in the main survey. The items within the projects cover a broad range of difficulties as well as all the competency levels. The long and short versions of the problem-solving projects proved to be diagnostically equivalent. Due to financial and logistical reasons, the short versions of the problem-solving projects — somewhat extended and modified — were selected for use in the ALL main survey.