2.4 Domain-specific vs. general problem solving

One of the most important insights of recent research in cognitive psychology is that solving demanding problems requires at least some knowledge of the domain in question. The concept of a problem space through which a General Problem Solver moves by means of domain-independent search strategies (Newell and Simon, 1972) proved to be too simple to describe how problem situations are understood and the process of finding a solution. Efforts to identify a general, domain-independent competence for steering dynamic systems (operative intelligence) within the framework of complex problem-solving research were also unsuccessful; performance on such systems can only partially be transferred to other systems (Funke, 1991). However, research on grade-3 to grade-12 students showed that problem-solving skills clearly improve under well-tuned training conditions and that a substantial transfer across different problems can be achieved (Reeff et al. 1989, 1992, 1993; Regenwetter, 1992; Regenwetter and Müller, 1992; Stirner, 1993).

Problem solving is dependent on knowledge of concepts and facts (declarative knowledge) and knowledge of rules and strategies (procedural knowledge) in a given subject domain. Although it is obvious from past research that declarative knowledge in the problem domain can substantially contribute to successful problem-solving strategies, procedural knowledge is crucial as well. The amount of relevant previous knowledge available could also account for the relation between intelligence and problem-solving performance, as shown in the work of Raaheim (1988) and Leutner (1999). People with no relevant previous knowledge at all are unable to explore the problem situation or plan a solution in a systematic manner and are forced to rely on trial and error instead. Those who are already very familiar with the task are able to deal with it as a matter of routine. General intellectual ability, as measured by reasoning tasks, plays no role in either of these cases. When problem solvers are moderately familiar with the task, analytical reasoning strategies can be successfully implemented.

2.5 Analytical problem solving: Definition and levels of proficiency

Despite the appeal of computer-based assessment of problem-solving skills the operational constraints imposed by contemporary large-scale comparative studies necessitate focusing on aspects of analytical problem solving that can be measured by paper-and-pencil tasks. The present framework also refrains from addressing social, emotional, and creative aspects of problem solving.

Analytical problem solving is the core of problem solving as a goal-directed cognitive process. It encompasses the use of content-specific and general knowledge, rules and strategies, and meta-cognition. A person's analytical problem-solving competency may be indicated by his or her performance in identifying a problem, searching for relevant information and integrating it into a coherent problem representation, evaluating the problem situation with respect to given goals and criteria, devising a plan — i.e. an ordered sequence of appropriate actions — and monitoring its execution.

Thus, analytical problem solving as it is defined here is closely related to reasoning ability and to the analytical subcomponent in Sternberg's triarchic theory of intelligence.