Critical Thinking Assessment Pdf

If you like, someone from Schuhfried would be glad to give you a personal guided tour in the form of a webcast.

Contact Fritz Mayr at mayr@schuhfried.at for more information or visit HCTA Information

More information about the HCTA

Employers, educators, and the general public all agree that critical thinking is an essential skill for citizens of the 21st century. It is the primary objective of education and a core ability that employers want for their prospective and current employees. A study by the Association of American Colleges and Universities (Hart Research Associates, 2013, p. 1) found that “nearly all employers surveyed (93 percent) say that ‘a demonstrated capacity to think critically, communicate clearly, and solve complex problems is more important than [a candidate’s] major.” Similar results have been found in reports from a wide range of employer and academic reports. But what is critical thinking, and how can we assess it?

The Halpern Critical Thinking Assessment (HCTA) was designed to help educators and employers assess critical thinking skills in their students and employees.

Unique characteristics of the HCTA

The following manual explains the unique properties of the HCTA. The central question is what makes a measure of critical thinking good? A good measure can predict how people act in the real world. The HCTA is the only measure of critical thinking that has real world validity—it can predict what adults do (more precisely, what they say they do) in their daily lives. These studies are described in the validity section in the HCTA Manual.

The HCTA provides a measure of how people think when they contemplate information that relates to real-world experiences. The HCTA uses two response formats: constructed response—how people first respond to a situation (in their own words) and forced choice, which is a measure of how well they can recognize a good response. It is the only measure of critical thinking to use two types of response formats. Even though most experts agree that constructed responses are usually the best measure of what people actually think and do, they often avoid constructed responses because of the time needed to grade the responses. In addition, another common problem with constructed responses is that it is difficult to get good interrater reliabilities. The HCTA uses a computerized grading system that guides the grader with prompts that make it easy and relatively fast for anyone to grade constructed responses. Interrater reliabilities are very high because of a computerized grading system that prompts the grader with questions about the constructed responses and the numerical grading is then computed automatically.

Finally, the HCTA is easy to use. There are several options for users. The HCTA can be administered online or offline. If test administrators opt to administer the test online, respondents are sent a link (via e-mail or other on-line method such as a link in a spread sheet) which opens a screen where the respondent provides basic demographic information and then takes the HCTA on-line. The grading of the constructed responses can be done by the test administrator. If the test administrator opts to grade the constructed responses, this is accomplished with the use of grading prompts. Test administrators receive HCTA test scores (along with subscores and norms) in various output formats (e.g., SPSS, CSV, etc). The easiest alternative involves very little work on the part of the administrator. Provide test takers with a link and then get results fully scored with norms. Alternatively, test administrators who want more control over the testing environment can opt to install the Vienna Test system on their own computers and use the system to administer and grade the tests. The choice is yours. The HCTA is culturally fair. It is currently being used in many countries and languages around the world with comparable norms.

Structure of the HCTA

The HCTA consists of 20 everyday scenarios, each of which is briefly described and presented using common language. For each scenario, respondents are first asked an opened ended (i.e., constructed response) question, which is followed by a forced choice question (e.g., multiple choice, ranking, or rating of alternatives) such as select the best alternative, rate each of the alternatives in terms of their relevance, or indicate which two of the following alternatives indicates a good response. Cognitive psychologists differentiate between free recall and recognition processes in memory and these two types of questions are designed to take advantage of the different cognitive processes. The total score is (approximately) equally weighted between constructed response and forced choice questions.

The questions of the HCTA represent five categories of critical thinking skills: verbal reasoning (e.g., recognizing the use of pervasive or misleading language), argument analysis (e.g., recognizing reasons, assumptions, and conclusions in arguments), thinking as hypothesis testing (e.g., understanding sample size, generalizations), using likelihood and uncertainty (e.g., applying relevant principles of probability such as base rates), as well as decision making and problem solving (e.g., identifying the problem goal, generating and selecting solutions among alternatives). Although there are an equal number of scenarios for each critical thinking category, some categories were worth more total points than other categories in their contribution to the total critical thinking score. The categories were weighted as follows with the following rationale as to their relative importance and contribution to critical thinking:

·Decision making and problem solving: In some sense all of the subtypes of critical thinking skills are involved decision making (generating and selecting from alternatives based on relevant criteria) and problem solving (finding solutions to a situation, or more colloquially, moving from a start space to a goal). Because this category relies on subsets of the other critical thinking skills (e.g., recognizing that an unlikely event is a not an optimal choice when making decisions or examining the reasons for a course of action), it was weighted with more total points than the other categories.

·Thinking as hypothesis testing: The skills of hypothesis testing are not restricted to evaluating formal research; they are (or should be) used in multiple everyday situations. Faulty thinking often involves hasty generalizations from small samples of behavior (e.g., a new friend is late and the respondent generalizes that the new friend must be habitually late) or failure to consider control conditions (e.g., a cold gets better after taking a vitamin supplement, but there is no consideration that it might have gotten better without the supplement).

·Argument analysis: Too often people reach conclusions without consideration of the reasons that support or fail to support the conclusion. The ability to seek and provide reasons and to recognize the differences between conclusions and assumptions is critical for good thinking. It is the difference between uninformed opinions and reasoned thinking.

·Likelihood and uncertainty: A basic understanding of probabilities and how they affect the likelihood of an outcome and how to use probabilities in uncertain situations are an essential component of critical thinking, but these skills are unlikely to develop beyond a rudimentary level without formal instruction. Many concepts relating to likelihood and uncertainty such as regression to the mean (an extreme event is likely to be followed by a less extreme event) and gambler's fallacy (if a fair coin comes up heads in 3 flips, a tail is not more likely on the 4th flip) are counterintuitive. Thus, although these are important concepts, the likelihood and uncertainty category was given a lower weight than some of the other categories so as not to penalize test takers who have not had any formal education in understanding likelihood and uncertainty.

·Verbal reasoning: The ability to understand how natural language influences thinking is also an essential component of critical thinking, but it was given a lower weighting than some of the other categories, in part, because the connotation of words varies among languages (e.g., tramp is a difficult concept to convey is many languages) and the relatively low weighting was designed so as not to penalize test takers whose native language is not English.

Unlike other tests of critical thinking, the HCTA uses both open ended and forced choice questions. Both response formats have advantages and limitations. Forced choice questions assess the ability to recognize a correct response, but there are few instances in real life where people are presented with an array of answers to select from. Recognition is a lower-level cognitive skill, which is expected to yield higher estimates of critical thinking skill than constructed response questions, which requires higher-level cognitive processing. The disadvantage of constructed response questions is that they benefit people with good writing skills, and thus may underestimate the critical thinking skills of mediocre writers. There is evidence that multiple-choice and open-ended responses are measuring separate cognitive abilities (Bridgeman & Moran, 1997). The constructed response portion of the HCTA attempts to reveal more of the dispositional component of thinking, as it allows test-takers to demonstrate whether they are inclined to apply the appropriate skills (Ku, 2009). Essentially, the constructed response format measures “free recall” as there are few constraints on the type of response that the test-taker may generate, whereas the multiple-choice format measures recognition memory. "The former requires test-takers to consciously search and select appropriate knowledge and skills from their own memory in constructing an answer, whereas the latter requires test-takers to identify the appropriate response from a given list of alternatives" (Ku, 2009, p. 74).

After responding to this constructed response prompt, test takers are then asked "to select the best alternative from a short list of alternatives. A sample alternative might be

We only know that being alcoholic is correlated with being depressed. Although relieving the depression could help alcoholics become sober, there is no reason to believe that depression causes alcoholism or that alcoholism causes depression or that by alleviating depression, alcoholics will find it easier to beat their addiction.

The HCTA assesses critical thinking with ecologically valid examples, in this case scenarios common to everyday life experiences. For example, if the skill of understanding and recognizing the distinction between correlation and cause were being assessed (in the thinking as hypothesis testing category), scenarios could be drawn from multiple disciplines such as medical research (e.g., coffee drinkers report more headaches than people who do not drink coffee), social policy analysis (e.g., welfare mothers who participated in a job training program were more likely to be employed one year later than welfare mothers who did not participate in the job training program), and numerous other believable scenarios. These scenarios are examples of situations that might be found in newspapers and in everyday conversations. Following the constructed response, participants are presented with forced choice questions pertaining to the same scenario. The multiple choice or multiple rating portions would demonstrate whether the respondent was able to recognize the appropriate skills when it is presented in a list of alternatives.

New and Improved Grading

A new grading system has recently been added to the HCTA to improve scoring consistency. The computer-assisted grading system prompts the grader with questions regarding the respondents answers. As the grader answers the grading prompts the program automatically assigns the appropriate points for that question. Once all the questions are answered the computer displays a detailed profile of the respondent’s critical thinking abilities.
  • Butler, H. A. (2012). Halpern Critical Thinking Assessment predicts real-world outcomes of critical thinking. Applied Cognitive Psychology, 26, 721-729.doi:10.1002/acp.2851

  • Halpern, D. F. (2010). Halpern Critical Thinking Assessment. Publisher: SCHUHFRIED (Vienna Test System). http://www.schuhfried.com/vienna-test-system-vts/all-tests-from-a-z/test/hcta-halpern-critical-thinking-assessment-1/

  • Marin, L., & Halpern, D. F. (2010). Pedagogy for developing critical thinking in adolescents: Explicit instruction produces greatest gains. Thinking Skills and Creativity. Doi: 10.1016/j.tsc.2010.08.002

  • Halpern, D. F. (2006). Is intelligence critical thinking? Why we need a new construct definition for intelligence. In P. Kyllonen, I. Stankov, & R. D. Roberts (Eds.), Extending intelligence: Enhancement and new constructs. Mahwah. NJ: Erlbaum Associates.

  • Ku, K. Y. L. (2009). Assessing students’ critical thinking performance: Urging for measurements using multi-response format. Thinking Skills and Creativity, 4, 70-76.

If you are interested in adopting the HCTA, please email Fritz Mayr at mayr@schuhfried.at
Sample HCTA Items:  To view a sample scenario, CLICK HERE  or type www.surveymonkey.com/s/HCTAsample into your internet browser. (Note: These are example items, but the format of the official assessment is slightly different)

Actual HCTA format:  To view a sample of the actual test from the test publisher, contact Mayr@Schuhfried.at

Please, wait while we are validating your browser

0 comments

Leave a Reply

Your email address will not be published. Required fields are marked *