Naturalistic Research: A Content Writer’s Journey
The Day I Lost Faith in Lab-Based Decision Science – And Found My Calling in Naturalistic Research
Table of Contents
The study of how people make decisions is a fascinating field, but for years I felt a growing disconnect between the research I was seeing and the reality of decision-making in the real world. This realization crystallized during a pair of experiences in the late 1980s and early 1990s, experiences that ultimately led me to embrace – and champion – a naturalistic approach to understanding judgment and decision-making.
The Sterile World of Artificial Decisions
My disillusionment began at a conference of the Judgment and Decision Making Society, likely in 1988 or 1989 in New Orleans. I attended a session hoping to find insights relevant to my work,but what I encountered felt…off.
The first presentation involved an economist analyzing data sets to infer decision strategies.Understandable.The second,focused on medical decision-making,initially seemed promising. The researcher had interviewed seven physicians, but the scenario he presented was anything but medical. he described a task involving abstract “Diseases” with arbitrary symptoms and probabilities. It wasn’t about diagnosing illness; it was about manipulating statistics.
The researcher recounted how each of the seven physicians reacted: they declared the task wasn’t medicine, it was statistics, and promptly walked out of the simulated ”cubicle.” The audience erupted in laughter. But I found myself laughing for a different reason.While others chuckled at the physicians for their perceived lack of sophistication, I was laughing at the researcher for creating such an artificial, irrelevant scenario.
The final presentation was even more jarring.A prominent figure in the field presented research on wildland firefighting – a topic directly relevant to my interests. Though, rather of studying actual firefighters, he studied college students. Their task? Managing a “fire” that spread across a simple map grid based on probability. Two colleagues had just returned from observing and interviewing firefighters battling a real forest fire in Idaho. The academic exercise felt utterly divorced from the complex, dynamic reality of the situation.
If this was considered Naturalistic Decision Making, I wondered, what was the point of attending these meetings? the experiance, however, did ignite a crucial realization: a deep appreciation for truly naturalistic research and its potential.
When Protocol Trumps curiosity
My growing conviction was further solidified by a conversation my late wife, Helen Klein, had with a colleague, Penny, an organizational psychologist. Penny was researching reactions to personnel decisions and casually mentioned that nearly half of her interviewees had cried.Helen, naturally curious, asked why they had cried. Penny’s response was astounding: she didn’t know. The study was halfway complete, and she hadn’t considered exploring the emotional responses of her participants. helen suggested probing further with future participants, or even revisiting those already interviewed.
Penny refused.Asking about the crying wasn’t ”in the protocol,” and she hadn’t asked earlier participants. Rigid adherence to the pre-defined plan outweighed a simple,yet possibly crucial,question.
This incident perfectly illustrated the fundamental difference between a naturalistic approach – one driven by a desire to learn and discover – and a rigid, methodological approach that stifles curiosity.
embracing the Real World
I adopted a naturalistic approach because I believed it was the most effective way to study decision-making in context. It’s about understanding how people actually make choices in the messy, unpredictable environments they inhabit, rather than attempting to distill those choices into sterile laboratory settings.
The experiences I described weren’t about dismissing the value of controlled experiments altogether. Rather, they highlighted the limitations of relying solely on such methods when studying complex human behavior. Those early encounters, and countless observations as, have only deepened my appreciation for the power and importance of naturalistic research - a commitment to understanding decisions as they unfold in the real world.