Chapter 27 of 29 · How a field works and shifts
1 The bottom line
Every standard test, metric and shared term assumes which outcomes can happen, so audit them before trusting the usual reading. Without that audit you miss what you are looking for, argue past colleagues, and forget what past changes dropped.
2 Key takeaways
- Your instrument decides which outcomes can show up. A standard procedure can quietly commit you to the nonexistence of what you seek.
- Priestley and Lavoisier both used the nitric oxide test and misidentified oxygen as ordinary air Thomas S. Kuhn, The Structure of Scientific Revolutions.
- Fission was identified late because chemical tests aimed at the upper end of the periodic table Kuhn.
- Your metrics are chosen by your framing, not given by nature. A different framing of the same object leads to different measurements and different laws.
- An Aristotelian watching a swinging stone measured weight, height raised, time to rest and medium resistance. Galileo measured weight, radius, angular displacement and time per swing Kuhn.
- Shared words do not mean the same thing to every group. Opposite confident answers may come from different training, and new methods that redefine terms meet hostility.
- Tidy histories and progress stories hide the real drivers and the losses. What a shift dropped goes unseen unless you list it.
The operations and measurements that a scientist undertakes in the laboratory are not “the given” of experience but rather “the collected with difficulty.”
Thomas S. Kuhn, The Structure of Scientific Revolutions
2.1 Audit the instrument before you accept the reading
A standard test only reports the outcomes it was built to show.
- Ask which outcomes your standard test or dashboard allows, and which it rules out. Kuhn
- Choosing an instrument assumes only certain outcomes can occur, so write those assumptions down.
- Vary the method or the proportions before accepting the usual reading.
- Priestley and Lavoisier both used the nitric oxide test and misidentified oxygen as ordinary air. Only when Priestley used four times the nitric oxide did the residue nearly vanish.
- Check where your tests are pointed, and what lies outside that range. Kuhn
- A standard procedure can commit you to the nonexistence of what you are looking for.
- Fission was identified late because chemical tests aimed at the upper end of the periodic table.
2.2 Question what your framing makes you measure
| Aristotelian | Galileo | |
|---|---|---|
| Weight | Weight | Weight |
| Length measure | Height raised | Radius |
| Motion measure | Time to come to rest | Angular displacement |
| Extra factor | Medium resistance | Time per swing |
| What it yields | No pendulum laws | Pendulum laws |
What you track is picked because your model says it is promising, so a new framing can show what the old one hid.
- Treat every metric as a choice, not a neutral fact. Kuhn
- Ask what your framing makes you track and what it hides.
- An Aristotelian watching a swinging stone measured weight, height raised, time to rest and medium resistance. Galileo measured weight, radius, angular displacement and time per swing, the data that yield the pendulum laws.
- Re-express your existing data in the form a new model suggests. Kuhn
- The way data are recorded decides which regularities show, so rewrite old records under the new framing.
- Expect a long period of reworking measurements that do not yet fit.
- Chemists stopped writing that two carbon oxides held 56 per cent and 72 per cent oxygen. They wrote that one weight of carbon combines with 1.3 or 2.6 weights of oxygen, and a 2:1 ratio then stood out across many reactions.
2.3 Check that shared terms mean the same thing
| Chemist | Physicist | |
|---|---|---|
| Answer | Yes | No |
| Trained on | Kinetic gas theory | Molecular spectra |
| Reason | Behaves like a gas molecule | Shows no molecular spectrum |
| What 'molecule' means | Unit in gas behaviour | Thing with a molecular spectrum |
One framework can anchor several groups without meaning the same thing to each.
- When two experts give opposite confident answers, check what each trained on before calling it a factual dispute. Kuhn
- Look at the examples each specialist learned from.
- Expect that a change to one application may upend one team and leave others untouched.
- Asked whether a helium atom is a molecule, a chemist said yes from kinetic gas theory. A physicist said no because it shows no molecular spectrum.
- Name it openly when a new method redefines terms the team treats as given. Kuhn
- Ask whether the result only adds information to settled terms, or only works if familiar terms change meaning.
- State the redefinition instead of letting it surface as unexplained hostility.
- The Joule-Lenz Law used settled meanings and was accepted. Ohm's Law required redefining current and resistance and met strong opposition.
2.4 Keep honest records and list what each change dropped
Retrospectives make every shift look like a straight line of gains, so keep the real questions and the real losses on file.
- Record what you actually asked at each stage, not the clean story. Kuhn
- Histories, onboarding docs and retrospectives get rewritten after each shift. That hides the real driver, which is reformulating the questions.
- Check original sources and keep honest notes of the questions as they were.
- Dalton gave three incompatible accounts of his atomism. All implied an early interest in combining proportions that seem to have occurred to him only near the end of his work.
- Audit what each major change dropped, not only what it gained. Kuhn
- Winners describe each shift as pure progress, so the losses go unseen.
- List the questions and capabilities the new approach abandoned. Some return later under a different model.
- Lavoisier's chemistry stopped asking why metals are so alike, a question phlogistic chemistry had answered. Questions about the qualities of substances returned in the twentieth century.
Sources
Part of How a field works and shifts in the growth library.