Efficiency masks risk by narrowing the field of attention.
— John Sterman
Past practices for engineering leaders.
Efficiency masks risk by narrowing the field of attention.
— John Sterman
Complex systems reward short-term fixes that accumulate long-term fragility.
— John Sterman
A system optimized for one outcome will sacrifice others without noticing.
— John Sterman
Organizations preserve routines that once prevented failure.
— Karl E. Weick
Decision makers rarely see the systems their decisions create.
— John Sterman
Systems that appear stable often conceal accumulating stress.
— John Sterman
Organizations adapt to measurement faster than to reality.
— Jerry Z. Muller
A failure is a system revealing itself.
— John Gall
Organizations tend to optimize what they can see.
— Jerry Z. Muller
Organizations drift when incentives substitute for judgment.
— James Q. Wilson
Systems resist change that exposes past errors.
— James Q. Wilson
A system that is stable in the short run may be unstable in the long run.
— Jay W. Forrester
Organizations adapt structure slower than incentives.
— James Q. Wilson
Systems adapt to incentives faster than to intentions.
— James Q. Wilson
Systems evolve around what is easiest to explain, not what is most accurate.
— James G. March
Incentives are blunt instruments.
— James Q. Wilson
Organizations learn slower than individuals because they must preserve legitimacy.
— James G. March
Organizations rarely remove constraints that once protected them.
— James G. March
Organizations tend to preserve explanations longer than evidence supports.
— James G. March
When accountability is unclear, performance follows incentives instead.
— James Q. Wilson
Organizations conserve ambiguity to preserve flexibility.
— James G. March
Organizations protect their routines more fiercely than their goals.
— James G. March
Systems drift where learning is disconnected from authority.
— James G. March
A system’s behavior reflects what it rewards, not what it says it values.
— James Q. Wilson
Organizations fail when learning is separated from authority.
— James G. March
Decisions shape environments, and environments shape decisions.
— James G. March
Experience is a poor teacher when outcomes are delayed or ambiguous.
— James G. March
Decisions reorganize the future more than they solve the present.
— James G. March
Organizations are shaped by the problems they face and the solutions they adopt.
— Herbert A. Simon
A decision rule that works in one context can fail disastrously in another.
— Herbert A. Simon
Efficiency is achieved by ignoring information.
— Herbert A. Simon
The greatest danger in complex systems is oversimplifying the problem they are meant to solve.
— Horst Rittel
Organizations resist decisions that expose hidden dependencies.
— Herbert A. Simon
Systems fail where coordination is assumed rather than designed.
— Herbert A. Simon
The success of a solution often masks the cost of alternatives not taken.
— Geoffrey Vickers
Systems resist change that threatens existing coordination patterns.
— Herbert A. Simon
Organizations resist decisions that make tradeoffs explicit.
— Geoffrey Vickers
Organizations adapt explanations faster than underlying structures.
— Geoffrey Vickers
Systems drift because tradeoffs are made implicit rather than explicit.
— Geoffrey Vickers
Policy decisions create the structure within which future decisions are made.
— Graham T. Allison
Systems preserve the decisions they cannot revisit.
— Geoffrey Vickers
Organizations change behavior faster than they change beliefs.
— Geoffrey Vickers
Systems learn slower than individuals, but forget more slowly.
— Geoffrey Vickers
Complexity is rarely created deliberately; it accumulates.
— Grady Booch
Organizations stabilize around the decisions they are unwilling to revisit.
— Geoffrey Vickers
Organizations become efficient at producing the outcomes they experience most often.
— Geoffrey Vickers
Expert systems fail when they ignore local knowledge.
— Friedrich Hayek
Expertise can become a liability when conditions change.
— Gary Klein
Every control system embeds assumptions about what can go wrong.
— Erik Hollnagel
A procedure is a hypothesis about how work should be done.
— Erik Hollnagel
Systems grow brittle when exceptions are treated as errors rather than signals.
— Erik Hollnagel
Control increases predictability while reducing resilience.
— Erik Hollnagel
Most organizations are optimized for local success and global failure.
— Eliyahu M. Goldratt
Organizations learn what they can afford to notice.
— Edgar H. Schein
Organizations resist learning that threatens existing competence.
— Edgar H. Schein
Organizations protect explanations that make them feel competent.
— Edgar H. Schein
The structure of a system determines its behavior more than the intentions of its designers.
— Donella H. Meadows
Complex systems punish solutions that ignore feedback delays.
— Donella H. Meadows
Systems fail in ways that are invisible to those inside them.
— Donella H. Meadows
The real problem of humanity is the following: we have Paleolithic emotions, medieval institutions, and godlike technology.
— E. O. Wilson
Control without understanding leads to brittle systems.
— Donella H. Meadows
A system’s behavior is the product of its structure, not its stated goals.
— Donella H. Meadows
Control systems fail when they substitute compliance for understanding.
— Donella H. Meadows
Organizations optimize locally even when the system suffers globally.
— Eliyahu M. Goldratt
Systems tend to reward the behaviors that keep them stable, not healthy.
— Donella H. Meadows
A system’s constraints define its possible behavior more than its goals.
— Donella H. Meadows
Intervening in a system at the wrong level can make it harder to fix.
— Donella H. Meadows
Every act of measurement disturbs the system being measured.
— Donella H. Meadows
We fail to anticipate consequences because we are too focused on intent.
— Donald A. Norman
Organizations normalize risk by treating anomalies as noise.
— Diane Vaughan
Organizations treat coordination failures as individual mistakes.
— Diane Vaughan
Every increase in efficiency increases vulnerability.
— Dietrich Dörner
Organizations stabilize around explanations that minimize blame.
— Diane Vaughan
Organizations normalize signals that contradict their success narrative.
— Diane Vaughan
Organizations become blind to risks they have normalized.
— Diane Vaughan
Organizations preserve ambiguity when clarity would force choice.
— Chris Argyris
Systems fail at the boundaries between responsibilities.
— Diane Vaughan
Organizations drift toward decisions that minimize conflict, not risk.
— Chris Argyris
Organizations often treat symptoms because causes are politically difficult.
— Chris Argyris
Every solution creates new problems.
— Daniel L. Katz
Organizations drift when learning is subordinated to performance.
— Chris Argyris
Organizations drift when learning is decoupled from decision-making.
— Chris Argyris
Complex systems fail where learning is suppressed.
— Chris Argyris
Control increases predictability at the cost of adaptability.
— Chris Argyris
Complex systems amplify small coordination failures.
— Charles Perrow
Complexity and tight coupling make failure inevitable.
— Charles Perrow
The more tightly a system is coupled, the more it resists local fixes.
— Charles Perrow
Standardization makes things efficient, but it also makes them fragile.
— Charles Perrow
Systems drift because no one owns the accumulated risk.
— Barry Turner
Organizations drift when risk is reframed as acceptable variance.
— Barry Turner
Organizations normalize risks that accumulate slowly.
— Barry Turner
Complex systems hide their failure modes during normal operation.
— Charles Perrow
Organizations prefer reversible decisions even when irreversible ones are required.
— Barry Turner
Control mechanisms reduce surprises while increasing fragility.
— Barry Turner
Systems drift when incremental changes escape scrutiny.
— Barry Turner
Complex systems amplify small errors through normal operation.
— Charles Perrow
Organizations drift when small compromises go unexamined.
— Barry Turner
Control mechanisms age faster than the risks they are meant to manage.
— Barry Turner
Most failures are preceded by decisions that felt reasonable at the time.
— Barry Turner
Organizations act rationally within irrational systems.
— Charles Perrow
Stability creates the conditions for surprise.
— Barry Turner
Most breakdowns are preceded by a long period of unnoticed warning signals.
— Barry Turner
Every simplification hides a choice about what to ignore.
— Albert O. Hirschman
Without a theory, experience has no meaning.
— W. Edwards Deming
Systems drift when long-term consequences remain abstract.
— Albert O. Hirschman
Control reduces variance at the expense of adaptability.
— W. Edwards Deming
Control reduces variation but also reduces information.
— W. Edwards Deming
What looks like a violation is often the only way the work gets done.
— Sidney Dekker
A system is never the sum of its parts; it is the product of their interactions.
— Russell L. Ackoff
Every increase in efficiency increases vulnerability.
— Dietrich Dörner
Every act of measurement disturbs the system being measured.
— Donella H. Meadows
A complex system that works is invariably found to have evolved from a simple system that worked.
— John Gall
Organizations optimize what can be audited, not what matters.
— Jerry Z. Muller
Failures are rarely caused by isolated errors but by the unexpected interaction of multiple factors.
— James Reason
Design is the art of arranging constraints.
— Charles Eames
The most dangerous failures are those that appear rational at the time.
— Barry Turner