Skip to the content

Analytical Challenge

Challenge Network

Structured analytical disagreement and alternative interpretation, recorded against the representation it challenges.

A challenge is not a verdict. The Network exposes analytical disagreement so that a representation can be argued with. No challenge carries a weight, a score or a rank, and the number of challenges raised has no bearing on the outcome.

The flow

Primary representation through to revision

Eight stages. A challenge enters at the second and only leaves the flow through synthesis.

  1. 01Primary RepresentationThe representation as published.
  2. 02Alternative RepresentationsCompeting readings, stated in their own terms.
  3. 03EvidenceWhat supports each reading, and what conflicts.
  4. 04AssumptionsThe assumptions each reading depends on.
  5. 05Points of DivergenceWhere the readings actually part company.
  6. 06SynthesisWhat survives both readings.
  7. 07AssessmentWhat the evidence currently supports.
  8. 08RevisionWhat changed in the representation, and why.

The flow runs in one direction only. Synthesis does not average the representations, and a challenge does not become an assessment by being repeated.

Challenge types

Nine ways a representation can be challenged

Each type names the question being asked of the representation.

Evidence Challenge

Does the evidence support the claim as stated?

Assumption Challenge

Which assumption is doing the work?

Boundary Challenge

Is the boundary drawn in the right place?

Causal Challenge

Is this causation, or co-movement?

Representation Challenge

Does the representation reproduce the thing it replaces?

Scenario Challenge

Are these the scenarios that matter?

Institutional Perspective

How does another institution represent this?

Historical Analogy Challenge

Does the analogy hold beyond its original context?

Data Quality Challenge

What does the underlying dataset systematically miss?

Challenge records

The challenges currently on the record

Each record names its subject, its challenger, the claim challenged, the evidence on both sides, and what was synthesized from them.

CH-01Historical Analogy ChallengeSynthesised

Subject

Negotiation Campaign framing

Challenger

Scholarly literature — Menkel-Meadow, Negotiation Journal

Scholarly literature

Alternative representation

Analysing a single negotiator's practice cannot support generalisable conclusions. Context dependence, preparation and implementation conditions dominate, so the campaign structure may be a property of the situations rather than of the negotiator.

Conflicting evidence

  • Source not recorded

Assumptions

  • That the campaign framing is being offered as generalisable rather than descriptive.
  • That the cases share enough structure to be compared.

Boundary

The challenge addresses generalisation. It does not dispute that the cited cases were conducted across multiple channels.

Confidence

Moderate

Synthesis

Retained as a descriptive representation with the caution carried alongside it. No generalisable claim is made from the cases, and the pattern is stated with its conditions and risks rather than as a rule.

CH-02Causal ChallengeOpen

Subject

Bab-el-Mandeb disruption reconstruction

Challenger

Analytical function — Causal Analysis

Lawton analytical function

Alternative representation

Co-movement across connected corridors may reflect common external conditions — freight rates, insurance pricing, seasonal demand — rather than propagation from the disrupted node. The representation may be reading a shared shock as a causal pathway.

Supporting evidence

  • Source not recorded

Conflicting evidence

Assumptions

  • That the observed co-movement is attributable to the modelled pathway.
  • That the system boundary excludes the relevant common conditions.

Boundary

The challenge concerns attribution only. It does not dispute that conditions changed across the corridors.

Confidence

Low

Synthesis

No synthesis recorded. The challenge remains open and the representation stands unrevised.

CH-03Representation ChallengeUnder synthesis

Subject

Value Repository identification

Challenger

Analytical function — Boundary Analysis

Lawton analytical function

Alternative representation

Identifying value repositories analytically risks reproducing the organisational chart under a new label, so that the representation inherits the structure it claims to look beneath.

Conflicting evidence

  • Source not recorded

Assumptions

  • That the analytical identification is genuinely independent of the existing institutional structure.

Boundary

Concerns the method of identification, not any individual repository.

Confidence

Moderate

Synthesis

No synthesis recorded. The challenge remains open and the representation stands unrevised.

CH-04Data Quality ChallengeSynthesised

Subject

Published company universe

Challenger

Analytical function — Data Quality

Lawton analytical function

Alternative representation

A universe compiled from disclosed financials systematically under-represents non-listed, state-linked and privately held actors — which are frequently the actors that move the system the representation is trying to describe.

Supporting evidence

Conflicting evidence

  • Source not recorded

Assumptions

  • That the largest system-moving actors are all within the disclosed corporate universe.

Boundary

The challenge accepts the source as published. It disputes the completeness of the universe.

Confidence

Moderate

Synthesis

The limitation is recorded on the evidence record and on the claim. The universe is retained as the published base, with the omission stated rather than corrected by substitution.

CH-05Institutional PerspectiveNo revision

Subject

Scenario ranges rather than point estimates

Challenger

Institutional perspective — source not recorded

Institutional perspective

Alternative representation

Some institutional consumers require a point estimate in order to budget or plan, and a range may be treated internally as a refusal to commit rather than as an honest statement of uncertainty.

Supporting evidence

  • Source not recorded

Conflicting evidence

  • Source not recorded

Assumptions

  • That a point estimate would be more useful than a range to a planning function.

Boundary

No source is recorded for this perspective, so it is held as a consumer constraint rather than as a finding. It is not attributed to any named institution.

Confidence

Not established

Synthesis

No revision to the method. The requirement is recorded as a consumer constraint, and the range presentation is retained.

CH-06Assumption ChallengeUnder synthesis

Subject

Shared 16-component framework

Challenger

Analytical function — Synthesis

Lawton analytical function

Alternative representation

Applying one framework across five directorates assumes that the systems are commensurable. Complexity science is not a single unified methodology, and a shared schema may impose a common shape on systems that do not share one.

Conflicting evidence

  • Source not recorded

Assumptions

  • That the shared framework constrains the representation more than it enables comparison.

Boundary

Concerns the framework's claim to shared applicability, not its individual components.

Confidence

Moderate

Synthesis

No synthesis recorded. The challenge remains open and the representation stands unrevised.

Challenge status

Where a challenge can stand

A challenge that ends in No revision is a recorded outcome, not a failure.

OpenUnder synthesisSynthesisedRevision triggeredNo revision

A representation that cannot be argued with is not an analytical instrument.