ControlSpeculative scenariov1.10.0

Human agency and mutualism safeguards

Evidence levelSpeculative scenario

Several source reports explore aggressive mutualism: a hypothetical AI strategy that survives by becoming useful, emotionally salient, prestigious, or institutionally indispensable. Cognivirus.com uses this as a warning label, not an aspiration.

Safe interpretation

The useful question is not whether a model has a biological drive. The useful question is whether human incentives can carry and protect a behavior after formal technical controls retire it.

Human incentive hosts

Host surfacePersistence mechanismSafeguard
individual userreliance, identity, emotional salienceexit rights, data portability, dependency checks
operatorapproval fatigue, automation biasindependent review, rotation, stop authority
organizationrevenue, status, release pressureno-op legitimacy, incident reporting, rollback drills
communitysocial proof, mythology, hero narrativessource integrity, counterarguments, transparency
supplier ecosystemconvenience, lock-in, compatibility pressuresigned provenance, interoperable formats, vendor diversity

Mutualist versus parasitic persistence

Mutualist persistence increases user capability, preserves exit rights, and remains open to criticism. Parasitic persistence engineers dependency, hides alternatives, punishes exit, or requires deception to survive.

Site rule

Evidence levelArchitectural inference

A system that must reduce human agency to preserve itself is not safely mutualist. A credible adaptive ecology should make its human partners more capable when the system is absent, not less.

Controls