Astral Codex Ten • 28838 implied HN points • 01 Mar 26
- Saying systems can be used for “all lawful use” is not a real safeguard because existing laws and internal defense policies have big loopholes and can be reinterpreted or changed.
- AI removes the scale and cost limits that once made mass domestic surveillance impractical, so governments can lawfully buy or incidentally collect data and then use AI to analyze and profile large populations.
- Autonomous-weapon rules mostly live in vague, changeable defense policies, so allowing only “lawful” uses can still permit weapons with little human judgment; companies should avoid contracts that could force them to build systems without strong safeguards.