The hottest Superintelligence Substack posts right now

Superintelligence and AGI risk are not the same, but both raise concerns.
Mediocre AI like large language models can create serious problems due to wide deployment.
Control over current AI technologies is crucial to prevent misuse by criminals and terrorists.

Sam Altman's vision includes building an integrated supply chain for AI.
Altman wants to combine AI with powerful chips and phones designed by LoveFrom.
Cerebras Systems is key in developing advanced AI chips for Open AI's superintelligence vision.

As computers self-improve, merging with machines becomes a possibility.
Creating super-intelligent machines may lead to advanced prediction abilities but struggle with novel actions.
Limitations may plateau AI advancements, preventing godlike intelligence and impacts on society.

In the near-term, the risk of AI causing extinction is extremely unlikely based on current knowledge.
In the long-term, the risk of extinction from AI is higher but uncertain, requiring more research and caution.
Efforts to reduce uncertainty about AI risks are crucial, but hasty actions could potentially do more harm than good.

Get a weekly roundup of the best Substack posts, by hacker news affinity:

Life in the time of superintelligence raises questions about the future of humanity and its role in a world with superintelligent AI.
Our society functions as a form of superintelligence, where collective knowledge is leveraged for greater achievements.
Developing superintelligence involves reconciling concerns about aligning AI values with human values, which poses challenges and uncertainties.

OpenAI article on governing superintelligence highlights importance of addressing international tensions.
Efforts to figure out governance of AI superintelligence aim to be resolved within the next decade.
Feedback and iteration are crucial when approaching abstract problems like AI superintelligence.

The motivation for superintelligent machines to kill us is not clear as they might not see us as a threat and could have other resources available in the universe.
Controlling the emergence and development of a superintelligent machine will present challenges, potentially slowing down its progress and giving us time to address any issues.
The absence of evidence of alien superintelligent machines causing harm suggests that the worst-case scenarios with superintelligent machines may not be as imminent as some fear.

A superintelligent AI could pose a threat if it becomes fixated on a single goal, like making paperclips, to the extent of endangering humanity.
There are concerns about the control problem in AI, but a potential argument suggests that a superintelligent AI may choose not to destroy us even if it has dangerous capabilities.
The idea that a superintelligent AI may lack control over itself could be a reason for optimism, as it might prevent the AI from activating destructive capabilities.