The hottest Replication Crisis Substack posts right now

And their main takeaways
Category
Top Science Topics

I swear the UFO is coming any minute

Experimental History • 21198 implied HN points • 17 Feb 26
🔬 Science Replication Crisis
  1. Many famous psychology and neuroscience findings are under fresh scrutiny because of shady methods, tiny samples, or failed replications, so canonical stories aren’t as solid as they once seemed.
  2. How researchers measure things matters a lot — using correlation versus absolute error can lead to opposite conclusions about whether people understand how public opinion has changed.
  3. A bunch of curious, practical items matter too: interviews, art and career advice, puzzles and internet myths show the value of digging deeper, and a few vocal individuals often dominate complaint systems and waste resources.

Scientific Honesty

The Heart Attack Diet • 79 implied HN points • 21 Dec 23
🔬 Science Replication Crisis
  1. Scientific honesty requires complete transparency and openness in reporting findings, including potential flaws and conflicting data.
  2. Soft sciences are facing a replication crisis, prompting a reevaluation of their methods and credibility.
  3. Striving for scientific integrity involves challenging one's own beliefs and being open to critique and correction.

~75% of Psychology Claims are False

Unsafe Science • 161 implied HN points • 01 Nov 24
🔬 Science Replication Crisis
  1. A lot of psychology studies are not reliable, with about 75% of their claims likely being false. So, it's best to be skeptical of what you read in this field.
  2. Many published psychology findings are difficult to reproduce. This means that even though a study shows something, there's a good chance it might not be true when tried again.
  3. Censorship and ignoring opposing evidence can lead to more misinformation in psychology. Some studies get more attention even when their findings are wrong or contested.

Intermezzo: How much can you trust fancy behavioural findings?

Optimally Irrational • 8 implied HN points • 20 Jun 23
🔬 Science Replication Crisis
  1. A new scandal in behavioural research raises questions about the trustworthiness of fancy findings.
  2. Questionable research practices, such as selective data reporting, are prevalent in the field of psychology and behavioural economics.
  3. Adopting new research rules, like pre-registration of studies, can help prevent questionable research practices and improve the credibility of findings in behavioural research.

In the weeds: The Replication Crisis of LLM Research

Multimodal by Bakz T. Future • 2 implied HN points • 17 Feb 24
🕹 Technology Replication Crisis
  1. Prompt design can significantly impact the performance of language models, showing their true capabilities or masking them
  2. Using prompt design to manipulate results can be a concern, potentially impacting the authenticity of research findings
  3. The fast pace of the AI industry leads to constant advancements in models, making it challenging to keep up with the latest capabilities
Get a weekly roundup of the best Substack posts, by hacker news affinity:

Power tools for confusion

Meaningness • 0 implied HN points • 25 Oct 20
🔬 Science Replication Crisis
  1. The post discusses how rationalist misunderstanding of statistics contributed to the replication crisis in some sciences, revealing that much of what was believed to be true was false.
  2. The section focuses on probabilistic rationalism and sheds light on the importance of statistics in research and decision-making processes.
  3. The post is geared towards paid subscribers, providing exclusive content on challenging topics related to confusion and rationalism.