The hottest Statistical Analysis Substack posts right now

And their main takeaways

Category

Top Technology Topics

How to do linear regression and correlation analysis

Lenny's Newsletter • 3144 implied HN points • 02 May 23

🚌 Education Data Analysis Statistical Analysis Product Analytics

Correlation analysis shows how closely two variables are connected.
Linear regression goes further by showing how much one variable affects another and helps predict behavior.
Use product analytics tools for faster confirmation of relationships between metrics and user activity.

Don’t Trust, Verify ... Your Visual Stats

FILWD • 294 implied HN points • 16 Jan 24

🔬 Science Data Visualization Statistical Analysis Normalization

Develop intellectual curiosity and explore different solutions in data transformations and visualizations.
Always verify and normalize data to avoid base rate bias and misleading conclusions.
Consider both aggregating and disaggregating data to reveal different insights in visualizations.

Stealing Signals, Week 8, Part 1

Stealing Signals • 432 implied HN points • 31 Oct 23

🎾 Sports Analytics Film analysis Statistical Analysis Data interpretation

Teams may not always give 100% effort every game in the NFL due to strategic reasons.
Watching games can give a big advantage in fantasy football over just looking at stats.
First-read targets dataset may not accurately reflect offensive intentions in play calling and should be analyzed cautiously.

454: Biggest Bond Crash in 150 Years, Microsoft + Activision, ARM, Wikipedia, Jimmy Buffett, Semiconductors, and Tokyo Digital Twin

Liberty’s Highlights • 471 implied HN points • 16 Oct 23

💰 Finance Investing Markets Economics Statistical Analysis Trends

The biggest bond market rout in 150 years is happening now.
Once-in-a-century events appear more frequently due to statistical misunderstanding, evolving baselines, and increased detection and reporting.
Statistical probabilities can explain why 'rare' events seem to be happening more often in recent times.

How To Run An A/B Testing On Low Traffic - Issue 181

Data Analysis Journal • 137 implied HN points • 10 Jan 24

🕹 Technology Data science Analytics A/B Testing Experimentation Statistical Analysis

No specific rules on when to start A/B testing or the minimum user numbers required.
Consider adjusting thresholds when experimenting with small sample sizes.
Address factors like confidence levels and test timelines for effective decision-making.

Get a weekly roundup of the best Substack posts, by hacker news affinity:

How Intelligent is the Average Rationalist?

sebjenseb • 157 implied HN points • 03 Jul 23

🔬 Science Research Data Analysis Statistical Analysis Psychometrics

The average IQ of rationalists may not be as high as self-reported values suggest, with estimates pointing to an average IQ between 125-130.
Analysis of SAT and IQ scores of rationalists indicates an estimated average IQ of about 133.6 after accounting for biases.
Educational attainment and plausible assumptions suggest the average IQ of internet rationalists is between 125-130, considering selection for educational attainment.

Explaining the Surprising Rebound in Consumer Confidence

The People's Economist with Anthony Chan • 19 implied HN points • 22 Jan 24

💰 Finance Inflation Statistical Analysis Global Economy

Consumer sentiment is influenced by consumer prices and inflation rates.
There is a negative correlation between consumer sentiment and yearly rise in consumer prices.
The recent rebound in consumer confidence suggests a shift towards optimism.

p < 0.05 considered harmful

Simplicity is SOTA • 122 HN points • 10 Apr 23

🔬 Science Experimentation Statistical Analysis Decision-making Tech industry

The standard use of p < 0.05 as a threshold in experiment analysis may not be as useful as commonly believed.
The choice of p < 0.05 as a significance level in experiments is a default that was set nearly a century ago.
In the tech industry, where the goal is to find real product improvements, the risk of false negatives should also be carefully considered, not just false positives.

Axial Discovery - Clinical trial statistical analysis

Discovery by Axial • 1 implied HN point • 08 Sep 23

🔬 Science Clinical Trials Statistical Analysis Software Development Data Integration Data Visualization

Clinical trial statistical analysis involves collecting and interpreting data to evaluate new treatments.
Startups have opportunities to develop software for automating and streamlining statistical analysis processes due to increasing data complexity.
Software development for data integration, visualization, and communication can improve efficiency in clinical trial statistical analysis.

Research Report: Incorrectness Cascades

From AI to ZI • 0 implied HN points • 14 Apr 23

🕹 Technology AI Research Data Analysis Statistical Analysis

Large Language Models may produce more incorrect answers if previous answers were incorrect
The effect of incorrect previous answers on future answers is small and varies based on the prompt given to the AI
Prompts that explicitly ask the AI to match previous behavior can lead to more incorrect answers