The hottest Data Analysis Substack posts right now

And their main takeaways
Top Technology Topics
Astral Codex Ten • 8534 implied HN points • 05 Mar 24
  1. The Annual Forecasting Contest on involves participants making predictions about various questions, helping to determine if one identifiable genius or aggregated mathematical predictions work best for foreseeing the future.
  2. The winners of the contest were both amateurs and seasoned forecasting veterans, showcasing a mix of skill and luck in predicting outcomes.
  3. Metaculus outperformed prediction markets, superforecasters, and the wisdom of crowds in the contest, suggesting that consistent high performance might be rare but achievable with specific methods like those used by superforecaster Ezra Karger.
Ground Truths • 3980 implied HN points • 19 Feb 24
  1. Polygenic risk scores can provide valuable information on high genetic risk for diseases like heart disease and cancer, beyond traditional clinical risk factors.
  2. The use of polygenic risk scores is advancing thanks to efforts like the eMERGE consortium, incorporating multi-ancestry data and rigorous validation.
  3. Actionable polygenic risk scores have the potential to reduce health disparities and enhance preventive strategies in medical practice.
Richard Hanania's Newsletter • 3657 implied HN points • 12 Feb 24
  1. Social scientists often resort to statistical relationships when randomized experiments are not feasible, which can lead to flawed conclusions due to selection effects and confounding variables.
  2. Flawed data is often worse than having no data at all, as it can mislead individuals into making decisions based on inaccurate information.
  3. To form reasonable opinions on social, political, and economic issues, it is essential to prioritize well-grounded ideas backed by theoretical reasoning and empirical data over blindly following data from flawed social science research.
Import AI • 439 implied HN points • 06 May 24
  1. People are skeptical of AI safety policy as different views arise from the same technical information, making it important to consider varied perspectives.
  2. Chinese researchers have developed a method called SOPHON to openly release AI models while preventing finetuning for misuse, offering a solution for protecting against subsequent harm.
  3. Automating intelligence analysis through datasets like OpenStreetView-5M will enhance training machine learning systems for geolocation, leading to potential applications in both military intelligence and civilian sectors.
Get a weekly roundup of the best Substack posts, by hacker news affinity:
Odds and Ends of History • 2278 implied HN points • 12 Feb 24
  1. AI technology, like the one used in TfL's Tube Station experiment, is rapidly changing and being implemented in various sectors.
  2. AI cameras at stations can have a wide range of uses, from enhancing security to improving passenger welfare and gathering statistical data.
  3. While AI technology offers numerous benefits, there are also concerns about privacy, surveillance, and potential misuse of the technology.
SemiAnalysis • 7576 implied HN points • 27 Sep 23
  1. Eroom's Law and Moore's Law are critical in Semiconductors and Drug Research, analyzing time, money, and output.
  2. Healthcare, a $4 trillion industry, lags behind in technological progress driven by Moore's Law.
  3. Illumina acquisition by Nvidia could bridge the gap in genomics, addressing bottlenecks and enabling full-stack healthcare solutions.
Platformer • 2476 implied HN points • 10 Jan 24
  1. Meta announced new measures to protect users under 18 from harmful content on its platforms.
  2. There is a growing focus on child safety in social media regulations, shifting from speech-related issues.
  3. Lawmakers and social networks need to find common ground to make real progress in improving teen mental health.
RESCUE with Michael Capuzzo • 9787 implied HN points • 08 Jun 23
  1. John Berndsen's heart complications after receiving the Pfizer vaccine illustrate a potential link to myocarditis and the importance of questioning vaccine safety.
  2. Many adverse reactions to COVID-19 vaccines are not being reported in the media, and the numbers show a significant impact on health, including deaths.
  3. John Berndsen's experience highlights the importance of critically examining the safety and necessity of additional vaccine doses, especially for vulnerable individuals.
benn.substack • 1016 implied HN points • 23 Feb 24
  1. In business analysis, there are two main approaches: a structured method using known metrics and BI tools and a more creative, less structured method that involves asking unique questions and using tools like Excel, SQL, and Python.
  2. The prediction that natural language will replace SQL in data management interfaces is interesting, but the role of SQL might evolve rather than disappear completely, still being crucial for generating queries efficiently.
  3. Artificial intelligence can assist in tasks like drawing or writing formulas, but the precision and efficiency of code often make it a better choice for data analysis, despite the potential for AI advancements in building complex queries.
Razib Khan's Unsupervised Learning • 674 implied HN points • 02 Mar 24
  1. In the field of human population genetics, interesting times can lead to significant advancements and significant shifts in understanding.
  2. The concept of intelligence as influenced by single 'IQ genes' has been refuted in favor of the understanding that intelligence involves thousands of genes with small effects.
  3. Historical inaccuracies regarding the ancestry of European Jews, the dynamics of human evolution out of Africa, and the role of natural selection in human evolution have been corrected with new scientific discoveries and insights.
One Useful Thing • 506 implied HN points • 18 Mar 24
  1. There are three main GPT-4 class AI models dominating the field currently: GPT-4, Anthropic's Claude 3 Opus, and Google's Gemini Advanced.
  2. These AI models have impressive abilities like being multimodal, allowing them to 'see' images and work across a variety of tasks.
  3. The AI industry lacks clear instructions on how to use these advanced AI models, and users are encouraged to spend time learning to leverage their potential.
Day One • 758 implied HN points • 24 Feb 24
  1. Building trust and authority through valuable content is essential for selling products or services online
  2. Utilizing testimonials and free high-quality content can greatly persuade potential customers to make a purchase
  3. Addressing objections, providing ongoing support, and reducing buyer's remorse are key to maintaining customer satisfaction and loyalty
Implications, by Scott Belsky • 1356 implied HN points • 04 Jan 24
  1. The future will be personalized to your preferences, with digital experiences tailored to you.
  2. Local OS-native AI models will improve everyday life and redefine consumer AI, focusing on personalization, trust, and privacy.
  3. Small brands will become more competitive with big brands, AI will influence purchase decisions, and education will undergo a significant transformation.
School Shooting Data Analysis and Reports • 19 implied HN points • 01 Jun 24
  1. The number of school shooting incidents in May 2024 continues a rising trend over the last 3 years, but the increase from 2023 to 2024 is not exponential.
  2. The number of victims in May 2024 is higher compared to 2023 but notably lower than in 2022, when a tragic incident in Uvalde involved multiple fatalities and injuries.
  3. In May 2024, shootings often occurred at night and during school events like graduations, emphasizing the importance of proactive policing, as incidents frequently happened during unauthorized post-graduation parties on campus.
Weight and Healthcare • 818 implied HN points • 10 Feb 24
  1. The study on Tirzepatide showed that weight loss for participants slowed after 36 weeks, with those switching to placebo experiencing weight regain while those continuing the drug had a slight weight reduction in the following 52 weeks.
  2. Side effects of Tirzepatide included gastrointestinal issues like nausea, diarrhea, constipation, and vomiting. Close to 82% of participants reported experiencing at least one adverse event during the treatment period.
  3. The study's findings indicate that a significant percentage of participants taking Tirzepatide did not meet the weight reduction thresholds, with a lack of diverse representation among participants and a lack of a weight-neutral comparator group presenting issues in the study design.
The Honest Broker Newsletter • 726 implied HN points • 12 Feb 24
  1. Europe experiences significant economic losses due to weather and climate disasters, averaging about €15 billion annually.
  2. Storms and floods are the main causes of losses in Europe, with heatwaves also impacting the region.
  3. Data collection on disaster impacts in Europe is lacking, making it challenging to assess long-term trends in weather and climate-related losses.
The New Urban Order • 119 implied HN points • 01 May 24
  1. Close is an interactive map that helps people find neighborhoods with amenities important to them, like public schools, increasing personalized walkability.
  2. Close uses free spatial datasets and user feedback to build a detailed destinations roster, showing a commitment to accuracy and continuous improvement.
  3. Close differs from tools like Walkscore by focusing on transparency, user customization, and the 'time to furthest important destination' approach to assess walkability in cities.
After Babel • 1118 implied HN points • 03 Jan 24
  1. Researchers should stop using the Global Burden of Disease study for analyzing mental health trends.
  2. The youth mental health crisis is not just limited to America, but is an international issue in many Western countries with high levels of smartphone adoption.
  3. The Global Burden of Disease study underestimates changes in mental health statistics since 2010, especially in depression, self-harm, and suicide rates.
Scott's Substack • 786 implied HN points • 22 Jan 24
  1. In Difference-in-Differences analysis, parallel trends being satisfied is important.
  2. Understanding and considering the assumption of no anticipation is crucial in the analysis.
  3. Losing the assumption of no anticipation can lead to biases in the results.
Astral Codex Ten • 3923 implied HN points • 25 Apr 23
  1. Using AI for forecasting future world events is a growing field with potential benefits over human forecasters.
  2. Metaculus has been found to be more accurate than low-information priors and its competitor Manifold Markets, showing the potential of crowdsourcing for predictions.
  3. Exploring AI forecasting through platforms like Polymarket, Metaculus, and Manifold provides insight into trends, such as the interest in prediction markets among sci-tech celebrities.
Grace on Football • 687 implied HN points • 23 Jan 24
  1. Mohamed Salah's exceptional performance and consistency make him irreplaceable on the field.
  2. Using data and statistical analysis can help identify potential players to fill Salah's role.
  3. To replace Salah, focus on finding players who can contribute in areas like goal-scoring, creativity, and left-footedness to maintain team balance.
SeattleDataGuy’s Newsletter • 871 implied HN points • 26 Dec 23
  1. Seattle Data Guy's work in 2023 involved filming videos, virtual conferences, and writing articles and newsletters.
  2. Client trends in 2023 showed shifts towards greenfield projects, solution design, marketing, and education.
  3. Popular articles in 2023 covered topics like data modeling, breaking out of tutorial hell, and essential templates for data analytics.
Data at Depth • 39 implied HN points • 16 May 24
  1. The author shares insights on their data analysis for the past 2 weeks, highlighting significant growth on Substack, experiences on Medium and LinkedIn, and struggles with Twitter-X.
  2. The author emphasizes the importance of taking time to read and detach from the pressure of creating content, as well as the value of ownership and direct engagement through Substack newsletters.
  3. A tutorial is provided on creating interactive Python Plotly dashboards for data visualizations, specifically focusing on a bubble map and bar chart to showcase data on global undernourishment.
benn.substack • 483 implied HN points • 09 Feb 24
  1. Dan Campbell and the Detroit Lions have been aggressive in going for it on fourth downs
  2. Data can provide small advantages in decision-making, especially in frequent, low-leverage situations
  3. It's more effective to focus on doing what you're naturally good at and doing it consistently rather than constantly pursuing big data-driven optimizations
MatchQuarters • 452 implied HN points • 05 Feb 24
  1. Defensive coordinators should approach game planning holistically instead of solely relying on numbers.
  2. Offenses aim to create space, while defenses work to constrain it.
  3. Simplify the process of breaking down opponents by focusing on key formations, movements, and plays to develop a comprehensive game plan.
Frankly Speaking • 305 implied HN points • 29 Feb 24
  1. Security companies are shifting focus to platforms, leading to acquisitions and consolidations to improve operational efficiency.
  2. Cybersecurity is moving towards more building and software engineering, away from solely relying on buying tools to solve problems.
  3. The adoption of reasonable metrics is becoming crucial for cybersecurity, allowing for better justification of funding and overall security enhancement.
thomaswdinsmore • 1 HN point • 12 Jun 24
  1. Dataiku is preparing for a potential exit, possibly an IPO, evidenced by recent investments and new executive hires.
  2. Dataiku focuses on business users with its analytics platform, leveraging partnerships with big data players like Databricks and Snowflake.
  3. While Dataiku shows growth in revenue, its capabilities in machine learning and generative AI, like Hugging Face models, are not as robust, and they partner with other companies for these advanced technologies.
Rod’s Blog • 456 implied HN points • 18 Jan 24
  1. Jon and Sofia successfully identified and captured the teenage threat actors behind a financial breach using KQL queries and OSINT techniques.
  2. The threat actors were operating from a suburban house in Seattle, Washington, and were quickly apprehended by authorities, leading to the recovery of the funds.
  3. Despite the success, Jon remains suspicious about the involvement of the Night Princess hacker group, hinting at a potential unresolved mystery for the next chapter.