The hottest Data Analysis Substack posts right now

And their main takeaways
Category
Top Technology Topics

KSDRP: Settling Science Fairly. A new method to objectively resolve scientific disputes

Steve Kirsch's newsletter • 3 implied HN points • 22 May 25
🔬 Science Data Analysis
  1. The Kirsch Scientific Dispute Resolution Protocol (KSDRP) is a new way to settle scientific disagreements logically and fairly.
  2. It involves choosing judges, using real data, and letting chatbots help analyze the information before judges make a final decision.
  3. This method can help answer tough questions, like the impact of COVID vaccines, by measuring outcomes from different groups.

E10 - Future Trends: Gen AI and the Next Generation of Products

The Product Channel By Sid Saladi • 6 implied HN points • 16 Jan 25
🕹 Technology Data Analysis
  1. Generative AI is reshaping industries by creating new opportunities and enhancing product development. It's not just a technology; it can change the way we work and create.
  2. Real-world examples, like DeepMind's AlphaFold, show how generative AI can lead to breakthroughs in fields like healthcare, making processes faster and more efficient.
  3. Product managers should harness generative AI to create better user experiences. By integrating this technology, they can offer more personalized and engaging products.

What happens when you ask 146 economists the same question?

Klement on Investing • 2 implied HN points • 24 Jul 25
💰 Finance Data Analysis
  1. When 146 economists analyzed the same data about a policy, they found similar results despite minor differences in their estimates. This suggests that economists can broadly agree when working with the same information.
  2. The researchers found that differences in opinions among economists often arise from how they interpret data and their theoretical models. So, disagreements aren't always about facts but can depend on personal beliefs and biases.
  3. The study showed that with clear instructions and the same data, economists tend to reach almost the same conclusions. This challenges the idea that economists will always have conflicting views.

Experiments in Speed Dating & Matchmaking

Dan's Stack • 2 HN points • 12 Feb 24
💼 Business Data Analysis
  1. Speed dating events are optimal with around 20 attendees (10 men, 10 women), maintaining a balanced gender ratio is important for a successful event.
  2. Ticket prices for speed dating events vary based on demand and gender ratio, with average prices around $25.
  3. Marketing strategies for speed dating events focus on gender-specific ad campaigns to ensure equal attendance of men and women, with Instagram and Facebook ads being the most effective channels.
Get a weekly roundup of the best Substack posts, by hacker news affinity:

hello, world

Dataplane.org Newsletter • 19 implied HN points • 29 Nov 21
🕹 Technology Data Analysis
  1. Dataplane.org, a platform for providing data feeds on internet activity, has gained recognition in the security community for its reliability.
  2. Dataplane.org is evolving from a personal project to a more formal organization with potential revenue streams to support growth.
  3. Future plans for Dataplane.org include website redesign, creating a search API, and expanding the types of data covered.

A Walk Through of the New Analyst Dashboard

The Security Industry • 15 implied HN points • 04 Mar 24
🕹 Technology Data Analysis
  1. Version 6 of the Analyst Dashboard for cybersecurity industry research brings a dramatic update to user interface and introduces useful new tools.
  2. Knowing all cybersecurity product vendors is crucial for creating a comprehensive data tool, and manual categorization of vendors is currently necessary.
  3. By collecting data on vendors, answering specific questions about the cybersecurity industry becomes possible, like listing vendors in a certain city or sorting them by year founded.

E8 - 🤖 AI Integration for Faster, Better Product Development

The Product Channel By Sid Saladi • 6 implied HN points • 29 Dec 24
🕹 Technology Data Analysis
  1. AI can help improve product development by analyzing customer feedback and identifying what users want. Using AI for market research can spot new opportunities and gaps in the market.
  2. Integrating AI into decision-making processes, like demand forecasting and risk assessment, can save time and resources. This way, product managers can make smarter choices about what to build.
  3. AI makes the design and development phases faster and more efficient. It can quickly create prototypes and help optimize engineering tasks, leading to quicker product launches.

Santa Clara County's wastewater shows the COVID vaccine increased infections

Steve Kirsch's newsletter • 7 implied HN points • 04 Nov 24
🏥 Health Politics Data Analysis
  1. In Santa Clara County, the amount of COVID in wastewater is higher than the national average. This suggests that vaccination may not have helped reduce infections.
  2. The data shows that after vaccinations were rolled out, infection rates actually went up. This raises questions about the effectiveness of the vaccines.
  3. There hasn't been much discussion from health officials about these findings, which seems strange given the serious implications for public health.

Prompt-Based Feature Engineering Part 1: Generative AI Generates Data

nick’s datastack • 1 HN point • 24 Apr 24
🕹 Technology Data Analysis
  1. Generative AI can generate data, impacting workflows and pipelines significantly.
  2. Using LLMs for prompt-based feature engineering can save time and effort compared to traditional methods like manual data searching and merging.
  3. While LLMs in data pipelines may feel magical, it's important to be cautious of potential inaccuracies due to the probabilistic nature of AI outputs.

🏆20+ ChatGPT Plugins for Product Managers and Builders - Unleashing the Power of ChatGPT Plugins

The Product Channel By Sid Saladi • 23 implied HN points • 23 Jul 23
🕹 Technology Data Analysis
  1. ChatGPT plugins enhance product development with automation and specialized research capabilities.
  2. Installing ChatGPT plugins involves upgrading to ChatGPT Plus and enabling the Plugins Beta feature.
  3. Top 20 ChatGPT plugins offer diverse functionalities like creating diagrams, conducting data analysis, and providing personalized recommendations.

Cities and Covid Reopening

Joshua Gans' Newsletter • 39 implied HN points • 04 Aug 20
🏥 Health & Wellness Data Analysis
  1. Tailored policies based on locality-specific data are crucial for effective Covid-19 management in different cities.
  2. Different US cities have unique network structures affecting the impact of various policies like work from home or essential work.
  3. Understanding city network structures and demographics can help predict policy outcomes, and this data remains relatively stable over time.

Which mRNA vaccine is safer?

Steve Kirsch's newsletter • 5 implied HN points • 10 Jan 25
🏥 Health Politics Data Analysis
  1. The Moderna vaccine might be riskier than the Pfizer vaccine based on some studies, suggesting it has a higher chance of serious side effects.
  2. Recent information indicates that the safety comparison between the two vaccines might not be as clear as previously thought.
  3. Being updated with new data is important for anyone who may help others decide which vaccine to take.

New Medicare data makes it clear that the COVID vaccines have killed millions of people worldwide

Steve Kirsch's newsletter • 15 implied HN points • 14 Jan 24
🏥 Health & Wellness Data Analysis
  1. New Medicare data suggests that COVID vaccines may have increased mortality rates, contradicting promises of safety and efficacy.
  2. Unvaccinated individuals appeared to fare better in terms of mortality since April 2022, challenging the need for booster shots after that time.
  3. Flu vaccines also show concerning mortality rates, suggesting unsafe practices and lack of benefit.

A Guide to Customer Analysis for Sequencing Kit Providers

LatchBio • 6 implied HN points • 03 Dec 24
🕹 Technology Data Analysis
  1. Kit providers should create analysis packages that include tools to help customers understand their data better. This makes it easier for scientists to answer their research questions.
  2. Redeemable codes can be embedded in kits to give customers access to these analysis tools. This lets providers track which customers are using the tools and how.
  3. It's crucial for kit providers to monitor their customers' progress with the analysis tools. If customers can't get the insights they need, they are less likely to buy more kits.

Can AI Identify an Author’s Background from a Writing Sample?

Jakob Nielsen on UX • 5 implied HN points • 09 Jan 25
🕹 Technology Data Analysis
  1. Current AI tools struggle to accurately determine someone's background from their writing. They often miss subtle clues that could reveal a person's origin.
  2. Different AI models can give varying guesses about an author's background. Some might guess English native speakers or Americans when the real background is different.
  3. To test AI's ability, you can try analyzing your own writing through an AI tool. It can be fun to see if the AI gets your background right!

Second-Order Consequences

IntelEdge360 with Bidemi Ologunde • 1 HN point • 05 Apr 24
🕹 Technology Data Analysis
  1. Ryan's routine before high-level intelligence briefings involves distinct activities to prepare mentally and logistically.
  2. In his briefing, Ryan utilizes various intelligence sources like OSINT, HUMINT, and SIGINT to analyze cyber threats and their implications on global operations.
  3. Scenario planning helps organizations like Ryan's client in the Middle East prepare for various cyber threats, fostering resilience and strategic foresight to navigate digital complexities.

Data Update 1 for 2022: It is Moneyball Time!

Musings on Markets • 19 implied HN points • 08 Jan 22
💰 Finance Data Analysis
  1. Having a lot of data isn't always helpful. Sometimes, too much information can make it harder to make good decisions.
  2. Just because everyone thinks something is right doesn't mean it is. Crowds can be wrong, so it's important to think critically about popular opinions.
  3. Using data effectively requires understanding and skill. Knowing how to read the data properly can help you make better investment choices.

Cellphone location-tracking firm follows in Palantir's footsteps with Large Language Model

All-Source Intelligence Fusion • 20 implied HN points • 20 Jun 23
🕹 Technology Data Analysis
  1. Babel Street announced the launch of its "Insights GPT" large language model.
  2. Babel Street aims to transition from a cellphone location-tracking firm to an artificial intelligence company.
  3. The Insights GPT platform may have significant government surveillance use cases, such as summarizing data on the Chinese Communist Party.

"Single panes of glass" are horrible

Counting Stuff • 21 implied HN points • 30 Mar 23
🕹 Technology Data Analysis
  1. Single panes of glass in technology often promise magic but fail to deliver in a meaningful way
  2. The concept of 'single panes of glass' in tech is fundamentally flawed because it doesn't mirror the efficiency and specialization seen in physical interfaces like those in transportation
  3. Project requests for 'single panes of glass' tend to lead to complex, unsustainable solutions that are difficult to manage and maintain over time

Quant Letter: January 2025, Week-2

The Parlour • 4 implied HN points • 09 Jan 25
💰 Finance Data Analysis
  1. Quant finance uses advanced math and data analysis to make investment decisions. It's all about finding patterns in numbers to predict market trends.
  2. Machine learning is becoming increasingly important in finance. It helps in automating processes and analyzing large amounts of data quickly.
  3. Staying updated with recent research and findings in quant finance can provide valuable insights. It's key to adapt and grow in this fast-changing field.

What are the best "gold standard" data sources for determining COVID safety and efficacy?

Steve Kirsch's newsletter • 5 implied HN points • 01 Nov 24
🏥 Health Politics Data Analysis
  1. It’s important to find reliable data sources to understand the COVID vaccine's impact on safety and effectiveness. Good data helps answer important questions about health.
  2. Key questions include how vaccines affect infection risk, death rates from COVID, and overall mortality rates. These questions guide the research on vaccine impact.
  3. Some of the best data sources for these questions include worldwide COVID case numbers, nursing home COVID data in the US, and detailed records from the Czech Republic.

Data Science Weekly - Issue 414

Data Science Weekly Newsletter • 19 implied HN points • 28 Oct 21
🕹 Technology Data Analysis
  1. Machine learning can work with messy data. The key is to adapt techniques to handle things like missing values instead of spending all the time cleaning the data.
  2. Visualizations should be clear and focused. Good designs help people understand the information better by removing clutter and emphasizing main points.
  3. There are emerging tools and techniques that can speed up scientific discovery through faster machine learning methods. This helps researchers process data in real time and make new discoveries.

New Zealand OIA request reveals the COVID vaccines increased your risk of dying

Steve Kirsch's newsletter • 10 implied HN points • 19 Feb 24
🏥 Health Politics Data Analysis
  1. The New Zealand OIA request revealed that COVID vaccines were found to increase the risk of dying, instead of providing protection against COVID.
  2. The data released under OIA showed that vaccinated individuals experienced a significant increase in mortality during the COVID outbreak, contrary to what was expected.
  3. Mainstream epidemiologists have avoided analyzing the data that shows the vaccines increased the risk of dying from COVID, leading to a lack of public discussion and questioning.

Destination-Adjacent Source Address Spoofing

Dataplane.org Newsletter • 1 HN point • 05 Mar 24
🕹 Technology Data Analysis
  1. A new technique called Destination-Adjacent Source Address Spoofing (DASA) was observed where source IP addresses were faked to a neighbor address of the target, potentially for unique Internet surveying or experimental purposes.
  2. The DASA spoofed addresses were noticed in DNS queries, showing unusual patterns like using IPv4 addresses in hex format and inconsistent query domains over time.
  3. Through Source Address Spoofing Triangulation, attempts were made to pinpoint the true origin of the spoofed packets, suspecting an academic institution in China, showing the potential to uncover interesting insights using network intelligence.

Want To Know How To Calculate Your Enterprise AI Usage? You Can't!

Theology • 3 implied HN points • 26 Jan 25
🕹 Technology Data Analysis
  1. Different AI services have complicated pricing models that make it hard to budget. This can lead to unexpected costs every month.
  2. It's tough to compare different AI vendors since their pricing isn't standardized. You might not even know if you're paying for the same features with different companies.
  3. Trying to manage multiple AI platforms can be a headache. In the end, the savings you expect might vanish due to the effort needed to track everything.

Data Science Weekly - Issue 400

Data Science Weekly Newsletter • 19 implied HN points • 22 Jul 21
🕹 Technology Data Analysis
  1. Deepfake technology raises ethical questions about the use of AI-generated content without disclosure, as seen in the documentary about Anthony Bourdain.
  2. The way we use data is changing. A modern cloud data stack is becoming essential for building new businesses and improving access to data.
  3. GitHub Copilot is transforming coding by generating code automatically, making it feel like a magical assistant, though some users are still figuring out how to best use it.

Does Github CoPilot increase developer productivity?

Brick by Brick • 9 implied HN points • 07 Feb 24
🕹 Technology Data Analysis
  1. Microsoft reported significant growth with GitHub CoPilot, reflecting high adoption and productivity among developers
  2. An experiment showed developers using CoPilot completed tasks 55.8% faster, raising questions about generalizability
  3. Assessing the true impact of CoPilot on productivity requires rigorous experiments tailored to individual engineering organizations

It's not the COVID vaccine that deserves the credit for the reduction in MIS-C cases. It's the virus!

Steve Kirsch's newsletter • 8 implied HN points • 17 Mar 24
🏥 Health Politics Data Analysis
  1. The reduction in MIS-C cases can be attributed to the virus, not the COVID vaccine. The virus shift to BA.2 variants coincided with the drop in cases.
  2. The data indicates that the protective effect of the vaccine did not suddenly grow stronger after a year. Immunity actually started to rapidly increase over time.
  3. Credit should be given to the virus for the drop in MIS-C cases, not the vaccine. The CDC did not recognize this relationship.

The single most misleading graph of the pandemic

Steve Kirsch's newsletter • 4 implied HN points • 24 Oct 24
🏥 Health Politics Data Analysis
  1. A graph shows that vaccinated people are much less likely to die from COVID compared to those who are unvaccinated. This sounds convincing to get vaccinated.
  2. However, the graph might be misleading and doesn't tell the full story behind the numbers.
  3. The author offers more insights about why the graph is deceptive and argues against getting vaccinated.

Data Science Weekly - Issue 392

Data Science Weekly Newsletter • 19 implied HN points • 27 May 21
🕹 Technology Data Analysis
  1. Archaeologists are using a neural network to help sort pottery fragments. This combines tech and human expertise to improve artifact classification.
  2. JavaScript is now favored for data analysis on the web. It allows for easier collaboration and better communication of insights.
  3. Companies are focusing on AI compliance and risk management. There's a growing need for legal support to handle AI-related challenges.

Analyzing media bias with AI

serious web3 analysis • 5 HN points • 20 Aug 24
🇺🇸 U.S. Politics Data Analysis
  1. AI can quickly analyze news articles for bias, saving time compared to human assessment. It rates articles on a scale to determine if they lean left or right.
  2. Mainstream outlets like CNN and NYT tend to show moderate left-wing bias, while Fox News has a stronger right-wing bias. Some sources like AP and Reuters are closer to neutral.
  3. Bias in media can change over time. For example, CNN has become more left-wing recently, especially since the rise of Donald Trump, while Fox News has consistently maintained a right-wing stance.

Still Time to Register: Takara Bio x LatchBio Spatial Webinar

LatchBio • 1 implied HN point • 28 Jul 25
🔬 Science Data Analysis
  1. There's a webinar on July 29, 2025, where Takara Bio and LatchBio will show a new tool for analyzing spatial data from specific kits.
  2. Participants will learn practical ways to filter data, compare samples, and explore gene expression in different tissue areas.
  3. This session is great for anyone using Seeker™ kits or those interested in spatial biology, providing a hands-on look at the new analysis tool.

Data Science Weekly - Issue 385

Data Science Weekly Newsletter • 19 implied HN points • 08 Apr 21
🕹 Technology Data Analysis
  1. Building a machine learning rig can be a fun project. It involves planning and buying the right hardware, especially GPUs.
  2. Data observability is crucial for businesses using large data sets. It helps ensure data quality and reduces issues in complex data pipelines.
  3. Using deep learning and automation can simplify tasks like monitoring bird nests. This can save time and keep track of nature without constant watching.

Data Week: How to manage your data

Joshua Gans' Newsletter • 19 implied HN points • 12 Oct 20
🕹 Technology Data Analysis
  1. Management of mission-critical data should ensure robust systems to avoid errors like the UK Excel scandal.
  2. Having a unified data infrastructure for COVID-19 reporting across various testing venues is crucial for accurate data collection.
  3. Lessons from data management failures, such as the UK Excel error, underline the importance of investing in advanced data systems for efficient pandemic handling.