The hottest Data Analysis Substack posts right now

And their main takeaways
Category
Top Technology Topics

The Counterfactual's science poll #1

The Counterfactual • 59 implied HN points • 03 Jan 24
🔬 Science Research Data Analysis Large Language Models
  1. Subscribers can vote on which research topics to explore each month. This makes it a fun way for people to get involved in science.
  2. Most research will focus on concrete questions and often involve Large Language Models. The goal is to keep projects manageable and achievable in a month.
  3. Some topics will involve summarizing existing research. This helps everyone understand what we know about a subject more clearly.

The GenAI D&R Revolution Begins

Detection at Scale • 19 implied HN points • 13 May 24
🕹 Technology AI Security Automation Data Analysis Tools
  1. Security companies at RSA are increasingly focusing on AI to enhance Detection and Response (D&R) processes.
  2. Automated Tier 1 Triage using autonomous SOC analysts can streamline alert triage and analysis, improving efficiency for SecOps teams.
  3. GenAI can also improve D&R through AI-powered chatbots for automating organizational Q&A and log summarization for quicker insights and analysis.
Get a weekly roundup of the best Substack posts, by hacker news affinity:

AI Scraping Benchmarks

serious web3 analysis • 20 HN points • 24 Sep 24
🕹 Technology AI Web scraping Data Analysis Software Development Machine Learning
  1. AI can make web scraping super easy by letting users scrape information in plain English instead of complicated coding. This can help many more people access scraping tools.
  2. It's important to track the costs of using AI for scraping. Choosing the right AI model can save money while still getting accurate results.
  3. Benchmarking AI scrapers based on accuracy, runtime, and cost is essential. It helps users find the best tools for their specific scraping needs.

Triangulation in UX Research

UX Psychology • 238 implied HN points • 14 Jun 22
🕹 Technology UX Research Data Analysis Research Methods User Insights Study Design
  1. Triangulation in UX research involves using multiple research methods or data sources to study the same phenomenon, enhancing credibility and providing more robust insights.
  2. There are 4 main types of triangulation recognized in research: data triangulation, investigator triangulation, theory triangulation, and methodological triangulation.
  3. Using triangulation in user research can lead to more confidence in data, reveal unexpected findings, and help to understand a problem more clearly, although it may also increase chances of confirmation bias.

Choosing the right UX metrics - Part 2

UX Psychology • 158 implied HN points • 03 Oct 22
🕹 Technology UX Design Metrics Product Management User Experience Data Analysis
  1. Identifying clear goals is crucial in choosing the right UX metrics, involving team and stakeholders can help define meaningful and actionable metrics.
  2. Mapping goals to signals helps track progress towards goals; gathering user feedback and reviews can be essential signals to measure UX success.
  3. Refining signals into specific metrics is the final step, where data scientists can assist in ensuring metrics are measured accurately; focus on key metrics and avoid adding unnecessary data.

What do Americans use electricity for?

Sustainability by numbers • 75 implied HN points • 19 Mar 24
🔬 Science Energy Electricity Renewable Energy Data Analysis
  1. American households primarily use electricity for heating, cooling, and controlling humidity.
  2. Future challenges in energy demand will revolve around balancing supply and demand, particularly for temperature control like heating and cooling.
  3. Electricity consumption is dominated by heating, cooling, and humidity control in households, highlighting the importance of efficient solutions in this area.

Series B Activity: January 2024

Magid and Co • 39 implied HN points • 08 Feb 24
💼 Business Finance Investments Data Analysis Startups Entrepreneurship
  1. Series B deal volume increased significantly in January compared to December, which is positive news for founders seeking funding.
  2. Data focused on Series B deals globally (excluding China) with amounts raised over $5M and companies not centered on therapeutics.
  3. The post provides insights into recent Series B activity, highlighting key statistics and trends in the sector.

Top Questions ahead of Neudata’s New York Winter Data Summit

The Data Score • 59 implied HN points • 05 Dec 23
💼 Business Data Analysis Finance Investing Technology Conferences
  1. The questions asked at Neudata's New York Winter Data Summit cover themes like alternative data in investing, AI applications in financial analysis, and insights from recent data trends.
  2. Speakers will discuss the evolving role of alternative data and its impact on investment strategies, the use of AI in financial analysis, and the real-world implications of data trends on the economy and key sectors.
  3. Attendees will gain insights on the impact of alternative data on decision-making, the potential of AI in financial analysis, and the practical applications of recent data trends in the finance industry.

Wastewater measurements indicate highly vaccinated states had no benefit. Rachel Maddow was wrong.

Steve Kirsch's newsletter • 12 implied HN points • 08 Feb 25
🏥 Health Politics Vaccines Public Health COVID-19 Data Analysis Health Studies
  1. Data from wastewater shows that highly vaccinated states did not have fewer COVID infections than less vaccinated ones. This suggests mass vaccination may not have been effective.
  2. The rise in COVID cases in highly vaccinated areas like Israel indicates that vaccines may have increased the virus's spread instead of controlling it.
  3. Studies, including ones from the Cleveland Clinic, found that the more vaccine doses people received, the higher their risk of contracting COVID. This raises questions about the vaccine's overall effectiveness.

Microsoft Sentinel SOC 101: How to Detect and Mitigate Supply Chain Attacks with Microsoft Sentinel

Rod’s Blog • 79 implied HN points • 25 Sep 23
🕹 Technology Cybersecurity Data Analysis Automation Integration Threat Detection
  1. Supply chain attacks target vulnerabilities within the chain, aiming to compromise products or services before reaching end-users. They pose a significant threat due to their indirect nature, multi-stage process, and high impact potential.
  2. Kusto Query Language (KQL) in Microsoft Sentinel is essential for detecting anomalies or patterns linked to supply chain attacks. By using KQL queries, organizations can identify unusual activities and potential threats.
  3. Microsoft Sentinel's integration with various tools and automated response capabilities, such as Playbooks, enables swift detection, investigation, and mitigation of supply chain threats. Leveraging these features enhances security measures.

NVIDIA: How could alternative data be used to assess its long-term potential?

The Data Score • 79 implied HN points • 15 Jun 23
💰 Finance Investment Data Analysis Market Analysis Alternative Data
  1. Assessing a company's long-term potential requires more than just traditional financial metrics, and alternative data sources can provide valuable insights.
  2. For NVIDIA, alternative data can illuminate aspects like market presence, evolving applications, competitive threats, and supply chain investments, aiding in making informed investment decisions.
  3. Key questions to answer include evaluating demand, diverse use cases for GPU chips, potential competitors, and investment needs, all essential for understanding NVIDIA's future prospects.

Monitor Azure Open AI Deployments with Microsoft Sentinel

Rod’s Blog • 79 implied HN points • 20 Apr 23
🕹 Technology Cloud Computing Security Data Analysis Automation Software Development
  1. Defender for Cloud Apps can now monitor Azure Open AI activity, making it easier to track and locate activity using Microsoft Sentinel.
  2. Utilize KQL queries to identify Azure Open AI deployments and create a maintained Watchlist in Microsoft Sentinel for easy monitoring.
  3. Automate the updating of the Watchlist with Logic Apps to ensure it always contains the most up-to-date information on Azure Open AI instances.

Mixtape Mailbag #8: Continuous Triple Differences

Scott's Substack • 39 implied HN points • 05 Feb 24
🔬 Science Causal Inference Data Analysis Research Methods Econometrics
  1. Triple difference design can be used with continuous treatment by defining the parameters based on dosage levels.
  2. When treatment is continuous, the target parameter shifts from average treatment effect to average causal response function.
  3. Continuous treatments require careful definition of parameters to compare different dosages along a treatment curve.

More than 30 unique tracking events will cause you problems

timo's substack • 78 implied HN points • 12 Feb 23
🕹 Technology Data Tracking Data Quality Data Analysis Documentation
  1. Having more than 30 unique tracking events can lead to problems in data adoption and productivity.
  2. Too many unique events can lead to difficulties in analyst productivity and data exploration.
  3. Implementing a lean event approach with a focus on good event design and ownership can help prevent issues caused by high event volumes.

In good company

Tabletops • 78 implied HN points • 03 Jul 23
🕹 Technology Retail Data Analysis App Development
  1. Apple Stores often choose locations near other popular brands like Victoria's Secret, Lululemon, and Sephora.
  2. Most Apple Stores are located on the main level of the malls they are in.
  3. Apple Store distribution seems to loosely correlate with mall operators like Simon and Brookfield.

March Madness Forecasts: FiveThirtyEight vs. Betting Markets

Mike’s Blog • 78 implied HN points • 07 Apr 23
💰 Finance Data Analysis Forecasting Academic Research Sports
  1. Betting markets slightly outperformed FiveThirtyEight in predicting NBA, NFL, and MLB games.
  2. New data collected for March Madness shows both FiveThirtyEight and betting markets performed similarly, and neither significantly outperformed.
  3. Hypothesis: Both betting markets and experts may have worse accuracy in playoffs and tournaments compared to regular season games.

Building Cyborgs

Condensing the Cloud • 78 implied HN points • 01 Mar 23
🕹 Technology AI Startups Generative AI Data Analysis
  1. Identifying problems that need to be solved is crucial in building a successful business.
  2. Leveraging generative AI like GPT in conjunction with human intelligence can create innovative solutions.
  3. Bots and cyborgs represent two paradigms of AI businesses, with cyborgs showing more promise for startups due to their collaborative nature.

A Guide to Customer Analysis for Sequencing Kit Providers

LatchBio • 6 implied HN points • 03 Dec 24
🕹 Technology Biotechnology Data Analysis Cloud Computing Software Development Customer Support
  1. Kit providers should create analysis packages that include tools to help customers understand their data better. This makes it easier for scientists to answer their research questions.
  2. Redeemable codes can be embedded in kits to give customers access to these analysis tools. This lets providers track which customers are using the tools and how.
  3. It's crucial for kit providers to monitor their customers' progress with the analysis tools. If customers can't get the insights they need, they are less likely to buy more kits.

The KQL Mysteries: Prologue

Rod’s Blog • 59 implied HN points • 20 Nov 23
🕹 Technology Cybersecurity Programming Data Analysis Digital World Query Language
  1. Jon Block, a top-tier security analyst, used KQL - Kusto Query Language, to tackle cyber threats. This powerful query language helped him root out elusive cyber threats and protect digital landscapes.
  2. Jon's journey into cybersecurity began with self-taught programming and a determined spirit after being a victim of a cyber attack. His dedication led him to become a renowned cybersecurity professional using KQL.
  3. KQL's elegance and power allowed Jon to shine in the cybersecurity realm, offering protection to clients from all levels of society. His mastery of KQL made him a formidable force against cybercriminals.

The State of 'the Gaps' 2022-23

Cremieux Recueil • 96 implied HN points • 31 Dec 23
🔬 Science Psychometrics Data Analysis
  1. The observed Black-White intelligence gap in standardized test performance has shown some variations over the years.
  2. Errors were found in a study that claimed a significant closure in the intelligence gap between Black and White individuals.
  3. Recent data and analyses suggest that the racial intelligence gap in the U.S. has not significantly closed and remains consistent with historical observations.

ChatGPT agrees that more COVID vaccination --> more cases

Steve Kirsch's newsletter • 13 implied HN points • 26 Jan 25
🏥 Health Politics Vaccines Public Health COVID-19 Data Analysis Health Policy
  1. More COVID vaccinations could be linked to an increase in COVID cases. This idea goes against what health authorities have been saying.
  2. Analyzing data suggests that getting vaccinated may actually raise the risk of getting infected with COVID.
  3. There's a concern that historical data might be rewritten to ignore these findings, leaving people wondering about the truth behind vaccine mandates.

Interpret Complex Pipelines By Drawing A Box

Mindful Modeler • 159 implied HN points • 22 Nov 22
🕹 Technology Data Analysis Interpretability
  1. Interpretation of complex pipelines can be challenging when model changes impact interpretability. Use model-agnostic interpretation methods to interpret arbitrary pipelines.
  2. Think of predictive models as pipelines with various steps like transformations and model ensembles. View the entire pipeline as the model for better interpretation.
  3. Draw the box around the entire pipeline in model-agnostic interpretation to gain insights into feature importance, prediction changes, and explanations, disregarding the specific models within the pipeline.

Microsoft Sentinel SOC 101: How to Detect and Mitigate Rare Domains Seen in Cloud Logs with Microsoft Sentinel

Rod’s Blog • 59 implied HN points • 06 Nov 23
🕹 Technology Security Cloud Computing Data Analysis Threat intelligence Automation
  1. Rare or malicious domains in cloud logs can be used by attackers for phishing, malware delivery, data exfiltration, and command and control.
  2. Detection and analysis of rare domains in cloud logs can help identify threats like phishing attacks, malware delivery, data exfiltration, and command and control activities.
  3. Microsoft Sentinel offers features like built-in hunting queries, automation rules, and playbooks to help detect, enrich, validate, and respond to rare domains in cloud logs.

Long run Long Covid post

Logging the World • 99 implied HN points • 18 Dec 22
🏥 Health & Wellness Long Covid Vaccination Data Analysis Risk Assessment
  1. The idea of COVID risks changing over time due to factors like vaccination and new variants must be understood.
  2. The concept of Long COVID being like taking a risk with 'Russian roulette' might not accurately represent the real-world data.
  3. Severe Long COVID conversion rates don't seem to be as high as initially expected, indicating the situation is different than a constant risk per infection.

October Housing Starts: Near Record Number of Multi-Family Housing Units Under Construction

CalculatedRisk Newsletter • 105 implied HN points • 17 Nov 23
💼 Business Real Estate Construction Economy Data Analysis Housing Market
  1. Housing starts increased to 1.372 million annual rate in October.
  2. Single-family starts bounced back, while multi-family housing faced weakness in late 2022 and early 2023.
  3. Total housing starts in October were above expectations, with year-to-date starts down compared to last year.