The hottest Data Analysis Substack posts right now

And their main takeaways
Category
Top Technology Topics

Cities and Covid Reopening

Joshua Gans' Newsletter • 39 implied HN points • 04 Aug 20
🏥 Health & Wellness Pandemic response Data Analysis Economic Impact
  1. Tailored policies based on locality-specific data are crucial for effective Covid-19 management in different cities.
  2. Different US cities have unique network structures affecting the impact of various policies like work from home or essential work.
  3. Understanding city network structures and demographics can help predict policy outcomes, and this data remains relatively stable over time.

Second-Order Consequences

IntelEdge360 with Bidemi Ologunde • 1 HN point • 05 Apr 24
🕹 Technology Cybersecurity Threat assessment Data Analysis
  1. Ryan's routine before high-level intelligence briefings involves distinct activities to prepare mentally and logistically.
  2. In his briefing, Ryan utilizes various intelligence sources like OSINT, HUMINT, and SIGINT to analyze cyber threats and their implications on global operations.
  3. Scenario planning helps organizations like Ryan's client in the Middle East prepare for various cyber threats, fostering resilience and strategic foresight to navigate digital complexities.

Data Update 1 for 2022: It is Moneyball Time!

Musings on Markets • 19 implied HN points • 08 Jan 22
💰 Finance Data Analysis Investment Strategies Market Trends Company Valuation Economic Indicators Corporate Finance
  1. Having a lot of data isn't always helpful. Sometimes, too much information can make it harder to make good decisions.
  2. Just because everyone thinks something is right doesn't mean it is. Crowds can be wrong, so it's important to think critically about popular opinions.
  3. Using data effectively requires understanding and skill. Knowing how to read the data properly can help you make better investment choices.
Get a weekly roundup of the best Substack posts, by hacker news affinity:

LLMs shouldn’t write SQL

benn.substack • 3 HN points • 23 Feb 24
🕹 Technology Data Analysis Artificial Intelligence Business Intelligence
  1. In business analysis, there are two main approaches: a structured method using known metrics and BI tools and a more creative, less structured method that involves asking unique questions and using tools like Excel, SQL, and Python.
  2. The prediction that natural language will replace SQL in data management interfaces is interesting, but the role of SQL might evolve rather than disappear completely, still being crucial for generating queries efficiently.
  3. Artificial intelligence can assist in tasks like drawing or writing formulas, but the precision and efficiency of code often make it a better choice for data analysis, despite the potential for AI advancements in building complex queries.

Malloy Data

Why Now • 5 implied HN points • 26 Oct 23
🕹 Technology Programming Database Management Data Analysis Software Development Programming Languages
  1. Malloy is a new query language for describing data relationships and transformations in SQL databases.
  2. Malloy compiles to SQL optimized for your database, has a semantic data model and query language, excels at reading and writing nested data sets, and handles complex queries seamlessly.
  3. Malloy also introduces a semantic layer similar to Looker, allowing for saving calculations like measures and defining dimensions to describe and transform data.

Improve your SQL skills X2 in 5 minutes

Leading Developers • 3 HN points • 13 Feb 24
🕹 Technology Data Management SQL Data Analysis Programming
  1. SQL skills are crucial for managers because they can help answer business questions, understand technical designs, and provide a huge return on effort invested.
  2. Don't stop with just learning joins in SQL. Advancing to using CTEs, window functions, and partitions can greatly enhance your ability to write complex queries.
  3. Window functions in SQL, such as ranking functions, aggregation functions, and positional functions, can help in advanced query writing by allowing calculations across sets of rows or returning a single value from a specific row within partitions.

Data Science Weekly - Issue 414

Data Science Weekly Newsletter • 19 implied HN points • 28 Oct 21
🕹 Technology Data science Machine Learning AI Software Development Data Analysis
  1. Machine learning can work with messy data. The key is to adapt techniques to handle things like missing values instead of spending all the time cleaning the data.
  2. Visualizations should be clear and focused. Good designs help people understand the information better by removing clutter and emphasizing main points.
  3. There are emerging tools and techniques that can speed up scientific discovery through faster machine learning methods. This helps researchers process data in real time and make new discoveries.

How to hunt down TikTok's top videos

12challenges • 3 HN points • 13 Feb 24
🕹 Technology Social media Data Analysis Web scraping APIs Regulations
  1. Hunting down TikTok's top videos is challenging because the data is not easily accessible through conventional methods like Google search.
  2. Using TikTok's Research API is limited and not helpful in obtaining the top TikTok videos by view count.
  3. Scraping TikTok's platform or using social monitoring tools are options to consider, but these methods come with challenges like legal implications and high costs.

How to Gain an Edge as a B2B PM

Product Managers at Work • 4 implied HN points • 28 Feb 24
💼 Business Product Management Customer Feedback Data Analysis User Insights
  1. Being a B2B Product Manager comes with unique challenges compared to B2C, like blending limited data with qualitative feedback for decision-making.
  2. It's crucial for B2B Product Managers to gather direct feedback from users through feedback portals to avoid bias and make informed decisions.
  3. Contextualizing and acting on user feedback effectively, based on target segments and feature usage data, can help prioritize product improvements for B2B success.

Destination-Adjacent Source Address Spoofing

Dataplane.org Newsletter • 1 HN point • 05 Mar 24
🕹 Technology Cybersecurity Data Analysis Internet Research Networks
  1. A new technique called Destination-Adjacent Source Address Spoofing (DASA) was observed where source IP addresses were faked to a neighbor address of the target, potentially for unique Internet surveying or experimental purposes.
  2. The DASA spoofed addresses were noticed in DNS queries, showing unusual patterns like using IPv4 addresses in hex format and inconsistent query domains over time.
  3. Through Source Address Spoofing Triangulation, attempts were made to pinpoint the true origin of the spoofed packets, suspecting an academic institution in China, showing the potential to uncover interesting insights using network intelligence.

Data Science Weekly - Issue 400

Data Science Weekly Newsletter • 19 implied HN points • 22 Jul 21
🕹 Technology Data science Machine Learning Artificial Intelligence Software Development Data Analysis
  1. Deepfake technology raises ethical questions about the use of AI-generated content without disclosure, as seen in the documentary about Anthony Bourdain.
  2. The way we use data is changing. A modern cloud data stack is becoming essential for building new businesses and improving access to data.
  3. GitHub Copilot is transforming coding by generating code automatically, making it feel like a magical assistant, though some users are still figuring out how to best use it.

The Art of Camouflage

Deceiving Adversaries • 7 implied HN points • 09 May 23
🕹 Technology Cybersecurity Deception Psychology Threat intelligence Data Analysis
  1. Understand the mindset, behavior, and tactics of potential cyber adversaries to tailor effective lures.
  2. Craft believable lures by focusing on realism, integration into the environment, and attractiveness to attackers.
  3. Deploy and manage lures strategically, monitor attacker interactions, adapt tactics over time for a dynamic deception strategy.

VSRF LIVE Tonight: Episode 150 - Santa Clara County Case Fatality Rate Analysis after C19 Vaccination

Steve Kirsch's newsletter • 1 implied HN point • 31 Oct 24
🏥 Health Politics Vaccination Public Health Crisis response Data Analysis Health Freedom
  1. The upcoming VSRF LIVE episode will discuss a study on the case fatality rate in Santa Clara County after COVID-19 vaccination. It suggests vaccinated residents might have a higher rate of death compared to those who are unvaccinated.
  2. The show aims to encourage open discussions about health data between the community and government agencies. The host has been actively participating in local public health events to share findings.
  3. Viewers are invited to watch the live episode and support the VSRF through donations. This support is crucial for keeping the show going and promoting health freedom.

Data Science Weekly - Issue 392

Data Science Weekly Newsletter • 19 implied HN points • 27 May 21
🕹 Technology Data science Machine Learning Artificial Intelligence Software Development Data Analysis
  1. Archaeologists are using a neural network to help sort pottery fragments. This combines tech and human expertise to improve artifact classification.
  2. JavaScript is now favored for data analysis on the web. It allows for easier collaboration and better communication of insights.
  3. Companies are focusing on AI compliance and risk management. There's a growing need for legal support to handle AI-related challenges.

Head of CIA OSINT emphasizes centrality of Twitter and Telegram surveillance

All-Source Intelligence Fusion • 4 HN points • 28 Sep 23
🇺🇸 U.S. Politics Intelligence Surveillance Data Analysis National Security Congress
  1. The head of CIA OSINT highlights the importance of surveillance on Twitter and Telegram for gathering open source intelligence.
  2. CIA's focus on AI technology has improved data analysis efficiency for vast amounts of surveillance data.
  3. The CIA incorporates controversial surveillance technologies like facial recognition and cellphone tracking data into their open source intelligence methodology.

Haystack 2024 - My Favorite Talks

Talking to Computers: The Email • 1 HN point • 09 Jul 24
🕹 Technology Information Retrieval Artificial Intelligence Machine Learning Data Analysis
  1. Retrieval Augmented Generation (RAG) is a hot topic this year, mixing search and text generation. It's being used in new and complex ways, even integrating images and tables.
  2. Vector and hybrid searches are also popular, combining traditional keyword searches with modern techniques for better results. This approach helps tailor searches more effectively.
  3. There were talks on various other topics, highlighting the importance of basics in search technology. Simple methods can still be very effective, especially for organizations trying to improve their search results.

Data Science Weekly - Issue 385

Data Science Weekly Newsletter • 19 implied HN points • 08 Apr 21
🕹 Technology Data science Machine Learning Artificial Intelligence Data Analysis Automation
  1. Building a machine learning rig can be a fun project. It involves planning and buying the right hardware, especially GPUs.
  2. Data observability is crucial for businesses using large data sets. It helps ensure data quality and reduces issues in complex data pipelines.
  3. Using deep learning and automation can simplify tasks like monitoring bird nests. This can save time and keep track of nature without constant watching.

Data Week: How to manage your data

Joshua Gans' Newsletter • 19 implied HN points • 12 Oct 20
🕹 Technology Data Management Big Data Software Data Analysis
  1. Management of mission-critical data should ensure robust systems to avoid errors like the UK Excel scandal.
  2. Having a unified data infrastructure for COVID-19 reporting across various testing venues is crucial for accurate data collection.
  3. Lessons from data management failures, such as the UK Excel error, underline the importance of investing in advanced data systems for efficient pandemic handling.

Why Credit Card Data still makes money

Magis • 2 HN points • 03 Feb 24
💼 Business Data science Investment Hedge Funds Data Analysis Talent Acquisition
  1. Credit card data remains valuable despite its availability because of the infrastructure and talent required to utilize it effectively.
  2. Having the computational resources and expertise to analyze consumer spending data gives larger firms an advantage over smaller firms.
  3. Success in leveraging consumer spending data depends on the rarity of talent that can understand and apply it effectively.

✅ Monday briefing #18: Influencer insights, ad budgets, remote presentations, COVID-19 creativity challenge, DIY app builder, data skills and Instagram business guide, and more

Wadds Inc. newsletter • 19 implied HN points • 02 Nov 20
💼 Business Marketing Advertising Influencer Data Analysis Social media Remote work
  1. More marketers are spending more on influencer marketing than before, showing its growing importance in advertising.
  2. Presenting online requires different skills than in-person presentations, as remote work changes how we share ideas.
  3. Creating apps is now easier with no-code platforms, allowing more people to build their own apps without needing to write code.

Data Science Weekly - Issue 364

Data Science Weekly Newsletter • 19 implied HN points • 12 Nov 20
🕹 Technology Data science Machine Learning Artificial Intelligence Data Analysis Software Development
  1. Organizing data in spreadsheets can help prevent errors and make analysis easier. It's important to keep a consistent format and to avoid leaving any empty cells.
  2. AI is being used to create music that sounds like famous artists, which could change the music industry. This technology raises questions about copyright and authenticity.
  3. Monitoring tools are becoming essential for data scientists to track their models for performance and integrity. These tools help ensure that models are accurate and reliable over time.

✅ Monday briefing #17: PR start-ups, search metrics, propaganda media, sustainable local media, COVID-19 data, LinkedIn hack, foodbank fundraiser, and more

Wadds Inc. newsletter • 19 implied HN points • 26 Oct 20
💼 Business Public Relations Media Data Analysis Social media Entrepreneurship
  1. PR start-ups in the UK are adapting to challenges by finding new business models during COVID-19.
  2. Using search metrics like Google Trends can help marketers measure the success of their campaigns better.
  3. Local media needs to focus on publishing fewer but higher-quality articles to survive and create a sustainable business.

Người Việt Nam chọn mật khẩu như thế nào?

Thái | Hacker | Kỹ sư tin tặc • 39 implied HN points • 01 May 18
🕹 Technology Data security Data Analysis
  1. Many Vietnamese people use easily crackable encryption algorithms for their passwords, making them vulnerable to security breaches.
  2. Analyzing common passwords can help individuals understand which types of passwords are weak and encourage them to choose stronger ones.
  3. Interesting statistics show unique password choices of Vietnamese users, revealing preferences related to food and self-perception.

Hyperscaling, Computational Humanness, and Paid Sick Leave

Gradient Flow • 19 implied HN points • 13 Mar 20
🕹 Technology AI Machine Learning Data Analysis Distributed Computing Open Source
  1. Access to paid sick leave is crucial, as it has been shown to reduce flu cases by about 10% or more.
  2. Distributed computing is becoming increasingly important, especially in the context of machine learning models that require extensive training.
  3. There are new tools and databases available for data enrichment and time series management in the tech industry.