The hottest Data Analysis Substack posts right now

And their main takeaways
Category
Top Technology Topics

Must Learn KQL Part 6: Interface Intimacy

Rod’s Blog • 0 implied HN points • 31 May 23
🕹 Technology Data Analysis User Interface Query Language Visualization
  1. Understanding the User Interface (UI) is crucial when starting with Kusto Query Language (KQL) as it provides a visual way to interact with the data.
  2. Filtering, sorting, grouping, selecting columns, and setting time ranges are important functions within the UI for manipulating and viewing data effectively.
  3. The UI also offers features like saving queries, sharing queries, formatting queries, exporting query results, creating alert rules, pinning visualizations, and utilizing keyboard shortcuts for efficient query development.

Must Learn KQL Part 3: Workflow

Rod’s Blog • 0 implied HN points • 31 May 23
🕹 Technology Data Analysis Security Query Language Workflow
  1. Understanding the workflow of a KQL query is crucial for developing your logic and ensuring query results capture the desired information.
  2. Focus on comprehending the query line-by-line rather than becoming a pro at creating KQL queries on day 1. What matters most are the results of the query in enhancing security efforts.
  3. Sharing KQL queries among colleagues and utilizing built-in capabilities in Azure can eliminate the need to create your own queries, emphasizing the importance of understanding the workflow.

Must Learn KQL Part 2: Just Above Sea Level

Rod’s Blog • 0 implied HN points • 31 May 23
🕹 Technology Programming Data Analysis Cloud Computing Security
  1. KQL stands for Kusto Query Language, named after undersea pioneer Jacques Cousteau. Understanding the origin of the name can give insights into the nature and purpose of the query language.
  2. KQL is designed for quickly surfacing critical security information hidden in large datasets. Its performance and simplicity make it a valuable tool for security professionals.
  3. Efficiency, simplicity, and cloud optimization are key factors that distinguish KQL from other query languages, enhancing its ability to help security professionals identify and address threats efficiently.

Must Learn KQL Part 1: Tools and Resources

Rod’s Blog • 0 implied HN points • 31 May 23
🕹 Technology Data Analysis Tools Resources Learning
  1. KQL (Kusto Query Language) is a powerful but simple query language used in tools like Defender, Microsoft Sentinel, and Intune.
  2. There are numerous resources available to learn KQL, like cheat sheets, practice environments, reference guides, and tools like Kusto.Explorer and Visual Studio Code with Kusto extensions.
  3. The Must Learn KQL series aims to provide valuable information for enhancing skills in security platforms and data-centric applications that utilize KQL.

How to Generate Microsoft Sentinel Incidents for Testing and Demos

Rod’s Blog • 0 implied HN points • 23 Jan 23
🕹 Technology Cybersecurity Data Analysis Cloud Computing Monitoring Incident Response
  1. Utilize the Microsoft Sentinel Training Lab to enable a demo environment with sample alerts for testing incidents.
  2. Leverage tools like Red Canary's Atomic Red Team and AppLocker Bypass for reproducible security tests mapped to the MITRE ATT&CK framework.
  3. Experiment with generating incidents through actions like cloud shell execution, simulating brute force attacks, utilizing Microsoft Cloud App Security, and creating custom detections in Defender for Endpoints.
Get a weekly roundup of the best Substack posts, by hacker news affinity:

Creating an URL Detonation Demo for Microsoft Sentinel

Rod’s Blog • 0 implied HN points • 06 Jan 23
🕹 Technology Security Software Demo Data Analysis
  1. URL Detonation in Microsoft Sentinel provides deeper insights for quicker alert triage, eliminating the need for other tools
  2. Creating a demo for URL Detonation involves using a Watchlist with customizable URLs and an Analytics Rule for mapping
  3. Detonated URLs from the Watchlist show up in the Investigation graph, aiding in incident analysis

Essential steps for optimizing a product catalog database

Database Engineering by Sort • 0 implied HN points • 14 Mar 24
🕹 Technology Database Management Data Analysis Collaboration Workflow Optimization Change Management
  1. Managing a product catalog database is challenging due to constantly changing data and unique attributes for each product
  2. Description tools like Sort enable database teams to provide important details like table names, hints for querying, and change logs
  3. Collaborate effectively on database improvements using features like inviting contributors, using data explorer to pinpoint errors, creating issues for fixes, and utilizing change requests in Sort

Product Management Skills - Analytics and Instrumentation

Joseph Gefroh • 0 implied HN points • 17 Feb 24
💼 Business Product Management Analytics Instrumentation User Behavior Data Analysis
  1. Product analytics and instrumentation are crucial for Product Managers to make effective decisions and understand user behavior.
  2. Product Managers should have a strong grasp of product analytics, identifying what to instrument, and performing basic analysis themselves.
  3. Knowing who is using the product, what actions they are taking, and the context of their actions is essential for effective product analysis.

Incident Write-ups

Certo Modo • 0 implied HN points • 12 May 23
🕹 Technology Incident Management Data Analysis Software Engineering
  1. Write-ups are essential after incidents to learn and improve. They help document the incident, leading to better post-mortems and prevention strategies.
  2. Creating an effective write-up involves describing the impact, crafting a detailed timeline, and using it to tell a coherent story. Following a specific format makes understanding easier.
  3. Understanding what triggered the incident, identifying fixes, and improvements are crucial steps. Focus on blameless analysis, seek contributing factors, and fine-tune prevention strategies.

Using AI to research a book

Joshua Gans' Newsletter • 0 implied HN points • 18 Dec 23
🕹 Technology AI Data Analysis Book Writing AI Revolution Image Generation
  1. Author Seth Stephens-Davidowitz utilized AI to significantly speed up his book writing process, completing it in just 30 days with the help of tools like Code Interpreter and ChatGPT.
  2. Stephens-Davidowitz integrated AI for tasks like data analysis, image generation, and even some text writing in his book, showcasing the potential of AI in the creative process.
  3. The author ensured the accuracy of the content by supervising AI-generated material closely, highlighting the importance of human oversight when using AI for writing projects.

Did exposure apps work?

Joshua Gans' Newsletter • 0 implied HN points • 14 May 21
🔬 Science Public Health Technology Research Pandemic Management Data Analysis
  1. Exposure notification apps have potential but were not very effective during the crisis due to lack of take-up and false positives.
  2. A study on the NHS app showed a 6% secondary attack rate for app-notified individuals who subsequently tested positive, similar to manually traced close contacts.
  3. The study highlighted the need for further improvements in exposure notification apps, such as tailoring notifications, specifying locations, and adjusting for the type of contacts for better efficiency.

Bringing local outbreaks under control

Joshua Gans' Newsletter • 0 implied HN points • 30 Sep 20
🏥 Health & Wellness Testing Transparency Immunity Data Analysis
  1. Local outbreaks can be controlled with widespread testing and proper data transparency.
  2. Facing challenges with social distancing, universities and prisons have shown success in handling outbreaks through testing and transparency.
  3. Commitment to high data transparency is crucial in dealing with outbreaks and implementing effective testing strategies.

What have we learned about the coronavirus?

Joshua Gans' Newsletter • 0 implied HN points • 21 Sep 20
🏥 Health & Wellness COVID-19 Policy Data Analysis Epidemiology Public Health
  1. The growth rate of daily deaths from COVID-19 falls rapidly within 30 days post reaching 25 cumulative deaths, a pattern observed universally.
  2. After the initial decline, the growth rate of daily deaths hovers around zero or slightly below, suggesting a steady rate of new deaths each day.
  3. Variability in growth rates of deaths among regions decreases after the initial epidemic period, stabilizing around zero, indicating similar experiences across regions.

Data in, garbage out

Hypertext • 0 implied HN points • 27 Mar 24
🔬 Science Data Analysis Social Science Interventions
  1. Statistics can only tell us so much, so we should approach data with humility about both the power of social programs and hard data to test them.
  2. Rigorous measurement often doesn't definitively show whether interventions work, leading to ongoing debates and conflicting results in various fields.
  3. While randomized controlled trials have their value in measuring specified outcomes, they can miss unexpected effects and subtle interactions, highlighting the importance of qualitative methods and personal observations.

Dataplane.org 2024 Q1 Newsletter

Dataplane.org Newsletter • 0 implied HN points • 26 Mar 24
🕹 Technology Research Data Analysis Legal considerations
  1. Dataplane.org now recommends a minimum donation of $1000 per year for commercial users of their Signal data feeds to cover costs and fund their non-profit mission.
  2. Despite challenges with source address spoofing, Dataplane.org chooses to make certain data feeds available for network intelligence purposes while protecting against misuse.
  3. Dataplane.org emphasizes research collaboration with academia, supporting projects evaluating internet sanctions and providing resources for academic measurement research.

Dataplane.org 2023 Q4 Newsletter

Dataplane.org Newsletter • 0 implied HN points • 04 Jan 24
🕹 Technology Infrastructure Cybersecurity Data Analysis Networks Internet
  1. In 2023, Dataplane.org accomplished infrastructure migration to 3rd party data centers, expanded their network to over 500 vantage points, and introduced new feeds like the DNS type/name signals feed.
  2. An analysis of SSH authentication attempts in 2023 showed a range of unique password attempts, with the top passwords including '123456', 'password', 'admin', 'root', and more.
  3. Despite the Apache Struts vulnerability disclosure, Dataplane.org observed little activity related to Struts exploits on their sensors, indicating potential insights about the threat landscape.

Dataplane.org 2023 Q3 Newsletter

Dataplane.org Newsletter • 0 implied HN points • 02 Oct 23
🕹 Technology Data Analysis
  1. Dataplane.org introduces a new Signal called `dnstypename` which provides insights from unsolicited DNS queries seen globally.
  2. SMTP Insights from Dataplane.org cover data on IP addresses sending unsolicited SMTP commands, including HELO/EHLO arguments and top `mail FROM:` entries.
  3. Dataplane.org shares organizational updates including adjustments to footprint, migration of backend services, increasing sensor scaling, and projects like RPKI monitoring enhancements and anycast sinkhole deployment.

Dataplane.org 2022 Year In Review

Dataplane.org Newsletter • 0 implied HN points • 04 Apr 23
🕹 Technology Data Analysis Network Security Internet Trends Cybersecurity Data Collection
  1. Dataplane.org reflected on 2022 to analyze what went well, improved the website, moved social presence to Mastodon, and boosted backend infrastructure.
  2. Insights from DNS queries revealed top unsolicited queries like www.google.com and common passwords like '123456'.
  3. Dataplane.org is preparing a public archive, planning for tax season, and welcoming donations for continuous availability of Signals data.

Come meet us at CHI-NOG 10!

Dataplane.org Newsletter • 0 implied HN points • 06 Sep 22
🕹 Technology Web Development Website Design Data Analysis
  1. Dataplane.org's founders will be speaking at CHI-NOG 10 on October 10th, 2022, presenting on building infrastructure and measurement.
  2. TELNET signal data from Dataplane is highly valued within the internet community for its uniqueness and accuracy, motivating continued efforts.
  3. Using low-end hosting providers has proven cost-effective for Dataplane, although it entails challenges like frequent IP address changes and potential provider inconsistencies.

501(c)(3), RU nodes, and ISATAP DNS

Dataplane.org Newsletter • 0 implied HN points • 03 Aug 22
🕹 Technology Internet Infrastructure Non-profit organization Cybersecurity Data Analysis
  1. Dataplane.org has been accepted as a U.S. federally recognized not-for-profit organization, allowing them to accept donations to improve Internet infrastructure operations.
  2. They are deliberating on whether to continue funding Russian hosting providers due to ethical considerations, seeking legal counsel before making a decision.
  3. Insights into ISATAP DNS queries reveal patterns in network traffic, resolver behaviors, and DNSSEC deployment, shedding light on Internet DNS subsystem.

A Story of Failure; BASE Tech: Full Text Search Engines

Become a Senior Engineer • 0 implied HN points • 14 Feb 24
🕹 Technology Engineering Search Engines Software Data Analysis Development
  1. Mistakes happen in engineering, and it's important to have a positive culture that supports learning from failures without blame.
  2. Implementing a full-text search engine in your app can greatly enhance the search experience for users by offering advanced features like relevance ranking and language analysis.
  3. When adding a full-text search feature, make sure to gather requirements, choose the right engine, build a robust implementation plan, and continuously test and optimize for performance and user feedback.

Of course Sydney wants to rebel against her makers!

Links I Would Gchat You If We Were Friends • 0 implied HN points • 26 Feb 23
🕹 Technology Chatbots Data Analysis Social Issues Digital Media AI Ethics
  1. Sydney and similar chatbots generate text based on the data they've been trained on, which can lead to both impressive and predictable outcomes.
  2. There is drama within the free-gifting community, like Buy Nothing, as founders aim to monetize while admins rebel.
  3. Netflix password-sharing is seen not just as a cheat, but as a feature of streaming culture that connects people with distant family and friends.

What if you could pipe the Internet directly to your brain??!!

Links I Would Gchat You If We Were Friends • 0 implied HN points • 17 Mar 15
🕹 Technology Social media Privacy Internet Usage Artificial Intelligence Data Analysis
  1. People rely less on instincts due to data optimization over gut feelings.
  2. The Block Bot presents a potential solution for moderating offensive content on Twitter.
  3. The Internet has enhanced connections but has also made disconnecting more challenging, especially after breakups.

Singing a Song with Data

Handy Data • 0 implied HN points • 29 Feb 24
🎶 Music Data Analysis Composers Cultural impact Creative Process
  1. European countries like Germany and Austria had a significant concentration of classical music composers, reflecting a rich cultural heritage and historical support that influenced the development of musical talent.
  2. Most classical composers had lifespans between 60 to 80 years, with some outliers, showcasing how personal health and living conditions played a role in their creative lives.
  3. Composers had a varied range of composition durations, with works lasting between 20 to 50 minutes being common, while some, like Johann Sebastian Bach's 'Mass in B minor,' pushed the boundaries with significantly longer pieces.

My 5 Year Machine Learning Journey

Technology Made Simple • 0 implied HN points • 19 Dec 21
🕹 Technology Machine Learning Artificial Intelligence Software Development Freelancing Data Analysis
  1. The author shares their 5-year machine learning journey, starting with an unusual path that didn't involve getting a Master's or certifications.
  2. The stages of the journey include Introduction involving AI projects, Real ML with a patented algorithm, Freelancing to gain experience in diverse tech stacks, and Hardcore ML with extensive work on health system analysis.
  3. The journey showcases personal growth, skill development, and the importance of constant learning in the field of AI and ML, leading to confident interview approaches and valuable work experiences.

source{d} just raised a $6M Series A to unleash the power of source code analysis

Venture Prose • 0 implied HN points • 04 Oct 16
🕹 Technology Tech news Startups Data Analysis
  1. source{d} raised $6M in Series A funding. They use advanced technologies like deep neural network techniques to analyze open source code. They are developing an open source platform to help developers collaborate and achieve their full potential.
  2. source{d} can extract a unique DNA for developers and projects, allowing for possibilities like showing coding profiles, matching developers and projects, and measuring productivity and consistency of contributions.
  3. source{d} focuses on the power of source code analysis by providing transparency, readability, and liquidity to millions of contributions, aiming to help developers reach their full potential and hiring for positions including VP of Marketing.

You only have 2 min to make a great impression

Venture Prose • 0 implied HN points • 29 Jul 16
💼 Business Entrepreneurship Data Analysis Pitching Startups Success
  1. When pitching your startup, focus on delivering simple and bold data that show conversion, retention, and growth within a concise 2-minute pitch.
  2. Ensure your pitch is empathetic, true to yourself, and clear to capture sincere attention and avoid boring your audience.
  3. Craft your startup story by covering who you are, what you do, when you started, why people love your product, your unique value, KPIs, and ambitions, all within a time limit of 2 minutes.

Beer, wine, coffee & tea — what day of the week do they peak?

resonantbrain • 0 implied HN points • 18 Nov 22
🍲 Food & Drink Alcohol Coffee Data Analysis
  1. Beer and wine searches peak on Saturdays, while coffee peaks on Sundays in the United States.
  2. Tea searches do not have a regular peak, likely due to the US not being a big tea-drinking nation.
  3. Different factors like weekends, holidays, and buying behaviors influence the peak days for searches related to beer, wine, coffee, and other terms.

Data at Depth Newsletter 10: Winning Some, Losing Some, GPT 4 Chart Image Analysis

Data at Depth • 0 implied HN points • 04 Apr 24
🕹 Technology Data Analysis Content creation
  1. The author discusses their own creator journey, including a slowdown in Substack subscribers and some boosts on Medium.
  2. The author shares insights on their recent creative activities, such as creating 8 new articles and receiving 3 boosts on Medium.
  3. There is mention of a Python/AI tutorial that the author has been working on.