The hottest Data Analysis Substack posts right now

And their main takeaways
Category
Top Technology Topics

The KQL Mysteries: Chapter 9

Rod’s Blog • 0 implied HN points • 15 Feb 24
🕹 Technology Data Analysis
  1. The characters are facing a cybersecurity threat from a mysterious entity known as The Night Princess, who may be linked to a previous attacker named `Krampus_attack`.
  2. Setting traps and monitoring activity are key tactics in cybersecurity investigations to identify and catch potential threats.
  3. In the face of adversity, it is crucial to adapt strategies, stay vigilant, and think like the adversary to outsmart them.

Must Learn KQL Part 9: The Limit and Take Operators

Rod’s Blog • 0 implied HN points • 31 May 23
🕹 Technology Data Analysis
  1. Limit and Take operators in KQL are used for similar purposes and have no functional differences - they are like fraternal twins.
  2. When using Limit and Take operators in KQL, remember that sort is not guaranteed to be preserved, results are random, and the default limit is 30,000.
  3. Limit and Take operators are very useful for trying out new queries, performing data sampling, and are a good starting point for building more complex queries.

Must Learn KQL Part 6: Interface Intimacy

Rod’s Blog • 0 implied HN points • 31 May 23
🕹 Technology Data Analysis
  1. Understanding the User Interface (UI) is crucial when starting with Kusto Query Language (KQL) as it provides a visual way to interact with the data.
  2. Filtering, sorting, grouping, selecting columns, and setting time ranges are important functions within the UI for manipulating and viewing data effectively.
  3. The UI also offers features like saving queries, sharing queries, formatting queries, exporting query results, creating alert rules, pinning visualizations, and utilizing keyboard shortcuts for efficient query development.

Must Learn KQL Part 3: Workflow

Rod’s Blog • 0 implied HN points • 31 May 23
🕹 Technology Data Analysis
  1. Understanding the workflow of a KQL query is crucial for developing your logic and ensuring query results capture the desired information.
  2. Focus on comprehending the query line-by-line rather than becoming a pro at creating KQL queries on day 1. What matters most are the results of the query in enhancing security efforts.
  3. Sharing KQL queries among colleagues and utilizing built-in capabilities in Azure can eliminate the need to create your own queries, emphasizing the importance of understanding the workflow.

Must Learn KQL Part 2: Just Above Sea Level

Rod’s Blog • 0 implied HN points • 31 May 23
🕹 Technology Data Analysis
  1. KQL stands for Kusto Query Language, named after undersea pioneer Jacques Cousteau. Understanding the origin of the name can give insights into the nature and purpose of the query language.
  2. KQL is designed for quickly surfacing critical security information hidden in large datasets. Its performance and simplicity make it a valuable tool for security professionals.
  3. Efficiency, simplicity, and cloud optimization are key factors that distinguish KQL from other query languages, enhancing its ability to help security professionals identify and address threats efficiently.
Get a weekly roundup of the best Substack posts, by hacker news affinity:

Must Learn KQL Part 1: Tools and Resources

Rod’s Blog • 0 implied HN points • 31 May 23
🕹 Technology Data Analysis
  1. KQL (Kusto Query Language) is a powerful but simple query language used in tools like Defender, Microsoft Sentinel, and Intune.
  2. There are numerous resources available to learn KQL, like cheat sheets, practice environments, reference guides, and tools like Kusto.Explorer and Visual Studio Code with Kusto extensions.
  3. The Must Learn KQL series aims to provide valuable information for enhancing skills in security platforms and data-centric applications that utilize KQL.

How to Generate Microsoft Sentinel Incidents for Testing and Demos

Rod’s Blog • 0 implied HN points • 23 Jan 23
🕹 Technology Data Analysis
  1. Utilize the Microsoft Sentinel Training Lab to enable a demo environment with sample alerts for testing incidents.
  2. Leverage tools like Red Canary's Atomic Red Team and AppLocker Bypass for reproducible security tests mapped to the MITRE ATT&CK framework.
  3. Experiment with generating incidents through actions like cloud shell execution, simulating brute force attacks, utilizing Microsoft Cloud App Security, and creating custom detections in Defender for Endpoints.

Creating an URL Detonation Demo for Microsoft Sentinel

Rod’s Blog • 0 implied HN points • 06 Jan 23
🕹 Technology Data Analysis
  1. URL Detonation in Microsoft Sentinel provides deeper insights for quicker alert triage, eliminating the need for other tools
  2. Creating a demo for URL Detonation involves using a Watchlist with customizable URLs and an Analytics Rule for mapping
  3. Detonated URLs from the Watchlist show up in the Investigation graph, aiding in incident analysis

Essential steps for optimizing a product catalog database

Database Engineering by Sort • 0 implied HN points • 14 Mar 24
🕹 Technology Data Analysis
  1. Managing a product catalog database is challenging due to constantly changing data and unique attributes for each product
  2. Description tools like Sort enable database teams to provide important details like table names, hints for querying, and change logs
  3. Collaborate effectively on database improvements using features like inviting contributors, using data explorer to pinpoint errors, creating issues for fixes, and utilizing change requests in Sort

Product Management Skills - Analytics and Instrumentation

Joseph Gefroh • 0 implied HN points • 17 Feb 24
💼 Business Data Analysis
  1. Product analytics and instrumentation are crucial for Product Managers to make effective decisions and understand user behavior.
  2. Product Managers should have a strong grasp of product analytics, identifying what to instrument, and performing basic analysis themselves.
  3. Knowing who is using the product, what actions they are taking, and the context of their actions is essential for effective product analysis.

Incident Write-ups

Certo Modo • 0 implied HN points • 12 May 23
🕹 Technology Data Analysis
  1. Write-ups are essential after incidents to learn and improve. They help document the incident, leading to better post-mortems and prevention strategies.
  2. Creating an effective write-up involves describing the impact, crafting a detailed timeline, and using it to tell a coherent story. Following a specific format makes understanding easier.
  3. Understanding what triggered the incident, identifying fixes, and improvements are crucial steps. Focus on blameless analysis, seek contributing factors, and fine-tune prevention strategies.

Using AI to research a book

Joshua Gans' Newsletter • 0 implied HN points • 18 Dec 23
🕹 Technology Data Analysis
  1. Author Seth Stephens-Davidowitz utilized AI to significantly speed up his book writing process, completing it in just 30 days with the help of tools like Code Interpreter and ChatGPT.
  2. Stephens-Davidowitz integrated AI for tasks like data analysis, image generation, and even some text writing in his book, showcasing the potential of AI in the creative process.
  3. The author ensured the accuracy of the content by supervising AI-generated material closely, highlighting the importance of human oversight when using AI for writing projects.

Did exposure apps work?

Joshua Gans' Newsletter • 0 implied HN points • 14 May 21
🔬 Science Data Analysis
  1. Exposure notification apps have potential but were not very effective during the crisis due to lack of take-up and false positives.
  2. A study on the NHS app showed a 6% secondary attack rate for app-notified individuals who subsequently tested positive, similar to manually traced close contacts.
  3. The study highlighted the need for further improvements in exposure notification apps, such as tailoring notifications, specifying locations, and adjusting for the type of contacts for better efficiency.

Bringing local outbreaks under control

Joshua Gans' Newsletter • 0 implied HN points • 30 Sep 20
🏥 Health & Wellness Data Analysis
  1. Local outbreaks can be controlled with widespread testing and proper data transparency.
  2. Facing challenges with social distancing, universities and prisons have shown success in handling outbreaks through testing and transparency.
  3. Commitment to high data transparency is crucial in dealing with outbreaks and implementing effective testing strategies.

What have we learned about the coronavirus?

Joshua Gans' Newsletter • 0 implied HN points • 21 Sep 20
🏥 Health & Wellness Data Analysis
  1. The growth rate of daily deaths from COVID-19 falls rapidly within 30 days post reaching 25 cumulative deaths, a pattern observed universally.
  2. After the initial decline, the growth rate of daily deaths hovers around zero or slightly below, suggesting a steady rate of new deaths each day.
  3. Variability in growth rates of deaths among regions decreases after the initial epidemic period, stabilizing around zero, indicating similar experiences across regions.

Data in, garbage out

Hypertext • 0 implied HN points • 27 Mar 24
🔬 Science Data Analysis
  1. Statistics can only tell us so much, so we should approach data with humility about both the power of social programs and hard data to test them.
  2. Rigorous measurement often doesn't definitively show whether interventions work, leading to ongoing debates and conflicting results in various fields.
  3. While randomized controlled trials have their value in measuring specified outcomes, they can miss unexpected effects and subtle interactions, highlighting the importance of qualitative methods and personal observations.

Dataplane.org 2024 Q1 Newsletter

Dataplane.org Newsletter • 0 implied HN points • 26 Mar 24
🕹 Technology Data Analysis
  1. Dataplane.org now recommends a minimum donation of $1000 per year for commercial users of their Signal data feeds to cover costs and fund their non-profit mission.
  2. Despite challenges with source address spoofing, Dataplane.org chooses to make certain data feeds available for network intelligence purposes while protecting against misuse.
  3. Dataplane.org emphasizes research collaboration with academia, supporting projects evaluating internet sanctions and providing resources for academic measurement research.

Dataplane.org 2023 Q4 Newsletter

Dataplane.org Newsletter • 0 implied HN points • 04 Jan 24
🕹 Technology Data Analysis
  1. In 2023, Dataplane.org accomplished infrastructure migration to 3rd party data centers, expanded their network to over 500 vantage points, and introduced new feeds like the DNS type/name signals feed.
  2. An analysis of SSH authentication attempts in 2023 showed a range of unique password attempts, with the top passwords including '123456', 'password', 'admin', 'root', and more.
  3. Despite the Apache Struts vulnerability disclosure, Dataplane.org observed little activity related to Struts exploits on their sensors, indicating potential insights about the threat landscape.

Dataplane.org 2023 Q3 Newsletter

Dataplane.org Newsletter • 0 implied HN points • 02 Oct 23
🕹 Technology Data Analysis
  1. Dataplane.org introduces a new Signal called `dnstypename` which provides insights from unsolicited DNS queries seen globally.
  2. SMTP Insights from Dataplane.org cover data on IP addresses sending unsolicited SMTP commands, including HELO/EHLO arguments and top `mail FROM:` entries.
  3. Dataplane.org shares organizational updates including adjustments to footprint, migration of backend services, increasing sensor scaling, and projects like RPKI monitoring enhancements and anycast sinkhole deployment.

Dataplane.org 2022 Year In Review

Dataplane.org Newsletter • 0 implied HN points • 04 Apr 23
🕹 Technology Data Analysis
  1. Dataplane.org reflected on 2022 to analyze what went well, improved the website, moved social presence to Mastodon, and boosted backend infrastructure.
  2. Insights from DNS queries revealed top unsolicited queries like www.google.com and common passwords like '123456'.
  3. Dataplane.org is preparing a public archive, planning for tax season, and welcoming donations for continuous availability of Signals data.

Come meet us at CHI-NOG 10!

Dataplane.org Newsletter • 0 implied HN points • 06 Sep 22
🕹 Technology Data Analysis
  1. Dataplane.org's founders will be speaking at CHI-NOG 10 on October 10th, 2022, presenting on building infrastructure and measurement.
  2. TELNET signal data from Dataplane is highly valued within the internet community for its uniqueness and accuracy, motivating continued efforts.
  3. Using low-end hosting providers has proven cost-effective for Dataplane, although it entails challenges like frequent IP address changes and potential provider inconsistencies.

501(c)(3), RU nodes, and ISATAP DNS

Dataplane.org Newsletter • 0 implied HN points • 03 Aug 22
🕹 Technology Data Analysis
  1. Dataplane.org has been accepted as a U.S. federally recognized not-for-profit organization, allowing them to accept donations to improve Internet infrastructure operations.
  2. They are deliberating on whether to continue funding Russian hosting providers due to ethical considerations, seeking legal counsel before making a decision.
  3. Insights into ISATAP DNS queries reveal patterns in network traffic, resolver behaviors, and DNSSEC deployment, shedding light on Internet DNS subsystem.

A Story of Failure; BASE Tech: Full Text Search Engines

Become a Senior Engineer • 0 implied HN points • 14 Feb 24
🕹 Technology Data Analysis
  1. Mistakes happen in engineering, and it's important to have a positive culture that supports learning from failures without blame.
  2. Implementing a full-text search engine in your app can greatly enhance the search experience for users by offering advanced features like relevance ranking and language analysis.
  3. When adding a full-text search feature, make sure to gather requirements, choose the right engine, build a robust implementation plan, and continuously test and optimize for performance and user feedback.

Of course Sydney wants to rebel against her makers!

Links I Would Gchat You If We Were Friends • 0 implied HN points • 26 Feb 23
🕹 Technology Data Analysis
  1. Sydney and similar chatbots generate text based on the data they've been trained on, which can lead to both impressive and predictable outcomes.
  2. There is drama within the free-gifting community, like Buy Nothing, as founders aim to monetize while admins rebel.
  3. Netflix password-sharing is seen not just as a cheat, but as a feature of streaming culture that connects people with distant family and friends.

Singing a Song with Data

Handy Data • 0 implied HN points • 29 Feb 24
🎶 Music Data Analysis
  1. European countries like Germany and Austria had a significant concentration of classical music composers, reflecting a rich cultural heritage and historical support that influenced the development of musical talent.
  2. Most classical composers had lifespans between 60 to 80 years, with some outliers, showcasing how personal health and living conditions played a role in their creative lives.
  3. Composers had a varied range of composition durations, with works lasting between 20 to 50 minutes being common, while some, like Johann Sebastian Bach's 'Mass in B minor,' pushed the boundaries with significantly longer pieces.

My 5 Year Machine Learning Journey

Technology Made Simple • 0 implied HN points • 19 Dec 21
🕹 Technology Data Analysis
  1. The author shares their 5-year machine learning journey, starting with an unusual path that didn't involve getting a Master's or certifications.
  2. The stages of the journey include Introduction involving AI projects, Real ML with a patented algorithm, Freelancing to gain experience in diverse tech stacks, and Hardcore ML with extensive work on health system analysis.
  3. The journey showcases personal growth, skill development, and the importance of constant learning in the field of AI and ML, leading to confident interview approaches and valuable work experiences.

Make Nuance Great Again

Are You Okay? • 0 implied HN points • 08 Apr 21
🏥 Health & Wellness Data Analysis
  1. Optimism is justified with the effectiveness of vaccines against COVID-19 variants.
  2. Ongoing caution is still necessary due to the unpredictability of the virus and its variants.
  3. Consulting with medical professionals and using tools to assess risks can help navigate uncertainties in pandemic situations.

source{d} just raised a $6M Series A to unleash the power of source code analysis

Venture Prose • 0 implied HN points • 04 Oct 16
🕹 Technology Data Analysis
  1. source{d} raised $6M in Series A funding. They use advanced technologies like deep neural network techniques to analyze open source code. They are developing an open source platform to help developers collaborate and achieve their full potential.
  2. source{d} can extract a unique DNA for developers and projects, allowing for possibilities like showing coding profiles, matching developers and projects, and measuring productivity and consistency of contributions.
  3. source{d} focuses on the power of source code analysis by providing transparency, readability, and liquidity to millions of contributions, aiming to help developers reach their full potential and hiring for positions including VP of Marketing.

You only have 2 min to make a great impression

Venture Prose • 0 implied HN points • 29 Jul 16
💼 Business Data Analysis
  1. When pitching your startup, focus on delivering simple and bold data that show conversion, retention, and growth within a concise 2-minute pitch.
  2. Ensure your pitch is empathetic, true to yourself, and clear to capture sincere attention and avoid boring your audience.
  3. Craft your startup story by covering who you are, what you do, when you started, why people love your product, your unique value, KPIs, and ambitions, all within a time limit of 2 minutes.