The hottest Substack posts of Sonal’s Newsletter

And their main takeaways

Building Identity Resolution on Snowflake Using Snowpark

58 implied HN points • 19 Jun 23
🕹 Technology Data processing Machine Learning Software Development Open Source Cloud Computing
  1. Building ML pipelines in Snowpark requires using third-party libraries like scikit-learn for machine learning.
  2. Integrating specialized functionalities like graph processing in Snowpark may require additional support or custom solutions.
  3. Adapting a codebase from Apache Spark to Snowpark requires careful consideration and potential restructuring to maintain efficiency and avoid technical debt.

Performance Tuning Snowpark For Identity Resolution On Snowflake

19 implied HN points • 29 Jul 23
🕹 Technology Data processing Database Management
  1. Performance tuning Snowpark on Snowflake can significantly reduce processing time, from half a day to half an hour.
  2. Utilizing the query profiler by Snowflake and making targeted optimizations can have a high impact on performance.
  3. Optimizations like converting UDTFs to UDFs, caching Dataframes, and using batch size annotations can further optimize Snowpark workflows.

Measure What Matters! Our Simple Data Stack To Understand Open Source Adoption

0 implied HN points • 18 Apr 23
🕹 Technology Data Analytics
  1. Learn how people are discovering your product, such as through direct interactions, website traffic, and testimonials.
  2. Understand how users are using your product, like the platform they run it on, scalability, and frequency of use.
  3. Utilize a simple data stack to track open source adoption and product usage, collecting data manually to understand growth and user behavior.