The hottest Experimentation Substack posts right now

And their main takeaways
Category
Top Business Topics
Both Are True 49 implied HN points 18 Feb 25
  1. Writing for an audience can improve your ideas and make them more engaging. It helps you see your thoughts in a different light.
  2. Keeping a log of your thoughts can be a great way to capture ideas that may turn into bigger projects later on.
  3. Sharing your ideas in a way that others can interact with can lead to interesting discussions and feedback.
Granted 10781 implied HN points 25 Aug 23
  1. The current system for selecting public officials is flawed and often attracts self-serving candidates.
  2. Radical proposals like selecting leaders by lottery can spark important conversations about improving our electoral system.
  3. Experimenting with alternative methods of choosing leaders is necessary to attract and elect better officials.
Software Design: Tidy First? 375 implied HN points 17 Dec 24
  1. Exploring new ideas is important, but they should be tested carefully to see if they work.
  2. Sometimes, even if an idea works, it might have negative side effects that aren't worth it.
  3. The best experiments are those that try new things without risking too much; it's all about learning and improving.
Asimov Press 367 implied HN points 17 Nov 24
  1. In the late 19th century, Lord Rayleigh measured the size of a single molecule using simple materials like oil and water. This clever experiment showed how basic observations can lead to important scientific discoveries.
  2. Benjamin Franklin also made significant observations about oil on water in the 18th century, but he didn't calculate the size of molecules. His work laid the groundwork for future scientists like Rayleigh.
  3. Rayleigh's experiment demonstrated that you don’t always need complex tools to make groundbreaking discoveries. Even simple experiments can provide valuable insights that inspire later research.
Software Design: Tidy First? 1634 implied HN points 12 Mar 24
  1. In software design, there are ordinary phases (small changes) and revolutionary phases (fundamental changes) - understanding when each is needed is important.
  2. Revolutionary design violates the open/closed principle by requiring new elements and relationships that don't fit with the existing design.
  3. Revolutionary changes in design require different values and care compared to ordinary design - they are essential for accommodating new types of features.
Get a weekly roundup of the best Substack posts, by hacker news affinity:
Fields & Energy 359 implied HN points 12 Mar 24
  1. Michael Faraday discovered that moving magnets can create electricity, a process called induction. This was a major breakthrough in understanding how electricity and magnetism work together.
  2. Faraday also introduced the idea of 'lines of force' to visualize magnetic fields. This concept helps us understand the direction and strength of magnetic effects.
  3. He believed scientific discoveries should come from direct observations of nature, not just complicated math. Faraday's practical experiments made him one of the great experimental physicists.
Fields & Energy 239 implied HN points 06 Mar 24
  1. Hans Christian Örsted proved that electricity and magnetism are connected by running a current near a compass, making them part of the same field called electromagnetism.
  2. André-Marie Ampère built on Örsted's work, showing that moving electric currents can attract or repel each other just like magnets do.
  3. Many scientists assumed forces acted at a distance, but Michael Faraday later suggested that closer particles must interact to create these forces.
Erika’s Newsletter 550 implied HN points 15 Feb 23
  1. The author conducted an experiment on releasing updates publicly to provide insight into her research process.
  2. The experiment showcased how traditional scientific publishing differs from immediate updates in terms of production, readability, and narrative.
  3. The project involved expanding the genetic code to include more chemically diverse amino acids, holding potential for engineering better proteins.
Milk Trekker 176 implied HN points 10 Jan 24
  1. Experimenting with plant rennets in cheesemaking can yield unique flavors and textures, but may require different techniques than traditional animal rennet.
  2. Using local medicinal plants for cheese production can be intriguing, but caution should be exercised due to potential toxic compounds.
  3. Working with plant rennets can be a delicate process, requiring specific ranges of temperature, acidity, and milk type.
Asimov Press 270 implied HN points 20 Feb 24
  1. The concept of viewing time differently through the lens of the Minute Man and the Millennium Man prompts questions about our understanding of speed and time in the world.
  2. Biological processes at the cellular level can occur at astonishing speeds, with enzymes performing millions of chemical reactions per second and protein 'motors' spinning thousands of times a minute.
  3. Scientists use innovative experiments to directly observe rapid biological processes, such as watching ATP synthase spin or tracking ribosomes moving along messenger RNA strands, to gain a deeper understanding of the intricate workings of life.
Data Analysis Journal 235 implied HN points 28 Jun 23
  1. Embracing accelerated testing in the modern data analysis landscape is essential for success.
  2. The current traditional academic workflow for A/B testing may not be suitable for the evolving landscape of experimentation.
  3. To thrive in the era of rapid feature flagging and A/B testing, teams need to adapt by automating statistical checks, simplifying documentation, and eliminating bias.
Remote View 196 implied HN points 29 Mar 23
  1. Joe Parr conducted experiments with pyramids and radioactive sources, noting cyclical variations in radioactive counts possibly linked to moon phases and solar activity.
  2. Parr's hypothesis of a 'hyperspace bubble' forming around the pyramid passing through magnetic fields is based on anomalous events in the data.
  3. The test setups involved rotating pyramids between magnetic fields, with a sophisticated setup to measure radioactive counts and variations.
followfox.ai’s Newsletter 157 implied HN points 13 Mar 23
  1. Estimate the minimum and maximum learning rate values by observing when the loss decreases and increases during training.
  2. Choosing learning rates within the estimated range can optimize model training.
  3. Validating learning rate ranges and fine-tuning with different datasets can improve model flexibility and accuracy.
Gradient Flow 259 implied HN points 26 Jan 23
  1. The need for tools to help developers pick models that fit their needs and understand model limitations as general-purpose models are widely used.
  2. Data science teams are tackling automation and early examples targets aspects of projects like modeling and coding assistance, but further advancements are needed.
  3. There's a shortage of research and tools for experimentation and optimization in data science, creating opportunities for entrepreneurs to deliver innovative solutions.
Sarah's Newsletter 99 implied HN points 19 Sep 23
  1. Decide which product feature should be behind a test, read the results of an A/B test, prioritize features based on data
  2. Understand that frontend tests focus on user experience and user groups in the browser, while backend tests require business logic and user assignment in the database
  3. Choose frontend user group assignment for speed and simplicity via firing analytics events; go for backend assignment for more complete data by storing user assignment in a database model
The Leadership Lab 78 implied HN points 24 Sep 23
  1. Belief in things happening without direct involvement can be beneficial for Type A personalities, promoting trust and allowing for more enjoyable journeys.
  2. High performers often have an unwavering belief in achieving their goals, which boosts resilience and positivity in difficult times.
  3. Balancing fundamental knowledge with experimentation is key for optimal learning, as relying solely on hacks or fundamentals can lead to stagnation.
Kyle Poyar’s Growth Unhinged 283 implied HN points 17 May 23
  1. Product-led marketing involves aligning the product, marketing, and customer success for growth.
  2. Focus on user intent and eliminate unnecessary distractions in marketing efforts.
  3. Layer in the right messaging, experiment, triage, choose your battles wisely, and stay focused to reach milestones like 400,000 users.
CAUSL Effect 119 implied HN points 12 Apr 23
  1. The Region-Beta Paradox shows that people often tolerate mild discomfort until they reach a more intense state, which can lead to faster recovery. In simple terms, we might ignore small problems until they become serious.
  2. This idea can change how product teams think about improving customer experiences. Instead of aiming for perfect satisfaction, it might be okay to allow for some mild frustration, as it can be a signal for customers to take action.
  3. Not all products need to be perfect to be successful. Sometimes, a product that fits well in the market is more important than one that delivers an ideal experience but lacks user interest.
10x your mind 19 implied HN points 07 Mar 24
  1. Optionality is about having backup plans for complex problems, not just deciding between simple choices like ice cream flavors.
  2. Smart options should be non-obligatory and allow for decisions after outcomes, helping increase luck in various aspects of life.
  3. Practice optionality for potentially unlimited gains with limited losses by exploring new opportunities and treating each option as an experiment.
Simplicity is SOTA 122 HN points 10 Apr 23
  1. The standard use of p < 0.05 as a threshold in experiment analysis may not be as useful as commonly believed.
  2. The choice of p < 0.05 as a significance level in experiments is a default that was set nearly a century ago.
  3. In the tech industry, where the goal is to find real product improvements, the risk of false negatives should also be carefully considered, not just false positives.
Sunday Letters 19 implied HN points 20 Aug 23
  1. People often trust the old experts too much, which can block new ideas. It's important to stay open to new possibilities, even if they seem strange.
  2. In science, we tend to only celebrate successful discoveries, while failed experiments often get ignored. Both successes and failures are essential for learning.
  3. Being open minded and willing to be wrong is key to making groundbreaking discoveries. Sometimes, you have to fail many times before you find something that works.
Jakob Nielsen on UX 15 implied HN points 13 Mar 24
  1. In A/B testing, the average uplift from design changes is small, about 0.15%, with 54% of cases showing improvements of 0.5%.
  2. Only 19% of experiments result in statistically significant gains, with an average lift of 1.0% across those cases.
  3. As companies mature in UX, gains from design experimentation may decrease over time due to the nature of tested designs and the diminishing low-hanging fruit.
Eclecticism: Reflections on literature, writing and life 5 implied HN points 18 Feb 24
  1. Experimenting with reworking text into different styles can be a fun and creative writing exercise.
  2. Tools like reversing the order of letters in words can lead to unique and interesting word combinations for storytelling.
  3. Exploring experimental writing styles can spark new ideas and provide fresh perspectives for writers.