The hottest Research Methods Substack posts right now

And their main takeaways
Category
Top Science Topics

Horrors Of The Theoretical Maximum

ASeq Newsletter • 14 implied HN points • 30 Oct 24
🕹 Technology Bioinformatics Data Analysis Genomics Research Methods
  1. Vendors sometimes quote theoretical maximums for data output, which can be misleading. It's important to understand that these numbers might not reflect actual performance.
  2. Comparing different technologies can be complicated because they have different specifications and capabilities. Each technology, like PacBio, Oxford Nanopore, and Illumina, has its unique strengths and limitations.
  3. In the real world, the difference between what is theoretically possible and what is actually achieved can be significant. This means we should be cautious and not rely solely on theoretical figures.

Triangulation in UX Research

UX Psychology • 238 implied HN points • 14 Jun 22
🕹 Technology UX Research Data Analysis Research Methods User Insights Study Design
  1. Triangulation in UX research involves using multiple research methods or data sources to study the same phenomenon, enhancing credibility and providing more robust insights.
  2. There are 4 main types of triangulation recognized in research: data triangulation, investigator triangulation, theory triangulation, and methodological triangulation.
  3. Using triangulation in user research can lead to more confidence in data, reveal unexpected findings, and help to understand a problem more clearly, although it may also increase chances of confirmation bias.

Mixtape Mailbag #8: Continuous Triple Differences

Scott's Substack • 39 implied HN points • 05 Feb 24
🔬 Science Causal Inference Data Analysis Research Methods Econometrics
  1. Triple difference design can be used with continuous treatment by defining the parameters based on dosage levels.
  2. When treatment is continuous, the target parameter shifts from average treatment effect to average causal response function.
  3. Continuous treatments require careful definition of parameters to compare different dosages along a treatment curve.

Exploring Social Loafing in Human-Computer Teams

UX Psychology • 59 implied HN points • 03 Nov 23
🔬 Science Human-computer interaction Psychology Artificial Intelligence Research Methods Technology
  1. Social loafing in human-computer teams can lead to reduced human effort over time, even if participants report consistent effort and engagement.
  2. Humans may rely excessively on dependable robotic or AI teammates, potentially impairing human attentiveness and performance.
  3. Mitigating the effects of social loafing in human-computer teams can involve strategies such as establishing individual accountability, validating robot or AI performance, and designing robots/AI to provide motivation to human teammates.
Get a weekly roundup of the best Substack posts, by hacker news affinity:

Correlation vs Causation Errors are Killing Fat Patients

Weight and Healthcare • 299 implied HN points • 15 Dec 21
🏥 Health & Wellness Research Methods Weight Loss Stigma Body positivity
  1. Correlation does not equal causation. Just because two things happen together doesn't mean one causes the other.
  2. Research on weight and health often overlooks confounding variables like weight stigma, weight cycling, and healthcare inequality.
  3. Assuming higher weight causes health issues has led to harmful practices, like the weight loss industry profiting from perpetuating weight stigma and promoting ineffective solutions.

Building the science factory with LLMs

The Counterfactual • 39 implied HN points • 13 Dec 23
🔬 Science Psychology Research Methods Cognitive Science Automation Peer Review
  1. Large Language Models (LLMs) could make scientific research faster and more efficient. They might help researchers come up with better hypotheses and analyze data more easily.
  2. Breaking down the research process into smaller parts might allow automation in areas like designing experiments and preparing stimuli. This could save time and improve the quality of research.
  3. While automating parts of scientific research can be helpful, it's important to ensure that human involvement remains, as fully automating the process could lead to lower-quality science.

You can't escape construct validity

The Counterfactual • 59 implied HN points • 27 Jun 23
🚌 Education Research Methods Psychology Measurement
  1. Measuring abstract concepts like happiness is really tough. Researchers need to find good ways to define and measure these big ideas accurately.
  2. Construct validity is important for any type of research claim. It checks if what you're measuring actually reflects the concept you're interested in.
  3. Making decisions, like hiring or choosing a restaurant, involves relying on imperfect measures. It's essential to understand the limitations of these measures to make better choices.

Randomization maximalism

inexactscience • 39 implied HN points • 09 Aug 23
🔬 Science Research Methods Data Analysis Decision-making Experimental Design
  1. Relying only on randomized experiments can be limiting. It's important to consider all types of evidence based on their quality.
  2. Not every decision needs a complex A/B test; sometimes simpler data or even gut feelings are enough.
  3. We should weigh the cost of getting reliable data against the value it provides. For some choices, high-quality data is a must, but for others, less rigorous information can do the job.

Welcome to The Weight and Healthcare Newsletter

Weight and Healthcare • 159 implied HN points • 27 Oct 21
🏥 Health & Wellness Healthcare Weight Science Weight Stigma Research Methods Community support
  1. The Weight and Healthcare Newsletter explores weight science, weight stigma, and healthcare, offering valuable information to support individuals dealing with medical weight stigma.
  2. Weight stigma in healthcare causes significant harm, especially to individuals with higher weights and multiple marginalized identities. There is a more helpful and less harmful paradigm available through examining evidence and lived experiences.
  3. Positive changes are possible in healthcare regarding weight-inclusive care and best practices. Education and dialogue can lead to improved understanding and practices among healthcare professionals.

Demand Characteristics in UX Research

UX Psychology • 79 implied HN points • 11 Apr 22
🕹 Technology UX Research User Behavior Research Methods Psychology Ethics
  1. Participants in research studies often change their natural behavior to match what they think the researcher expects.
  2. Demand characteristics, the Hawthorne effect, and social desirability bias are related but have subtle differences in how they impact participant behavior.
  3. To mitigate the impact of demand characteristics in UX research, strategies like using a double-blind approach, being mindful of participant cues, recruiting diverse participants, and employing methodological triangulation can be effective.

Don't Run Coibion-Gorodnichenko Regressions with Micro Data

inexactscience • 39 implied HN points • 27 Mar 23
💰 Finance Economics Data Analysis Statistics Research Methods Forecasting
  1. Running Coibion-Gorodnichenko regressions with individual data can lead to misleading results. It's important to use appropriate data types to avoid confusion in the findings.
  2. Individual forecasts tend to produce negative results compared to positive results in average forecasts. This means that the insights from these regressions can differ significantly based on the data used.
  3. The methodology is sensitive to noise and measurement errors, which can skew results. Researchers need to be cautious and robust in their approach to ensure accurate interpretations.

Data Science Weekly - Issue 464

Data Science Weekly Newsletter • 19 implied HN points • 13 Oct 22
🕹 Technology Data science Artificial Intelligence Machine Learning Software Development Research Methods
  1. Building a community around R in the pharmaceutical industry can help users connect and share knowledge more effectively. It's important to identify who the users are and create a space for collaboration.
  2. Creating research ideas can start with understanding gaps in existing literature. By reading a single paper, you can learn frameworks to generate new ideas and improve your research quality.
  3. Data cleaning for machine learning models is crucial, starting from the ETL pipeline. It’s important to commit to high-quality data from the beginning to avoid common pitfalls that impact model accuracy.

The Intricate Beauty of Pecking Orders

Creating Inequality • 4 HN points • 14 Jun 23
🔬 Science Animal Behavior Social Dynamics Research Methods
  1. Pecking orders in animals might not be based on individual abilities but on dynamic interactions within a group.
  2. Linear pecking orders can arise from intricate behavioral dynamics rather than differences in individual qualities.
  3. Pecking orders are not stable and enduring, but rather constantly changing structures formed by ongoing aggressive interactions within a group.

The National Weight Control Registry's Shaky Science

Weight and Healthcare • 2 HN points • 15 Oct 22
🏥 Health & Wellness Weight Loss Research Methods Interventions Fat Activism
  1. The National Weight Control Registry's definition of weight loss success may not accurately represent the reality of weight loss maintenance.
  2. The NWCR's findings do not conclusively disprove the idea that weight loss attempts fail about 95% of the time.
  3. The NWCR's suggested behaviors for weight loss maintenance lack specificity and may not be effective for the general population.

School Shootings: Better Data, Better Decisions

School Shooting Data Analysis and Reports • 0 implied HN points • 30 Sep 18
🚌 Education Database Research Methods Data Analysis School Shootings
  1. There is a lack of accurate and consolidated statistical data on school shootings in the USA.
  2. The K-12 School Shooting Database was created to address this data gap by including detailed incident information and sources for further research.
  3. The database collects data from various sources, filters incidents, and provides interactive analysis tools for users to generate more accurate reports and make informed decisions.

Not All Zeros Are Equal

Nano Thoughts • 0 implied HN points • 20 Jan 25
🔬 Science Data Analysis Biology Statistics Research Methods
  1. Not all zeros in data mean the same thing. Sometimes, they can indicate something was never there, or other times, they mean something was just missed.
  2. Zero inflation happens when there's lots of data and many readings come back as zero. This can make it hard to understand what's really going on behind those zeros.
  3. There are different methods to deal with zeros in data, like checking if they are real or just unnoticed signals. Choosing the right method is important to get accurate insights.

Roche Nanopore: Instrument Cost

ASeq Newsletter • 0 implied HN points • 27 Feb 25
🔬 Science Biotechnology Genetics Data Analysis Research Methods Instruments
  1. Roche is working on new nanopore sequencing technology, focusing on how much the instruments will cost to produce. Understanding these costs is important for the technology's success.
  2. The nanopore sequencing process involves collecting a large amount of data quickly, which means the data rates are extremely high. This could lead to challenges in storing and processing such vast amounts of information.
  3. Since the raw data volume is so large, it's unlikely that most users will store it all. Instead, they will probably need to focus on analyzing only the most crucial information collected.

When ‘can’t miss’ programs fail

Hypertext • 0 implied HN points • 27 Mar 24
🇺🇸 U.S. Politics Social programs Government funding Innovation Research Methods
  1. Experimentation and evaluation are crucial in discovering effective social solutions; funding should consider reinvestment in programs with null results for improvements.
  2. Interpreting null findings from programs is important; reasons for ineffectiveness could range from program inefficacy to delivery issues or changing environments.
  3. Being cautious in prioritizing 'evidence-based' programs is necessary; it may hinder innovation and obstruct the quest for better solutions.

Biotech Needs Its Hydrogen Atom

Niko McCarty • 0 implied HN points • 25 May 24
🔬 Science Biotechnology Physics Molecular Biology Genomics Research Methods
  1. Biotechnology needs a common foundation, much like how hydrogen is essential to physics. This foundation would help scientists work together more effectively and share their findings.
  2. If scientists could collaborate and understand life better, they could design solutions for diseases and other challenges. This could lead to a future where we have more control over creating living organisms for our needs.
  3. Focusing on studying a simple organism like Mycoplasma genitalium could be key to building this foundation. By deeply understanding it, we could create models that help us predict how other cells function.