Pedram's Data Based

Data Based dives deep on the latest in data so you don't have to. It's data content written for data practitioners and those who have the pleasure of working with them.

The hottest Substack posts of Pedram's Data Based

And their main takeaways

The Future of Data

38 implied HN points • 21 May 23

🕹 Technology Data Management Semantic Layers

Ops teams are starting to learn from data teams
A single semantic layer for all tools may not be achievable
The biggest challenge for data teams is managing and understanding business logic

dbt Reimagined

33 implied HN points • 09 Mar 23

🕹 Technology Programming Tools Debugging Testing Innovation

Utilizing Domain-Specific Languages can enhance data modeling with features like type safety and validation.
Implementing debuggers in SQL modeling can help understand the system's state and improve troubleshooting.
Enabling unit testing in dbt with alternative adapters could simplify validation of logic.

Doing Data The Hard Way

14 implied HN points • 04 Apr 23

🕹 Technology Data Vendors Cloud Computing Development

The tech industry is experiencing pushback against the complexity of recent years.
The gap between the cost of data solutions and their value is increasing, leading to a re-examination of needs.
Exploring old ways of solving data problems before the abundance of vendors can provide valuable insights for building more robust systems.

The Trouble with Growth

15 implied HN points • 23 Feb 23

🕹 Technology Product Development Data Analysis Statistics Entrepreneurship Innovation

New features and additions may lead to a decline in user experience over time.
Product growth often slows down due to natural limitations.
Constant innovation and preparation for the future are crucial for sustained success in business.

Doing Data The Hard Way Part 1: Extracting Data

11 implied HN points • 02 May 23

🕹 Technology Data Extraction Data Storage

Extracting data from systems involves querying and saving the data.
Consider incremental data load options like Change Data Capture or using updated_at columns.
Choosing between saving data in text (like CSV) or binary (like Parquet) format has implications on efficiency and data structure.

Get a weekly roundup of the best Substack posts, by hacker news affinity: