The hottest Data Formats Substack posts right now

And their main takeaways
Category
Top Technology Topics

Data's final format

Data People Etc. • 391 implied HN points • 09 Dec 24
🕹 Technology Data Management Cloud Computing Data Formats Software Development Tech Innovation
  1. Apache Iceberg™ is a popular way to manage data, offering features like scalability and openness. However, using it can feel complicated and less exciting than expected.
  2. CSV format is an easy and humble way to manage data, requiring no special knowledge or complex setups. It’s simple and widely understood, making it a go-to choice for many.
  3. The transformation of data management, like Iceberg™, is like building a transcontinental railroad. It's a huge effort aimed at improving the way we process and use information in the modern world.

Automating API Discovery with RFC 9727

The API Changelog • 6 implied HN points • 20 Jun 25
🕹 Technology APIs Software Development Data Formats Automation
  1. RFC 9727 introduces a way to easily find and use APIs through a programmatic catalog. This means both humans and machines can discover APIs more efficiently.
  2. It uses predefined paths and techniques like 'well-known' URIs to help consumers locate an api-catalog. This makes it simpler for anyone looking to advertise their APIs.
  3. The api-catalog document can have different formats, but it must include a list of links to APIs. However, having a consistent format could help consumers understand and discover the APIs better.

GroupBy #10: Netflix's Psyberg, Parquet format, SQL is not Designed for Analytics

VuTrinh. • 0 implied HN points • 21 Nov 23
🕹 Technology Data Engineering Distributed Systems Data Formats
  1. Netflix's Psyberg is a new way for processing data that helps manage membership information better. It uses innovative methods to make data processing more efficient.
  2. The Parquet format is great for storing data because it organizes information in a smart way. It can improve how quickly and easily data is accessed and processed.
  3. SQL isn't the best tool for doing analytics because it was designed a long time ago. There are newer tools that fit analytics needs much better.
Get a weekly roundup of the best Substack posts, by hacker news affinity: