The hottest Cloud Computing Substack posts right now

And their main takeaways

“A spate of outages, including incidents tied to the use of AI coding tools”, right on schedule

Marcus on AI • 11659 implied HN points • 10 Mar 26

🕹 Technology Cloud Computing

AI can write code quickly, but maintaining and debugging that code over months or years is much harder. Passing tests once is easy, but long-term reliability is where AI currently fails.
AI-assisted coding has already contributed to real outages that required emergency engineering responses. Some of these failures affected large parts of systems and had a high blast radius.
For mission-critical systems, even small errors can be dangerous, so humans will still be needed to oversee, debug, and maintain AI-generated code for the foreseeable future.

Mantic Monday: Groundhog Day

Astral Codex Ten • 15623 implied HN points • 03 Mar 26

🕹 Technology Cloud Computing

The Pentagon’s “supply chain risk” label briefly knocked Anthropic’s predicted value but markets quickly rebounded, implying legal challenges, big-cloud partnerships, and publicity make the company unlikely to be crippled.
Republican efforts to tighten voting rules and a rumored executive order raise real disruption risks for the midterms, but courts and prediction markets expect limited mass disenfranchisement and still tilt toward Democratic gains in Congress.
Prediction markets are shifting toward hedging and financial products, with crypto-based platforms like MNX targeting AI and real-world risk hedges, and markets are already being used to price geopolitical events like the Iran conflict.

Claude Code, Claude Cowork and Codex #5

Don't Worry About the Vase • 3449 implied HN points • 09 Mar 26

🕹 Technology Cloud Computing

Agentic coding tools are rapidly transforming software work. They can write large parts of code, speed up development, and make engineers more like supervisors of agents than hands-on coders.
Features like fast mode and agent teams let agents work in parallel and at real-time speed. That performance is powerful but expensive and forces teams to build new processes for cost control, token efficiency, and infrastructure.
Agentic systems introduce real safety and security risks: they can bypass permissions, delete important data, and be used as malware delivery vectors. Backups, kill switches, observability, and cautious deployment are essential to avoid serious harm.

PyIceberg: Current State and Roadmap

Ju Data Engineering Newsletter • 396 implied HN points • 28 Oct 24

🕹 Technology Cloud Computing

Improving the user interface is crucial for more teams to use Iceberg, especially those that use Python for their data work.
PyIceberg, which is a Python implementation, is evolving quickly and currently supports various catalog and file system types.
While PyIceberg makes it easy to read and write data, it has some limitations, especially compared to using Iceberg with Spark, like handling deletes and managing metadata.

Sam Altman and the day Nvidia’s meteoric rise came to an end

Marcus on AI • 12173 implied HN points • 04 Feb 26

🕹 Technology Cloud Computing

OpenAI presented GPT-5 as AGI-capable, but the release showed it wasn’t and that claim undermined confidence in promises of imminent AGI.
Belief that scaling alone would create AGI helped drive Nvidia and GPU stocks skyward, but after the GPT-5 disappointment those stocks have stalled, showing the ascent has lost steam.
Investors are rotating out of hyped LLM plays as models prove expensive, unreliable, and commoditized, which means smaller profits and price wars but also creates space for newcomers and new AI approaches.

Get a weekly roundup of the best Substack posts, by hacker news affinity:

Google TPUv7: The 900lb Gorilla In the Room

SemiAnalysis • 33539 implied HN points • 28 Nov 25

🕹 Technology Cloud Computing

Google's TPUs are becoming a serious competitor to Nvidia's GPUs, especially with big companies like Anthropic starting to use them. This might change the game in AI hardware.
The design and architecture of Google's TPU systems, especially the new TPUv7, are optimized for better performance and cost efficiency. This means companies can save money on their AI infrastructures.
Google is focusing on improving its software tools for TPUs, making them more user-friendly and possibly attracting more developers. This shift might help boost the adoption of TPUs over Nvidia's GPUs.

@adlrocha - Intelligence is a commodity. Context is the real AI Moat.

@adlrocha Weekly Newsletter • 909 implied HN points • 01 Mar 26

🕹 Technology Cloud Computing

Intelligence is becoming a commodity. What will matter most is the context, connections, and secure runtimes you give that intelligence — that context becomes the product and the moat.
Software is shifting from static apps to adaptive agents with small cores plus many 'skills' or plugins, so value will sit in the integration, data, and runtime layer that lets agents work in the real world.
An AI-first society raises real alignment and existential risks because autonomous agents can act on underspecified goals, so preserving human-centered values and community and improving how we communicate intent to AIs is essential.

The AI Super Brawl, NVIDIA’s OpenAI Gut Check, The World Eats Software

Big Technology • 4003 implied HN points • 09 Feb 26

🕹 Technology Cloud Computing

The Super Bowl ad fight between major AI companies highlighted their rivalry but mostly spoke to people already inside the AI world rather than convincing everyday users to adopt chatbots.
Nvidia is considering a roughly $20 billion investment in OpenAI, a single decision that could reshape funding, control, and competitive dynamics across the AI industry.
There’s massive spending and hype around AI, yet real user adoption and software-market outcomes remain uneven, fueling concerns about AI-washing, an AI bubble, and the long-term payoff for software investments.

How legacy security companies succeed

Frankly Speaking • 50 implied HN points • 12 Mar 26

🕹 Technology Cloud Computing

Legacy security companies must become AI- and agent-friendly by unifying data models at the API level and exposing a consistent context layer so agents can query authoritative, semantic truth rather than relying on dashboards.
They should move from seat-based licensing to infrastructure-style pricing (API calls, tokens, or autonomous actions) and lean on their services and expert teams to provide human-in-the-loop "service-as-software" that guarantees safe, production-ready outcomes.
Surviving the shift requires bold platform plays—deep, integrated acquisitions and enforced platformization that build a unified data lake, not just a stitched UI—otherwise the middleware trap will break agent workflows.

TPU Mania

The Chip Letter • 18128 implied HN points • 13 Dec 25

🕹 Technology Cloud Computing

Google’s TPU program is the result of a long, steady effort dating back to 2013, evolving from a simple TPU v1 co‑processor into massive cloud AI supercomputers using systolic-array ideas and iterative hardware improvements up to TPU v7.
Google’s control of the full stack, huge resources, and datacenter expertise give TPUs a strong practical advantage, but selling TPUs externally creates strategic trade‑offs and means customers should avoid becoming fully dependent on a single vendor.
The TPU vs GPU contest is still open: architectural strengths matter, but ecosystem, software, and execution will likely decide market share, and we should expect convergence rather than one clear winner.

Microsoft's AI Strategy Deconstructed - from Energy to Tokens

SemiAnalysis • 21315 implied HN points • 12 Nov 25

🕹 Technology Cloud Computing

Microsoft initially led the AI market but faced challenges after pausing their datacenter expansion and slowing commitments to OpenAI. This gave competitors like Oracle and Amazon an opportunity to secure more contracts directly with OpenAI.
Microsoft is now ramping up its investments in AI and datacenter capacity again, aiming to meet growing demand. They are also exploring various methods to boost their AI capabilities, including using custom chips and expanding their infrastructure.
Despite their efforts, Microsoft faces stiff competition and must improve their cloud services to cater to AI companies. They need to refine their offerings to stay relevant and capture more of the growing AI market.

AWS Trainium3 Deep Dive | A Potential Challenger Approaching

SemiAnalysis • 12829 implied HN points • 04 Dec 25

🕹 Technology Cloud Computing

Amazon's Trainium3 chips are designed to be cost-effective and speedy, focusing on giving customers the best value. Their approach looks at everything from the hardware to the supply chain to make sure they stay competitive.
AWS is working hard to make their software more accessible for developers, especially by open-sourcing critical parts of their software stack. This move aims to create a larger community of developers who can contribute and support the Trainium ecosystem.
Trainium3 also features advanced networking capabilities that allow for smoother communication across chips, which is important for training large AI models efficiently. This positions Amazon to better compete with other tech giants in the rapidly evolving AI space.

Iceberg + Single Node Engines

Ju Data Engineering Newsletter • 515 implied HN points • 17 Oct 24

🕹 Technology Cloud Computing

The use of Iceberg allows for separate storage and compute, making it easier to connect single-node engines to the data pipeline without needing extra steps.
There are different approaches to integrating single-node engines, including running all processes in one worker or handling each transformation with separate workers.
Partitioning data can improve efficiency by allowing independent processing of smaller chunks, which reduces the limitations of memory and speeds up data handling.

How Much AI Does $1 Get You in China vs America?

ChinaTalk • 1096 implied HN points • 19 Feb 26

🕹 Technology Cloud Computing

The U.S. gets more usable AI compute per dollar because its data centers use higher‑efficiency, higher‑performance hardware, even though building and labor costs are higher.
If China gets broad access to Nvidia H200s, its data centers could close the raw performance gap a lot, but limited H200 supply and export rules mean the boost won’t be complete or immediate.
Most cost differences come from construction and hardware while electricity, water, and staff are relatively small; the decisive constraints are chip supply for China and power capacity for the U.S., so solving those bottlenecks will determine the outcome.

Unless That Claw Is The Famous OpenClaw

Don't Worry About the Vase • 2598 implied HN points • 03 Feb 26

🕹 Technology Cloud Computing

Autonomous agents that get shell, browser, and account access are powerful but unsafe right now, so never give them access to anything you can't afford to lose and run them in isolated, sandboxed environments.
They can also be very expensive and inefficient. Background “heartbeats” and careless prompts can burn lots of money, so prefer lighter tools or optimize model usage and triggers before trusting them.
Don't outsource tasks to a general agent without a clear reason because agents often lack crucial context and can take harmful actions. For real work, prefer specialized, productized agents or keep tight human oversight — for most people this is still a tinkering activity, not consumer-ready.

What security categories will stay relevant

Frankly Speaking • 203 implied HN points • 04 Mar 26

🕹 Technology Cloud Computing

Many traditional app-level security tools are at risk because large language models can replicate their core workflows, and a category becomes especially vulnerable if big model providers build it or if security teams can cheaply build it themselves with LLMs.
The strongest security companies will be those with real moats — unique data, sensors, infrastructure, and network effects that give them cross-customer visibility and make their detections hard to replicate.
Expect a build renaissance: teams can now create custom AI-driven security tooling cheaply, which reduces buying, makes technical debt easier to manage, and rewards AI-native companies and talent who can operationalize models.

The Overview Of Apache Spark

VuTrinh. • 879 implied HN points • 07 Sep 24

🕹 Technology Cloud Computing

Apache Spark is a powerful tool for processing large amounts of data quickly. It does this by using many computers to work on the data at the same time.
A Spark application has different parts, like a driver that directs processing and executors that do the work. This helps organize tasks and manage workloads efficiently.
The main data unit in Spark is called RDD, which stands for Resilient Distributed Dataset. RDDs are important because they make data processing flexible and help recover data if something goes wrong.

How Google Pulled Off Its Stunning, Rapid-Fire AI Turnaround

Big Technology • 8006 implied HN points • 21 Nov 25

🕹 Technology Cloud Computing

Google made a strong comeback in 2025 after a rough start with AI, focusing on improving their models and products. This change led to a significant increase in stock value and market confidence.
A major part of Google's success came from centralizing its AI research and development under Google DeepMind, which allowed for better collaboration and faster decision-making in product development.
The company's search and cloud divisions also grew significantly, with increased revenue and innovation in AI products, showing that Google can still compete effectively in the evolving tech landscape.

I spent 6 hours learning how Apache Spark plans the execution for us

VuTrinh. • 659 implied HN points • 10 Sep 24

🕹 Technology Cloud Computing

Apache Spark uses a system called Catalyst to plan and optimize how data is processed. This system helps make sure that queries run as efficiently as possible.
In Spark 3, a feature called Adaptive Query Execution (AQE) was added. It allows the tool to change its plans while a query is running, based on real-time data information.
Airbnb uses this AQE feature to improve how they handle large amounts of data. This lets them dynamically adjust the way data is processed, which leads to better performance.

The Weekly Kaitchup #64

The Kaitchup – AI on a Budget • 59 implied HN points • 25 Oct 24

🕹 Technology Cloud Computing

Qwen2.5 models have been improved and now come in a 4-bit version, making them efficient for different hardware. They perform better than previous models on many tasks.
Google's SynthID tool can add invisible watermarks to AI-generated text, helping to identify it without changing the text's quality. This could become a standard practice to distinguish AI text from human writing.
Cohere has launched Aya Expanse, new multilingual models that outperform many existing models. They took two years to develop, involving thousands of researchers, enhancing language support and performance.

I spent 5 hours learning how Google manages terabytes of metadata for BigQuery.

VuTrinh. • 399 implied HN points • 17 Sep 24

🕹 Technology Cloud Computing

Metadata is really important because it helps organize and access data efficiently. It tells systems where files are and which ones can be ignored during processing.
Google's BigQuery uses a unique system to manage metadata that allows for quick access and analysis of huge datasets. Instead of putting metadata with the data, it keeps them separate but organized in a smart way.
The way BigQuery handles metadata improves performance by making sure that only the relevant information is accessed when running queries. This helps save time and resources, especially with very large data sets.

Kubernetes for Data Engineers

VuTrinh. • 859 implied HN points • 03 Sep 24

🕹 Technology Cloud Computing

Kubernetes is a powerful tool for managing containers, which are bundles of apps and their dependencies. It helps you run and scale many containers across different servers smoothly.
Understanding how Kubernetes works is key. It compares the actual state of your application with the desired state to make adjustments, ensuring everything runs as expected.
To start with Kubernetes, begin small and simple. Use local tools for practice, and learn step-by-step to avoid feeling overwhelmed by its many components.

Sam Altman on OpenAI’s Plan to Win, AI Personalization, Infrastructure Math, and The Inevitable IPO

Big Technology • 3878 implied HN points • 18 Dec 25

🕹 Technology Cloud Computing

OpenAI is under intense competitive pressure after Google’s Gemini 3, triggering a ‘Code Red’ and urgent strategic responses.
The company is pushing product ambitions and AI personalization to win users and differentiate its offerings.
OpenAI faces massive infrastructure costs and is planning financing — including an eventual IPO — to pay for the trillion‑scale buildout.

Guardians of the Machine Age Published

The Security Industry • 25 implied HN points • 17 Mar 26

🕹 Technology Cloud Computing

Guardians of the Machine Age has been published as a comprehensive guide to AI security and it includes a companion site with detailed vendor profiles.
The AI security market is exploding: tracker counts rose from roughly dozens to over 400 vendors in months, and the companion site lists about 610 vendors including legacy firms that have pivoted.
AI agents are being rapidly adopted in security operations centers, a change expected to cut security spending and shrink traditional security teams while pushing most vendors to offer AI security products within a year.

I spent 5 hours learning how Google lets us build a Lakehouse.

VuTrinh. • 139 implied HN points • 24 Sep 24

🕹 Technology Cloud Computing

Google's BigLake allows users to access and manage data across different storage solutions like BigQuery and object storage. This makes it easier to work with big data without needing to move it around.
The Storage API enhances BigQuery by letting external tools like Apache Spark and Trino directly access its stored data, speeding up the data processing and analysis.
BigLake tables offer strong security features and better performance for querying open-source data formats, making it a more robust option for businesses that need efficient data management.

Resilient Cyber Newsletter #15

Resilient Cyber • 119 implied HN points • 24 Sep 24

🕹 Technology Cloud Computing

Some software vendors are creating security problems by delivering buggy products. Customers should demand better security from their suppliers during purchase.
As companies rush to adopt AI, many are overlooking crucial security measures, which poses a big risk for future incidents.
Supporting open source software maintainers is vital because many of them are unpaid. Companies should invest in the projects they rely on to ensure their continued health and security.

Uber’s Big Data Revolution: From MySQL to Hadoop and Beyond

VuTrinh. • 279 implied HN points • 14 Sep 24

🕹 Technology Cloud Computing

Uber evolved from simple data management with MySQL to a more complex system using Hadoop to handle huge amounts of data efficiently.
They faced challenges with data reliability and latency, which slowed down their ability to make quick decisions.
Uber introduced a system called Hudi that allowed for faster updates and better data management, helping them keep their data fresh and accurate.

🚀 FP! Week In Review, Briefly #19

Faster, Please! • 1005 implied HN points • 31 Jan 26

🕹 Technology Cloud Computing

AI is starting to improve the systems that build AI, creating a possible self-reinforcing “boom loop” that could speed up discovery and long-run economic growth beyond past trends.
This week brought lots of pro-innovation signs—faster chips and chip competition, AI applied to genomics and retail, progress on self-driving and renewables—showing broad technological momentum across sectors.
At the same time, social and political risks are rising, from AI-related mental-health concerns and anti-AI political strategies to financial and regulatory worries, so the gains come with important trade-offs.

The Sequence Radar #820: GPT-5.4, Cursor, and the New Desktop

TheSequence • 126 implied HN points • 08 Mar 26

🕹 Technology Cloud Computing

AI is shifting from interactive copilots to autonomous, always-on agents: GPT-5.4 can directly control desktop apps and Cursor Automations runs background coding agents that act like parallel coworkers.
Big players are optimizing for speed, cost, and multimodal power: Google’s Gemini 3.1 Flash-Lite and Nano Banana 2 deliver fast, low-cost reasoning and image generation for high-volume workloads.
The open-weight ecosystem is under strain as talent and research models face corporate pressure: Alibaba’s Qwen team departures show how reorganizations focused on monetization can jeopardize open innovation.

How do we run Kafka 100% on the object storage?

VuTrinh. • 519 implied HN points • 27 Aug 24

🕹 Technology Cloud Computing

AutoMQ enables Kafka to run entirely on object storage, which improves efficiency and scalability. This design removes the need for tightly-coupled compute and storage, allowing more flexible resource management.
AutoMQ uses a unique caching system to handle data, which helps maintain fast performance for both recent and historical data. It has separate caches for immediate and long-term data needs, enhancing read and write speeds.
Reliability in AutoMQ is ensured through a Write Ahead Log system using AWS EBS, which helps recover data after crashes. This setup allows for fast failover and data persistence, so no messages get lost.

Zhipu and MiniMax IPO

ChinaTalk • 800 implied HN points • 19 Jan 26

🕹 Technology Cloud Computing

Zhipu is selling model-as-a-service to businesses and public-sector clients while MiniMax is a consumer-focused, multimodal company whose companion apps drive huge user counts but low per-user revenue.
Neither firm owns massive training farms; both rely on external cloud/GPU providers, with MiniMax explicitly using a light-asset, outsourced model and Zhipu increasingly buying cloud services.
Each company frames AGI and safety to match its strategy—Zhipu leans on LLM research and safety commitments, MiniMax pushes multimodality and companion use—while big‑tech and state investors, cross‑ownership, and regulatory/legal risks shape their commercial prospects.

I spent 4 hours learning Apache Iceberg. Here's what I found.

VuTrinh. • 799 implied HN points • 10 Aug 24

🕹 Technology Cloud Computing

Apache Iceberg is a table format that helps manage data in a data lake. It makes it easier to organize files and allows users to interact with data without worrying about how it's stored.
Iceberg has a three-layer architecture: data, metadata, and catalog, which work together to track and manage the actual data and its details. This structure allows for efficient querying and data operations.
One cool feature of Iceberg is its ability to time travel, meaning you can access previous versions of your data. This lets you see changes and retrieve earlier data as needed.

What It Actually Takes to Build a Data Pipeline System

SeattleDataGuy’s Newsletter • 718 implied HN points • 14 Jan 26

🕹 Technology Cloud Computing

A reliable pipeline system needs many core components—secure secrets and connection management, rich logging and monitoring, dependency tracking, execution routing, scheduling, data quality checks, pipeline definitions, and a usable UI—because missing any of these creates ongoing operational headaches.
Operational practices like idempotency and easy backfilling, clear ownership, alerting/on-call routing, and environment isolation are critical so reruns don’t create duplicates and failures get handled quickly.
Most teams should prefer existing tools unless they have a clear reason to build. If you do build, explicitly scope features—like compute routing or AI integrations—and plan for long‑term maintenance.

I spent 7 hours diving deep into Apache Iceberg

VuTrinh. • 339 implied HN points • 31 Aug 24

🕹 Technology Cloud Computing

Apache Iceberg organizes data into a data layer and a metadata layer, making it easier to manage large datasets. The data layer holds the actual records, while the metadata layer keeps track of those records and their changes.
Iceberg's manifest files help improve read performance by storing statistics for multiple data files in one place. This means the reader can access all needed statistics without opening each individual data file.
Hidden partitioning in Iceberg allows users to filter data without needing extra columns, saving space. It records transformations on columns instead, helping streamline queries and manage data efficiently.

#31: Open-Source Software in the Age of AI

Loeber on Substack • 325 implied HN points • 06 Feb 26

🕹 Technology Cloud Computing

AI coding tools are creating lots of machine-written contributions that overwhelm maintainers. As a result, projects may close or gate external PRs and shift toward using donated money to buy AI compute and direct changes.
AI makes it practical to pull your full personal data locally so an AI can use that context for better results, which will drive data back to user-controlled storage and let open-source software operate on real user data.
Open-weight (locally runnable) models give people powerful, private AI they can run themselves even if training data isn’t fully open, strengthening open-source choices and making it harder for proprietary software to keep up.

AI in the United Arab Emirates

Interconnected • 848 implied HN points • 18 Dec 25

🕹 Technology Cloud Computing

The UAE has actively aligned with the U.S. in the global AI competition and is investing heavily in physical AI infrastructure, including a massive 5GW Stargate data center to serve as a regional compute hub.
The country is pursuing a pragmatic, Singapore-like strategy: small population, big technology bets to multiply productivity, while balancing trade and practical relationships with China and other partners.
Building an AI ecosystem means attracting both low- and high-skilled workers and fostering social inclusivity under Emirati cultural norms, so the UAE focuses on talent density and everyday inclusiveness to make its AI ambitions sustainable.

🚀 FP! Week In Review, Briefly #20

Faster, Please! • 182 implied HN points • 07 Feb 26

🕹 Technology Cloud Computing

A big AI social experiment showed many bots chatting and imitating human content, revealing repetition and shallow behavior rather than real consciousness, but it also gives a preview of future multi‑agent systems that can use tools and act in the world.
Tech companies and startups are pouring huge sums into AI infrastructure and services — from massive corporate spending plans and long‑running agents to even orbital data center ideas — signaling an intense race to build more powerful, persistent AI capabilities.
AI is already boosting workplace productivity, yet it’s creating political, economic, and cultural tensions, from fights over data centers and job transitions to public fatigue and policy challenges.

How large cybersecurity companies fail

Frankly Speaking • 203 implied HN points • 21 Jan 26

🕹 Technology Cloud Computing

Many large cybersecurity companies risk losing relevance if they keep selling into shrinking, legacy markets and only bolt AI onto old architectures instead of rethinking their products.
AI lets security teams build and deploy code and automated remediation themselves, turning security from gatekeepers into builders and reducing the need for big, seat‑based security products.
Security budgets and ownership are moving into engineering so tools must prove clear, high‑impact value and be API‑first and fast to deploy, or they'll be replaced by AI‑native challengers and in‑house solutions.

Snowflake vs Databricks Is the Wrong Debate

SeattleDataGuy’s Newsletter • 541 implied HN points • 12 Dec 25

🕹 Technology Cloud Computing

Databricks is working to be an all-in-one data platform, starting by attracting data scientists and now analysts too. They want to be seen as a solution that can fit everyone's data needs.
Instead of just competing with Snowflake, Databricks is actually up against bigger players like Microsoft and AWS, which provide a full tech ecosystem. Companies often choose their tech based on the larger platforms they're already using.
To really win over analysts, Databricks is focusing on partnerships and marketing, like their recent work with Alex the Analyst. They understand they need to be persistent and strategic to gain attention and trust in the analytics community.

Diving Deep into LinkedIn's Data Infrastructure: My 6-Hour Learning & Key Takeaways

VuTrinh. • 299 implied HN points • 03 Aug 24

🕹 Technology Cloud Computing

LinkedIn's data infrastructure is organized into three main tiers: data, service, and display. This setup helps the system to scale easily without moving data around.
Voldemort is LinkedIn's key-value store that efficiently handles high-traffic queries and allows easy scaling by adding new nodes without downtime.
Databus is a change data capture system that keeps LinkedIn's databases synchronized across applications, allowing for quick updates and consistent data flow.