The hottest Data Substack posts right now

And their main takeaways

1984, but with LLM’s

Marcus on AI • 11264 implied HN points • 21 Jun 25

🕹 Technology AI Data Ethics Surveillance Media

Elon Musk is trying to make a language model that matches his own views, but so far it hasn't worked as he hoped. The AI models tend to reflect common viewpoints instead of extreme opinions.
Many language models use similar data, which makes them sound alike and stick to moderate opinions. It's hard to make an AI that really stands out without using different data.
Musk's plan to rewrite information to fit his beliefs is concerning. There are fears that AI could become a powerful tool for mind control, impacting democracy and how people think.

What I've been reading (#1)

Democratizing Automation • 411 implied HN points • 21 Jun 25

🕹 Technology AI Computing Data Machine Learning Innovation

Links are important and will now have their own dedicated space. This way, they can be shared and discussed more easily.
AI is being used more than many realize, and there's promising growth in its revenue. The future looks positive for those already in the industry.
It's crucial to stay informed about advancements in AI, especially regarding human-AI relationships and the challenges that come with making AI more capable.

Spreadsheet, Not Skynet: Microdoses, Not Microprocessors

Brad DeLong's Grasping Reality • 130 implied HN points • 24 Jun 25

🕹 Technology AI Economy Data Innovation Impact

AI tools like GPT are not as powerful as some say; they're more like useful spreadsheets than super intelligent machines. This means their impact on the economy is real but not world-changing.
The benefits of AI on human welfare will be positive but limited. It's important to use AI wisely and not let it distract us.
AI models are great for processing language, but they aren't complex enough to be truly revolutionary. They function similarly to simple input-output machines rather than groundbreaking technologies.

AI #103: Show Me the Money

Don't Worry About the Vase • 2374 implied HN points • 13 Feb 25

🕹 Technology AI Software Data Innovation Automation Regulation

The Paris AI Anti-Safety Summit failed to build on previous successes, leading to increased concerns about nationalism and lack of clear plans for AI safety. It's making people worried and hopeless.
Elon Musk's huge bid for OpenAI's assets complicates the situation, especially as another bid threatens to overshadow the original efforts to secure AI's future.
OpenAI is quickly releasing new versions of their models, which brings excitement but also skepticism about their true capabilities and risks.

How reliable is your node?

Kerman Kohli • 99 implied HN points • 29 Oct 24

🔮 Crypto Blockchain Performance Data Infrastructure

RPC calls to blockchain nodes only succeed about 78.5% of the time on average. This means that sometimes you might have trouble getting the data you need.
The performance of nodes varies depending on the blockchain you’re accessing, the RPC provider you choose, and even the time of day you make your requests.
To ensure better reliability, it’s smart to use multiple node providers rather than depending on just one. This way, if one fails, you have a backup.

Get a weekly roundup of the best Substack posts, by hacker news affinity:

While the West Hesitates China Marches Forward

The Algorithmic Bridge • 637 implied HN points • 21 Feb 25

🕹 Technology AI Innovation Government Data Globalization

China is rapidly adopting AI technology, using systems like DeepSeek across government operations to improve efficiency and decision-making. This shows their proactive approach to embracing innovation.
DeepSeek has emerged as a competitive AI model that rivals established Western technologies, highlighting China's growing capabilities in the tech sector. China is focused on getting results, not just discussing ideas.
The cultural mindset in China emphasizes efficiency and action, contrasting with the West's tendency to debate and regulate rather than implement. This difference in attitude could impact global technological leadership.

Building a "Vertical Agent"

The Security Industry • 13 implied HN points • 24 Feb 25

🕹 Technology AI Software Security SaaS Data

Vertical agents are a new trend gaining interest for their potential impact in various fields. They utilize specialized AI to cater to specific industries or tasks.
AI tools like HarvestIQ.ai can assist organizations in managing their security tools and processes. They can streamline research and decision-making by providing quick insights and analysis.
The future may see AI agents that fully understand an organization's needs. These agents could help businesses choose the right tools and maintain compliance more effectively.

FBI's Stealth Revisions: The 2022 Crime Numbers They Don't Want You to Notice

COVID Reason • 832 implied HN points • 16 Oct 24

🇺🇸 U.S. Politics Crime Data Government Policy Transparency

The FBI initially reported a drop in violent crime for 2022, but later revised the numbers to show a significant increase, changing the narrative without much public notice.
Revisions included thousands more cases of serious crimes, raising questions about the accuracy and transparency of the FBI's data.
Many crimes go unreported, leading to incomplete data and a lack of trust in official crime statistics, which affects public safety understanding.

Google and Stage Two of the AI Boom

Dana Blankenhorn: Facing the Future • 39 implied HN points • 30 Oct 24

🕹 Technology AI Cloud Computing Data Business

Nvidia's rise marked the start of the AI boom, with companies heavily buying chips for AI tools. This growth continues, and Nvidia is now a leading company.
Google's cloud revenue is growing quickly at 35%, while overall revenue growth is slower at 15%. This shows strong demand for AI services from Google.
Despite revenue growth, Google's search revenue isn't doing as well, rising only 12%. This could mean they are losing some of their search market share.

How I Stole Your ChatGPT API Keys

Jacob’s Tech Tavern • 2624 implied HN points • 27 Jan 25

🕹 Technology Cybersecurity AI Programming Software Data

Never store API keys on the client side. It's too easy for hackers to get them that way.
If bad actors steal your API keys, they can run up big bills on your account.
To keep your data safe, always follow basic security rules and store sensitive information securely.

4 Strategies To Elevate Your Communication Style From Engineer To Leader

SeattleDataGuy’s Newsletter • 412 implied HN points • 10 Jun 25

💼 Business Leadership Communication Data Strategy Consulting

When communicating with non-technical stakeholders, focus on the impact of your work rather than the technical details. Using clear language helps everyone understand why your projects matter.
Highlight the risks of inaction to motivate decision-makers. Making them aware of potential costs or missed opportunities can encourage them to prioritize your recommendations.
Use analogies relevant to your audience to make complex ideas easier to grasp. Relating technical concepts to familiar ideas can help build understanding and trust.

You can’t build a moat with AI (redux)

Generating Conversation • 256 implied HN points • 20 Feb 25

🕹 Technology AI Software Applications Data User Experience

Using AI like LLMs isn't unique anymore. Just having AI in your product doesn't really set it apart from competitors.
To really stand out, focus on making a great user experience and integrating your product into how users already work. This makes your tool more valuable and hard to replace.
Data is crucial for AI. It's not just about having lots of data; it's about using it smartly over time to improve your product and understand your users better.

Which AI to Use Now: An Updated Opinionated Guide

One Useful Thing • 2229 implied HN points • 26 Jan 25

🕹 Technology AI Software Data Models Applications

When choosing an AI, consider using a paid version for better features. Claude, Gemini, and ChatGPT are the top choices right now.
New AI advances include live interaction and reasoning capabilities. This helps AIs understand and respond more naturally, making them feel more human.
Privacy is now better handled by major AI models, and you can customize them for your specific needs. Explore different AIs to find one that fits your style.

AI Roundup 107: GPT-4.5

Artificial Ignorance • 58 implied HN points • 28 Feb 25

🕹 Technology AI Software Computing Innovation Data

OpenAI just released GPT-4.5, a powerful AI model that is more expensive to run than GPT-4 but doesn't perform as well in some areas. This raises questions about whether bigger models are always better.
Amazon is launching Alexa+, a new subscription service that adds generative AI features to their smart assistant, aiming for more natural conversations and complex tasks.
DeepSeek is pushing ahead in the AI race, planning to launch new models quickly while its free distribution strategy helps democratize AI access in China.

Deep Research, Deep Bullshit, and the potential (model) collapse of science

Marcus on AI • 14386 implied HN points • 03 Feb 25

🕹 Technology AI Science Research Data Ethics

Deep Research tools can quickly generate articles that sound scientific but might be full of errors. This can make it hard to trust information online.
Many people may not check the facts from these AI-generated writings, leading to false information entering academic work. This could cause problems in important fields like medicine.
As more of this low-quality content spreads, it could harm the credibility of scientific literature and complicate the peer review process.

OpenAI is an App Company Now

Big Technology • 13260 implied HN points • 31 Jan 25

🕹 Technology AI Software Apps Innovation Data

OpenAI is focusing more on building apps rather than just creating AI models. This shift reflects a need to stay competitive and profitable in the changing AI landscape.
The market for AI applications is growing, and OpenAI's ChatGPT is performing well, far ahead of its competitors in earnings. This positions OpenAI favorably as it continues to innovate its products.
While OpenAI aims to develop artificial general intelligence, it faces challenges as competition increases and cost structures change in the AI industry. Staying ahead will require continuous product improvements.

Everyone Loves The Idea Of AI, But Not The Reality

High ROI Data Science • 615 implied HN points • 06 Oct 24

🕹 Technology AI Data Business Modeling Training Platforms

Many businesses love the idea of AI but find it hard to put into practice. It often looks easy on paper, but the reality is very different when trying to make it work.
Data is really important for AI to work well. Companies need good data to build effective AI products, and often, they realize this too late after facing challenges.
AI projects often fail because businesses don’t fully understand what they need to achieve. Companies should focus on solving real problems rather than just using the latest technology.

TPRR check-in: Who has made strides earning volume so far?

Stealing Signals • 599 implied HN points • 03 Oct 24

🎾 Sports Football Analytics Statistics Data Performance

Routes data is really important for understanding how well players are performing. Different sources measure these routes in different ways, which can create confusion.
The NFL has started providing its own routes data, which could help standardize how we analyze player performance. This might make comparisons easier and clearer moving forward.
Stats like TPRR (Targets Per Route Run) help us understand player efficiency, but they need to be used alongside other context like player roles and QB performance for better insights.

The next year of AI target analysis

All-Source Intelligence Fusion • 467 implied HN points • 23 Jan 25

🕹 Technology AI Military Analysis Intelligence Data

AI is being used to improve how military targets are tracked and analyzed. This means we could see continuous updates on things like tanks, instead of just occasional snapshots.
Companies like Anthropic and Google are investing big in AI for defense purposes. They're aiming to compete with others, like OpenAI, for military contracts and capabilities.
The U.S. National Geospatial-Intelligence Agency (NGA) is working on integrating AI systems to enhance their intelligence efforts, but it's facing some challenges with existing technologies.

State-by-state electricity mixes and prices in the United States

Sustainability by numbers • 279 implied HN points • 05 Feb 25

🌞 Climate & Environment Sustainability Energy Electricity Policy Data

There are interactive slide decks available that show how electricity sources and prices vary across different states in the US. This makes it easy for people to understand where their electricity comes from.
The slide decks get updated with new data to reflect changes in energy policy and the electricity market over time. It's helpful for anyone interested in seeing the latest trends and figures.
Users can freely explore the data on electricity mixes and prices without needing permission, promoting accessibility and awareness about energy consumption.

CROSSPOST: LEIF WEATHERBY: Our Spreadsheet Overlords

Brad DeLong's Grasping Reality • 146 implied HN points • 09 Jun 25

🕹 Technology AI Data Automation Bureaucracy Engineering

AI tools like ChatGPT are often seen as super smart, but they're really just advanced digital bureaucrats. They help manage data and tasks but can hide errors behind a layer of complexity.
Relying too much on AI can lead us to overlook its limitations. It doesn't think like humans; it's more about processing and translating data rather than genuine understanding.
There's a risk in using AI for important tasks without careful oversight. As it automates jobs and decision-making, we need to stay aware of the potential for misuse and the loss of human judgment.

𝗼𝟯 “𝗔𝗥𝗖 𝗔𝗚𝗜” 𝗽𝗼𝘀𝘁𝗺𝗼𝗿𝘁𝗲𝗺 𝗺𝗲𝗴𝗮𝘁𝗵𝗿𝗲𝗮𝗱: 𝘄𝗵𝘆 𝘁𝗵𝗶𝗻𝗴𝘀 𝗴𝗼𝘁 𝗵𝗲𝗮𝘁𝗲𝗱, 𝘄𝗵𝗮𝘁 𝘄𝗲𝗻𝘁 𝘄𝗿𝗼𝗻𝗴, 𝗮𝗻𝗱 𝘄𝗵𝗮𝘁 𝗶𝘁 𝗮𝗹𝗹 𝗺𝗲𝗮𝗻𝘀

Marcus on AI • 8378 implied HN points • 22 Dec 24

🕹 Technology AI Software Data Research Innovation

Many experts feel that the recent test called ARC-AGI should not have been labeled as such. It wasn't a proper test for Artificial General Intelligence.
The presentation was confusing and didn't clearly show what the AI was tested on. This left people with the impression that the AI performed better than it actually did.
There's a need for more scientific scrutiny of the results. Until we get that, we can't really compare the AI's performance fairly with humans.

Shame on Google, twice

Marcus on AI • 4703 implied HN points • 09 Feb 25

🕹 Technology AI Software Innovation Data Ethics

Large language models (LLMs) can make mistakes, sometimes creating false information that is hard to spot. This is a recurring issue that has not been fully addressed over the years.
Google has been called out for its ongoing issues with LLMs failing to provide accurate results, as these problems seem to occur regularly.
The idea of rapid improvements in AI technology may be overhyped, as the same mistakes keep happening, indicating slower progress than expected.

AI Roundup 106: Grok 3

Artificial Ignorance • 54 implied HN points • 21 Feb 25

🕹 Technology AI Software Robotics Tech Trends Data

Grok 3 is a new AI model that shows great reasoning capabilities, ranking well in benchmarks, but it's still behind a future model called o3. Many early reviews say it has potential.
Meta is focusing on building humanoid robots, believing they could be a big part of the future, while also working on software to support these robots. Competition in this area is heating up, especially from companies like Apple.
There's a growing concern that new junior developers lack coding skills because they rely too much on AI tools, which may hurt their understanding of how programming works.

AI: A Means to an End or a Means to Our End?

The Fry Corner • 186 HN points • 15 Sep 24

🕹 Technology Artificial Intelligence Computing Innovation Data Ethics

AI can change our world significantly, but we must handle it carefully to avoid negative outcomes. It's crucial to put rules in place for how AI is developed and used.
Humans and AI have different strengths; machines can process data faster, but humans have emotions and creativity that machines can't replicate. We shouldn't be too quick to believe AI can think like us.
The growth of AI might disrupt many industries and change how we live. We need to be aware of these changes and adapt, ensuring that technology serves humanity rather than harms it.

China's Deepseek is NOT as smart as ChatGPT-o1

Maximum Truth • 231 implied HN points • 29 Jan 25

🕹 Technology AI Machine Learning Competitiveness Innovation Data

Deepseek performs on par with free AI models but does not reach the intelligence of OpenAI's paid models. It can exceed or match free AIs like Claude and ChatGPT-4o, but falls short against the more advanced paid versions.
When tested with IQ questions only found offline, Deepseek does better than free models but still trails behind OpenAI’s paid models. Its results imply it may have leveraged internet data for online IQ tests, thus affecting its offline performance.
Despite being competitive, the US maintains a lead in AI intelligence. Deepseek shows promise but faces challenges ahead, especially with the restrictions on technology that China experiences.

ChatGPT, at Age Two

Marcus on AI • 7074 implied HN points • 28 Nov 24

🕹 Technology AI Software Innovation Data Digital ethics

ChatGPT has been popular for two years, but many of the initial uses people expected, like taking over Google, haven't happened. Companies are not as impressed with its real-world results.
Despite promises of improvement, ChatGPT still struggles with inaccuracies and generating false information. Users continue to experience 'hallucinations' where the AI makes things up.
The investment in AI is huge, but the fundamental issues with reliability and factual accuracy haven't improved significantly. There's a call for new approaches to make AI more trustworthy.

Scale AI’s Alexandr Wang’s Predictions for AI In 2025: Geopolitical Turf Wars Escalate, AI Agents Progress, Data Beats Compute

Big Technology • 5629 implied HN points • 12 Dec 24

🕹 Technology AI Geopolitics Military Data Innovation

The competition between the U.S. and China in AI will heat up, with each country trying to promote their AI technology globally. This battle will affect which AI systems become the global standard.
In 2025, we might see AI agents become more useful in everyday life, helping with tasks like managing emails and planning trips. People will likely start trusting these agents to handle bigger parts of their work and personal lives.
Military use of AI is expected to grow significantly, with AI agents being implemented to process large amounts of data and improve logistical operations. This could change how wars are fought and complicate decisions about military autonomy.

An AI rumor you won’t want to miss

Marcus on AI • 7153 implied HN points • 10 Nov 24

🕹 Technology AI Deep Learning Scaling Data Computing

The belief that more scaling in AI will always lead to better results might be fading. It's thought we might have reached a limit where simply adding more data and computing power is no longer effective.
There are concerns that scaling laws, which have worked before, are just temporary trends, not true laws of nature. They don’t actually solve issues like AI making mistakes or hallucinations.
If rumors are true about a major change in the AI landscape, it could lead to a significant loss of trust in these scaling approaches, similar to a bank run.

DeepSeek: Frequently Asked Questions

Artificial Ignorance • 243 implied HN points • 28 Jan 25

🕹 Technology AI Software Innovation Data Research

DeepSeek is a new AI company that has made a big impact by focusing on research instead of just selling products. It started quietly but became popular with its recent models that work well and are cheaper than competitors.
Their latest products, DeepSeek V3 and R1, perform similarly to big names like ChatGPT but at much lower prices, making AI more accessible. People can even use their chatbot for free on their website.
DeepSeek's success has raised questions about the future of AI development, suggesting that state-of-the-art systems can be built without spending billions. This shift in the industry has attracted significant attention and worry from major tech companies.

⤴⤵ Up Wing/Down Wing #28

Faster, Please! • 1005 implied HN points • 14 Dec 24

🕹 Technology AI Innovation Space Data Communication

New chips using fiber optics can transfer data way faster, which may cut down AI training times and save energy. This could really speed up tech advancements.
Businesses are finding out that human skills are still important when using AI tools. People are getting new jobs related to organizing data so AIs can work better.
SpaceX is becoming super important for US defense technology. Its innovations may give the US an advantage over rivals like China in military capabilities.

($) Two Charts That Matter in Mary Meeker’s AI Deck

Interconnected • 77 implied HN points • 02 Jun 25

🕹 Technology AI Data Trends Geopolitics Business

Mary Meeker's new AI deck shows a lot of positive trends about AI growth, but two specific charts tell a more complex story.
One of the charts focuses on the geopolitical competition between the US and China in AI technology.
The other chart looks at the fundamental business aspects of AI, providing a more balanced view of its future.

Sora still appears to have trouble with physics

Marcus on AI • 3636 implied HN points • 10 Dec 24

🕹 Technology AI Computer Science Data Physics Innovation

Sora struggles to understand basic physics. It doesn't know how objects should behave in space or time.
Past warnings about Sora's physics issues still hold true. Even with more data, it seems these problems won't go away.
Investing a lot of money into Sora hasn't fixed its understanding of physics. The approach we're using to teach it seems to be failing.

Yes, AI really can be used to tackle potholes

Odds and Ends of History • 2077 implied HN points • 17 Jan 25

🕹 Technology AI Infrastructure Data Innovation Public Services

AI can help local councils find and fix potholes more efficiently. It uses cameras and algorithms to spot problems without needing workers to stop and inspect manually.
The technology can identify not only potholes but also other issues like broken signs and overgrown vegetation. This means councils can be proactive in road maintenance.
Using AI for road maintenance can save time and resources for councils. This allows them to collect useful data and prioritize repairs better, despite limited budgets.

Issue #17 - Unpacking the People, Process, Technology & Data Framework

The Data Ecosystem • 339 implied HN points • 04 Aug 24

💼 Business Operations Management Strategy Data Technology

The People, Process, Technology framework helps organizations balance these three key areas but often misses the importance of data. Companies should not just focus on technology but also consider how people and processes interact.
A new framework that includes data is called People, Process, Technology & Data. This approach shows how these four components work together, helping organizations make better decisions and manage change more effectively.
Using structured questions and understanding the roles of each component can enhance planning and execution in businesses. It's essential to revisit these elements regularly to stay aligned with goals and adapt as needed.

AI models’ fusion future

Alex's Personal Blog • 32 implied HN points • 14 Feb 25

🕹 Technology AI Software Innovation Data Startups

AI companies are combining different types of models into one product. This means improvements in how they work together for tasks like reasoning and generating text.
The market for secondary shares in startups is improving. Higher demand for good AI startups is helping to boost prices lately.
There are ongoing debates in politics about technology and defense, particularly around companies like TikTok and relations with countries like China and India. This is creating a lot of uncertainty in the tech space.

The Hidden World of Undersea Cables

The Garden of Forking Paths • 2869 implied HN points • 10 Jan 24

🕹 Technology Internet Infrastructure Data Security Geopolitics

The internet largely runs through undersea cables spanning about 900,000 miles, connecting the world in a hidden network.
Early undersea cables were made possible by materials like gutta-percha and played a key role in rapid communication during events like the US Civil War.
Specialized ships lay and repair undersea cables made of fiber optics, and even guard against threats like sharks and sabotage by SCUBA divers.

AI as electricity, AI as magic

New World Same Humans • 31 implied HN points • 02 Feb 25

🕹 Technology AI Innovation Robotics Data Software

AI is becoming more like electricity, meaning it will be everywhere and very useful for things like robots and smart devices. This will make intelligence widespread and accessible.
On the other hand, AI is also like magic, creating amazing content and automating complex tasks that used to be just for humans. This aspect makes AI feel special and creative.
The real money won't be in creating AI but in using it to deliver great experiences. Companies with lots of user data and reach, like Meta and Google, will likely benefit the most from this trend.

"Cache me" if you can!

System Design Classroom • 659 implied HN points • 01 Jun 24

🕹 Technology Software Systems Data Engineering Architecture

The type of caching strategy you choose depends on your read and write ratios. If you read a lot, caching is very helpful, but if you write often, you need a more complex approach.
Data consistency is crucial for some applications. Using methods like Write-Through helps keep data in cache and databases aligned, while other methods, like Write-Behind, prioritize speed over immediate consistency.
To see if your caching is effective, you should track metrics like how many times data is successfully retrieved from the cache versus not retrieved. This will help you understand how well your caching is working.

Weekly Top Picks #93

The Algorithmic Bridge • 148 implied HN points • 07 Jan 25

🕹 Technology AI Computing Data Robotics Video

ChatGPT Pro is losing money despite its high subscription cost. This shows that even popular AI tools can face financial troubles.
Nvidia has introduced an expensive new AI supercomputer for individuals. This highlights the growing demand for advanced AI technology in personal computing.
More artists are embracing AI-generated art, sparking discussions about creativity and technology. This signals a shift in how art is produced and appreciated.