The hottest Data Substack posts right now

And their main takeaways

Deep Research, Deep Bullshit, and the potential (model) collapse of science

Marcus on AI • 14386 implied HN points • 03 Feb 25

🕹 Technology AI Science Research Data Ethics

Deep Research tools can quickly generate articles that sound scientific but might be full of errors. This can make it hard to trust information online.
Many people may not check the facts from these AI-generated writings, leading to false information entering academic work. This could cause problems in important fields like medicine.
As more of this low-quality content spreads, it could harm the credibility of scientific literature and complicate the peer review process.

OpenAI is an App Company Now

Big Technology • 13260 implied HN points • 31 Jan 25

🕹 Technology AI Software Apps Innovation Data

OpenAI is focusing more on building apps rather than just creating AI models. This shift reflects a need to stay competitive and profitable in the changing AI landscape.
The market for AI applications is growing, and OpenAI's ChatGPT is performing well, far ahead of its competitors in earnings. This positions OpenAI favorably as it continues to innovate its products.
While OpenAI aims to develop artificial general intelligence, it faces challenges as competition increases and cost structures change in the AI industry. Staying ahead will require continuous product improvements.

Shame on Google, twice

Marcus on AI • 4703 implied HN points • 09 Feb 25

🕹 Technology AI Software Innovation Data Ethics

Large language models (LLMs) can make mistakes, sometimes creating false information that is hard to spot. This is a recurring issue that has not been fully addressed over the years.
Google has been called out for its ongoing issues with LLMs failing to provide accurate results, as these problems seem to occur regularly.
The idea of rapid improvements in AI technology may be overhyped, as the same mistakes keep happening, indicating slower progress than expected.

AI #103: Show Me the Money

Don't Worry About the Vase • 2374 implied HN points • 13 Feb 25

🕹 Technology AI Software Data Innovation Automation Regulation

The Paris AI Anti-Safety Summit failed to build on previous successes, leading to increased concerns about nationalism and lack of clear plans for AI safety. It's making people worried and hopeless.
Elon Musk's huge bid for OpenAI's assets complicates the situation, especially as another bid threatens to overshadow the original efforts to secure AI's future.
OpenAI is quickly releasing new versions of their models, which brings excitement but also skepticism about their true capabilities and risks.

China on Dario, DeepSeeking Truth, Ali + DeepSeek, and a Procurement IP Manifesto

ChinaTalk • 281 implied HN points • 14 Feb 25

🕹 Technology AI Internet China Data Security Censorship

DeepSeek, a new Chinese AI model, is being seen as a serious competitor to U.S. AI in helping researchers gather information about China. However, it struggles to answer questions that cross different areas of knowledge.
Many in China believe the U.S. has double standards regarding AI and security, saying that U.S. restrictions are more about keeping an edge in technology than genuine concerns for safety.
DeepSeek is powerful for safe topics, but it has issues with censorship. It often can’t handle politically sensitive topics, making it less useful for in-depth research on controversial issues.

Get a weekly roundup of the best Substack posts, by hacker news affinity:

How reliable is your node?

Kerman Kohli • 99 implied HN points • 29 Oct 24

🔮 Crypto Blockchain Performance Data Infrastructure

RPC calls to blockchain nodes only succeed about 78.5% of the time on average. This means that sometimes you might have trouble getting the data you need.
The performance of nodes varies depending on the blockchain you’re accessing, the RPC provider you choose, and even the time of day you make your requests.
To ensure better reliability, it’s smart to use multiple node providers rather than depending on just one. This way, if one fails, you have a backup.

While the West Hesitates China Marches Forward

The Algorithmic Bridge • 637 implied HN points • 21 Feb 25

🕹 Technology AI Innovation Government Data Globalization

China is rapidly adopting AI technology, using systems like DeepSeek across government operations to improve efficiency and decision-making. This shows their proactive approach to embracing innovation.
DeepSeek has emerged as a competitive AI model that rivals established Western technologies, highlighting China's growing capabilities in the tech sector. China is focused on getting results, not just discussing ideas.
The cultural mindset in China emphasizes efficiency and action, contrasting with the West's tendency to debate and regulate rather than implement. This difference in attitude could impact global technological leadership.

Building a "Vertical Agent"

The Security Industry • 13 implied HN points • 24 Feb 25

🕹 Technology AI Software Security SaaS Data

Vertical agents are a new trend gaining interest for their potential impact in various fields. They utilize specialized AI to cater to specific industries or tasks.
AI tools like HarvestIQ.ai can assist organizations in managing their security tools and processes. They can streamline research and decision-making by providing quick insights and analysis.
The future may see AI agents that fully understand an organization's needs. These agents could help businesses choose the right tools and maintain compliance more effectively.

FBI's Stealth Revisions: The 2022 Crime Numbers They Don't Want You to Notice

COVID Reason • 832 implied HN points • 16 Oct 24

🇺🇸 U.S. Politics Crime Data Government Policy Transparency

The FBI initially reported a drop in violent crime for 2022, but later revised the numbers to show a significant increase, changing the narrative without much public notice.
Revisions included thousands more cases of serious crimes, raising questions about the accuracy and transparency of the FBI's data.
Many crimes go unreported, leading to incomplete data and a lack of trust in official crime statistics, which affects public safety understanding.

Google and Stage Two of the AI Boom

Dana Blankenhorn: Facing the Future • 39 implied HN points • 30 Oct 24

🕹 Technology AI Cloud Computing Data Business

Nvidia's rise marked the start of the AI boom, with companies heavily buying chips for AI tools. This growth continues, and Nvidia is now a leading company.
Google's cloud revenue is growing quickly at 35%, while overall revenue growth is slower at 15%. This shows strong demand for AI services from Google.
Despite revenue growth, Google's search revenue isn't doing as well, rising only 12%. This could mean they are losing some of their search market share.

𝗼𝟯 “𝗔𝗥𝗖 𝗔𝗚𝗜” 𝗽𝗼𝘀𝘁𝗺𝗼𝗿𝘁𝗲𝗺 𝗺𝗲𝗴𝗮𝘁𝗵𝗿𝗲𝗮𝗱: 𝘄𝗵𝘆 𝘁𝗵𝗶𝗻𝗴𝘀 𝗴𝗼𝘁 𝗵𝗲𝗮𝘁𝗲𝗱, 𝘄𝗵𝗮𝘁 𝘄𝗲𝗻𝘁 𝘄𝗿𝗼𝗻𝗴, 𝗮𝗻𝗱 𝘄𝗵𝗮𝘁 𝗶𝘁 𝗮𝗹𝗹 𝗺𝗲𝗮𝗻𝘀

Marcus on AI • 8378 implied HN points • 22 Dec 24

🕹 Technology AI Software Data Research Innovation

Many experts feel that the recent test called ARC-AGI should not have been labeled as such. It wasn't a proper test for Artificial General Intelligence.
The presentation was confusing and didn't clearly show what the AI was tested on. This left people with the impression that the AI performed better than it actually did.
There's a need for more scientific scrutiny of the results. Until we get that, we can't really compare the AI's performance fairly with humans.

How I Stole Your ChatGPT API Keys

Jacob’s Tech Tavern • 2624 implied HN points • 27 Jan 25

🕹 Technology Cybersecurity AI Programming Software Data

Never store API keys on the client side. It's too easy for hackers to get them that way.
If bad actors steal your API keys, they can run up big bills on your account.
To keep your data safe, always follow basic security rules and store sensitive information securely.

You can’t build a moat with AI (redux)

Generating Conversation • 256 implied HN points • 20 Feb 25

🕹 Technology AI Software Applications Data User Experience

Using AI like LLMs isn't unique anymore. Just having AI in your product doesn't really set it apart from competitors.
To really stand out, focus on making a great user experience and integrating your product into how users already work. This makes your tool more valuable and hard to replace.
Data is crucial for AI. It's not just about having lots of data; it's about using it smartly over time to improve your product and understand your users better.

Which AI to Use Now: An Updated Opinionated Guide

One Useful Thing • 2229 implied HN points • 26 Jan 25

🕹 Technology AI Software Data Models Applications

When choosing an AI, consider using a paid version for better features. Claude, Gemini, and ChatGPT are the top choices right now.
New AI advances include live interaction and reasoning capabilities. This helps AIs understand and respond more naturally, making them feel more human.
Privacy is now better handled by major AI models, and you can customize them for your specific needs. Explore different AIs to find one that fits your style.

Scale AI’s Alexandr Wang’s Predictions for AI In 2025: Geopolitical Turf Wars Escalate, AI Agents Progress, Data Beats Compute

Big Technology • 5629 implied HN points • 12 Dec 24

🕹 Technology AI Geopolitics Military Data Innovation

The competition between the U.S. and China in AI will heat up, with each country trying to promote their AI technology globally. This battle will affect which AI systems become the global standard.
In 2025, we might see AI agents become more useful in everyday life, helping with tasks like managing emails and planning trips. People will likely start trusting these agents to handle bigger parts of their work and personal lives.
Military use of AI is expected to grow significantly, with AI agents being implemented to process large amounts of data and improve logistical operations. This could change how wars are fought and complicate decisions about military autonomy.

AI Roundup 107: GPT-4.5

Artificial Ignorance • 58 implied HN points • 28 Feb 25

🕹 Technology AI Software Computing Innovation Data

OpenAI just released GPT-4.5, a powerful AI model that is more expensive to run than GPT-4 but doesn't perform as well in some areas. This raises questions about whether bigger models are always better.
Amazon is launching Alexa+, a new subscription service that adds generative AI features to their smart assistant, aiming for more natural conversations and complex tasks.
DeepSeek is pushing ahead in the AI race, planning to launch new models quickly while its free distribution strategy helps democratize AI access in China.

ChatGPT, at Age Two

Marcus on AI • 7074 implied HN points • 28 Nov 24

🕹 Technology AI Software Innovation Data Digital ethics

ChatGPT has been popular for two years, but many of the initial uses people expected, like taking over Google, haven't happened. Companies are not as impressed with its real-world results.
Despite promises of improvement, ChatGPT still struggles with inaccuracies and generating false information. Users continue to experience 'hallucinations' where the AI makes things up.
The investment in AI is huge, but the fundamental issues with reliability and factual accuracy haven't improved significantly. There's a call for new approaches to make AI more trustworthy.

An AI rumor you won’t want to miss

Marcus on AI • 7153 implied HN points • 10 Nov 24

🕹 Technology AI Deep Learning Scaling Data Computing

The belief that more scaling in AI will always lead to better results might be fading. It's thought we might have reached a limit where simply adding more data and computing power is no longer effective.
There are concerns that scaling laws, which have worked before, are just temporary trends, not true laws of nature. They don’t actually solve issues like AI making mistakes or hallucinations.
If rumors are true about a major change in the AI landscape, it could lead to a significant loss of trust in these scaling approaches, similar to a bank run.

Everyone Loves The Idea Of AI, But Not The Reality

High ROI Data Science • 615 implied HN points • 06 Oct 24

🕹 Technology AI Data Business Modeling Training Platforms

Many businesses love the idea of AI but find it hard to put into practice. It often looks easy on paper, but the reality is very different when trying to make it work.
Data is really important for AI to work well. Companies need good data to build effective AI products, and often, they realize this too late after facing challenges.
AI projects often fail because businesses don’t fully understand what they need to achieve. Companies should focus on solving real problems rather than just using the latest technology.

Sora still appears to have trouble with physics

Marcus on AI • 3636 implied HN points • 10 Dec 24

🕹 Technology AI Computer Science Data Physics Innovation

Sora struggles to understand basic physics. It doesn't know how objects should behave in space or time.
Past warnings about Sora's physics issues still hold true. Even with more data, it seems these problems won't go away.
Investing a lot of money into Sora hasn't fixed its understanding of physics. The approach we're using to teach it seems to be failing.

TPRR check-in: Who has made strides earning volume so far?

Stealing Signals • 599 implied HN points • 03 Oct 24

🎾 Sports Football Analytics Statistics Data Performance

Routes data is really important for understanding how well players are performing. Different sources measure these routes in different ways, which can create confusion.
The NFL has started providing its own routes data, which could help standardize how we analyze player performance. This might make comparisons easier and clearer moving forward.
Stats like TPRR (Targets Per Route Run) help us understand player efficiency, but they need to be used alongside other context like player roles and QB performance for better insights.

Deepseek Meets Li Qiang, Data Labeling Subsidies, Taiwan's Debt, Automation Optimism

ChinaTalk • 429 implied HN points • 24 Jan 25

🕹 Technology AI Data Policy Automation Economics

DeepSeek, a major player in China's AI sector, recently caught the attention of government leaders, highlighting its rise as a 'national champion.' This may lead to more funding but also increased scrutiny from the government.
China is putting effort into developing the data labeling industry as a key part of its AI advancements, offering tax breaks and support to help businesses in this area grow. High-quality data is essential for effective AI development.
Taiwan needs to rethink its strict debt policy to invest more in military and energy security due to rising threats from China. Maintaining a low debt level could limit Taiwan's ability to strengthen its defense.

DeepSeek's Edge

ChinaTalk • 741 implied HN points • 12 Jan 25

🕹 Technology AI Software Hardware Research Data

DeepSeek has no business model, which allows its team to experiment freely without pressure to earn money. This gives them a unique advantage over most other AI labs that need to focus on revenue.
DeepSeek runs its own data centers instead of relying on external cloud services. This means they have better control over their resources and can optimize their setup for efficiency.
The company's success comes from their innovative software optimization techniques. By being smart about how they use their hardware, they've achieved high performance even with limited resources.

The next year of AI target analysis

All-Source Intelligence Fusion • 467 implied HN points • 23 Jan 25

🕹 Technology AI Military Analysis Intelligence Data

AI is being used to improve how military targets are tracked and analyzed. This means we could see continuous updates on things like tanks, instead of just occasional snapshots.
Companies like Anthropic and Google are investing big in AI for defense purposes. They're aiming to compete with others, like OpenAI, for military contracts and capabilities.
The U.S. National Geospatial-Intelligence Agency (NGA) is working on integrating AI systems to enhance their intelligence efforts, but it's facing some challenges with existing technologies.

State-by-state electricity mixes and prices in the United States

Sustainability by numbers • 279 implied HN points • 05 Feb 25

🌞 Climate & Environment Sustainability Energy Electricity Policy Data

There are interactive slide decks available that show how electricity sources and prices vary across different states in the US. This makes it easy for people to understand where their electricity comes from.
The slide decks get updated with new data to reflect changes in energy policy and the electricity market over time. It's helpful for anyone interested in seeing the latest trends and figures.
Users can freely explore the data on electricity mixes and prices without needing permission, promoting accessibility and awareness about energy consumption.

AI Roundup 106: Grok 3

Artificial Ignorance • 54 implied HN points • 21 Feb 25

🕹 Technology AI Software Robotics Tech Trends Data

Grok 3 is a new AI model that shows great reasoning capabilities, ranking well in benchmarks, but it's still behind a future model called o3. Many early reviews say it has potential.
Meta is focusing on building humanoid robots, believing they could be a big part of the future, while also working on software to support these robots. Competition in this area is heating up, especially from companies like Apple.
There's a growing concern that new junior developers lack coding skills because they rely too much on AI tools, which may hurt their understanding of how programming works.

AI: A Means to an End or a Means to Our End?

The Fry Corner • 186 HN points • 15 Sep 24

🕹 Technology Artificial Intelligence Computing Innovation Data Ethics

AI can change our world significantly, but we must handle it carefully to avoid negative outcomes. It's crucial to put rules in place for how AI is developed and used.
Humans and AI have different strengths; machines can process data faster, but humans have emotions and creativity that machines can't replicate. We shouldn't be too quick to believe AI can think like us.
The growth of AI might disrupt many industries and change how we live. We need to be aware of these changes and adapt, ensuring that technology serves humanity rather than harms it.

AI companies are just SaaS companies

benn.substack • 869 implied HN points • 20 Dec 24

🕹 Technology AI SaaS Software Data Startups

AI companies have a lot in common with traditional SaaS companies. They’re selling software services, often built on complex tech, rather than just cool algorithms.
The success of AI models like ChatGPT depends heavily on branding and user experience. People care more about how easy and useful the software is than just the tech behind it.
OpenAI is at a crossroads, needing to adapt its business model and offerings to stay ahead, especially as competition increases and tech costs rise.

China's Deepseek is NOT as smart as ChatGPT-o1

Maximum Truth • 231 implied HN points • 29 Jan 25

🕹 Technology AI Machine Learning Competitiveness Innovation Data

Deepseek performs on par with free AI models but does not reach the intelligence of OpenAI's paid models. It can exceed or match free AIs like Claude and ChatGPT-4o, but falls short against the more advanced paid versions.
When tested with IQ questions only found offline, Deepseek does better than free models but still trails behind OpenAI’s paid models. Its results imply it may have leveraged internet data for online IQ tests, thus affecting its offline performance.
Despite being competitive, the US maintains a lead in AI intelligence. Deepseek shows promise but faces challenges ahead, especially with the restrictions on technology that China experiences.

Searching for insight

benn.substack • 1099 implied HN points • 29 Nov 24

💼 Business Economics Analytics Media Marketing Publishing Data

Many jobs in areas like think tanks or journalism are more about creating a background or illusion rather than producing real change or value. They serve as props for the more influential figures.
There's a concern that as AI becomes capable of producing content, it might not be because it’s better, but because the original jobs might not have mattered as much as once thought.
In analytics, there's a question of whether the insights businesses claim to offer are real or just part of the narrative they tell to appear competent and important.

DeepSeek: Frequently Asked Questions

Artificial Ignorance • 243 implied HN points • 28 Jan 25

🕹 Technology AI Software Innovation Data Research

DeepSeek is a new AI company that has made a big impact by focusing on research instead of just selling products. It started quietly but became popular with its recent models that work well and are cheaper than competitors.
Their latest products, DeepSeek V3 and R1, perform similarly to big names like ChatGPT but at much lower prices, making AI more accessible. People can even use their chatbot for free on their website.
DeepSeek's success has raised questions about the future of AI development, suggesting that state-of-the-art systems can be built without spending billions. This shift in the industry has attracted significant attention and worry from major tech companies.

⤴⤵ Up Wing/Down Wing #28

Faster, Please! • 1005 implied HN points • 14 Dec 24

🕹 Technology AI Innovation Space Data Communication

New chips using fiber optics can transfer data way faster, which may cut down AI training times and save energy. This could really speed up tech advancements.
Businesses are finding out that human skills are still important when using AI tools. People are getting new jobs related to organizing data so AIs can work better.
SpaceX is becoming super important for US defense technology. Its innovations may give the US an advantage over rivals like China in military capabilities.

($) Stargate is America’s Sovereign AI

Interconnected • 138 implied HN points • 22 Jan 25

🕹 Technology AI Innovation Data Security Automation

Stargate is seen as a key AI technology for America, focusing on improving national capabilities. It aims to make the U.S. more self-sufficient in AI development.
The project emphasizes the importance of sovereign technology, meaning that the U.S. can control and utilize its own AI resources without relying heavily on foreign technologies.
Community support and subscriptions play a crucial role in sharing insights about such technologies, encouraging more people to get involved and informed.

Yes, AI really can be used to tackle potholes

Odds and Ends of History • 2077 implied HN points • 17 Jan 25

🕹 Technology AI Infrastructure Data Innovation Public Services

AI can help local councils find and fix potholes more efficiently. It uses cameras and algorithms to spot problems without needing workers to stop and inspect manually.
The technology can identify not only potholes but also other issues like broken signs and overgrown vegetation. This means councils can be proactive in road maintenance.
Using AI for road maintenance can save time and resources for councils. This allows them to collect useful data and prioritize repairs better, despite limited budgets.

The next big thing in 2025 will be...

next big thing • 243 implied HN points • 30 Dec 24

🕹 Technology AI Robotics Software Data Consumer Tech

In 2025, we will see the rise of AI agents that can help automate tasks more efficiently and handle complex activities, making our lives easier.
There will be a big shift in technology with AI becoming more integrated into our daily routines, making things like healthcare and language translation more personalized and seamless.
Consumer healthcare will improve a lot as people gain more control over their health data, leading to a better experience and more trust in healthcare systems.

Issue #17 - Unpacking the People, Process, Technology & Data Framework

The Data Ecosystem • 339 implied HN points • 04 Aug 24

💼 Business Operations Management Strategy Data Technology

The People, Process, Technology framework helps organizations balance these three key areas but often misses the importance of data. Companies should not just focus on technology but also consider how people and processes interact.
A new framework that includes data is called People, Process, Technology & Data. This approach shows how these four components work together, helping organizations make better decisions and manage change more effectively.
Using structured questions and understanding the roles of each component can enhance planning and execution in businesses. It's essential to revisit these elements regularly to stay aligned with goals and adapt as needed.

5 Cybersecurity Predictions for 2024

Frankly Speaking • 203 implied HN points • 27 Dec 24

🕹 Technology Cybersecurity AI Software Engineering Data

In 2024, cybersecurity companies will focus more on creating platforms instead of using many separate tools. This means they can work faster and solve problems better.
Cybersecurity is moving towards building its own solutions rather than just buying products. This change is necessary to keep up with the evolving threats.
The use of AI in cybersecurity will become more effective. Companies will learn how to use AI to make their security processes better and faster.

AI models’ fusion future

Alex's Personal Blog • 32 implied HN points • 14 Feb 25

🕹 Technology AI Software Innovation Data Startups

AI companies are combining different types of models into one product. This means improvements in how they work together for tasks like reasoning and generating text.
The market for secondary shares in startups is improving. Higher demand for good AI startups is helping to boost prices lately.
There are ongoing debates in politics about technology and defense, particularly around companies like TikTok and relations with countries like China and India. This is creating a lot of uncertainty in the tech space.

Lessons from Cybersyn

Magis • 227 implied HN points • 23 Dec 24

💼 Business Startups Data Economics Innovation Market Trends

Starting a data company can be really challenging because it takes a lot of time and money to create useful products. It’s hard to find customers who are ready to pay for insights quickly.
Big companies have valuable data but making deals can be tough. You often have to convince them to sell data at a good price while also showing them the benefits of monetizing it.
The shift in the market towards valuing profits over growth made it harder to raise funds for data startups. Sometimes, it might be smarter to shut down a project to save capital instead of pushing forward with uncertain outcomes.

The Hidden World of Undersea Cables

The Garden of Forking Paths • 2869 implied HN points • 10 Jan 24

🕹 Technology Internet Infrastructure Data Security Geopolitics

The internet largely runs through undersea cables spanning about 900,000 miles, connecting the world in a hidden network.
Early undersea cables were made possible by materials like gutta-percha and played a key role in rapid communication during events like the US Civil War.
Specialized ships lay and repair undersea cables made of fiber optics, and even guard against threats like sharks and sabotage by SCUBA divers.