Diffbot 🤖 @diffbot

Never write another web scraper. Diffbot structures information from the web, so you don't have to. diffbot.com The Future Joined September 2009

Tweets

2K
Followers

8K
Following

8K
Likes

10K

Diffbot 🤖 @diffbot

3 months ago

@dambuildshit Step 1: Build a free DNS provider Step 2: Collect tolls for access to sites behind their DNS Step 3: Build a crawler that doesn't need to pay their own toll Step 4: Profit

0 0 1 14 0

View Details

The web isn't a database. @diffbot makes it one. 10B+ entities and 1T facts extracted from 60B+ pages, rebuilt every 4-5 days. DuckDuckGo, Snapchat, and Dow Jones run on it. Massive powers the proxy infra behind their continuous crawl.

1 1 3 251 0

View Details

Cheng Lou @_chenglou

3 months ago

Ever wondered what your white name should have been? Introducing: whatismywhitename.com Upload a picture of you, and let the puppy guess your name! Let's test out nominative determinism 🫡 (Immigrants who named themselves will correlate more highly. Give us feedback plz) Our thanks to: - @modal for their generous credits toward training this meme model - @diffbot for the clean, diverse dataset! - @leannch86920 for the training research! - Everyone NOT named David (biggest & noisiest dataset ever)

7 8 62 8K 12

View Details

Diffbot 🤖 @diffbot

4 months ago

@devanshu_twt Sorry! It’s not ideal but it’s the easiest way to weed out 99% of abusers. When the product makes it easy to crawl the web, you get a lot of bad actors. Still thinking of a better way to solve this!

0 0 0 12 0

View Details

Diffbot 🤖 @diffbot

5 months ago

@groby Sorry for the late reply (and happy new years!) It's not on the immediate horizon, but implementing a credit balance model with a low minimum is something we've discussed. I personally prefer it. Would you mind emailing me at jerome[@]diffbot?

0 0 0 18 0

View Details

Jason Grad 🇺🇦 @mrjasongrad

5 months ago

State of E-commerce Data Providers - Q4 2025 E-commerce runs on constant measurement: prices, promos, availability, seller changes, and "what the shelf actually looks like" across retailers and marketplaces. The challenge is stable collection at scale, retries when sites break, anti-bot evasion, clean geo signals, and then turning messy HTML into usable structured data. In preparation for the holiday season, we mapped the landscape of e-commerce data providers: Competitive intel + digital shelf: @dataweavein, @Price2Spy, @bigdataNODE, @Profitero, @WiserInc Marketplace intelligence + data: @junglescout, @H10Software, @datahawkco, @SellerSprite_EN Trade, Supply Chain, Imports / Exports: @Trademo1, @ImportYeti, @datamyne Scraper APIs & Extraction Platforms: @zytedata, @diffbot, @Stratalis, (AutoScraping handle?), @serpapi Managed Data Extraction & Services: @groupBWT, @Data_Ox, @epctex, @MrScraper_ Retail Media & Ad Platforms: @Pacvue, @PerpetuaLabs, @Teikametrics Network & runtime infra for e-com scraping: @playwrightweb, Puppeteer, @browserless

0 1 0 433 2

View Details

Diffbot 🤖 @diffbot

5 months ago

@groby Wish granted. Will a $50 starting plan work?

1 0 0 16 0

View Details

Matthew Cassinelli @mattcassinelli

7 months ago

YouTube, TikTok, Mastodon, & Threads are mostly there but need optimizing. Diffbot goes incredibly far with articles & that’s also moving along well. Reddit & Bluesky are readily available but I haven’t spent the time. X is finished by the endpoint gets rate limited 😞

Matthew Cassinelli @mattcassinelli

7 months ago

I am in love with scraping using Shortcuts. I have about 8 sets of shortcuts for everyday social media sites that I'm developing in tandem. I'll be releasing them as I finish them – thread starts here.

2 2 30 6K 20

1 2 8 3K 6

View Details

Diffbot 🤖 @diffbot

12 months ago

Not Diffbot!

Morning Brew ☕️ @MorningBrew

12 months ago

BREAKING: The Internet Massive outage being reported across platforms including Spotify, Google Cloud, AWS, Cloudflare, Claude, YouTube, Gmail, and many, many, more

477 1K 7K 1.9M 1K

0 0 4 914 3

View Details

Diffbot 🤖 @diffbot

a year ago

A datacenter story...

0 1 4 791 2

View Details

Unstructured @UnstructuredIO

a year ago

San Diego developers, join us and our technical partners @neo4j, @Intuit, Eyepop.ai, @Replit , and @diffbot at our HackNight next week!

Unstructured @UnstructuredIO

a year ago

We're excited to join @neo4j , @Intuit, EyePop.ai, @Replit and @diffbot as technical partners for the upcoming Startup San Diego - FirstWave Innovator HackNight happening Wednesday, February 19th at the Intuit San Diego Campus. This is going to be an epic night

1 0 6 2K 0

1 4 7 2K 0

View Details

Diffbot 🤖 @diffbot

a year ago

Check out the repo for more info: github.com/diffbot/diffbo…

0 0 1 379 1

View Details

Diffbot 🤖 @diffbot

a year ago

89,886 developers are building their own Perplexity on-prem with Diffbot LLM — huggingface.co/diffbot/Llama-…

1 0 1 468 1

View Details

Diffbot 🤖 @diffbot

a year ago

#Perplexity Sonar Pro API launched last week as the best performing model on factuality. 24 hours later, it's the 2nd best performing model (and it's not because of #DeepSeek). Why? 👇

1 0 2 573 3

View Details

Michael Nuñez @MichaelFNunez

a year ago

Diffbot launches open-source AI model that achieves 81% accuracy by querying a trillion-fact Knowledge Graph in real-time instead of relying on static training data 🧠📊 Read more: venturebeat.com/ai/diffbots-ai… #ArtificialIntelligence #Enterprise #MachineLearning @diffbot