Product Updates — August 2026

Two new scrapers, six upgrades, and runs that come back from the dead. 🧟

LinkedIn Jobs and YouTube Comments joined the store. One gives you every public job with the salary split into real numbers. The other pulls up to 1,100 comments a minute from any video.

Let's get into it. 👇

Update #1 – 2 new scrapers launched 🚀

Two new kinds of data, and neither one needs a login.

Our LinkedIn lineup already covered profiles, companies, posts and Sales Navigator. The job board was the missing piece. YouTube Comments joins the YouTube Channel Scraper, so you can go from a channel to every conversation under its videos.

What launched:

1. LinkedIn Jobs Scraper... 40 data points per job, salaries as real numbers
2. YouTube Comments Scraper... every comment and reply, 650 to 1,100 per minute

LinkedIn Jobs Scraper 💼

Every public LinkedIn job, with the salary split into columns you can actually sort.

Type a keyword and a location, paste a LinkedIn jobs search URL, or drop a single job link. No account sync, no cookies, nothing to get banned.

The smart part is the Newer than filter. It runs inside LinkedIn's own search, so jobs outside your window are never fetched and never billed.

What you can collect:

1. 40 data points per job, with full job details included in the base price
2. Salary as real numbers... min, max, currency and period in their own columns
3. Recruiter name and profile, apply type and company ID
4. Optional company details for 1 extra credit per job
5. Filters for date posted, easy apply, under 10 applicants, distance, job type, experience level and remote
6. $0.5 per 1,000 jobs at scale

Perfect for job market monitoring, talent sourcing, salary benchmarking, and spotting which companies are hiring before you reach out.

YouTube Comments Scraper 💬

Drop a YouTube video URL, get every comment and every reply. No login, no API key.

It's built for monitoring... sort by newest, set Newer than to 24 hours, and only the fresh comments come back.

A pinned creator comment with 1,000+ replies can eat a whole run on its own. So you can skip it, or cap how many replies you take per comment.

What you can collect:

1. 23 data points per comment... text, likes, reply count, date, pinned status and creator heart
2. Author details... handle, channel ID, profile URL, avatar, verified and member badges
3. Sort by top or newest, plus a Newer than filter
4. Replies on or off, with a cap per comment and an option to skip the pinned one
5. 0.5 credits per comment, which is $0.25 per 1,000 at scale

Perfect for audience sentiment analysis, campaign monitoring, competitor content research, and vetting influencers before you sign them.

Update #2 – 6 scrapers got sharper 🛠️

More data, more filters, and a lot less waiting.

Some got new fields, some got new filters, and some just got fast. Google News now pulls 300 articles in 19 seconds, and Twitter User Tweets runs about 8× quicker.

What got sharper:

1. Google News Search Export... topics, sections and a Newer than filter
2. PAP Search Export... 14 new fields, no listing cap, 3× faster
3. Twitter Search Results Scraper... 19 new filters
4. Twitter User Tweets Scraper... the full timeline, about 8× faster
5. YouTube Channel Scraper... videos, Shorts, streams, playlists and comments
6. Immoweb Listings & Phones Scraper... 33 new fields and the full photo gallery

Google News Search Export 📰

Track a whole Google News topic, not just a keyword. And stop waiting on it.

Pick a topic like BUSINESS or TECHNOLOGY, or paste any topic URL from Google News, and you get 100 to 200 fresh articles from it. 300 articles now land in 19 seconds, where 100 used to take 11 and a half minutes.

What's new:

1. Topics and sections... 8 predefined topics, or any topic URL from news.google.com
2. Newer than filter... the last 24 hours, 7 days, 2 weeks, or an exact date
3. Time range and Newer than work together, and the tighter one wins
4. Built for daily tracking... rerun the same topic Squid and only new articles get added

Perfect for daily news monitoring, media and PR tracking, and keeping an eye on your industry.

PAP Search Export 🏠

14 new fields, no more 200-listing cap, and about 3× faster.

The data got a lot cleaner too. Titles and publication dates now come back on every listing, descriptions arrive in full, and photos land as a proper list.

What you can collect:

1. 14 new fields, including price per m², nearby metro and tram stations, virtual tours and full energy ratings
2. Seller signals... exclusive listing, price validated by PAP, seller refuses canvassing
3. Newer than filter to collect only fresh listings
4. Unlimited results... leave max results empty and you get every listing in the search
5. About 3× faster... 3 seconds per listing, down from 11

Perfect for French property market monitoring, prospecting owner listings, and price-per-m² analysis.

Twitter scrapers 🐦

19 new search filters, and full user timelines about 8× faster.

The Twitter Search Results Scraper got filters that don't even exist in X's own advanced search, like minimum engagement and location. The Twitter User Tweets Scraper used to stop around 313 tweets on a thin page. Now it reads the whole timeline, and 400 tweets take 135 seconds where 313 used to take 14 minutes.

Both handle X's rate limits better too, picking back up at the real reset time instead of sitting out a flat hour.

What's new:

1. Search filters... language, verified or Blue users only, images, videos, quotes, author, mentions and replies
2. Location and engagement filters... near a place, within a radius, minimum retweets, likes and replies
3. Sort and dates... Top or Latest, plus a start and end date
4. Tweets inside conversation threads now show up in search results
5. Full user timelines, about 8× faster at roughly 178 tweets a minute, up from 22
6. Exclude reposts works as it should, and retweets link back to the original tweet

Perfect for brand and hashtag monitoring, trend research, and analyzing what competitors and influencers actually post.

YouTube Channel Scraper 📺

Channel info was just the start. Now you get the content too.

Five new toggles pull a channel's videos, Shorts, live streams, playlists and comments alongside its profile. Each reads the first page, around 30 items, and bills once per call instead of once per item.

What you can collect:

1. Videos, Shorts, live streams and playlists, each behind its own toggle
2. Comments on up to 5 of the videos or Shorts collected
3. Everything you already got from the channel profile

Perfect for creator research, influencer vetting, and auditing competitor channels.

Immoweb Listings & Phones Scraper 🏠

33 new fields per listing, and the full photo gallery.

New-build projects now come broken down unit by unit. And dates, EPC, the full gallery and price per m² moved into basic mode, so they no longer need the paid listing details fetch.

What you can collect:

1. New-build project units with price, surface, bedrooms, floor and sale status
2. Energy and legal data... CO2 emissions, heat pump, solar panels, asbestos, electrical and flood certificates
3. Rooms, parking and amenities, plus monthly costs and old price
4. The full photo gallery, around 19 to 21 photos per listing instead of 1 to 4
5. View and bookmark counts, plus the agency website

Perfect for Belgian property market analysis, tracking new-build projects, and agency prospecting.

Update #3 – 6 new app and API features ⚙️

Aborted runs aren't dead, failed tasks don't need a new run, and lobstr.io now lives inside n8n.

If you run Squids with hundreds of tasks, a hiccup no longer costs you the whole run. The rest makes the app easier to live in... a new home page, bonus credits for sharing your story, and a key you can finally rotate.

What's new:

1. Resurrect aborted runs... pick up exactly where the run stopped
2. Retry a single task... rerun one failed task, not the whole run
3. Overview page... your new home in the app
4. Community Story Rewards... bonus credits for sharing how you use lobstr.io
5. n8n integration... an official, verified node
6. API key rotation... on every plan

Resurrect runs and retry single tasks 🔁

An aborted run isn't dead anymore. It's just in a coma.

Before, an aborted run meant re-scraping from task one. Now a Resurrect button picks it back up... finished tasks stay finished, interrupted ones restart, and the rest carry on as if nothing happened.

What's new:

1. Re-scraped rows are free, so a resurrected run costs about the same as if you'd never aborted
2. Same run, same ID, one download with everything in it
3. Tasks you added after the abort get picked up too
4. One-task retries inside the same run, no new launch
5. Both in the API... Resurrect Run and Retry Run Task

A resurrected run keeps the concurrency and enrichment settings it started with. If you aborted to change a setting, launch a fresh run instead.

Overview page 🧭

The app has a new home page, and it tells you what needs your attention.

What's on it:

1. Usage summary... your credits, plus a brand-new API usage summary
2. New feature cards that link straight to where you use each feature
3. Action items... paused Squids, accounts that need a resync, billing issues
4. Recent Squids and runs, and a welcome screen if you haven't built one yet

Community Story Rewards 🎁

Tell people how you use lobstr.io. Get bonus credits worth 20% of your plan.

Share a genuine story on Reddit or LinkedIn, submit the link from your dashboard banner or Overview page, and bonus credits land once we verify it.

How it works:

1. On Reddit... a comment (not a post) that mentions lobstr.io in an eligible subreddit like r/webscraping, r/n8n or r/LeadGeneration, live for at least 3 days
2. On LinkedIn... a standalone post from your real profile covering the problem you had, what you used lobstr.io for, and what changed, with a real number
3. 20% of your plan's monthly credits... 2,000 on Free and Starter, 20,000 on Pro, 200,000 on Team, 400,000 on Business
4. Free plan bonus... your 30-row export cap lifts for 30 days too
5. Once per quarter, and a rejection doesn't burn your quarter
6. Reward credits expire 30 days after they land

n8n integration ⚡

lobstr.io is now an official, verified n8n node.

What you get:

1. Start and Get Results... one node launches a run, waits for it, and hands the rows back as n8n items
2. The lobstr.io node... manage crawlers, Squids, tasks, runs and results from any workflow
3. The lobstr.io Trigger node... fires a workflow when a run finishes, fails, pauses or resumes
4. Webhooks handled for you... registered when you activate the workflow, cleaned up when you deactivate it
5. Works with n8n AI Agents as a tool

You'll need n8n 1.57.0 or newer.

API key rotation 🔑

Leaked your API key? Rotate it in one click, on any plan.

What's new:

1. One-click rotation, with a confirmation first
2. An atomic swap... if anything fails midway, your old key keeps working
3. Your app session survives the rotation
4. Available in the API too, up to 10 rotations an hour

The old key stops working the moment you rotate, so update your scripts, integrations and saved export links right after.