Scraper: How can I do pagination on a page where there’s no next button?

A workaround you can try (which depends on the page) is to build your workflow based on a pattern of the URL's.


In the case of Linkedin Job search for instance, there's a pattern in the url's


Page 1: https://www.linkedin.com/jobs/search/?geoId=100876405&keywords=product&location=Colombia
Page 2: https://www.linkedin.com/jobs/search/?geoId=100876405&keywords=product&location=Colombia&start=25
Page 3: https://www.linkedin.com/jobs/search/?geoId=100876405&keywords=product&location=Colombia&start=50
Page 4 +: just add +25 to each URL


The workaround would be:
Do a google sheet very quickly and "build those urls"


Run a "scrape data on the background for URLs" action on those Urls.

Learn about data enrichment in this Youtube Tutorial: Data Enrichment & Scrape data in the background

You can also vote for this canny item to solve cases like these, at: https://bardeen.canny.io/features/p/select-next-pagination-button-when-theres-no-next-button


Now, there's some chases that don't have a URL pattern.

What you can do in those cases is to run the "Scrape data on active tab" on each page and paginate manually.

get bardeen

Don't just connect your apps, automate them.

200,000+ users and counting use Bardeen to eliminate repetitive tasks

Effortless setup
AI powered workflows
Free to use
Little Rocket Ship

Launch your productivity boost today.

By clicking “Accept”, you agree to the storing of cookies. View our Privacy Policy for more information.