Scraper: How can I do pagination on a page where there’s no next button?

A workaround you can try (which depends on the page) is to build your workflow based on a pattern of the URL's.


In the case of Linkedin Job search for instance, there's a pattern in the url's


Page 1: https://www.linkedin.com/jobs/search/?geoId=100876405&keywords=product&location=Colombia
Page 2: https://www.linkedin.com/jobs/search/?geoId=100876405&keywords=product&location=Colombia&start=25
Page 3: https://www.linkedin.com/jobs/search/?geoId=100876405&keywords=product&location=Colombia&start=50
Page 4 +: just add +25 to each URL


The workaround would be:
Do a google sheet very quickly and "build those urls"


Run a "scrape data on the background for URLs" action on those Urls.

Learn about data enrichment in this Youtube Tutorial: Data Enrichment & Scrape data in the background

You can also vote for this canny item to solve cases like these, at: https://bardeen.canny.io/features/p/select-next-pagination-button-when-theres-no-next-button


Now, there's some chases that don't have a URL pattern.

What you can do in those cases is to run the "Scrape data on active tab" on each page and paginate manually.

Little Rocket Ship

Launch your productivity boost today.

By clicking “Accept All Cookies”, you agree to the storing of cookies. View our Privacy Policy for more information.