Hi,
I'm trying to scrape a series of javascript pages. I've created and tested all of the kinds needed for this, including a "Next" kind. Each one tests perfectly. But when I "play" the scrape, it never advances past the first page.
I made the "Next" kind per instructions in the tutorial:I selected "next page" on the first page that I'm interested in scraping, and I created a kind based on that selection. I turned of the select too, manually advanced to the second page, turned the select tool back on, selected "next page" and added it to the kind. When I tested the kind, it did find "next page" on whatever page I happen to be on. But when I hit "play," only data on the first page was captured.
I did change the "repeat" number to the correct number of pages, but instead of advancing through the pages, "play" captures the first page repeatedly.
If anyone has any tips or can steer me toward help on this subject, I'd appreciate it!
J
"Next" kind doesn't advance pages
Re: "Next" kind doesn't advance pages
Have you tried checking the Simulate Click option? Also, see if adding a Wait action of 1000-2000 milliseconds right after the Navigate action helps.
Juan Soldi
The Helium Scraper Team
The Helium Scraper Team