I am using the Helium Scraper GUI and I was wondering how I can dynamically go to web addresses. For example I want to visit the following web addresses:
http://www.nettiauto.com/4739952
http://www.nettiauto.com/4739953
http://www.nettiauto.com/4739954
http://www.nettiauto.com/4739955
http://www.nettiauto.com/4739956
where I am constantly adding 1 to the id number at the end of the URL. Thanks!
Dynamic URL
Re: Dynamic URL
Hi,
Just use the URL Variations premade at File -> Online Premades or at New Action -> Execute Actions Tree -> More... in any actions tree.
Just use the URL Variations premade at File -> Online Premades or at New Action -> Execute Actions Tree -> More... in any actions tree.
Juan Soldi
The Helium Scraper Team
The Helium Scraper Team
Re: Dynamic URL
Hi,
I have a related problem. I want to scrape a supplier's website gathering data on product pages. This works so far, but I really want to get the translations of item name and description as well. So I would go from the generic product detail page www.someurl.com/product.php?artnr=4711 to the variations
www.someurl.com/product.php?artnr=4711&clang=fr
www.someurl.com/product.php?artnr=4711&clang=en
www.someurl.com/product.php?artnr=4711&clang=dt
and extract only title and description there, ideally in the same row.
Any hint
Best regards
I have a related problem. I want to scrape a supplier's website gathering data on product pages. This works so far, but I really want to get the translations of item name and description as well. So I would go from the generic product detail page www.someurl.com/product.php?artnr=4711 to the variations
www.someurl.com/product.php?artnr=4711&clang=fr
www.someurl.com/product.php?artnr=4711&clang=en
www.someurl.com/product.php?artnr=4711&clang=dt
and extract only title and description there, ideally in the same row.
Any hint
Best regards