Helium Scraper

Here's how to use the login premade. If that doesn't work, this is how to use the fill form wizard to login.

You can use this premade to login. That works on most sites since it detects the login form like a password manager, but if that fails then it's just a matter of filling up the form like you'd fill up any other form. See here for an example on how to fill up a form. As for logging out, not sure if y...

There are pages where the content won't load until we scroll down to where the content is located, and scrolling all the way to the bottom of the page at once sometimes fails to load the content. This premade scrolls slowly to the bottom of the page so all content is loaded. It takes a speed argumen...

Have you tried using Gather.Link? If that doesn't work then it's probably a JavaScript button and that'll depend on the particular implementation so I'd need to see the actual page.

Hi Ed,

No sure what you mean by Java Linking Data. Are you trying to grab info from a web request? Can you send a sample URL?

Core.ToBoolean just parses a "true" or "false" value into a boolean, so it won't work with empty strings. But you can write your own function using String.IsMatch and the negation operator. The following will return false when the string is empty and true when not: function (text) not · String.IsMa...

You could start by importing this premade from the wizard. Just right click Project Explorer -> Globals -> Import Premade and visit the premade page. Then you'll be asked for a global name (you can just keep the default), and a selector and gatherer. For the gatherer, just use Gather.Text and as a s...

To use this template, place it on an empty folder and open it with Helium Scraper 3. Check this video for a quick walkthrough. The template has two globals that extract different pieces of information: ProductLinks : This global extracts top-level information without visiting any actual product page...

All scrolling functions scroll the currently selected element, which defaults to the whole page. So if you select the scrollable element it will scroll that element instead of the whole page: Select.ScrollableElement InfiniteScroll · Select.ListItem · 1000 · true To select the scrollable element, ju...

We've just updated Common Crawler to include the Sequence.WriteFile function. If you don't get an update prompt, this may be because we've migrated the publish location to AWS. If so, just uninstall it and reinstall it from here . Once you have the latest version (3.2.4.9) you can do this to save th...