Page 1 of 1

Helium Scraper released!

Posted: Tue Oct 04, 2011 7:10 am
by webmaster
This update includes a bunch of new features. Here is a list of the main ones:
  • Redesigned extraction algorithm used by the Extract action to distribute elements among data rows in a way that is coherent with the HTML structure.
  • Added the option (active by default) to add an Id column to extraction tables.
  • Added the ID_{TableName} gatherers that let you extract Id's from other tables.
  • Added the Unique field to the Extract action editor to prevent duplicated elements.
  • Added the Only if modified on option to the Navigate Each action which will cause it to navigate only elements that have been inserted or updated in the specified table during the current extraction process.
  • Can add headers to exported CSV.
  • Added the Custom Export functionality, which let you export data to virtually any kind of document.
  • Kinds can be created and edited manually from an easy to use interface.
  • Kinds and Actions Trees can be moved up and down.
  • Added the Quick Data View feature to quickly see the data in the output tables of Extract actions and automatially create JOINed queries between them.
  • Added SaveToVirtualTree and GetExtractionInfo functions to the GlobalObject and SetCurrentParent function to the NodeObject JavaScript objects.
  • Added the Gatherers function to ProjectObject JavaScript object.
  • Limited gatherers available when setting up an Extract action to the ones selected as Extraction gatherers. These gatheres can be selected from the Select Property Gatherers button in the Project -> Options menu item.
  • Added the Auto data type, which is a text data type that increments its capacity as necessary.
  • Every new project comes with a BODY kind by default that selects the BODY element in any page.
  • Added window.location to auto complete in JavaScript editor.
  • Tabs can be moved left and right.
Many of these new features might seem confusing at the beginning. I've uploaded a couple of videos to the blog where you can see the ID_{TableName} and the Custom Export features in action.

Re: Helium Scraper released!

Posted: Tue Oct 25, 2011 4:56 pm
by rmbraaten
Keeps getting better and better. I love it. These relational database type features (linking multiple tables via table IDs) are terrific. Thanks for the videos. Very helpful.