Check links on external websites?

Question

I need to check reciprocal links on external websites - are the best options webrat or capybara in a Rails app? Or something else?

Users will submit the URL of the page where the link back to us has been placed, so we don't need a crawl of the whole site, just the page that is submitted.

Answer 1

For typical HTML parsing, use Nokogiri.