Question

Using Ruby's Anemone Gem to Scrape All Email Addresses From a Site

score 218 · Answer 1 · 2017-04-20T00:29:45.757000

218

Views

Using Ruby's Anemone Gem to Scrape All Email Addresses From a Site

Published on 20 April 2017 at 00:29

score 98 · Answer 2 · 2016-10-19T14:21:10.717000

98

Views

Anemone Crawler skip_links_like not obeyed

Published on 19 October 2016 at 14:21

score 853 · Answer 3 · 2016-09-27T10:00:49.367000

853

Views

Anemone - NoMethodError: undefined method `xpath' for nil:NilClass

Published on 27 September 2016 at 10:00

score 737 · Answer 4 · 2016-04-16T07:26:41.680000

737

Views

Crawl page which requires login with Anemone

Published on 16 April 2016 at 07:26

score 81 · Answer 5 · 2015-08-28T15:34:34.237000

81

Views

gems/anemone-0.7.2/lib/anemone/storage.rb:28:in `MongoDB': uninitialized constant Mongo::Connection (NameError)

Published on 28 August 2015 at 15:34

score 580 · Answer 6 · 2014-09-14T05:22:39.840000

580

Views

character class has duplicated range:/ regular expression of email/

Published on 14 September 2014 at 05:22

score 321 · Answer 7 · 2014-04-25T11:33:07.340000

321

Views

break statement in loop not working

Published on 25 April 2014 at 11:33

score 105 · Answer 8 · 2014-03-26T12:02:24.253000

105

Views

Ruby open_uri always 404. (allow https redirects git version)

Published on 26 March 2014 at 12:02

score 687 · Answer 9 · 2013-11-15T10:21:34.923000

687

Views

Prevent fake analytics statistics with custom crawler

Published on 15 November 2013 at 10:21

score 184 · Answer 10 · 2013-10-23T11:55:32.610000

184

Views

Anemone Ruby spider - create key value array without domain name

Published on 23 October 2013 at 11:55

score 1.4k · Answer 11 · 2013-10-11T05:32:17.437000

1.4k

Views

web crawler in rails,how to crawl all pages of the site

Published on 11 October 2013 at 05:32

score 1.5k · Answer 12 · 2013-10-03T09:57:19.150000

1.5k

Views

Writing the output of loop into a text file from a Ruby web crawler gem

Published on 03 October 2013 at 09:57

score 230 · Answer 13 · 2013-09-08T05:19:27.330000

230

Views

Not able to access page data, using anemone with socksify gem and Tor

Published on 08 September 2013 at 05:19

score 117 · Answer 14 · 2013-09-04T10:02:15.173000

117

Views

Matching URL structures with Anemone

Published on 04 September 2013 at 10:02

score 1.6k · Answer 15 · 2013-09-02T20:35:51.340000

1.6k

Views

How to handle 500 Internal Server Error and 404 Page Not Found with Anemone, Boilerpipe and Nokigiri

Published on 02 September 2013 at 20:35

score 1.3k · Answer 16 · 2013-08-21T20:35:35.140000

1.3k

Views

Getting all URLs using anemone gem (very large site)

Published on 21 August 2013 at 20:35

score 144 · Answer 17 · 2013-08-13T20:47:58.647000

144

Views

How to handle NILs with Anemone / Nokogiri web scraper?

Published on 13 August 2013 at 20:47

score 168 · Answer 18 · 2013-08-01T20:42:40.597000

168

Views

Heroku H12 Request timeout when running Ruby Anemone

Published on 01 August 2013 at 20:42

score 112 · Answer 19 · 2013-06-15T04:41:31.740000

112

Views

When to use 'http://' or 'http://www.' when scraping?

Published on 15 June 2013 at 04:41

score 1k · Answer 20 · 2013-05-30T21:22:01.323000

1k

Views

HTTP Basic Authentication with Anemone Web Spider

Published on 30 May 2013 at 21:22

List Question

Using Ruby's Anemone Gem to Scrape All Email Addresses From a Site

Anemone Crawler skip_links_like not obeyed

Anemone - NoMethodError: undefined method `xpath' for nil:NilClass

Crawl page which requires login with Anemone

gems/anemone-0.7.2/lib/anemone/storage.rb:28:in `MongoDB': uninitialized constant Mongo::Connection (NameError)

character class has duplicated range:/ regular expression of email/

break statement in loop not working

Ruby open_uri always 404. (allow https redirects git version)

Prevent fake analytics statistics with custom crawler

Anemone Ruby spider - create key value array without domain name

web crawler in rails,how to crawl all pages of the site

Writing the output of loop into a text file from a Ruby web crawler gem

Not able to access page data, using anemone with socksify gem and Tor

Matching URL structures with Anemone

How to handle 500 Internal Server Error and 404 Page Not Found with Anemone, Boilerpipe and Nokigiri

Getting all URLs using anemone gem (very large site)

How to handle NILs with Anemone / Nokogiri web scraper?

Heroku H12 Request timeout when running Ruby Anemone

When to use 'http://' or 'http://www.' when scraping?

HTTP Basic Authentication with Anemone Web Spider

Trending Questions

Popular # Hahtags

Popular Questions