How can I get href attribute from a dynamic link using java?

Question

I am trying to extract dynamic links from this website but couldn't extract them.

But I extracted links i.e., static links successfully from this website

Sample Code:

public class JavaScript {

    public static void main(String[] args) throws IOException {
        Document doc = Jsoup.connect("http://economictimes.indiatimes.com/archive.cms").get();
        Elements links = doc.select("a[href]");
        for (Element element : links) {
            System.out.println(element.attributes());
        }
    }
}

Now I want to extract dynamic links from website i.e., when we click on date it will call a function and generates the link. How can I get those links using JAVA?

Answer 1

Jsoup is an HTML parser. It has no support for Javascript. So it won't be able to run the Javascript code generating dynamic links.

Use one of the solution below (to name a few) to acheive your goal:

• Selenium
• ui4j
• HTMLUnit