How to scrape Legue Of Legends summoner ranking data, with Portia?

148 Views Asked by At

Hi everyone. My thesis project is about e-sport behavior analytics. I have limited programming and data engineer skills.

  • I have a list of summoner names (the participants of the study)
  • I try to scrape their ranking data from pages like "lolking.net"
    • there are different seasons (S1, S2 ...)
    • rank medal is marked by a .png, not a number or text. (this is the biggest issue)

Lets see this with an example: [sry for the big picture link, aim not allowed to embed]

Here is a picture of a summoner profile, and the items containing the information. I need,the main medal shows the actual Seasion (S7) rank picture (bronze_1). But there is hidden items also, which shows after clicking to the button marked by the arrow. After this the the HTML source, and the desired output

The desired output is like:

SUMMONER NAME;S1rank;S2rank;S3rank;S4rank;S5rank;S6rank;S7rank Shadowhuner;NA;NA;NA,NA;bronze_5;silver4;silver_2;bronze_1

Good people of StackOverflow, please help me to build this spider! My specific issue:

How to address the selectors to the ranking data in Portia?

  • remember: there are hidden, or sometimes not, depending on the summoner's play history. (basically: when they started to play)
0

There are 0 best solutions below