I have been working with Psiturk, jspsych and Pybossa for a while. After working on each of it, I experienced that Pybossa is doing the same work what Psiturk is doing, except that Psiturk (with GUI interface designed using jspsych) can be used to integrate directly with Amazon Mechanical Turk.
I am new to all these open source platforms and wish to perform the evaluation of micro-tasks. What each of it is doing is storing the data, giving platform to manage the users, and handle the workflow; what I need is to evaluate the results from these experiments to calculate what we call the Cohen's Kappa and Fleiss' Kappa coefficients. How can this be done?