Archives

Resources for online experiments

Software Access What it does Users happy to offer help Tutorials Comments
Qualtrics City provides access Questionnaires; Fairly simple experiments that don’t require timing Tutorials from Stian Reimers: http://www.reimers.co.uk/video/qualtrics/Qualtrics_1.html (and then substitute 1 for numbers 2 to 7 to get all other tutorials)
PsychoPy Free, open source Psychophysics; good control in experiments; allows for a lot of flexibility and variation in experimental design. GUI and code-based options https://www.psychopy.org/documentation.html Paper: https://link.springer.com/article/10.3758%2Fs13428-018-01193-y ; The developer got a grant from the Wellcome Trust to make it online and it’s now working. I (Lucia) saw a demo last year and it looked fantastic, but haven’t used it yet (though I’ve been meaning to…)
lab.js Free, open source Experiments with presentation of stimuli and recording of responses. GUI and code-based options https://labjs.readthedocs.io/en/latest/learn/builder/index.html https://link.springer.com/article/10.3758%2Fs13428-017-0900-z
Testable Commercial. We have a departmental account (no fees, no commissions) until September. Experiments with presentation of stimuli and recording of responses. No coding required as you design experiment in excel Lucia, Ansgar https://www.testable.org/#tutorial They provide department accounts. The Department of Psychology at City has a free account (no fees, no commissions) until September. You need to use you City e-mail. To read in the testable data, you can do so with the two lines
source("http://endress.org/progs/tt.R")
data <- read.testable.results(yourFolder)
where yourFolder is the folder where your data is located.
Gorilla.sc Commercial. Not free, commission for each participant tested Experiments with presentation of stimuli and recording of responses. GUI based. https://gorilla.sc/support/getstarted Lots of people/departments use it and seems very easy. I think they provide department accounts.
Shiny from R Studio Free, open source Haven’t looked at it yet… Please fill in if you know more. Great for interactive graphs. If you need to sequence stimuli with more than one duration per trial, this is somewhat cumbersome (Ansgar) https://shiny.rstudio.com/tutorial/ You may want to check it if you know R
JSPsych Free Haven’t looked at it yet… Please fill in if you know more. I think all experiments need to be code based (javascript) https://www.jspsych.org/overview/timeline/
Meadows Commercial. Not free, commission for each participant tested Experiments with presentation of stimuli and recording of responses. Especially useful for using the multiple arrangement method (i.e. similarity judgments in multidimensional space). I’d say just use it if you want to do this https://www.youtube.com/channel/UCt5oYZFj4CXhW2VKtXithPw
PCIbex for Online Experiments Free Haven’t looked at it yet… Developed for psycho-linguistic experiments. Based on javascript but with with interface https://www.pcibex.net/documentation/
FindingFive Free Haven’t looked at it yet… Please fill in if you know more https://news.findingfive.com/2019/03/26/crash-course-part-1-building-your-study/
PsyToolkit Free Basic script-based experiment builder with its own scripting language. Haven’t looked at it yet… Please fill in if you know more https://www.psytoolkit.org/lessons/project.html
NodeGame Free Javascript based experiment builder with option for multi-participant designs . Haven’t looked at it yet… Please fill in if you know more http://nodegame.org/css_tutorial.htm
LionessLab Free A simple online experiment builder that allows for interactive experiments. Haven’t looked at it yet… Please fill in if you know more https://lioness-doc.readthedocs.io/en/latest/
O-tree Free Python based experiment builder with option for multi-participant designs. Haven’t looked at it yet… Please fill in if you know more https://otree.readthedocs.io/en/latest/
OpenSesame Free Online experiment builder with minimal GUI, using both javascript and python. Haven’t looked at it yet… Please fill in if you know more https://www.youtube.com/playlist?list=PLR-r0edywujcBzCPZGQTmZhUSlg8qaR7h