Edit the questions.csv file in the plugin directory. Format is question id,question category,question text. Questions can be input in any order, but you must have the same number of questions in each category.
Disable and re-enable the plugin. This will purge the old questions and load the new ones.