Empirical evidence from two cases
Online supplementary material
Survey questionnaire to assess student readiness-level (translated from Danish)
Please state to what degree you have experience with the following research designs, e.g., through a project where you used it, learning about it through classes or in your student job.
| Not at all | To a small extent | To some extent | To a high extent | To a very high extent | Don't know | |
|---|---|---|---|---|---|---|
| Experimental studies (e.g., RCT, quasi experiments, pre and post measurements) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Cross sectional studies (measuring only once, often through surveys) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Time series studies (multiple measurements over time, qualitative or quantitative) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Comparative case studies (comparison of two or more cases) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Single case studies (in depth examination of one case, e.g., an organisation) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
Please state to what degree you have experience with the following methods, e.g., through a project where you used it, learning about it through classes or in your student job.
| Not at all | To a small extent | To some extent | To a high extent | To a very high extent | Don't know | |
|---|---|---|---|---|---|---|
| Interviews (e.g., individual, expert, focus group) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Document study (searching and collecting) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Observation | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Analysis of interviews | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Analysis of documents | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Sample strategy | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Surveys | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Descriptive statistics of one variable (e.g., mean, median, etc.) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Statistical analysis of correlation between two variables (e.g., cross tables, Chi2) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Statistical analysis of more variables (e.g., linear regression) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
Please state whether you agree or disagree with the following statement for each method: “I feel well equipped to use this method”.
| Completely disagree | Partly disagree | Neither / or | Partly agree | Completely agree | Don't know | |
|---|---|---|---|---|---|---|
| Interviews (e.g., individual, expert, focus group) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Document study (searching and collecting) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Observation | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Analysis of interviews | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Analysis of documents | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Sample strategy | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Surveys | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Descriptive statistics of one variable (e.g., mean, median, etc.) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Statistical analysis of correlation between two variables (e.g., cross tables, Chi2) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Statistical analysis of more variables (e.g., linear regression) | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
To what degree do you have experience with the following programmes:
| Not at all | To a small extent | To some extent | To a high extent | To a very high extent | Don't know | |
|---|---|---|---|---|---|---|
| SPSS | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| nVivo | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
| Peergrade | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ | (6) ❑ |
And now for the final question. To what degree do you have experience with the following learning activities:
| Not at all | To a small extent | To some extent | To a high extent | To a very high extent | |
|---|---|---|---|---|---|
| Group exercises | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ |
| Lectures | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ |
| Individual exercises | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ |
| Student presentations | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ |
| Reading texts in English | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ |
| Giving feedback to other students | (1) ❑ | (2) ❑ | (3) ❑ | (4) ❑ | (5) ❑ |
Rubric for peer-evaluation
S1
Overall evaluation
Q1 Text
What are positive aspects of this project?
Response
Q2 Text
What are the main areas for improvement?
Response
Q3 Text
Comment on the quality of the suggested research question. Consider:
Clarity
Is it possible to answer the question with a project like this?
Does the question fit the context of this semester project?
Response
Q4 Text
Suggestions for improvement?
Q5 Text
Comment on the the suggested theory. Consider:
Relevancy
Fit with research question
Response
Q6 Text
Suggestions for improvement?
Response
Q7 Text
Comment on the the suggested methods. Consider:
Relevancy
Fit with research question
Response
Q8 Text
Suggestions for improvement?