Competence Assessment program (CAP) Self-evaluation Survey
 
Dear participant,
 

Thank you for taking the time to complete this survey. The purpose of collecting information is to identify the weaknesses of the current assessment programme so that we can improve it where necessary. 

This survey consists of 12 quality criteria, such as fitness for purpose, reproducibility of decision and transparency... under each criterion, there is one sentence briefly explaining what this criterion means.
For each criterion, 2-3 statements are given for you to judge.

Please let us know how you experienced the assessment methods:


1. to what extent do you agree or disagree with each statement and
2. provide evidence in the space provided. The information you provide will enable us to understand what your judgment is based on.

In case you cannot make a judgment on the statement, please select "don't know"

Below a short explanation on terms used in this questionnaire.


Assessors:
Those evaluating the student, i.e., teachers, counsellors in the field, fellow students and etc.


Assessment task:

The tasks that students perform for the assessment. Assessment tasks may vary, e.g., knowledge tests, reports or projects, assignments during a course, group work, simulated professional practice runs, lab practical examinations, and so on.


Assessment/scoring criteria:
The criteria on which students / assignments are assessed; derived from the competencies.

 

Competence:

Competence commonly defined as a combination of knowledge, skills and attitudes. It refers to two types of abilities:

  1. The ability of an individual to perform a job properly and effectively by integrating theoretical and practical knowledge he/she learnt.
  2. The ability to learn from practical experiences. This ability is especially important. In order to fit in with today’s society which evolves constantly in knowledge, one must construct and reconstruct one's expertise within a life‐long learning process.

 

Judgement:

The decision or opinion on a student’s competences which assessors form based on student’s performance. Such a decision or opinion can be expressed in scores and/or comments.

 

Standards:
Standards are about defined levels of quality of the performed assessment tasks. 

An example (criterion and standard were created for assessing a written assignment)

 

Standard

         

     Criteria

Excellent

4

Good

3

Pass

2

Insufficient

1

Purpose

(Is the writer's focus clear?)

 Establishes  a clear focus and purpose and fulfills the goals of the essay, e.g. to entertain, to inform, to persuade

 Establishes a focus and purpose and stays on the topic very well.

 Attempts to establish  a purpose; focus of writing is not fully clear.

 Purpose and focus need clarification.  What is the writer trying to accomplish? (e.g. to entertain, to inform, to persuade).

.

 

 
Form Login Account (optional)
New Users / Returning Users CLICK HERE to setup or return to your account for this form. Creating an account enables you to return to this form and your submitted results. An account will also enable you to partially complete this form and return later to finish the form. The account you establish is only for this form.
 
This online questionnaire is anonymous. Hence, you are NOT obligated to create a user name using your real name.
You are *

A description of your CAP 🛈
 Assessment methodWhat is assessed? e.g: What competences / knowledge/skills/attitude? )Who assesses? e.g: teacher / experts in the field / fellow students)When/ how often is the assessment? e.g: at the end of course /a few times per courseFor summative or/and formative purpose (s)? e.g: only scores or give individual/group feedback or neither feedback nor score
1.
2.
3.
4.
5.
6.
7.
8.
9.

1. Fitness for purpose

The assessment goals and methods are compatible with the defined course / training  goals.
1. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The assessment tasks not only aimed at knowledge, skills and attitudes separately but also test students' competences (a combination of knowledge, skills and attitudes) through problem solving tasks.
The CAP uses a mix of different assessment forms (e.g. Multiple choice questions, open questions, essay, group work, presentation, portfolio, project, case-study, observation & report, etc.).
1. To what extent do the following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The CAP tests competences (a combination of knowledge, skills and attitudes) through problem solving tasks.
The CAP uses a mix of different assessment forms (e.g. Multiple choice questions, open questions, essay, group work, presentation, portfolio, project, case-study, observation & report, etc.).

2. Reproducibility

A combination of multiple assessors, assessment tasks and assessment situations is used.
2. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The judgment of the competences is done by several assessors.
Multiple assessors assess a student independently.
In case of disagreement, assessors discuss and argue their judgement.
Judgment of the student’s competences is based on the different assessment tasks.
2. To what extent do following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The judgment of the competences is done by several assessors.
Multiple assessors judge your competences independently.
Judgment of your competences is based on different assessment tasks.

3. Transparency

The criteria and standards used by the CAP are clear and understandable to all stakeholders (i.e., students, assessors and external controlling agencies)
3. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
Students know and understand which competences are assessed.
Students know and understand assessment criteria (a property or characteristic by which the quality of something may be judged) and standards (defined level of achievement to be attained).
Teachers know and understand the contents of the assessment tasks, the criteria and procedures used in the CAP.
3. To what extent do the following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
I know and understand which competences are assessed.
I know and understand the assessment criteria (a property or characteristic by which the quality of something may be judged) and standards (defined level of achievement to be attained).
I believe that my teachers know and understand the contents of the assessment tasks, the criteria and procedures used in the CAP.

4. Acceptance

The assessment criteria and how the CAP was carried out are approved by all stakeholders.
4. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
Students agree with the criteria and standards of the assessments.
Teachers approve of the content, criteria and procedures of the CAP.
4. To what extent do the following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
I agree with all communicated criteria and standards on which I was assessed.
I believe that all teachers approve of the contents, criteria and procedures of all types of assessments in the CAP.

5. Comparability

The CAP is conducted in a consistent and responsible way.
5. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The assessment criteria and standards are comparable for all students (e.g., is there a mechanism implemented to ensure all assessors understand and apply the assessment criteria and standards in the same way?)
The assessment tasks are comparable in terms of difficulty level.
5. To what extent do the following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The assessment criteria and standards are comparable for all students.
The assessment tasks are comparable for all students (for instance, in an oral examination, questions are equally difficult for all students) .

6. Fairness

Students get a fair chance to demonstrate their competences.
6. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The assessors are competent in designing and implementing the different assessment methods of their choice.
Students can object to a judgement.

7. Fitness for self-assessment / reflection

The CAP stimulates self-reflection and formulation of personal learning goals by students.
7. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
CAP stimulates students to reflect on their learning process (e.g., they closely monitor their learning progress and change inefficient learning strategies to learn in a more efficient and effective manner.).
CAP promotes students to carry out self- and/or peer-assessment.
Students formulate their personal learning goals based on the results of assessments.
7. To what extent do the following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
CAP stimulates me to reflect on how to learn in a more efficient and effective manner (e.g., closely monitors my learning progress, changing inefficient learning strategies wherever needed, etc.).
CAP promotes me to carry out self- and/or peer-assessments.
I formulate my personal learning goals based on the results of the assessments.

8. Meaningfulness

The CAP generates a good feedback and a learning experience for students as well as to educators (e.g., teachers or tutors).
8. To what extent do the following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The CAP allows the assessors to provide meaningful individual and group feedback.(Do the various assessments provide teachers with the evidence and help them to acknowledge your levels of understanding and skills and enable the teachers to provide relevant and useful feedback to you?)
As a student, I found feedback generated from various assessments useful.
8. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The CAP enables me and other educators to provide meaningful individual and group feedback.
Various assessment methods enabled me and other assessors generate a valid picture of the students' development.

9. Cognitive complexity

CAP enables students to demonstrate different levels of cognitive skills and thinking processes. 
9. To what extent do the following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The CAP requires the level of thinking that is required in the professional context where I will work.
The assessment criteria focus on the learning outcomes (performance) as well as the thinking process in order to reach these outcomes.
The assessment tasks challenge me with new and complex situations.
When accomplishing the assessment tasks we are asked to explain why we made certain choices.
9. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The CAP requires the level of thinking that is required in the professional context.
The assessment criteria focus on the learning outcomes (performance) as well as the thinking process to reach the outcomes.
The assessment tasks confront students with new and complex situations.
When performing the assessment tasks students are asked to explain why they made certain choices.

10. Authenticity

The CAP resembles the future professional (work) context. 
10. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The assessment tasks resemble the future professional tasks.
The assessment criteria are derived from performance levels that professionals have to meet.
The assessors are familiar with the professional challenges students will be facing later (i.e., future professional reality).

11. Educational consequences

The CAP has a positive effects on teaching and learning and the negative effects are minimised. 
11. To what extent do the following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The CAP promotes to adopt effective learning behaviour in preparation for the assessments (e.g., the assessments make me have an analytical mindset, forcing me to be a self-regulated learner, etc).
The CAP helps me to get a good idea of what is needed to be done in a future professional environment.
The CAP promotes the expected teaching behaviour (e.g., rather than only using show & tell style, teachers use interactive teaching methods to involve students in critical thinking and problem-solving because these skills are assessed)
11. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The CAP promotes the desired learning behaviour in preparation for the assessment (e.g., the assessments stimulate students to apply what they learn rather than try to memorize; it induces them to be self-regulated learners).
The CAP helps students to get a firm idea of what is needed in the future professional environment.
The CAP promotes the desired teaching behaviour (for instance, rather than only using show & tell style, I can see myself and other teachers use various ways to involve students in critical thinking and problem-solving because the assessments warrant this)
The results of the assessment are/can be used as a base for curriculum development.

12. Cost-time

The development and implementation of the CAP are feasible in terms of time and cost.
12. To what extent do the following statements apply to your CAP? (for students) *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The students have sufficient means to undertake the assessment tasks.
The assessors are easily able to comfortably implement the CAP in terms of time and cost.
12. To what extent do the following statements apply to your CAP? *
 Strongly AgreeAgreeNeutralDisagreeStrongly DisagreeDon't know
The students have sufficient means to undertake the assessment tasks.
The assessors are easily able to implement the CAP in terms of time and cost.
The CAP is evaluated on a regular basis as to whether it can be done more efficiently.