Effectiveness Check Report
This report provides the report executor with a detailed evaluation of the effectiveness check feedback form responses so that he can evaluate the effectiveness of the trainings being conducted.

Effectiveness check Evaluation page

Effectiveness check Question Evaluation page
Key Performance Indicators
The effectiveness check report analyses the following KPIs in the order mentioned.

KPI - Overall average score for all questions on effectiveness by quarter
This KPI shows the average score for all questions on effectiveness (in percentage) by quarter. Average Score is calculated as follows:
Yes/No - (no. of users who have responded yes / total no. of replies) * 100.
Single response - (average value of the responses/highest value) * 100
Multiple choice - (average value of the responses/highest value) * 100
Free text: no. of participants who have responded positive / total no. of replies) * 100.
Matrix: sum of average values of each row / no of rows
For Arrange feedback form question type, average score is n/a.

KPI - Questions with more than 50% discrepancy between supervisor and learner feedback
This KPI displays a count of questions with more than 50% discrepancy between supervisor and learner feedback.

KPI - Supervisor feedback
This KPI displays the number of questions with an average score below 50% reflecting the courses which have not been well-received by the participants and need further improvement.

Visual - Learners feedback
Also the KPI displays the number of single response questions which have received even a single response lower or equal than 20% of the maximum value and thus helps to identify the outliers.

Visual - Questions
This overview displays the question´s name, text, type, published version, no. of addressees (participants (enrolled, in progress, passed, failed, cancelled if response has been submitted) and their supervisor), no. of replies, response rate, avg. response value in % (learner and supervisor combined), avg. response value (supervisor), avg. response value in % (supervisor), avg. response value (learner)
avg. response value in % (learner) and question ID.
Drill-down Page
The drill-down page analyses the following KPIs in the order mentioned.

Feedback question card
This card is shown if the specific question is selected. It displays question text, name, type, minimum value, maximum value, no. of feedback forms, courses, addresses to which have this question has been assigned, no. of replies.

Visual - Courses
This overview displays course templates and courses to which the selected feedback question has been assigned, addresses, no. of replies and if feedback evaluation period is over.

KPI - Average effectiveness score (in %)
This KPI displays the average effectiveness score (in %) given by the learners and supervisors for the selected feedback question.

KPI - Courses with lowest average response score (supervisor + learner)
This KPI displays the courses with lowest average score (in %) given by the learners and supervisors for the selected feedback question.

KPI - Courses with top average response score (supervisor + learner)
This KPI displays the courses with top average score (in %) given by the learners and supervisors for the selected feedback question.

KPI - Average effectiveness score trend
This KPI displays the trend of the combined average score (in %) by the learner and the supervisor compared by the course templates (including versions) for the selected question.

KPI - Results (count of answers)
This KPI displays how many participants have chosen yes and how many have chosen no for the selected Yes/No feedback question and compare it across the courses.

KPI - Results (count of answers)
This KPI displays how many participants have chosen the specific option for single response/multiple choice feedback question and compare it across the courses.

KPI - Results (absolute)
This KPI displays the number of participants who have chosen the respective option in each row of the selected matrix feedback question and compare it across the courses.

KPI - Results (absolute)
This KPI displays the number of participants who have ranked the specific item as first, second and so on for the selected arrange feedback question and compare it across the courses.

Visual - Results details by average rank of option
This KPI displays the highest average rank option for the selected arrange question and compare it across the courses.

Visual - Results details
This KPI displays responses for the selected free-text feedback question and marks it as positive, negative, or neutral and compares it across the courses.

Visual - Overview
This overview displays the course name, response rate, average respondents score, discrepancy in score (learner vs supervisor), average score (supervisor), average % score (supervisor), average score (learner), average % score (learner), course card.
Metrics
The effectiveness check report allows filtering the report results by the following metrics in the listed order.

Metric - Feedback submission period
This metric filters the report by the desired feedback submission period when the feedback form was submitted. The default time period is 6 months.

Metric - Feedback templates and feedbacks
This metric lists all feedback form templates and feedback forms assigned to the courses the reporter has access rights. The selection of a feedback form template also selects all listed feedback forms of that template.

Metric - Feedback evaluation period is over
When the “Feedback evaluation period is over” is selected, only the questions from the feedback forms assigned to date-dependent courses for which the feedback evaluation period is over are considered.
N/A is shown in case no such feedback question is available.

Metric - Course templates and courses
This metric list all courses the reporter has access rights and their course templates. The choice of a course template also selects all listed courses of that template.

Metric - Learning mode
This metric list all learning modes assigned to the courses the reporter has access rights.

Metric - Providers
This metric lists all providers assigned to the courses the reporter has access rights.

Metric - Tutors
This metric lists all tutors who have been assigned the tutor role in the course template and courses the reporter has access rights.

Metric - Classifications
This metric filters the report by the desired classification assigned to the feedback form question belonging to the effectiveness check feedback form of the courses the user has access to.