The effectiveness check is an add-on for course-related, non-anonymous follow-up feedback. It is designed to evaluate whether learning was transferred into workplace practice after a course has been completed. The workflow is based on transfer feedback forms and provides dedicated dashboard access for learners and supervisors, supported by reporting for administrators, tutors, and learning managers.
Scope of the feature
The functional scope below reflects implemented standard functionality and later standard enhancements. Tickets with declined status are not considered.
Purpose and functional concept
The effectiveness check extends standard feedback by focusing on the individual learner and, depending on configuration, the associated supervisor. Unlike anonymous course feedback, the effectiveness check is intended to support traceable evaluation of learning transfer, behavioural change, or formal confirmation after training.
The feature is built around transfer feedback forms that are configured for non-anonymous use. These forms are exposed through a dedicated effectiveness check panel and can also be evaluated through specific reports.
-
Supports post-training evaluation on learner level
-
Uses transfer feedback forms as the process backbone
-
Provides dedicated dashboard access for pending and completed actions
-
Enables reporting on submission and review status
-
Can support either comparative feedback workflows or confirmation workflows
Configuration and prerequisites
The effectiveness check requires the dedicated license for effectiveness check feedback. The implemented license concept makes the related settings and functionality available in the system.
The central object for configuration is the transfer feedback form. This template is used to create non-anonymous feedback forms for effectiveness check scenarios.
Prerequisite configuration
Only transfer feedback forms marked for non-anonymous reporting are relevant for the effectiveness check workflow. Supervisor-related actions are only available when the form configuration explicitly supports them and the license is enabled.
The following configuration options were implemented over time:
-
Display of effectiveness checks in dedicated learner and supervisor panels
-
Selection of who is permitted to submit the feedback form
-
Learner-only submission
-
Learner and supervisor submission
-
Learner submission with supervisor confirmation
For supervisor-related workflows, only forms eligible for non-anonymous reporting are shown in the supervisor effectiveness check panel. Depending on configuration, the supervisor can either provide own feedback or review and confirm the learner submission.
Effectiveness specific settings
|
Setting |
What does the setting do? |
|---|---|
|
Display in non-anonymous reports |
The responses provided as part of feedback forms which are marked as available in non anonymous reports are visible together with the name of the person who submitted the responses in the effectiveness check reports. In addition, in order for the learner to be able to view the feedback forms on the learner effectiveness check panel, this option needs to be enabled for the form. |
|
Persons which are permitted to submit a feedback form |
Defines who can provide input for the effectiveness check. The supervisor can either be allowed to submit the feedback himself, review and confirm the feedback submitted by the learner, or no action. Only forms marked as available in non anonymous reports, as well and marked as the ones where the supervisor can either provide feedback or provide a confirmation will be visible in the effectiveness check panel of the supervisor. The feedback provided by the supervisor for a learner’s training activity will be available in the Feedback form report accessible via the Course instruction, as well as in the dedicated Effectiveness check report. Important remark: If only the supervisor is selected, no feedback is sent to the learner. |
Dashboard panel behaviour
The initial standard implementation introduced a dedicated dashboard panel with two operating modes: Learner and Supervisor. Backend setup, API support, panel configuration, permission handling, and UI behaviour were implemented as part of the first delivery.
Learner mode
In learner mode, the panel provides access to relevant effectiveness check forms from the learner’s courses. The learner can work on pending forms and review submitted ones.
-
Displays pending and completed effectiveness checks
-
Shows course and feedback context
-
Supports access to the feedback form from the dashboard
-
Reflects the workflow state of the submission
Subsequent implementation work refined the learner experience, including removal of unnecessary status elements and corrections for display, naming, loading, and review behaviour.
Supervisor mode
Supervisor mode was implemented as a dedicated view for supervisors to process effectiveness checks related to their employees. The panel supports search, filtering, access to learner submissions, and workflow tracking.
-
Displays effectiveness checks relevant to supervised learners
-
Shows whether supervisor action is required
-
Supports opening the learner context and feedback form
-
Separates pending work from historical items
The supervisor access required dedicated backend, database, API, and frontend implementation. It also introduced adjustments to permissions and panel clearances to ensure the supervisor can work with effectiveness checks without requiring regular course access in the same way as the learner.
Supported workflows
1. Learner and supervisor feedback workflow
The original standard workflow allows the learner and, if configured, the supervisor to both contribute to the effectiveness check. In this mode, the supervisor can access the learner-related effectiveness check from the panel, open the form in context, and submit feedback. This submission is available for later review and reporting.
Implemented work covered:
-
Panel-based access to the feedback form for supervisors
-
Frontend and backend support for supervisor submission
-
Database and API support for storing and exposing supervisor responses
-
Comparative review of learner and supervisor answers
2. Learner submission with supervisor confirmation
A confirmation workflow in which the learner submits the effectiveness check and the supervisor does not provide separate answers. Instead, the supervisor reviews the learner input and confirms it, with an optional comment depending on configuration.
When this workflow is useful
This mode is suitable for scenarios in which the supervisor is expected to acknowledge or validate the learner submission rather than complete an additional evaluation.
The implemented confirmation workflow includes:
-
Additional form configuration modes for supervisor approval
-
Status indication in the learner panel, such as pending review and reviewed
-
Visibility of confirmation needs in the supervisor panel
-
Restriction that the supervisor can only review after learner submission
-
Movement of reviewed items from the to-do area to history
-
Report enhancement with supervisor confirmation status
Reporting and analytics
A status report for pending effectiveness checks and an extension of the effectiveness check report is available. This created visibility into open processing steps and submission progress.
The reporting scope includes two major layers:
-
Operational reporting for pending effectiveness checks and workflow status
-
Analytical reporting for evaluating effectiveness check responses
Operational reporting
The status reporting implementation supports tracking of pending effectiveness checks. Later enhancements added review-status information so reporting can distinguish more precisely between learner submission state and supervisor review state.
Analytical reporting
The analytical reporting was significantly expanded with Learning Analytics support. Implemented enhancements added the data basis for effectiveness check analysis and introduced evaluation KPIs for different question types.
These analytical capabilities include:
-
Question-level drill-down pages
-
Average effectiveness score views
-
Trend analysis over time
-
Course comparison views
-
Evaluation support for yes/no, single response, multiple choice, matrix, free text, and arrange questions
-
Configurable discrepancy and threshold-based KPIs