In our Defence Force, The Army Logistic Training Centre (ALTC) consists of a number of Training Establishments that deliver trade and career courses for ADF officers and soldiers for technical trade, specialist health, logistics, and military transport training.
The Workforce and Training Group required an evaluation workforce to deliver workplace training evaluation under the SADL framework in order to continually update and improve its training outcomes.
The ADF has developed a learning systems framework that applies the ADDIE (Analyse, Design, Develop, Implement, and Evaluate) educational model, through the Systems Approach to Defence Learning or SADL, specific to the requirements of the defence environment. Systematiq has a team of specialists, most of whom have a defence background, who provide each of the phases, depending on our client’s requirements.
Workplace evaluation team uplift
ALTC needed to place greater emphasis on evaluating its training innovation, to ensure it is continually refined to support Army’s needs to achieving a Future Ready Training System (FRTS).
Due to the lack of resourcing internally, ALTC looked to an external provider for the workforce and expertise to deliver the evaluation work.
Systematiq mobilises a team of specialists
Systematiq mobilised a team to work almost entirely remotely, utilising technology-driven solutions to integrate with the client and stay engaged through the process. The team worked closely with the Workforce and Training Group to evaluate courses spanning trade, career officer courses, and soldiers for technical trade, specialist health, logistics and military transport training.
The training delivery methods included face to face, e-Learning, distance learning and blended learning. Training environments included classroom, online, workplace, and in the field, dependent on the course.
Maj. Zane Lindsay, ALTC SO2 Training Futures, commented on Systematiq’s ability to adapt in challenging circumstances: “One of the impressive aspects of working with Systematiq is the flexibility demonstrated when negotiating project outcomes within a resource constrained environment.
Data gathering delivers evaluation outcomes
ADF Learning Management Packages (LMPs) for each course containing the course curriculum were evaluated, including learning and assessment information, learning review and evaluation strategies.
The purpose of the workplace evaluation was to determine the effectiveness of the learning solution for each course in relation to application within the workplace and how well it was meeting the workplace performance requirements. This is achieved through a range of data collection methods including desk-top research, questionnaire distributed to the target population of graduates and their supervisors via the in-service electronic survey program, interview, and focus groups if required.
Data was gathered, systematically reviewed, and analysed to derive conclusions. Evaluation outcomes were reported by Systematiq via a report and decision brief for each evaluation provided to relevant stakeholders.
Training outcomes improve performance
This evaluation work improves our war fighters’ preparation by ensuring that training remains effective in addressing workplace performance requirements. It also ensures that training continues to modernise to reflect changing force structures and the contemporary operating environment.
Maj. Lindsay praised the Systematiq Training Evaluation team: “I have been consistently impressed with Systematiq’s reporting and contract management processes. These are always high quality and on time, and the team is consistently proactive, responsive, and flexible when working with Defence staff to generate outcomes. The team’s capacity to build, foster, and maintain relationships with stakeholders in Defence is a key component of our combined success. Systematiq’s commitment to collaboration, communication, and consistency has been outstanding.”
At the time of writing, Systematiq’s contract has been extended to continue to deliver training evaluation across a broader range of ALTC training courses.