AI-Powered Instant Textual Feedback on Physiotherapist Student Practical Performance
This study addresses the need for comprehensive feedback in academic physiotherapy programs. Existing methods often fall short of providing coherent feedback using keywords, leaving a gap in evaluating crucial clinical …
Oluwasegun Odesola June 01, 2026 70 views 0 reactions
This study addresses the need for comprehensive feedback in academic physiotherapy programs. Existing methods often fall short of providing coherent feedback using keywords, leaving a gap in evaluating crucial clinical skills. The challenge of producing timely, high-quality feedback based on keywords that evaluate the systematic approach during an open practical exam is notable, given the scant research in this domain. Providing timely feedback is crucial in promoting academic achievement and student success. However, for multifarious reason (e.g. limited teaching recourses), feedback often arrives too late for leaners to act on the feedback and improves learning. Nonetheless, the challenge of providing prompt and detailed feedback to every student consistently proves to be daunting and repetitive task for tutors and examiners.
Context
The process of receiving information from an experienced, teacher, colleagues, superiors, tutor, books, parent and self, etc. regarding performance and improvement concerning a subject matter can be regarded as feedback. In an educational setting, feedback is an essential part of a student's journey towards academic success. Feedback helps students fully develop at every stage of their education, identify areas of strength and growth, and identify what must be done to meet expectations for their level of instruction. Feedback is information given to a student with the aim of closing the performance gap between present performance and the intended outcome. Not only does feedback benefit the student, but it also helps the teacher identify areas of weakness and error in their approach to teaching and communicating the key concepts to the class. Feedback is one of the most powerful influences on learning and achievement, but this impact can be either positive or negative.
Target Audience
physiotherapist students, tutors, examiners, academic institutions with health-related programs
17/20
4Us Score
🏛️ Peer Reviewed
Validation
Education
Category
4Us Problem Worthiness Score
1️⃣ Unworkable
5/5
100%
The challenge of producing timely, high-quality feedback based on keywords that evaluate the systematic approach during an open practical exam is notable, given the scant research in this domain. Nonetheless, the challenge of providing prompt and detailed feedback to every student consistently proves to be daunting and repetitive task for tutors and examiners. For multifarious reason (e.g. limited teaching recourses), feedback often arrives too late for leaners to act on the feedback and improves learning.
Feedback is information given to a student with the aim of closing the performance gap between present performance and the intended outcome. In an educational setting, feedback is an essential part of a student's journey towards academic success. Feedback helps students fully develop at every stage of their education, identify areas of strength and growth, and identify what must be done to meet expectations for their level of instruction. Feedback is one of the most powerful influences on learning and achievement.
Providing timely feedback is crucial in promoting academic achievement and student success. However, for multifarious reason (e.g. limited teaching recourses), feedback often arrives too late for leaners to act on the feedback and improves learning. The most important component of feedback is that it provides specific information regarding the achievement of learning goals.
Existing methods often fall short of providing coherent feedback using keywords, leaving a gap in evaluating crucial clinical skills. The challenge of producing timely, high-quality feedback based on keywords that evaluate the systematic approach during an open practical exam is notable, given the scant research in this domain. This study aims to bridge this gap by introducing an AI-driven, Keyword-Based system design to access student practical performance, thereby optimizing education for physiotherapists.
Total Score: 17/20
(85% on rubric scale)
— Decision:
✅ ACCEPT - Problem worth solving
Evidence Quality
6.8/10
⭐ Tier 1: 3📊 Tier 2: 2📄 Tier 3: 0💬 Tier 4: 0
Methodology
Utilizing a Seq2seq framework with diverse LSTM and attention mechanisms, iAtexF excels in relevance. The iAtexF feedback generation process is in 3 stages. Stage one involves data preparation. Stage two, Recurrent Neural A network (RNN) sequence-to-sequence-based model is set up and trained on input Fm(X) and feedback Y. At stage three an unsupervised method of content summarization was used on the generated feedback from each category from subjective and objective assessment. RNN is the backbone of Seq2seq learning with other parameters like bidirectional RNN, attention mechanism and beam search. When it's come to language model RNN has been proven to be largely effective based on its ability to model variable-length sequences. In this research Long-short-term memory (LSTM) is used, stack LSTM (SRNN) was first used then Bidirectional (BiRNN) with single LSTM. The attention mechanism was then introduced to both.
This study, approved by the relevant authority of a university, utilized a dataset from the Physiotherapy department of School of health and life Sciences, including both undergraduate and postgraduate students. Initial data comprised 1,100 anonymized student records, deemed insufficient for robust analysis. Consequently, senior therapists from various institutions contributed additional feedback based on the same template, enlarging the dataset to 32,616 entries. Combined with 12 ChatGPT-generated responses from OpenAI, the total dataset reached 32,628 entries across five categories: Keywords, Improvement, Read-more, and Feedback. The average feedback word length from senior physiotherapists and ChatGPT feedback are 119 and 104 words respectively while the average tokens are 135 and 122.
iAtexF excels in relevance, achieving a high similarity score of 73% and a ROUGE score of 34%. It surpasses both ChatGPT and experts in providing relevant suggestions (80.7%), maintaining an appropriate tone (86.7%), and ensuring a logical structure order (100%). User experience evaluation of the iAtexF web application yielded a favourable 92% rating, indicating its usability and effectiveness. Evaluation metrics including ROUGE-1 (34.1), ROUGE-2 (10.0), and ROUGE-L (33.0) indicates substantial lexical overlap and semantic alignment with expert feedback. Human-evaluation scores compare feedback from iAtexF, ChatGPT, and specialists, highlighting iAtexF's ability to produce coherent, structurally ordered feedback with superior language choice and tone. Although iAtexF's readability is slightly lower than experts by 1.4%, it excels by 1% in suggestions and 7% in structural order.
Key Findings
'iAtexF achieved a high similarity score of 73% and a ROUGE score of 34%', 'It surpasses both ChatGPT and experts in providing relevant suggestions (80.7%), maintaining an appropriate tone (86.7%), and ensuring a logical structure order (100%)', 'User experience evaluation of the iAtexF web application yielded a favourable 92% rating', 'iAtexF exhibited 8.1% superiority over expert feedback in utilizing positive language', 'Cosine similarity analysis indicated that iAtexF-generated text exhibited a 72% similarity with expert-crafted feedback'
Limitations
Results indicate iAtexF's proficiency in generating coherent and concise feedback, though it may overlook context-specific problems. Despite suboptimal text generation speed, the iAtexF web application received a 92% rating for user experience from a web developer expert.
Validation Status
Current Status
🏛️ Peer Reviewed
— IEEE
Method Selected:🏛️ Publisher Verified — DataIntell validation not required
What this means
🏛️ This research has been externally peer reviewed
✅ DataIntell validation was not required and has not been applied
🎓 Your hard-earned peer-review status is fully respected and displayed
Share your thoughts, ask questions, or provide feedback on this research.
No comments yet. Be the first to share your thoughts!
Oluwasegun Odesola
@segreen
I'm a researcher and data scientist at the intersection of artificial intelligence, algorithmic fairness, Financial and educational technology, with a …
Discussion (0)
No comments yet. Be the first to share your thoughts!