Improving the validity and reliability of authentic assessment in seafarer education and training: a conceptual and practical framework to enhance resulting assessment outcomes

Published on Sep 1, 2017in WMU journal of maritime affairs
· DOI :10.1007/s13437-017-0129-9
Samrat Ghosh5
Estimated H-index: 5
(UTAS: University of Tasmania),
Marcus Bowles8
Estimated H-index: 8
(Deakin University)
+ 1 AuthorsBen Brooks7
Estimated H-index: 7
(UTAS: University of Tasmania)
Past literature on authentic assessment suggests that it provides a far more reliable and valid indicator of outcomes such as higher student engagement, ability to transfer skills to different contexts, multiple evidence of competence, and student performance. This has appeal in seafarer education and training where both students and employers increasingly perceive traditional assessment methods as failing to consistently generate these outcomes. However, this paper argues that improving different aspects of assessment validity and reliability is essentially required to enhance the outcomes identified above. The paper builds on and extends previous work to investigate and develop a conceptual and practical framework that promotes a holistic approach to authentic assessment that provides greater assurances of validity and reliability throughout all stages of assessment within seafarer programs. It also lays the path to future research directions by establishing the agenda to test the practicality of the framework in the authentic assessment of seafarer students and also investigate the impact of students’ perception of increasing authenticity on performance scores in assessment tasks.
  • References (50)
  • Citations (3)
📖 Papers frequently viewed together
6 Citations
1 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Samrat Ghosh (Australian Maritime College)H-Index: 5
#2Marcus Bowles (Australian Maritime College)H-Index: 8
Last. Ben Brooks (Australian Maritime College)H-Index: 7
view all 4 authors...
With the Standards of Training, Certification and Watchkeeping Convention 1995 (STCW’95) moving seafarer training towards outcome-based education (OBE), emphasis has shifted to assessment practices that will allow seafarer students to demonstrate their ability to perform workplace tasks at standards described in the STCW Code. This paper argues that authentic assessment comprising of performance-based tasks applied in real-world and meaningful contexts can provide a holistic approach to competen...
6 CitationsSource
#1Heather McLaughlin (CCCU: Canterbury Christ Church University)H-Index: 10
5 CitationsSource
#1Desiree Hensel (IU: Indiana University)H-Index: 8
#2Leah Stanley (NU: Northwestern University)H-Index: 1
The purpose of this pilot study was to explore student perceptions and outcomes surrounding the use of a labor and delivery simulation as a midterm exam in a maternal-newborn lecture course. An exploratory case study design was used to gain a holistic view of the simulation experience. Data from focus groups, written debriefings, simulation scoring rubrics, student course evaluations, and other course exams were analyzed using Stake’s case study method. Qualitative analysis revealed four themes:...
7 CitationsSource
#1Samrat GhoshH-Index: 5
#2Marcus BowlesH-Index: 8
Last. Benjamin BrooksH-Index: 8
view all 4 authors...
The Standards of Training, Certification and Watchkeeping Convention (STCW) amendments in 1995 intended to improve the knowledge-based training mandate established in STCW’78 by making it outcome-based. This required seafarer students undertake competence assessment (or outcome of training received) to demonstrate their capacity to perform tasks listed in the STCW Code. This necessitates that students direct their learning efforts to the attainment of clearly stated expectations that, typically,...
1 Citations
Contemporary perspectives of higher education endorse a work integrated learning (WIL) approach to curriculum content, delivery and assessment. It is agreed that authenticity in learning relates to real-world experience, however, differentiating and strategically linking WIL provision and facilitation to assessment tasks and collation of authentic student evidence is critical. Irrespective of whether authentic learning tasks can be achieved in the education or workplace settings, the imperative ...
16 Citations
#1Peter Edward Morrissey (UOW: University of Wollongong)H-Index: 1
2 Citations
#1Siti FatonahH-Index: 1
#2PujiatiSuyataH-Index: 1
Last. Zuhdan Kun PrasetyoH-Index: 1
view all 3 authors...
This study aims at developing a model of authentic assessment, which can reveal the students’ creativity and the potential , develop their character and fulfill the requirements of a good assessment. The developed assessment model instrument consists of three kinds: (1) performance assessment, which consists of tasks and assessment rubrics; (2) assessment of the character of the students and its assessment criteria; and (3) assessment questionnaire of the scientific attitude. The problems formul...
3 Citations
#1Patricia Stevens (OU: Ohio University)H-Index: 1
2 Citations
#1Grace McCarthy (UOW: University of Wollongong)H-Index: 11
One of the distinctive characteristics of the millennial generation is the desire for continuous feedback on their performance (Meister & Willyerd, 2010). As Wilson and Gerber (2008) note, millennial students have grown up with video games from which they constantly receive feedback and rewards for achievement, and they continue to seek feedback both in their studies and in the workplace. However, Wilson and Gerber also note that many of these students are prone to overestimate their own perform...
5 Citations
#1Raymond Lister (UTS: University of Technology, Sydney)H-Index: 26
In this paper we describe our use of the criterion-referenced approach to assessment, where the criteria are based upon Bloom’s taxonomy. In our Bloom-based assessments scheme, all students in the class must satisfactorily complete a set of assessment tasks designed to demonstrate competence at the Knowledge and Comprehension levels of Bloom’s taxonomy. Any student who is content with the minimal passing grade need not complete any more assessment items. Other students, who elect to seek a highe...
3 Citations
Cited By3
#1Samrat Ghosh (Australian Maritime College)H-Index: 5
#2Waldemar Daszuta (Australian Maritime College)H-Index: 2
ABSTRACTPast analysis of marine accident investigations has revealed that inadequate risk assessment conducted on board ships lead to maritime accidents. The International Management Code for the S...
#1Santoshi Sengupta (JIIT: Jaypee Institute of Information Technology)H-Index: 4
#2Aarti Sharma (Sharda University)H-Index: 1
Last. Mridul Dharwal (Sharda University)
view all 4 authors...
In the recent times, it has become critical for the shipping companies to manage the diversity of people and gauge the extent to which they experience job resources and exhibit personal resources. The paper analyses if there exists a difference in the job and personal resources across various demographic factors. The comparison of these resources can aid in capitalizing on the human assets by managing diversity in the shipping companies. Analysis of data collected from 351 marine employees revea...
#1AJ James (Australian Maritime College)H-Index: 2
#2Ulf Schriever (Australian Maritime College)H-Index: 3
Last. Sinem Celik Girgin (Australian Maritime College)H-Index: 1
view all 4 authors...
The International Maritime Industry (IMI) is a global web of shipping, connecting all Continents and bringing together mariners from a multitude of national, ethnic and linguistic backgrounds. Wherever humans interact, they communicate in some form or another and the ability to communicate competently is the cornerstone of safety at sea. This paper identifies the growth of English as the lingua franca of the sea, as a framework for the later discussion on current teaching practices. We consider ...