| Proposal Type: | Symposium |
|---|---|
| Domain: | Assessment and Evaluation |
| SIG: | Higher Education |
| Scheduling category: | Assessment of Competence |
| Type | Submitted Symposium |
| Title | Assessing vocational competence in higher education: Comparing different methods throughout Europe |
| Abstract | Social scientists and governments throughout Each paper focuses on a different method of assessing competence. Stenstrom investigates the use of skills demonstration at the workplace as part of Finnish vocational programmes, in which the cooperation between education and working life plays a central role. Braun measures competence development by means of a self-report questionnaire and studies the relationship between teachers’ approaches and students’ self-reported competence. Bieri and Schuler focus on an assessment centre as part of a selection process for teacher education and study the relationship between self-ratings and ratings given by others. Finally, Baartman and De Bruijn present a literature study into the integration processes underlying competence development, distinguishing between integration between different types of knowledge, acquired in different learning situations such as school and work, and connected with skills and attitudes.
|
| Equipment |
Computer and data projector / beamer |
| Keywords | Assessment of Competence Higher education Vocational education |
| Chairperson list | |||||
|---|---|---|---|---|---|
| First Name | Last Name/Surname | Institution | Country | EARLI Number | |
| Liesbeth | Baartman | Utrecht University | Netherlands | l.k.j.baartman@uu.nl | |
| Organiser list | |||||
|---|---|---|---|---|---|
| First Name | Last Name/Surname | Institution | Country | EARLI Number | |
| Liesbeth | Baartman | Utrecht University | Netherlands | l.k.j.baartman@uu.nl | |
| Edith | Braun | Freie Universitaet Berlin | Germany | edith.braun@fu-berlin.de | |
| Discussant list | |||||
|---|---|---|---|---|---|
| First Name | Last Name/Surname | Institution | Country | EARLI Number | |
| David | Gijbels | University of Antwerp | Belgium | david.gijbels@ua.ac.be | |
| Paper Details |
|---|
| Paper type | Empirical |
|---|---|
| Title | Assessment of Competence through Skills Demonstrations at the Workplace |
| Abstract | In |
| Summary | Aims Data and Methods Findings Conclusion Theoretical and Educational Significance References Birenbaum, M. (1996). Assessment 2000: Towards a pluralistic approach to assessment. Teoksessa M. Birenbaum & F. Dochy (Eds.), Alternatives in assessment of achievement, learning processes and prior learning. Birenbaum, M. & Dochy, F. (1996). Introduction. In M. Birenbaum & F. Dochy (Eds.), Alternatives in assessment of achievements, learning processes and prior learning. Eraut, M. (2004). Transfer of knowledge between education and workplace settings. In H. Rainbird, A. Fuller & A. Munro (Eds.), Workplace learning in context (pp. 201-221). Eraut, M., Steadman, S., Trill, J., & Parker, J. (1996). The assessment of NVQs. (Research Report No. 4). Brighton: Kinnunen, E. (2005). Targets and criteria of assessment. In Kinnunen, E. & Halmevuo, T. (Eds.), Student assessment guide for vocational education and training (pp. 66-76). Stenström, M-L., & Laine, K. (Eds.) (2006). Quality and practice in assessment: New approaches in work-related learning. Jyväskylä: Stenström, M-L., Laine, K. & Kurvonen, L. (2006). Practice-oriented assessment in Finnish VET - Towards quality assurance through vocational skills demonstrations. In M-L. Stenström & K. Laine (Eds.), Quality and practice in assessment: New approaches in work-related learning (pp. 89-120). Jyväskylä: Wolf, A. (1995). Competence-based assessment. Bury St |
| Keywords | Assessment of Competence Collaboration Vocational education |
| Appendices | Symposium assessment_Stenstrom_Figure 1.jpg |
| Authors | ||||||
|---|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | Presenting | |
| Marja-Leena | Marja-Leena Stenstrom | University of Jyvaskyla | Finland | Marja-Leena.Stenstrom@ktl.jyu.fi | * | |
| Paper type | Empirical |
|---|---|
| Title | Assessing Students’ Competence by Means of Self-report Questionnaire and the Influence of Teachers’ Conceptions of Learning |
| Abstract | Supporting students’ gain in vocational competences will become a main task in higher education – against the background of the Bologna Process. Our research uses a self-report questionnaire, the HEsaCom (Braun & Leidner) to ask students about their subjective gain in vocational competence. We relate these outcomes to teaching variables, to identify variables that are responsible for students’ view of gain in competences. Therefore, 451 students were asked about their gain in vocational competences using the HEsaCom, and 68 lecturers were surveyed about their approaches to teaching (using Prosser and Trigwell’s ATI) and their applied teaching techniques. Our results show that students report higher gains in competence when their teachers’ conceptions of learning are more student-focused. Given that prerequisite, the students rate a higher increase in factual and vocational competences. Furthermore, specific teaching techniques are recognized as having a positive influence on students’ reported gain in competences. In academic courses in which interactive techniques were applied, students report more development in competences. Again, the use of techniques depends on lecturers’ approach to teaching. We conclude that teachers’ conceptions of learning are highly powerful in influencing students’ competence development. |
| Summary | Aims Students’ quantitative and qualitative gain in vocational competences seems to be dependent on their teachers’ approach on learning, and the use of specific teachings techniques is highly probable moderated by teachers’ approach. Therefore we want to investigate the complex interaction between students’ view on their gain in competences, teachers’ approach to learning and the used didactic techniques. Data and Methods Findings Theoretical and Educational Significance References Braun, E., & Leidner, B. (in press). Theoretical and empirical distinctions between self-rated gain in competences and satisfaction with teaching behaviour within academic course evaluation. European Psychologist. Coatsworth, J. D., & Masten, A. (1998). The Development of Competence in Favorable and Unfavorable Environments: Lessons from Research on Successful Children. American Psychologist, 53, 205-220. Gijbels, D., Van de Watering, G., Dochy, F., & Van den Bossche, P. (2006). New learning environments and constructivism: The students' perspective. Instructional Science, 34, 213-226. Prosser, M., & Trigwell, K. (2006). Confirmatory factor analysis of the Approaches to Teaching Inventory. British Journal of Educational Psychology, 76, 405-419. Trigwell, K., Prosser, M., & Waterhouse, F. (1999). Relations between Teachers’ Approaches to Teaching and Students’ Approaches to Learning. Higher Education, 37, 57–70. Weinert, F.E. (2001). Concept of competence: A conceptual clarification. In D. Rychen & L Salganik (Eds.), Defining and selecting key competencies (p. 17-31). Goettingen: Hogrefe. Wentzel, K.R. (1999). Social?motivational processes and interpersonal relationships: Implications for understanding students' academic success. Journal of Educational Psychology, 91, 76-97. |
| Keywords | Assessment of Competence Higher education Instructional Strategies |
| Appendices | |
| Authors | ||||||
|---|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | Presenting | |
| Edith | Braun | Freie Universitaet Berlin | Germany | edith.braun@fu-berlin.de | * | |
| Paper type | Empirical |
|---|---|
| Title | Assessing Future Teachers’ Competence in an Assessment Centre |
| Abstract | There is an increasing interest in teachers’ cross-curricular competencies as a result of reforms in teacher training and the Bologna Process. Teachers need a variety of social skills in order to succeed in their professional career. At the |
| Summary | Aims Data and methods Findings Theoretical and educational significance References Darling-Hammond, L. & Bransford, J. (2005). Preparing teachers for a changing world. What teachers should learn and be able to do. Jossey Bass: Frey, A. (2004). Die Kompetenzstruktur von Studierenden des Lehrerberufs. Zeitschrift für Pädagogik, 50 (6), 903-925. Herzog, W. (2002). Zeitgemässe Erziehung. Weilerswist: Velsbrück. Kleinmann, M. (1997). Assessment Center. Stand der Forschung – Konsequenzen für die Praxis. Göttingen: Verlag für angewandte Psychologie. Märki, A. (2006). Internetgestützte Laufbahnberatung bei angehenden Schweizer Lehrpersonen. Beiträge zur Lehrerbildung, 25, 132-134. Mayr, J. (2001). Career Counselling for Teachers. Context - European Education Magazine. No. 25, p. 11. Schaarschmidt, U. (2004). Halbtagsjobber? Psychische Gesundheit im Lehrberuf. Weinheim: Beltz. Terhart, E. (2003). Reform der Lehrerbildung: Chancen und Risiken. In I. Gogolin & R. Tippelt (Hrsg.), Innovation durch Bildung (S. 163-180). Opladen: Leske und Budrich. Thornton, G.C. & Rupp, D. (2006). Assessment Centers in human resource management. Strategies for prediction, diagnosis and development. |
| Keywords | Assessment of Competence Higher education Initial Teacher Education (Pre service) |
| Appendices | |
| Authors | ||||||
|---|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | Presenting | |
| Christine | Bieri | Padagogische Hochschule Zurich | Switzerland | Christine.bieri@phzh.ch | * | |
| Patricia | Schuler | Padagogische Hochschule Zurich | Switzerland | patricia.schuler@phzh.ch | ||
| Paper type | Theoretical |
|---|---|
| Title | Assessing Vocational Competence Aimed at the Integration of Knowledge, Skills and Attitudes |
| Abstract | Adequate assessments are needed to assess competence development, the integration processes of knowledge, skills and attitudes. However, it is not clear what these integration processes actually pertain and how they develop. Therefore, this paper conceptualises integration in three different processes: (1) integration between different types of knowledge (knowing that and how), (2) integration between knowledge acquired in different learning situations, and (3) integration between knowledge, skills and attitudes. Based on a literature study, the three integration processes are described, and different assessment methods are proposed to assess integration processes: a video task with reflective questions, concept maps, stimulated recall interviews and think aloud tasks, and performance assessments. Together, these assessment methods are thought to enable the elicitation of integration processes in vocational education students. |
| Summary | Aims Conceptualising integration Proposed assessment methods Theoretical and educational significance References Anderson, J. R., & Schunn, C.D. (2000). Implications of ACT-R learning theory: no magic bullets. In: R. Glaser (Ed.), Advances in Instructional Psychology. London: Lawrence Erlbaum. Baartman, L.K.J., Bastiaens, T.J., Kirschner, P.A., & Van der Vleuten, C.P.M. (2007). Evaluating assessment quality in competence-based education: A qualitative comparison of two frameworks. Educational Research Review, 2, 114-129. Beardsley, L., Cogan-Drew, D., & Olivero, F. (2007). VideoPaper: Bridging research and practice for pre-service and experienced teachers. Paper presented at the EARLI, Benjafield, J.G. (1992). Cognition. Engeström, Y., Engestrom, R., & Karkkainen, M. (1995). Polycontextuality and boundary crossing in expert cognition: learning and problem solving in complex work activities. Learning and Instruction, 5, 319-336. Eraut, M. (1994). Developing professional knowledge and competence. Lizzio, A., & Wilson, K. (2004). Action learning in higher education: an investigation of its potential to develop professional capability. Studies in Higher Education, 29, 469-488. Meijer, P., Verloop, N., & Beijaard, D. (2002). Multi-method triagulation in a qualitative study on teachers’ practical knowledge: An attempt to increase internal validity. Quality & Quantity, 36, 145-167. Van der Sanden, J.M.M. (2004). Ergens goed in worden. Naar leerzame loopbanen in het beroepsonderwijs. Oratie 12 maart 2004, Fontys Pedagogisch Technische Hogeschool, Eindhoven, The Netherlands. Vosniadou, S. (2007). The cognitive-situative divide and the problem of conceptual change. Educational Psychologist, 42, 55-66. |
| Keywords | Assessment of Competence Learning theory Vocational education |
| Appendices | |
| Authors | ||||||
|---|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | Presenting | |
| Liesbeth | Baartman | Utrecht University | Netherlands | l.k.j.baartman@uu.nl | * | |
| Elly | de Bruijn | Utrecht University | Netherlands | E.deBruijn@uu.n | ||

