License: Creative Commons Attribution 4.0 International license (CC BY 4.0)
When quoting this document, please refer to the following
DOI: 10.4230/OASIcs.ICPEC.2023.1
URN: urn:nbn:de:0030-drops-184970
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2023/18497/
Go to the corresponding OASIcs Volume Portal

Santos, André L.

Shifting programming education assessment from exercise outputs toward deeper comprehension (Invited Talk)

pdf-format:
OASIcs-ICPEC-2023-1.pdf (0.4 MB)

Abstract

Practice and assessment in introductory programming courses are typically centered on problems that require students to write code to produce specific outputs. While these exercises are necessary and useful for providing practice and mastering syntax, their solutions may not effectively measure the learners’ real understanding of programming concepts. Misconceptions and knowledge gaps may be hidden under an exercise solution with correct outputs. Furthermore, obtaining answers has never been so easy in the present era of chatbots, so why should we care (much) about the solutions? Learning a skill is a process that requires iteration and failing, where feedback is of utmost importance. A programming exercise is a means to build up reasoning capabilities and strategic knowledge, not an end in itself. It is the process that matters most, not the exercise solution. Assessing if the learning process was effective requires much more than checking outputs.
I advocate that introductory programming learning could benefit from placing more emphasis on assessing learner comprehension, over checking outputs. Does this mean that we should not check if the results are correct? Certainly not, but a significant part of the learning process would focus on assessing and providing feedback regarding the comprehension of the written code and underlying concepts. Automated assessment systems would reflect this shift by comprising evaluation items for such a purpose, with adequate feedback. Achieving this involves numerous challenges and innovative technical approaches. In this talk, I present an overview of past and future work on tools that integrate code comprehension aspects in the process of solving programming exercises.

BibTeX - Entry

@InProceedings{santos:OASIcs.ICPEC.2023.1,
  author =	{Santos, Andr\'{e} L.},
  title =	{{Shifting programming education assessment from exercise outputs toward deeper comprehension}},
  booktitle =	{4th International Computer Programming Education Conference (ICPEC 2023)},
  pages =	{1:1--1:5},
  series =	{Open Access Series in Informatics (OASIcs)},
  ISBN =	{978-3-95977-290-7},
  ISSN =	{2190-6807},
  year =	{2023},
  volume =	{112},
  editor =	{Peixoto de Queir\'{o}s, Ricardo Alexandre and Teixeira Pinto, M\'{a}rio Paulo},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/opus/volltexte/2023/18497},
  URN =		{urn:nbn:de:0030-drops-184970},
  doi =		{10.4230/OASIcs.ICPEC.2023.1},
  annote =	{Keywords: Introductory programming, assessment, comprehension}
}

Keywords: Introductory programming, assessment, comprehension
Collection: 4th International Computer Programming Education Conference (ICPEC 2023)
Issue Date: 2023
Date of publication: 09.08.2023

DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI