License: Creative Commons Attribution 4.0 International license (CC BY 4.0)
When quoting this document, please refer to the following
DOI: 10.4230/OASIcs.PARMA-DITAM.2022.3
URN: urn:nbn:de:0030-drops-161193
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2022/16119/
Go to the corresponding OASIcs Volume Portal

Berezov, Maksim ; Ancourt, Corinne ; Zawalska, Justyna ; Savchenko, Maryna

COLA-Gen: Active Learning Techniques for Automatic Code Generation of Benchmarks

pdf-format:
OASIcs-PARMA-DITAM-2022-3.pdf (0.8 MB)

Abstract

Benchmarking is crucial in code optimization. It is required to have a set of programs that we consider representative to validate optimization techniques or evaluate predictive performance models. However, there is a shortage of available benchmarks for code optimization, more pronounced when using machine learning techniques. The problem lies in the number of programs for testing because these techniques are sensitive to the quality and quantity of data used for training.
Our work aims to address these limitations. We present a methodology to efficiently generate benchmarks for the code optimization domain. It includes an automatic code generator, an associated DSL handling, the high-level specification of the desired code, and a smart strategy for extending the benchmark as needed.
The strategy is based on Active Learning techniques and helps to generate the most representative data for our benchmark. We observed that Machine Learning models trained on our benchmark produce better quality predictions and converge faster. The optimization based on the Active Learning method achieved up to 15% more speed-up than the passive learning method using the same amount of data.

BibTeX - Entry

@InProceedings{berezov_et_al:OASIcs.PARMA-DITAM.2022.3,
  author =	{Berezov, Maksim and Ancourt, Corinne and Zawalska, Justyna and Savchenko, Maryna},
  title =	{{COLA-Gen: Active Learning Techniques for Automatic Code Generation of Benchmarks}},
  booktitle =	{13th Workshop on Parallel Programming and Run-Time Management Techniques for Many-Core Architectures and 11th Workshop on Design Tools and Architectures for Multicore Embedded Computing Platforms (PARMA-DITAM 2022)},
  pages =	{3:1--3:14},
  series =	{Open Access Series in Informatics (OASIcs)},
  ISBN =	{978-3-95977-231-0},
  ISSN =	{2190-6807},
  year =	{2022},
  volume =	{100},
  editor =	{Palumbo, Francesca and Bispo, Jo\~{a}o and Cherubin, Stefano},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/opus/volltexte/2022/16119},
  URN =		{urn:nbn:de:0030-drops-161193},
  doi =		{10.4230/OASIcs.PARMA-DITAM.2022.3},
  annote =	{Keywords: Benchmarking, Code Optimization, Active Learning, DSL, Synthetic code generation, Machine Learning}
}

Keywords: Benchmarking, Code Optimization, Active Learning, DSL, Synthetic code generation, Machine Learning
Collection: 13th Workshop on Parallel Programming and Run-Time Management Techniques for Many-Core Architectures and 11th Workshop on Design Tools and Architectures for Multicore Embedded Computing Platforms (PARMA-DITAM 2022)
Issue Date: 2022
Date of publication: 08.06.2022
Supplementary Material: Software (Source Code): https://github.com/cri-internship/loop-generator

DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI