License: 
Creative Commons Attribution 4.0 International license (CC BY 4.0)
When quoting this document, please refer to the following
DOI: 10.4230/LIPIcs.WABI.2023.23
URN: urn:nbn:de:0030-drops-186494
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2023/18649/
Ferdosi, Mohsen ;
Ge, Yuejun ;
Kingsford, Carl
Reinforcement Learning for Robotic Liquid Handler Planning
Abstract
Robotic liquid handlers play a crucial role in automating laboratory tasks such as sample preparation, high-throughput screening, and assay development. Manually designing protocols takes significant effort, and can result in inefficient protocols and involve human error. We investigates the application of reinforcement learning to automate the protocol design process resulting in reduced human labor and further automation in liquid handling. We develop a reinforcement learning agent that can automatically output the step-by-step protocol based on the initial state of the deck, reagent types and volumes, and the desired state of the reagents after the protocol is finished. We show that finding the optimal protocol for solving a liquid handler instance is NP-complete, and we present a reinforcement learning algorithm that can solve the planning problem practically for cases with a deck of up to 20 × 20 wells and four different types of reagents. We design and implement an actor-critic approach, and we train our agent using the Impala algorithm. Our findings demonstrate that reinforcement learning can be used to automatically program liquid handler robotic arms, enabling more precise and efficient planning for the liquid handler and laboratory automation.
BibTeX - Entry
@InProceedings{ferdosi_et_al:LIPIcs.WABI.2023.23,
author = {Ferdosi, Mohsen and Ge, Yuejun and Kingsford, Carl},
title = {{Reinforcement Learning for Robotic Liquid Handler Planning}},
booktitle = {23rd International Workshop on Algorithms in Bioinformatics (WABI 2023)},
pages = {23:1--23:16},
series = {Leibniz International Proceedings in Informatics (LIPIcs)},
ISBN = {978-3-95977-294-5},
ISSN = {1868-8969},
year = {2023},
volume = {273},
editor = {Belazzougui, Djamal and Ouangraoua, A\"{i}da},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops.dagstuhl.de/opus/volltexte/2023/18649},
URN = {urn:nbn:de:0030-drops-186494},
doi = {10.4230/LIPIcs.WABI.2023.23},
annote = {Keywords: Liquid Handler, Reinforcement Learning, Planning}
}
