Please use this identifier to cite or link to this item:
Publisher URL:
Title: Critical evaluation of LOCO dataset with machine learning
Language: English
Authors: Savas, Recep 
Hinckeldeyn, Johannes  
Editor: Kersten, Wolfgang  
Jahn, Carlos  
Blecker, Thorsten 
Ringle, Christian M.  
Keywords: Artificial Intelligence; Blockchain
Issue Date: Sep-2022
Publisher: epubli
Source: Hamburg International Conference of Logistics (HICL) 33: 177-206 (2022)
Abstract (english): 
Purpose: Object detection is rapidly evolving through machine learning technology in automation systems. Well prepared data is necessary to train the algorithms. Accordingly, the objective of this paper is to describe a re-evaluation of the so-called Logistics Objects in Context (LOCO) dataset, which is the first dataset for object detection in the field of intralogistics.
Methodology: We use an experimental research approach with three steps to evaluate the LOCO dataset. Firstly, the images on GitHub were analyzed to understand the dataset better. Secondly, Google Drive Cloud was used for training purposes to revisit the algorithmic implementation and training. Lastly, the LOCO dataset was examined, if it is possible to achieve the same training results in comparison to the original publications.
Findings: The mean average precision, a common benchmark in object detection, achieved in our study was 64.54%, and shows a significant increase from the initial study of the LOCO authors, achieving 41%. However, improvement potential is seen specifically within object types of forklifts and pallet truck.
Originality: This paper presents the first critical replication study of the LOCO dataset for object detection in intralogistics. It shows that the training with better hyperparameters based on LOCO can even achieve a higher accuracy than presented in the original publication. However, there is also further room for improving the LOCO dataset.
Conference: Hamburg International Conference of Logistics (HICL) 2022 
DOI: 10.15480/882.4692
ISBN: 978-3-756541-95-9
ISSN: 2365-5070
Institute: Technische Logistik W-6 
Document Type: Chapter/Article (Proceedings)
Peer Reviewed: Yes
License: CC BY-SA 4.0 (Attribution-ShareAlike 4.0) CC BY-SA 4.0 (Attribution-ShareAlike 4.0)
Part of Series: Proceedings of the Hamburg International Conference of Logistics (HICL) 
Volume number: 33
Appears in Collections:Publications with fulltext

Files in This Item:
File Description SizeFormat
Savas and Hinckeldeyn (2022) - Critical Evaluation of LOCO dataset with Machine Learning.pdfCritical Evaluation of LOCO dataset with Machine Learning1,44 MBAdobe PDFView/Open
Show full item record

Page view(s)

checked on Dec 9, 2022


checked on Dec 9, 2022

Google ScholarTM


Note about this record

Cite this record


This item is licensed under a Creative Commons License Creative Commons