Hostname: page-component-76d6cb85b7-rxvq6 Total loading time: 0 Render date: 2026-07-15T13:38:22.757Z Has data issue: false hasContentIssue false

Deep learning-based collision detection framework for robot tasks in clutter

Published online by Cambridge University Press:  15 May 2025

Giacomo Golluccio*
Affiliation:
Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, Cassino, Italy
Daniele Di Vito
Affiliation:
Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, Cassino, Italy
Gianluca Antonelli
Affiliation:
Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, Cassino, Italy
Alessandro Marino
Affiliation:
Department of Electrical and Information Engineering, University of Cassino and Southern Lazio, Cassino, Italy
*
Corresponding author: Giacomo Golluccio; Email: giacomo.golluccio@unicas.it

Abstract

In this work, the problem of reliably checking collisions between robot manipulators and the surrounding environment in short time for tasks, such as replanning and object grasping in clutter, is addressed. Geometric approaches are usually applied in this context; however, they can result not suitable in highly time-constrained applications. The purpose of this paper is to present a learning-based method able to outperform geometric approaches in clutter. The proposed approach uses a neural network (NN) to detect collisions online by performing a classification task on the input represented by the depth image or point cloud containing the robot gripper projected into the application scene. Specifically, several state-of-the-art NN architectures are considered, along with some customization to tackle the problem at hand. These approaches are compared to identify the model that achieves the highest accuracy while containing the computational burden. The analysis shows the feasibility of the robot collision checker based on a deep learning approach. In fact, such approach presents a low collision detection time, of the order of milliseconds on the selected hardware, with acceptable accuracy. Furthermore, the computational burden is compared with state-of-the-art geometric techniques. The entire work is based on an industrial case study involving a KUKA Agilus industrial robot manipulator at the Technology $\&$ Innovation Center of KUKA Deutschland GmbH, Germany. Further validation is performed with the Amazon Robotic Manipulation Benchmark (ARMBench) dataset as well, in order to corroborate the reported findings.

Information

Type
Research Article
Copyright
© The Author(s), 2025. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Supplementary material: File

Golluccio et al. supplementary material

Golluccio et al. supplementary material
Download Golluccio et al. supplementary material(File)
File 3 MB