We propose a new pipeline to classify Ground Penetrating Radar (GPR) images, based upon the use of second-orders statistics computed over convolutional features of a ResNetlike architecture. In particular, the architecture consists in an end-to-end training phase with backpropagation from convolutional filters from layers adapted to Symmetric Positive Definite (SPD) matrices. The developed approach is tested and compared to a shallow network given in the GPR literature and a deep Computer Vision model like ResNet. We show that we outperform these methods when the number of training data is small and when some of them are mislabelled.