Training bottleneck layers with Support Vector Machine (SVM) is a good option as the images can be quite different among classes. This is typically used for content moderation to help avoid images that are explicit. You have learned how to approach new problems in image classification.