Federico Lopez collected a list of papers from Computational Linguistics and Representation Learning conferences that apply deep learning methods, grouped by application/topic.
Most of them have a differential geometric flavor.
Knowledge Graph Embeddings
Graph Neural Networks
Neural Network Extensions