Federico Lopez collected a list of papers from Computational Linguistics and Representation Learning conferences that apply deep learning methods, grouped by application/topic.

Most of them have a differential geometric flavor.  

General Reviews

• Representation Learning: A Review and New Perspectives
• Geometric deep learning: going beyond Euclidean data
  

Graph Embeddings

• Neural Embeddings of Graphs in Hyperbolic Space
• Poincaré Embeddings for Learning Hierarchical Representations
  
• Hyperbolic Entailment Cones for Learning Hierarchical Embeddings
  
• Low-rank approximations of hyperbolic embeddings
• Learning Mixed-Curvature Representations in Product Spaces <--- Hyperbolic and spherical spaces
• Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometry
  
• Representation Tradeoffs for Hyperbolic Embeddings

Knowledge Graph Embeddings

Reviews:

• On Understanding Knowledge Graph Representation
• Towards Understanding the Geometry of Knowledge Graph Embeddings

Papers:

• Riemannian TransE: Multi-relational Graph Embedding in Non-Euclidean Space <--- Hyperbolic and spherical
• Multi-relational Poincaré Graph Embeddings <--- Hyperbolic
  
• HyperKG: Hyperbolic Knowledge Graph Embeddings for Knowledge Base Completion
  
• Low-Dimensional Hyperbolic Knowledge Graph Embeddings <--- Hyperbolic rotations and reflections
  
• TorusE: Knowledge Graph Embedding on a Lie Group <--- Lie Group
• TuckER: Tensor Factorization for Knowledge Graph Completion <--- Tensor Factorization
  
• Complex Embeddings for Simple Link Prediction <--- Complex variable
  
• Holographic Embeddings of Knowledge Graphs <--- Modular arithmetic
  
• Analogical Inference for Multi-Relational Embeddings <--- Normal matrices

Graph Neural Networks

• Hyperbolic Graph Attention Network
  
• Hyperbolic Graph Neural Networks
  
• Hyperbolic Graph Convolutional Neural Networks
  
• Constant Curvature Graph Convolutional Networks

Word Embeddings

• Embedding Text in Hyperbolic Spaces
• Skip-gram word embeddings in hyperbolic space
• Poincaré GloVe: Hyperbolic Word Embeddings
  

Recommender Systems

• Scalable Hyperbolic Recommender Systems
  
• HyperML: A Boosting Metric Learning Approach in Hyperbolic Space for Recommender Systems
  

Neural Network Extensions

• Large-Margin Classification in Hyperbolic Space <--- Hyperbolic SVM
• Hyperbolic Neural Networks <--- Built on Gyrovector spaces
• Hyperbolic Attention Networks
• Mixed-curvature Variational Autoencoders <--- Hyperbolic and spherical
  

Other Applications

• Image classification: Hyperbolic Image Embeddings
• Question Answering: Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering
  
• Taxonomy refinement:
• Every child should have parents: a taxonomy refinement algorithm based on hyperbolic term embeddings
• Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddings

Optimization

• Stochastic gradient descent on Riemannian manifolds
  
• Riemannian Adaptive Optimization Methods