Key

Tag meaning:

• #todo => to read
• #next => to re-read and write notes on
• #p0, #p1, #p2 => priority
• #work => relating to work
• #done => have read

List

• Self-supervised
  • Masked Auto-encoders are Scalable Vision Transformers #todo
  • Masked Autoencoders As Spatiotemporal Learners #todo
  • DINO #todo
• Architecture Fundamentals
  • MLP-Mixer #todo
  • Pay Attention to MLPs #todo
• NLP
  • PaLM #todo #p0
• Diffusion
  • Imagen #todo #p1
  • DALLE-2 #todo #p1
• NeRFs
  • NeRF #todo #p0
  • RawNeRF #todo #p0
  • Neural Feature Fusion Fields #todo
  • Common Objects in 3D - https://github.com/facebookresearch/co3d
  • NeuralRecon
  • mipnerf
• 3D
  • ClothCap #todo
• Rethinking the value of network pruning #done
• EgoVLP #done
• AudioMAE #done
• RL
  • Learning how to Active Learn: A Deep Reinforcement Learning Approach
  • Offline RL for Natural Language Generation with Implicit Language Q Learning
• Data structures with ML
  • The Case for Learned Index Structures #todo