Skip to content

jsie7/normalized-attention

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

138 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Just tinkering and pondering on proper normalization

This code is a derivative of the Zoology code base.

About

Tinkering with normalization of self-attention.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Python 89.2%
  • Cuda 5.1%
  • Jupyter Notebook 4.4%
  • Other 1.3%