Skip to content

multiplied token embeddings by sqrt of embedding dimension#2661

Open
Ildar-Gaisin wants to merge 1 commit intod2l-ai:masterfrom
Ildar-Gaisin:master
Open

multiplied token embeddings by sqrt of embedding dimension#2661
Ildar-Gaisin wants to merge 1 commit intod2l-ai:masterfrom
Ildar-Gaisin:master

Commits