Draft: inline gelu - #16

Draft

certik wants to merge 6 commits into

mainfrom

Commits on Mar 7, 2023

ffn: Fuse some of the operations
certik
committed
1d8c856
Implement faster tanh(x) function
certik
committed
2399607

Commits on Mar 8, 2023

Implement fast_gelu
certik
committed
6e540ee
Inline fast_gelu
certik
committed
9389638
Flip the loop order
certik
committed
fdefc3e

Commits on Mar 17, 2023

Merge branch 'main' into gelu2
certik
committed
9472f6e