Refactoring training for readability - #296

Open

levoz92 wants to merge 5 commits into

MeetKai:mainfrom

levoz92:levent-update

Commits on Nov 24, 2024

removed unused imports. Added optimized functions for better data handling, tokenization, batch allocation and training distribution
levoz92
committed
6681f0e
removed unused imports. Integrated the optimized utility functions inside the train() function
levoz92
committed
cdf6a06
removed unused imports. Integrated the optimized utility functions inside the train() function
levoz92
committed
443c232

Commits on Dec 6, 2024

removed commented out code for readability
levoz92
committed
25cfec3
refactored the code to solve the unimported dataloader error
levoz92
committed
16626bf