Reimplementation of DistilBert with a focus on efficiency with minimal accuracy loss.
All Requirements are in requirements.txt.
To run the code the python notebook '570project.ipynb' is designed to run on Google Colab.
If you want to run the code locally, make sure you have all the dependancies installed:
Use pip install -r requirements.txt to install all dependencies.
There is also a helper script that generates the figures used for the report.
Link to Demo Video: https://limewire.com/d/9vBOg#pMkC6bxTvj