Skip to content

Commit 0e20ac8

Browse files
meatybobbynv-kkudrynski
authored andcommitted
[BERT/TF2] Add convergence log
1 parent dddb1d1 commit 0e20ac8

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

TensorFlow2/LanguageModeling/BERT/official/modeling/model_training_utils.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -607,5 +607,6 @@ def _run_callbacks_on_batch_end(batch):
607607

608608
if dllogging and perf_wo_n != 0:
609609
dllogging.logger.log(step=(), data={"throughput_train": perf_wo/perf_wo_n}, verbosity=Verbosity.DEFAULT)
610+
dllogging.logger.log(step=(), data={"total_loss": training_summary['train_loss']}, verbosity=Verbosity.DEFAULT)
610611

611612
return model

0 commit comments

Comments
 (0)