Skip to content

the train result is very bad, test_auc is 0.526, train as the procedure, what's wrong?  #5

Description

@PhenixY

train according to the procedure:
mkdir Criteo
python ./Dataprocess/Criteo/preprocess.py
python ./Dataprocess/Kfold_split/stratifiedKfold.py
python ./Dataprocess/Criteo/scale.py
Here's how to run the training.

      python -u train.py \
                             --data "Criteo"  --blocks 3 --heads 2  --block_shape "[64, 64, 64]" \
                             --is_save "True" --save_path "./test_code/Criteo/b3h2_64x64x64/"  \
                             --field_size 39  --run_times 1 --data_path "./" \
                             --epoch 3 --has_residual "True"  --has_wide "False" \
                             --batch_size 1024 \
                             > test_code_single.out &

but the result is not same with the example:
train logs
...
start testing!...
restored from ./test_code/Criteo/b3h2_dnn_dropkeep1_400x2/1/
test-result = 0.8088, test-logloss = 0.4430
test_auc [0.8088305055534442]
test_log_loss [0.44297631300399626]
avg_auc 0.8088305055534442
avg_log_loss 0.44297631300399626

my result is :
start testing!...
restored from ./test_code/Criteo/b3h2_64x64x64/1/
test-result = 0.5263, test-logloss = 0.5751
test_auc [0.5262644664774784]
test_log_loss [0.5751133874248523]
avg_auc 0.5262644664774784
avg_log_loss 0.5751133874248523

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions