File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change 1919import torch
2020from torch .utils .data import DataLoader
2121NGC_CHECKPOINT_URLS = {}
22- NGC_CHECKPOINT_URLS ["electricity" ] = "https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/versions/21.06.0/zip"
23- NGC_CHECKPOINT_URLS ["traffic" ] = "https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/versions/21.06.0/zip"
24-
25-
22+ NGC_CHECKPOINT_URLS ["electricity" ] = "https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/versions/22.11.0_amp/zip"
23+ NGC_CHECKPOINT_URLS ["traffic" ] = "https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/versions/22.11.0_amp/zip"
2624def _download_checkpoint (checkpoint , force_reload ):
2725 model_dir = os .path .join (torch .hub ._get_torch_home (), 'checkpoints' )
2826 if not os .path .exists (model_dir ):
Original file line number Diff line number Diff line change @@ -146,6 +146,9 @@ NVIDIA DGX A100 (1x A100 80GB): bash ./triton/runner/start_NVIDIA-DGX-A100-\(1x-
146146NVIDIA T4: bash ./triton/runner/start_NVIDIA-T4.sh
147147```
148148
149+ If one encounters an error like ` the provided PTX was compiled with an unsupported toolchain ` , follow the steps in
150+ [ Step by step deployment process] ( #step-by-step-deployment-process ) .
151+
149152## Performance
150153The performance measurements in this document were conducted at the time of publication and may not reflect
151154the performance achieved from NVIDIA’s latest software release. For the most up-to-date performance measurements, go to
@@ -2077,7 +2080,7 @@ Please use the data download from the [Main QSG](https://github.com/NVIDIA/DeepL
20772080#### Prepare Checkpoint
20782081Please place a ` checkpoint.pt ` from TFT trained on electricity in ` runner_workspace/checkpoints/electricity_bin/ ` . Note that the ` electricity_bin `
20792082subdirectory may not be created yet. In addition one can download a zip archive of a trained checkpoint
2080- [ here] ( https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip )
2083+ [ here] ( https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip )
20812084
20822085#### Setup Container
20832086Build and run a container that extends the NGC PyTorch container with the Triton Inference Server client libraries and dependencies.
@@ -2242,7 +2245,7 @@ mkdir -p ${SHARED_DIR}/input_data
22422245python triton/prepare_input_data.py \
22432246 --input-data-dir ${SHARED_DIR} /input_data/ \
22442247 --dataset ${DATASETS_DIR} /${DATASET} \
2245- --checkpoint ${CHECKPOINT_DIR} / \
2248+ --checkpoint ${CHECKPOINT_DIR} /
22462249```
22472250
22482251</details >
Original file line number Diff line number Diff line change 11checkpoints :
22- name : electricity_bin
3- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip
3+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip
44- name : traffic_bin
5- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/ versions/21.06.0 /zip
5+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/ versions/22.11.0_amp /zip
66configurations :
77- accelerator : none
88 batch_size :
Original file line number Diff line number Diff line change 11checkpoints :
22- name : electricity_bin
3- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip
3+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip
44- name : traffic_bin
5- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/ versions/21.06.0 /zip
5+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/ versions/22.11.0_amp /zip
66configurations :
77- accelerator : none
88 batch_size :
Original file line number Diff line number Diff line change 11checkpoints :
22- name : electricity_bin
3- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip
3+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip
44- name : traffic_bin
5- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/ versions/21.06.0 /zip
5+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/ versions/22.11.0_amp /zip
66configurations :
77- accelerator : none
88 batch_size :
Original file line number Diff line number Diff line change 11checkpoints :
22- name : electricity_bin
3- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_eletricity_amp/ versions/21.06.0 /zip
3+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-electricity/ versions/22.11.0_amp /zip
44- name : traffic_bin
5- url : https://api.ngc.nvidia.com/v2/models/nvidia/tft_pyt_ckpt_base_traffic_amp/ versions/21.06.0 /zip
5+ url : https://api.ngc.nvidia.com/v2/models/nvidia/dle/tft_base_pyt_ckpt_ds-traffic/ versions/22.11.0_amp /zip
66configurations :
77- accelerator : none
88 batch_size :
You can’t perform that action at this time.
0 commit comments