Hello,
I try to upload some old segments produced by an REALTIME table to an OFFLINE table.
It is working as expected using the API as explained here: https://docs.pinot.apache.org/build-with-pinot/ingestion/batch-ingestion/segment-upload#uri-push
But the API is for 1 segment and I want to upload an entire "directory" with many segments. For this a job using Pinot Admin seems to be the solution.
I tried using "SegmentUriPush" but it does not work because my segment are named "myTable__0__0__20260601T1557Z" with no tar.gz extension.
But this extension seems to be required when the job is used (this is not the case using the API).
Am I doing something wrong or is it a limitation that can be fixed in a future version ?
I use Azure Data Lake Storage as a deep store.
Thanks for your help.
Hello,
I try to upload some old segments produced by an REALTIME table to an OFFLINE table.
It is working as expected using the API as explained here: https://docs.pinot.apache.org/build-with-pinot/ingestion/batch-ingestion/segment-upload#uri-push
But the API is for 1 segment and I want to upload an entire "directory" with many segments. For this a job using Pinot Admin seems to be the solution.
I tried using "SegmentUriPush" but it does not work because my segment are named "myTable__0__0__20260601T1557Z" with no tar.gz extension.
But this extension seems to be required when the job is used (this is not the case using the API).
Am I doing something wrong or is it a limitation that can be fixed in a future version ?
I use Azure Data Lake Storage as a deep store.
Thanks for your help.