[Inferencing/API] Add logic to allow preempting inferencing logic during long downloads and expensive operations

[ArielG-NV]

Problem: ending a program stuck in a big download or operation (that is continuous) takes a long time

Solution: we want to enable preempting via potential design change such that if a user tries to close a program it closes quickly