Give user more control over docling processing - #509

Merged

ppinchuk merged 57 commits into

mainfrom

pp/docling_guards

Aug 3, 2026

Commits on Jul 24, 2026

Add logging
ppinchuk
committed
9818f19
More logger
ppinchuk
committed
a0fb78a
Allow pipeline options to be specified
ppinchuk
committed
2b49b5f
Allow user to specify `pdf_pipeline_options`
ppinchuk
committed
9162f81
Add timeout guards in case we add a hard time limit in the future
ppinchuk
committed
6671bda

Commits on Jul 27, 2026

Move logic to method
ppinchuk
committed
afdfb70
Cleaner disable
ppinchuk
committed
a69c879
Allow docling loader to use elm loader in failed cases
ppinchuk
committed
de0eb0e
Move logic to method
ppinchuk
committed
a1c7ed7
Rename methods
ppinchuk
committed
b844e1f
Minor re-arrange
ppinchuk
committed
f01dd79
Add doc conversion status as attr
ppinchuk
committed
9038d81
More details in log
ppinchuk
committed
7546c28
Fallback explicitly no OCR
ppinchuk
committed
6ef4b24
ELM re-fetch now replaces failed docs
ppinchuk
committed
7d08a93
More correct initialization
ppinchuk
committed
d1f7493
Improved logging
ppinchuk
committed
2235100
minor logic fix
ppinchuk
committed
e797b4a
Fix tests
ppinchuk
committed
0889843
Recycle process pool
ppinchuk
committed
149bbfd
Refactor for clarity
ppinchuk
committed
7cf9a51
linter
ppinchuk
committed
99bc34d
Move log logic to logging module
ppinchuk
committed
5fc2493
PR review updates
ppinchuk
committed
432e01e
Fix test
ppinchuk
committed
f75db19

Commits on Jul 31, 2026

Disable tasks per child
ppinchuk
committed
90c1b71
Add logger statement
ppinchuk
committed
cc1d902
Decrease timeout
ppinchuk
committed
4676fe0
Disable tests for now
ppinchuk
committed
91f3bf4
minor logic update
ppinchuk
committed
fb1c1c3
Update logger
ppinchuk
committed
09210a7
Add costs
ppinchuk
committed
078fdc7
Fix regression about missing source column
ppinchuk
committed
acb96e6

Commits on Aug 2, 2026

Move utility function
ppinchuk
committed
58ec86f
Normalize log file names
ppinchuk
committed
daceb2d
Add normalization step
ppinchuk
committed
efe7a62
Fix test
ppinchuk
committed
4e8da2c
Fix docstrings
ppinchuk
committed
f9fd1a5

Commits on Aug 3, 2026

Add `pdf_pipeline_options` to local read
ppinchuk
committed
61f7616
Broader catch
ppinchuk
committed
ef8fbd1
Update docstring
ppinchuk
committed
2f4b567
Docling conversion now runs in dedicated subprocess and forced shutdown after timeout
ppinchuk
committed
2cd2876
Fix timeout params
ppinchuk
committed
4a063d2
Fix tests
ppinchuk
committed
3b856af
Fix test
ppinchuk
committed
79c660a
Update README
ppinchuk
committed
0156d94
`crawl_semaphore` can now be `AsyncExitStack`
ppinchuk
committed
176cb89
download function no longer in charge of crawl semaphore
ppinchuk
committed
534ef0e
Steps now track crawl semaphore and enforce crawl timeout
ppinchuk
committed
05688c1
Add `website_crawl_timeout_seconds` as parameter
ppinchuk
committed
6120134
FIx test
ppinchuk
committed
1989dd7
Add `configure_docling_subprocess_logging`
ppinchuk
committed
5112fad
Add logging back
ppinchuk
committed
4f0f3e1
Fix import
ppinchuk
committed
7eb820b
Update test
ppinchuk
committed
829a1d7
Add missing vars
ppinchuk
committed
b6ac63f
Fix test on windows
ppinchuk
committed
c569a84