feat: Add timestamps to artifacts and worker_metadata for easier tracking#210

Open

gasperzgonec wants to merge 19 commits into

mainfrom

gasperz/timestamps_merged

gasperzgonec commented Jun 12, 2026

Contributor

Description

This PR merges PRs #202 and #205 together

Connected Issues

Checklist

Tests added/updated and ran with npm run test OR no tests needed.
Ran backwards compatibility tests with npm run test:backwards-compatibility.
Code formatted and checked with npm run lint.
Tested airdrop-template linked to this PR.
Documentation updated and provided a link to PR / new docs OR no docs needed.

gasperzgonec added 8 commits

May 14, 2026 11:04


          feat: added created_date to the NormalizedAttachment

d86af02

Started returning `progress_data` in `worker_metadata`.


          chore: renamed variable and improved nullability check

0d841c1


          chore: added tests for timestamp reporting

785b327


          feat: Updated to only report on the last item being processed.

cab6a5e


          fix(bug): Invalid dates would get stuck on NaN.

7c8b476


          feat: Changed timestamps to RFC3339 strings

643d1a4


          Merge branch 'main' into gasperz/ISS-252036

99027f8


          feat: Flattened the worker_metadata, added state_date fields.

a0ce4ee

gasperzgonec requested review from a team and radovanjorgic as code owners

June 12, 2026 06:57

gasperzgonec added 2 commits

June 12, 2026 10:12


          feat: Changed from epoch ms timestamps to RFC3339

7ce30d0


          feat: add artifact timestamp ranges

4d92e8d

gasperzgonec force-pushed the gasperz/timestamps_merged branch from 41866b6 to 4d92e8d Compare

June 12, 2026 08:14

radovanjorgic reviewed

View reviewed changes

src/multithreading/worker-adapter/worker-adapter.ts Outdated

src/types/extraction.ts

src/repo/repo.ts

src/repo/repo.ts Outdated

src/multithreading/worker-adapter/worker-adapter.ts

src/multithreading/worker-adapter/worker-adapter.ts Outdated


          chore: renamed variable, moved functions and updated comments

34d5fec

gasperzgonec force-pushed the gasperz/timestamps_merged branch from 8c1d0fa to 34d5fec Compare

June 12, 2026 10:05


          Merge branch 'main' into gasperz/timestamps_merged

7b15d3b

radovanjorgic reviewed

View reviewed changes

radovanjorgic left a comment

Collaborator

Looks good, will approve once it is tested and verified by @gasperzgonec and @GasperSenk.

svc-devrev-sdk and others added 2 commits

June 12, 2026 10:51


          chore: release v1.19.9-beta.1

6c32cca


          Merge branch 'main' into gasperz/timestamps_merged

1b2a6db

Resolve version conflicts by keeping branch beta version (1.19.9-beta.1)
while incorporating main's dependency updates.

Co-authored-by: Cursor <cursoragent@cursor.com>

github-actions Bot commented Jul 13, 2026

⚠️ Heads-up: This repository will be blocked from any work other than patching.

File src/common/control-protocol.test.ts is not allowed to be modified in this patch.
The following vulnerability issues are past SLA:

ISS-331530, overdue 6.0d, sev medium, owner: radovan.jorgic@devrev.ai, checked: 2026-07-13 06:06 UTC

Note that there is significant latency in updating this list. Please reach out on #antifragile if you are in a hurry or have an emergency.


          chore: added tests to verify a bug when EPOCH is 0

3ae1f77

github-actions Bot commented Jul 13, 2026

⚠️ Heads-up: This repository will be blocked from any work other than patching.

File src/common/control-protocol.test.ts is not allowed to be modified in this patch.
The following vulnerability issues are past SLA:

ISS-331530, overdue 6.0d, sev medium, owner: radovan.jorgic@devrev.ai, checked: 2026-07-13 06:35 UTC

Note that there is significant latency in updating this list. Please reach out on #antifragile if you are in a hurry or have an emergency.


          chore(deps): bump @devrev/typescript-sdk to 1.1.78 and yargs to 17.7.3

4b27ca8

Merges the Snyk-proposed upgrades from PRs #218 and #219.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

github-actions Bot commented Jul 13, 2026

⚠️ Heads-up: This repository will be blocked from any work other than patching.

File src/common/control-protocol.test.ts is not allowed to be modified in this patch.
The following vulnerability issues are past SLA:

ISS-331530, overdue 6.0d, sev medium, owner: radovan.jorgic@devrev.ai, checked: 2026-07-13 06:50 UTC

Note that there is significant latency in updating this list. Please reach out on #antifragile if you are in a hurry or have an emergency.

This was referenced Jul 13, 2026

[Snyk] Upgrade yargs from 17.7.2 to 17.7.3 #219

Closed

[Snyk] Upgrade @devrev/typescript-sdk from 1.1.76 to 1.1.78 #218

Closed

github-actions Bot commented Jul 14, 2026

⚠️ Heads-up: This repository will be blocked from any work other than patching.

File src/common/control-protocol.test.ts is not allowed to be modified in this patch.
The following vulnerability issues are past SLA:

ISS-331530, overdue 7.0d, sev medium, owner: radovan.jorgic@devrev.ai, checked: 2026-07-14 07:05 UTC

Note that there is significant latency in updating this list. Please reach out on #antifragile if you are in a hurry or have an emergency.

gasperzgonec force-pushed the gasperz/timestamps_merged branch from 0c6068a to 4b27ca8 Compare

July 14, 2026 08:09

github-actions Bot commented Jul 14, 2026

⚠️ Heads-up: This repository will be blocked from any work other than patching.

File src/common/control-protocol.test.ts is not allowed to be modified in this patch.
The following vulnerability issues are past SLA:

ISS-331530, overdue 7.0d, sev medium, owner: radovan.jorgic@devrev.ai, checked: 2026-07-14 08:05 UTC

Note that there is significant latency in updating this list. Please reach out on #antifragile if you are in a hurry or have an emergency.


          Merge branch 'main' into gasperz/timestamps_merged

ad3c2ba

radovanjorgic reviewed

View reviewed changes

src/common/control-protocol.ts

                   },
                   worker_metadata: {
+                    ...worker_metadata,
+                    newest_state_date: event.payload.event_context.extract_to,

radovanjorgic Jul 15, 2026

Collaborator

Would it make sense to name these two values extract_from and extract_to or event_context_extract_from and ..._to just to be a bit more consistent? We started using 3 or 4 names for the similar value: last successful sync started, worker oldest/newest, extraction_start/end_time, extract_from/to and now also oldest/newest_state_date. It is really becoming hard to track what is what.

radovanjorgic Jul 15, 2026

Collaborator

Also why we need these values here in worker_metadata if we can get it from the event context?

gasperzgonec Jul 15, 2026

Contributor Author

These worker_metadata fields are meant to be handled in the snapin-manager, and they should be formatted in a way that it can parse it.
I don't think snapin-manager can read from the event_context when we respond, and we just package content in there for the later processing on the platform.

Names have been set to what the platform expects.

src/multithreading/worker-adapter/worker-adapter.ts Outdated

gasperzgonec added 2 commits

July 15, 2026 08:35


          chore: moved interface into worker-adapter.interface.ts file

9b5c57d


          Merge remote-tracking branch 'origin/gasperz/timestamps_merged' into …

4f0de09

…gasperz/timestamps_merged

radovanjorgic approved these changes

View reviewed changes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet