Skip to content

feat: run comparison view for Scrape robots #1163

Description

@jceychen

Hi @RohitR311 and @amhsirak,

This is @jceychen, and together with @Wootark-Kim and @Batkhuu831, we'd like to propose our next contribution.

Background
We noticed that Maxun already supports scheduled runs for robots, which is great for recurring tasks like tracking product listings, job postings, or news pages. We'd like to build on that by creating a notification that detects change(s) between consecutive runs, making it easier to identify updates without manually comparing outputs while providing a foundation that we or future developers can continue to expand on.

Proposed Feature (Initial Scope)
We want to add a run comparison feature to Scrape robots that:

  • Adds a toggle in Robot Settings to turn on run comparison for that robot, so users can opt in on a per-robot basis
  • Automatically compares the most recent run to the previous one when a scheduled run completes, and shows a notification if changes are detected
  • Supports multiple output formats, starting with Text Content as the initial proof of concept
Image Image Image

Future Possibilities

  • Allows users to manually select any two runs from the runs view to compare directly, for cases outside of scheduled runs
  • Clicking the notification to open a side-by-side view showing exactly what was added, removed, or unchanged between the two runs

Let us know what you think in terms of direction and/or scope before we get started!

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions