FeaturesAgentOS Scope OutUpdated March 12, 2026
Bulk Re-Crawl Selected Products
Bulk Re-Crawl Selected Products
Introduced in v0.1.24, the bulk re-crawl feature lets you select multiple products from the ranked dashboard and trigger a refresh scrape and re-score operation across all of them in one action.
Overview
Product data can go stale as suppliers update their listings, pricing, or accumulate new reviews. Rather than re-crawling products one at a time, you can now select a batch of products and kick off a coordinated refresh in a single step.
How to Use It
- Open the ranked dashboard. Products are listed in composite opportunity score order by default.
- Check the checkboxes next to each product you want to refresh. Checkboxes appear on every row in the table.
- Review the bulk action toolbar that appears at the bottom (or top) of the table once at least one product is selected. It shows the number of products currently selected.
- Click "Refresh Scrape + Re-score". The platform submits one Inngest batch event per selected product.
- Monitor progress in the status tracker. Each product's re-crawl and re-score job appears individually in the existing status tracker panel, so you can see which jobs are queued, running, or complete.
Limits
| Constraint | Value |
|---|---|
| Maximum products per bulk operation | 50 |
If you attempt to submit more than 50 products at once, a warning is shown before the operation is submitted. To refresh more than 50 products, split your selection into multiple batches.
This cap exists to prevent runaway job queues that could delay other background processing across the platform.
Technical Notes
- One Inngest event per product — The bulk action does not create a single consolidated job. Each selected product gets its own independently queued Inngest batch event, so failures are isolated per product and do not block the rest of the batch.
- Re-score follows re-crawl — The refresh operation runs a full scrape (reviews, ratings, features, pricing signals) and then re-computes the composite opportunity score for each product. Dashboard rankings update as each product's job completes.
- Status tracker integration — No new UI panel is introduced; progress is surfaced through the existing status tracker to keep the interface consistent.
Related Features
- Ranked Dashboard — Sortable, data-dense product rankings by composite opportunity score.
- Status Tracker — Real-time visibility into crawl and scoring job progress.