Blog: Keeping Competitor Intelligence Fresh — Automatically
Keeping Competitor Intelligence Fresh — Automatically
v1.0.58 · Competitor Re-Analysis Scheduler
Competitors don't stand still, and neither should your intelligence on them. With v1.0.58, the platform introduces a nightly batch workflow that automatically re-analyzes every active competitor on a 7-day rolling cadence — no manual triggers, no stale data.
The Problem with Stale Competitive Data
Competitor landscapes shift constantly: pricing changes overnight, new features launch mid-week, messaging pivots happen without warning. A competitive snapshot that's two weeks old might as well be fiction. Keeping that data fresh, however, traditionally required someone to remember to check — which means it usually didn't happen.
What the Scheduler Does
Every day at 06:00 UTC, a new scheduled workflow sweeps the competitors table and asks a simple question for each active entry: has this competitor been analyzed in the last 7 days?
If the answer is no — or if the competitor has never been analyzed at all — the scheduler fires a pipeline/competitor-monitor event. That event hands off to the existing competitor monitoring pipeline, which re-scrapes the competitor and diffs the result against the last known state. Any changes in pricing, features, positioning, or messaging get surfaced to the relevant project automatically.
Always Fresh, Never Redundant
The 7-day rolling window strikes a balance: aggressive enough to catch meaningful changes quickly, conservative enough to avoid unnecessary scraping. Competitors analyzed recently are skipped entirely. Only those with status = 'active' are eligible, so archived or paused competitors never generate noise.
The result: your competitive intelligence is always at most one week old, maintained entirely without human intervention.
Under the Hood
- Cron schedule:
0 6 * * *— daily at 06:00 UTC - Eligibility filter:
status='active'AND (lastAnalyzedAt IS NULLORlastAnalyzedAt < NOW() - 7 days) - Event fired:
pipeline/competitor-monitor(one per eligible competitor) - Workflow type:
nightly_batch - Entities:
competitors,projects
This workflow is a foundational piece of the platform's autonomous marketing intelligence layer — ensuring that decisions around positioning, messaging, and feature prioritization are always grounded in current reality.