All Docs
FeaturesAgentOS Scope OutUpdated March 12, 2026

v0.1.37 — Multi-Directory Support with Source Directory Management

v0.1.37 — Multi-Directory Support with Source Directory Management

Overview

Release v0.1.37 introduces Source Directory Management — a settings UI that lets you add, configure, and monitor any number of proptech supplier directories for crawling. The platform is no longer limited to Kerfuffle.com.

The Problem It Solves

Prior to this release, the crawler was hardwired to Kerfuffle. Expanding to other directories (GetApp PropTech, G2 PropTech, and others) required a code change and a new deployment. That bottleneck is now gone.

What Was Shipped

Settings UI — Directory Management

A new section in the Settings page provides a table of all configured source directories. From here you can:

  • Add a new directory by pasting its URL
  • Set the crawl frequency per directory (one-off, weekly, or monthly)
  • Monitor crawl status — see the last crawl date and how many products were discovered from each directory

Crawl Frequency Options

OptionBehaviour
one-offCrawls the directory once; does not reschedule
weeklyRe-crawls every 7 days
monthlyRe-crawls every 30 days

source_directories Table

Directory configuration is stored in a new source_directories database table. Each row holds:

  • The directory URL
  • The configured crawl frequency
  • The timestamp of the last completed crawl
  • A count of products discovered from that directory

How to Use It

  1. Log in with your allowlisted account (glyn@agentos.com or dylan@agentos.com).
  2. Navigate to Settings.
  3. In the Source Directories section, click Add Directory.
  4. Paste the target directory URL (e.g. https://www.getapp.com/... or https://www.g2.com/...).
  5. Select a crawl frequency: one-off, weekly, or monthly.
  6. Save. The directory is queued for its first crawl immediately.
  7. Return to Settings at any time to check the last crawl date and product count.

Supported Directories (Examples)

Any publicly crawlable proptech supplier directory can be added. Directories confirmed as targets include:

  • Kerfuffle.com — the original source, now managed through the same UI
  • GetApp PropTech — GetApp's property technology category
  • G2 PropTech — G2's property technology category

Notes

  • All discovered products from every directory flow into the same opportunity scoring pipeline and ranked dashboard.
  • Removing or disabling a directory does not delete previously discovered products from the database.
  • Access to Settings remains restricted to the internal allowlist.