Settings

The Settings page lets you manage your subscription, configure AI providers for topic analysis, and set default crawler behavior. Access it from the Settings tab in the dashboard.

Overview

Settings are organized into three tabs:

Tab	What it controls
My Plan	View current plan limits, usage, and feature availability
AI & Topics	LLM provider selection, API keys, and topic naming preferences
Crawler Defaults	Default max depth and global URL exclude patterns

My Plan

The plan tab displays your current subscription tier and usage:

Plan name — Free, Starter, Pro, Advanced, or Premium
Max pages per crawl — Upper limit for each crawl job
Max crawls per month — Monthly crawl quota (with progress bar)
Crawl history limit — Number of saved crawl results
Export — Data export availability (Starter+ plans)
API access — Programmatic API access (Pro+ plans)

The usage progress bar turns amber at 80% and red at 100% capacity. See Plans & Pricing for details on each tier.

AI & Topics

LLM Provider

Choose the AI model used for topic naming and hierarchy generation:

Provider	Default Model	API Key
System Default (Hyperbolic)	Meta-Llama-3.1-8B-Instruct	Not required (shared, rate-limited)
Google Gemini AI	gemini-2.5-flash	Your own API key required

💡The system default uses a shared API key with global rate limits. For large sites or to avoid queues, configure your own Gemini API key.

Gemini Configuration

When Google Gemini is selected, three additional fields appear:

Gemini API Key — Your personal API key (stored securely, displayed as password field).
Gemini Model — Which model to use (e.g., gemini-2.5-flash, gemini-2.0-flash). Leave empty for the default.
Endpoint URI — Custom API endpoint (optional). Defaults to https://generativelanguage.googleapis.com.

Topic Naming Length

Controls how many words the LLM uses when generating topic cluster names:

Option	Example
Short (1–3 words)	"SEO Tools"
Medium (2–4 words)	"SEO Analysis Tools"
Long (5–6 words)	"Search Engine Optimization Analysis Tools"

Crawler Defaults

Default Max Depth

Sets the maximum BFS depth (click distance from root) for each crawl. Range: 0–10. Default: 3.

Note that your subscription plan's max-pages limit is still enforced — this setting controls how deep the crawl goes, while the plan controls how many pages are crawled.

Global Exclude Patterns

Comma-separated glob patterns to exclude specific URLs from all crawls. Patterns are matched against the full URL, pathname, or pathname + query string.

Examples:
/tag/*         — Skip WordPress tag archives
/author/*      — Skip author pages
*.pdf          — Skip PDF files
/wp-json/*     — Skip REST API endpoints
*?utm=*        — Skip URLs with UTM parameters

How Settings are Stored

Settings are stored as key-value pairs in the user_settings table in Supabase, with Row Level Security (RLS) ensuring each user can only read and write their own settings.

Key	Type	Default
`llm_provider`	string	`"hyperbolic"`
`gemini_api_key`	string	empty
`gemini_model`	string	empty (uses `gemini-2.5-flash`)
`gemini_endpoint`	string	empty (uses default)
`topic_length`	string	`"1-3"`
`default_max_depth`	number	`3`
`global_exclude_patterns`	string	empty