Background Operations Setup

Initialize the automated agent runner that continuously syncs sources, creates candidates, audits quality, and prepares Biennale.com feeds.

Step 1: Initialize Background Jobs

Create 10 configured background jobs with default schedules. This only needs to be run once.

What this does:

  • ✓ Creates BackgroundJob records for all 10 agent types
  • ✓ Sets default schedules (critical: every 6-12h, daily: once/day, weekly: once/week)
  • ✓ Configures priorities, max records per run, auto-pause thresholds
  • ✓ Makes jobs manageable via Admin Dashboard

Step 2: Set Up Scheduler

Choose how you want jobs to run automatically. Base44 may support native scheduling or you can use external tools.

Option A: Base44 Native Automations (Recommended)

If Base44 supports scheduled automations, create automations that call the job runner endpoint every 6-12 hours for critical jobs and daily for others.

POST /functions/runBackgroundJob?job=job_type

Option B: GitHub Actions

Create a workflow file at .github/workflows/biennale-radar-jobs.yml to run jobs on schedule.

See setup guide below ↓

Option C: External Scheduler (Make, Zapier, cron-job.org)

Use an external service to POST to the job runner endpoint on a schedule.

https://[your-app]/functions/runBackgroundJob?job=publication_feed_sync

Option D: Manual Trigger (No Automation)

If you prefer, admins can manually run jobs via the Operations Dashboard anytime. No scheduler needed.

→ Admin Dashboard → Operations / Agent Runner → Run All Active Jobs

Step 3: Access Operations Dashboard

Manage and monitor all background jobs from the admin dashboard.

Location:

/admin → Click "Operations / Agent Runner" tab

From here you can:

  • ✓ View all 10 background jobs and their status
  • ✓ See last run time, next scheduled run, success/failure
  • ✓ Run jobs manually with "Run Now" button
  • ✓ Pause/resume individual jobs
  • ✓ View daily publisher reports
  • ✓ Monitor consecutive failures and auto-pause

Step 4: Verify Operations

Confirm the system is working by running a test job.

Quick Test:

  1. Go to Admin Dashboard → Operations / Agent Runner
  2. Click "Run All Active Jobs" button
  3. Monitor the execution (should take 30-60 seconds)
  4. Check the "Daily Reports" tab for today's summary
  5. Verify review queues are being populated

✓ System Ready

Once scheduler is configured, Biennale Radar will continuously sync sources, create candidates, audit quality, and refresh delivery feeds — all without manual intervention.

Background Jobs Reference

Publication Feed Sync

Critical

Syncs RSS/Atom feeds from publication sources, ingests FeedItems, deduplicates

🕐 Every 12 hours

Institutional Source Sync

Critical

Syncs museums, galleries, foundations; creates InstitutionalSignals

🕐 Daily

Delivery Feed Refresh

Critical

Refreshes Biennale.com delivery feeds, excludes shell/demo records

🕐 Every 12 hours

Exhibition Candidate Creation

High

Identifies exhibition signals, creates candidates for review

🕐 Daily

Data Quality Audit

High

Finds missing dates, URLs, summaries, credits; routes to queue

🕐 Daily

Source Health Audit

High

Monitors source sync failures, identifies stale sources

🕐 Daily

Feed Readiness Audit

High

Checks feed completeness and production readiness

🕐 Daily

Newsletter Queue Preparation

Medium

Prepares recent exhibitions for Biennale Buzz newsletter

🕐 Weekly

Premium Research Queue Prep

Medium

Identifies high-value content for Biennale Briefings

🕐 Weekly

Daily Publisher Report

Medium

Summarizes agent activity, new content, feeds, and gaps

🕐 Daily

For detailed scheduler configuration options, safety rules, and troubleshooting, see BACKGROUND_JOBS_SCHEDULER_SETUP.md

HomeCitiesRadarBooksScheduleAbout