Prefect Flows

Monitor and manage Prefect flow deployments from within Palantiri.

Highlight:allauthmigrationprefectdbt

Page Overview

Prefect Flows

Monitor flow runs, view task breakdowns, and trigger migrations manually

How to Use

1View deployed flows and their status

2Browse recent flow runs with filtering

3Click a run to see task-level details

4Trigger manual flow runs as needed

Features

📋

Deployment List

View all deployed flows with their current status

📈

Run History

Browse recent runs with status filtering

🔍

Task Details

Drill into individual tasks within a flow run

▶️

Manual Trigger

Start flow runs on-demand with parameters

Flow Run States

State	Badge	Description
Completed	✓COMPLETED	Run finished successfully
Running	ℹRUNNING	Currently executing
Pending	⚠PENDING	Waiting to start
Failed	✗FAILED	Run encountered an error
Cancelled	○CANCELLED	Run was manually stopped

Deployments View

The deployments section shows:

• Flow Name - The registered flow name
• Deployment Name - Specific deployment configuration
• Status - Active/Inactive indicator
• Last Run - When the flow last executed
• Schedule - Configured schedule (if any)

Available Flows

Flow	Deployment	Purpose
table-migration	migrate-single-table	Migrate a single table
schema-migration	migrate-all-tables	Migrate entire schema
scheduled-migration	daily-sync	Daily synchronization

Run History

Filter runs by:

• Status - All, Completed, Failed, Running
• Time Range - Last hour, day, week, month
• Flow - Filter by specific flow name

Run Details

Click a run to see:

1. Summary - Total duration, state, start/end times
2. Parameters - Input parameters used
3. Task Timeline - Visual breakdown of task execution
4. Logs - Full execution logs

Triggering Flows

To manually trigger a flow:

1. Select a deployment from the list
2. Click Trigger Run
3. Configure parameters:
   • Source database
   • Target database
   • Table/schema selection
4. Click Start

warning

Manual triggers execute immediately. Ensure you've selected the correct source and target databases before triggering.

Prefect Cloud Integration

Palantiri connects to Prefect Cloud for orchestration. Ensure these environment variables are set:

PREFECT_API_URL=https://api.prefect.cloud/api/accounts/{account_id}/workspaces/{workspace_id}
PREFECT_API_KEY=pnu_xxxxxxxxxxxx

note

If Prefect is not configured, this page will display a configuration message with setup instructions.

Troubleshooting

"Prefect not configured"

1. Check that PREFECT_API_URL and PREFECT_API_KEY are set
2. Verify the API key hasn't expired
3. Ensure the workspace exists

Flow runs stuck in "Pending"

1. Check that a worker is running for the work pool
2. Verify the work pool has available capacity
3. Check Prefect Cloud for infrastructure issues