Airflow Crawler Monitor

Input Method

Choose Input Method

Commands Input

Commands (one per line)

Server

Configuration

Group Name (Optional)

Project

Since Date

Until Date

Data Path

Server

Schedule Job (Optional)

Load from PWR (Posts with Replies)

Group Name (Optional)

Project

Filter by Social Media

All

Twitter

TikTok

Facebook

YouTube

Search Objects

Select Objects (Instagram accounts excluded)

Start Date

End Date

Server

Schedule Job (Optional)

Filter by Labels

Fetch posts first to filter by labels

Manual Entry with Object Groups

Project (Select First) *

Group Name (Optional)

Default Server

Schedule Job (Optional)

Object Groups

How it works:

Select project first to load available objects
Add one or more object groups
Each group can have different URLs, dates, and job splitting
Jobs will be created based on your splitting configuration

Configuration

Group Name (Optional)

Project

Since Date

Until Date

Schedule Job (Optional)

All 0

Queued 0

Pending 0

Running 0

Completed 0

Failed 0

Cancelled 0

Select all on page

0 job(s) selected

Recurring Schedules

0 schedule(s) selected

Loading schedules...

Server Resources & Load

Real-time metrics from Prometheus • Thresholds: CPU/Memory 90%, Disk 95%

Loading server metrics...

Airflow Crawler

JAR Crawler

Global Configuration

Projects

Input Method

Commands Input

Form Configuration

Configuration

Load from PWR (Posts with Replies)

Manual Entry with Object Groups

Object Groups

Configuration

Recurring Schedules

Server Resources & Load

Airflow Crawler

JAR Crawler

Global Configuration

Projects

Input Method

Commands Input

Form Configuration

Configuration

Load from PWR (Posts with Replies)

Manual Entry with Object Groups

Object Groups

Configuration

Recurring Schedules

Server Resources & Load

Saved Filters

Edit Multiple Schedules

Bulk Create Schedules

Common Settings

Create Schedule

Save Filter

�� Job Logs