Peliqan’s scheduler keeps every pipeline running on its own interval. The Data Pipeline Manager is the data app template you add when you need control over a single table – re-sync one table, reset its bookmark, or reload it clean, without re-running the whole connection.
Why you need this plugin
You can already schedule a connection to sync hourly, nightly or every fifteen minutes. That covers normal operation. What the scheduler cannot do is act on one table. When a single table fails, or a source changed and only that table needs reloading, the scheduler’s only option is to re-run everything. The Data Pipeline Manager adds that missing level of control.
What you can do with it
- 1Re-sync one table on its own. Pick a connection, then select a single table – or all incremental tables, or all non-incremental tables – and run only those.
- 2Reset a bookmark. An incremental pipeline remembers where it stopped. Reset that bookmark and the next run reloads the table in full – useful after a bad load or a schema change at the source.
- 3Truncate before re-sync, or run discovery first. Clear the table and reload it clean, or let discovery pick up new columns from the source before the sync runs.
- 4See what actually happened. Bookmarks and row counts per table, plus the last five syncs, so you can confirm a run did what you expected.
- 5Schedule your selection. Save a connection, tables and action, then give the app its own interval, days and start time so it runs on its own.
How to add it
The Data Pipeline Manager is a data app template. Add it from the templates library in Peliqan and it works against your existing connections immediately – there is nothing to install or host.
Want to try it on your own pipelines? Get started with Peliqan
