Skip to main content
Version: 2.0.0 (Latest)

Cores

Management → Cores is the workload placement and deployment lifecycle surface: you assign sources, tasks, and sinks to one PADAS Core per inventory row, deploy configuration revisions to the engine, and read deployment state and deployment drift. It does not author pipeline topology or replace live runtime graphs—that work lives under Configurations and Control Tower.

Architecture context

LayerRole
Control planeStores assignments, drives deploy to each Core, and surfaces deployment drift markers.
Core runtimeRuns deployed workloads after runtime activation; reports status back to the UI.
This pageOrchestrates desired statedeployed state for per-component placement—not stream processing itself.
warning
  • Assigning workloads saves placement; it does not deploy revisions to the Core.
  • Deploying pushes deployed state; it does not start runtime execution.
  • Runtime activation (start / stop) is separate—use Advanced after deploy.

What this page manages

TopicWhere
Component placement for sources, tasks, sinksThis page — which workloads belong on which Core.
Pipeline topology (graph authoring)Pipelines
Pipeline assign + Deploy AllManagement → Pipelines
Engine registration (Host / Port / credentials directory)Cores
Live execution graph and pipeline-level controlsControl Tower

Assignment lifecycle

At a high level: define registry objects → bind them to a Core → deployactivate execution elsewhere.

StepMeaning
PlacementAssign saves which components run on this Core (desired state in the control plane).
DeployRow Deploy or Assign and Deploy pushes revisions so deployed state matches desired state.
ActivationAdvanced start / stop controls runtime execution after a successful deploy.

Assign vs deploy vs start

ActionUpdates placementDeployed on CoreRuntime activation
AssignYesNoNo
Assign and DeployYesYesNo
Deploy (row)Yes (pending slices)No
Start / Stop (Advanced)Uses last deployYes

Core inventory

Scan rows for connectivity, bound workloads, and deployment drift before incident deep dives.

ColumnUse
Core ID / NameStable row identity and operator label.
Host / PortManagement endpoint—should match Cores registration.
Sources / Tasks / SinksWorkload tags bound to this Core; empty implies unfinished placement.
ActionsAssign opens the modal; Deploy pushes pending changes for this Core only.
Management Cores list with Host, Port, component tags, and actions
Core inventory and deployment state.

Filters and search behave like other Management grids.

Working with assignments

Open Assign to choose sources, tasks, and sinks for the row.

ControlEffect
AssignSaves placement only—desired state updates; no push to the engine.
Assign and DeploySaves placement and runs deploy so the Core receives updated definitions.

Modal flow: pick components → Assign or Assign and Deploy. Until deploy completes, the runtime keeps the previous deployed revision for affected workloads.

Assign modal selecting Sources, Tasks, and Sinks for a Core
Component assignment workflow.

Deployment drift

Needs deploy means deployed state on the Core differs from desired state for that component—the registry or placement moved ahead of what the engine loaded.

BehaviorDetail
ScopeDrift is per component tag; tooltips usually name the stale object.
During deployRuntime execution can keep using the prior deployed revision for that slice until deploy finishes successfully.
Operator responseUse row Deploy or modal Assign and Deploy; clear warnings before assuming runtime parity with the registry.
Core row with Needs deploy indicator on a component tag
Deployment drift on assigned components.

Relationship to pipelines

SurfaceResponsibility
CoresWorkload placementsources, tasks, sinksone Core per row; per-component deploy.
PipelinesPipeline deployment — which pipeline attaches to which Core(s); Deploy All for pipeline topology.
Control TowerRuntime execution visibilitylive topology, stage health, graph-level actions on the selected Core.

Pipelines orchestrate graph-level rollouts; Cores reconcile component-level placement and deployment state. Both may be required before data flows end-to-end.

Activation after deploy

Deployment alone does not start workloads. After deployed state is current, use Advanced (Tasks, Sources, Sinks) for runtime activation. Control Tower complements this with pipeline execution visibility and controls when pipelines are attached.

Operational workflow

  1. Verify Core connectivityHost / Port align with Cores.
  2. Review assigned workloads — tags show sources, tasks, sinks on each row.
  3. Check deployment drift — clear needs deploy before trusting deployed state.
  4. Deploy pending changes — row Deploy or Assign and Deploy before blaming runtime issues.
  5. Start workloadsAdvanced when execution should run.
  6. Observe behaviorControl Tower and Pipelines status for graph-level posture.