Configuration File

The .pd4castrrc.json file is the central configuration for your model project. It lives at the root of your model directory and defines everything the platform needs to know about your model: its identity, inputs, outputs, sensitivities, and scheduling behaviour. The CLI validates this file against a schema on every command.

File Location and Format

The configuration file must be named .pd4castrrc.json and placed at the root of your model project. It uses standard JSON format. You can generate a starter config by running pd4castr init, which scaffolds a new project from a template.

You can point the CLI to a different config file using the -c or --config flag on any command:

pd4castr test -c .pd4castrrc.variant.json

Complete Field Reference

Top-Level Fields

These fields define your model’s identity and global behaviour.

FieldTypeRequiredDefaultDescription
namestringYes—Display name for the model.
forecastVariablestringYes—The variable being forecast. Currently only "price" is supported.
timeHorizonstringYes—Forecast time horizon: "day_ahead", "week_ahead", "quarterly", "annual", or "historical".
displayTimezonestringNoAustralia/BrisbaneIANA timezone string used for display in the pd4castr UI.
publicbooleanNofalseWhether the model is visible to other organisations.
runModestringNo"AUTOMATIC"How runs are triggered: "AUTOMATIC" or "ON_DEMAND". See Run modes.
outputFileFormatstringNo"json"Format the model outputs: "json", "csv", or "parquet". See Model outputs.
runDatetimeQuerystring or nullNonullPath to a SQL file for custom run datetime. See Custom run datetime.
summarystringNo""Terse description of the model, shown at the top of the model info page, below the model name (max 500 characters).
descriptionstringNo—Inline long-form Markdown description of the model, shown in the Description section of the model info page, below the summary.
descriptionFilestringNo—Path to a Markdown file whose contents are inlined at publish time and shown the same way as description. Mutually exclusive with description.
metadataobjectNo{}Freeform key-value metadata (for example, resolution, feature lists), shown in the Raw training metadata section of the model info page.
defaultComparisonModelsarray of UUIDsNo[]Model group IDs used as default comparison selections in the pd4castr UI. See Default comparison models.
axesarrayNo[]Dimensions the model runs over: one run per value on every trigger, or one trigger per source on a source-binding axis. See Model axes.

The platform UI recognises several well-known keys in metadata when present: resolution is used to build the model’s display name; features and feature_importances (aligned arrays of strings and numbers) power the feature importances panel; loss_function is shown as a training metadata attribute alongside author, version, and training_period; links adds labelled URLs (see Model links). Any other keys are preserved verbatim and visible in the Raw training metadata section.

metadata.links is a list of labelled URLs shown in the Model Info dialog and at the top of the model details card on the model info page. Each entry needs a label and a url, and both must be non-empty; entries that aren’t are skipped.

{
  "metadata": {
    "links": [
      {
        "label": "Retrospective reports",
        "url": "https://pdview.com.au/blog?category=retrospective-reports&tags=week-ahead"
      }
    ]
  }
}

A model that declares no links derives one from its horizon: week-ahead and quarterly point at the blog listing for their cadence. Declaring links replaces it.

Default comparison models

defaultComparisonModels lists the models used as default comparison selections in the pd4castr UI, before a viewer picks anything. Entries are model group IDs, and each resolves to the newest revision of that group, so a selection keeps tracking the target model as its author republishes.

Find a model group ID in the $$modelGroupID field of the target model’s .pd4castrrc.json, or as modelGroupId on any model returned by GET /v1/model.

{
  "defaultComparisonModels": ["828e98b1-9916-4a85-8a20-831fb2396845"]
}

An entry is skipped when it names a group on a different time horizon, a group you cannot see, or your own model’s group. Omit the field, or set it to [], for no default selections.

The value is read at publish time, so a change only takes effect once you republish the model.

Inputs

The inputs array defines the data your model consumes. Each entry has the following fields:

FieldTypeRequiredDefaultDescription
keystringYes—Identifier for this input. Becomes INPUT_<KEY>_URL in the container.
triggerstringYes—"WAIT_FOR_LATEST_FILE" or "USE_MOST_RECENT_FILE".
filestringStatic inputs without sources—Path to the local file the CLI uploads, relative to the project root.
storageLocationstringNo—ID of the storage location your input’s files land in. By default, the platform’s shared storage location is used. An input with sources declares it per source.
uploadFileFormatstringNo"json"Format of the uploaded file: "json", "csv", or "parquet".
targetFileFormatstringNo"json"Format served to the container. Converted automatically if different from uploadFileFormat.
axesobjectNo—Names the column this file is partitioned by, per axis, with { "kind": "partition", "column": ... }, or declares the input’s participation in a source-binding axis with { "kind": "source-binding" }. See Model axes.
sourcesobjectInputs that participate in a source-binding axis—One entry per source, keyed by source key. See Input sources.

For an input with automatic data fetching, add a fetcher block. An input with sources declares no fetcher of its own: each fetcher source declares one inside its sources entry, with the same fields.

FieldTypeRequiredDescription
fetcher.typestringYesThe fetcher type, for example, "AEMO_MMS".
fetcher.checkIntervalnumberYesPolling interval in seconds. Minimum 60.
fetcher.config.checkQuerystringYesPath to a SQL file containing a query that returns a “check”, used for determining whether new data is available.
fetcher.config.fetchQuerystringYesPath to a SQL file containing a query that retrieves the data when new data is detected.

For an input that declares sources, each entry of sources has:

FieldTypeRequiredDefaultDescription
sources.<key>.filestringExactly one of file/fetcher—Path to the local file the CLI uploads, relative to the project root.
sources.<key>.fetcherobjectExactly one of file/fetcher—Data fetcher configuration for this source.
sources.<key>.storageLocationstringNo—ID of the storage location this source’s files land in.
sources.<key>.uploadFileFormatstringNothe input’s uploadFileFormatFormat of this source’s files.
sources.<key>.maxFileAgenumberNo—Seconds this source’s latest file can age before Pipelabs receives an alert, minimum 60.

See Model inputs for detailed explanations, and Input sources for inputs that declare sources.

Datasets

The datasets array defines static reference data published alongside the model. Each entry has the following fields:

FieldTypeRequiredDefaultDescription
keystringYes—Identifier for this dataset. Used as the table name when the dataset is queried.
filestringYes—Path to the local file the CLI uploads, relative to the project root.
fileFormatstringNoinferred"json", "csv", or "parquet". Inferred from the file extension when omitted.
storageLocationstringNo—ID of the storage location your dataset’s files land in. By default, the platform’s shared storage location is used.
axesobjectNo—Names the column this file is partitioned by, per axis. Parquet datasets only. See Model axes.

See Model datasets for detailed explanations.

Outputs

The outputs array defines the schema of your model’s forecast data.

FieldTypeRequiredDefaultDescription
namestringYes—Display name for this output variable. This will be shown in the pd4castr UI.
keystringYes—Stable identifier for this output variable. Must be lowercase alphanumeric (with hyphens/underscores). Must be unique within the model.
typestringYes—Data type: "float", "integer", "string", "date", "boolean".
seriesKeybooleanYes—If true, this column is a categorical series key for chart grouping.
colourstringNo—Hex colour code (#RRGGBB) for this series in the forecast chart.

See Model outputs for detailed explanations.

Sensitivities

The sensitivities array defines alternative scenario runs. Each entry has the following fields:

FieldTypeRequiredDefaultDescription
namestringYes—Display name for the scenario, shown in the pd4castr UI.
keystringYes—Stable identifier for this sensitivity. Must be lowercase alphanumeric (with hyphens/underscores). Must be unique within the model.
querystringYes—Path to a SQL file that transforms the input data.

See Sensitivities for detailed explanations.

Input Aggregations

The inputAggregations array defines summary views of input data displayed below the forecast chart.

FieldTypeRequiredDefaultDescription
namestringYes—Display name for the aggregation chart.
keystringYes—Stable identifier for this aggregation, tracked across revisions. Must be lowercase alphanumeric (with hyphens/underscores). Must be unique within the model.
querystringYes—Path to a SQL file that aggregates input data.
descriptionstringNo""Tooltip text shown in the pd4castr UI when hovering over the chart title.
coloursstring[]No[]Array of hex colour strings for chart series.

See Input aggregations for detailed explanations.

Views

The views array defines custom model run views: parameterized reports that visualize a run’s output as a chart or table in the pd4castr UI. Each view runs a SQL query over the run output and supporting data.

FieldTypeRequiredDefaultDescription
keystringYes—Unique identifier for the view. Lowercase alphanumeric, with hyphens/underscores.
namestringYes—Display name for the view, shown in the pd4castr UI.
sqlstringYes—Path to the view’s SQL file.
paramsobjectNo{}Map of parameter name to parameter configuration.
columnsarrayYes—Metadata for each column the query returns.

Each entry in params supports type (string, number, or boolean), optional, control (select), options (path to an options SQL file), defaultFrom, and sample. Each entry in columns supports key, role (dimension or measure), label, unit, and format.

See Model run views for detailed explanations.

File Paths

All file paths in the configuration are relative to the project root. This includes query paths (fetcher queries, sensitivity queries, input aggregation queries, view queries, view options queries, and runDatetimeQuery) and the descriptionFile Markdown path. See SQL queries for the SQL dialect each query is written in.

Full Example

Here’s a complete .pd4castrrc.json for a day-ahead price forecast model with fetched inputs, output series, and input aggregations:

{
  "name": "Day Ahead Price Forecast",
  "forecastVariable": "price",
  "timeHorizon": "day_ahead",
  "displayTimezone": "Australia/Brisbane",
  "public": false,
  "runMode": "AUTOMATIC",
  "outputFileFormat": "json",
  "runDatetimeQuery": "queries/run-datetime.sql",
  "summary": "30-minute day-ahead electricity price forecast",
  "descriptionFile": "docs/description.md",
  "metadata": {
    "resolution": "30min"
  },
  "defaultComparisonModels": ["828e98b1-9916-4a85-8a20-831fb2396845"],
  "inputs": [
    {
      "key": "dispatch_price",
      "trigger": "WAIT_FOR_LATEST_FILE",
      "uploadFileFormat": "json",
      "targetFileFormat": "json",
      "fetcher": {
        "type": "AEMO_MMS",
        "checkInterval": 300,
        "config": {
          "checkQuery": "queries/data-fetchers/dispatch-price-check.sql",
          "fetchQuery": "queries/data-fetchers/dispatch-price-fetch.sql"
        }
      }
    },
    {
      "key": "regional_boundaries",
      "file": "test_input/regional_boundaries.csv",
      "trigger": "USE_MOST_RECENT_FILE",
      "uploadFileFormat": "csv",
      "targetFileFormat": "csv"
    }
  ],
  "datasets": [
    {
      "key": "duid_info",
      "file": "datasets/duid_info.parquet"
    }
  ],
  "outputs": [
    {
      "name": "NSW1",
      "key": "nsw1",
      "type": "float",
      "seriesKey": true,
      "colour": "#84EDDC"
    },
    {
      "name": "QLD1",
      "key": "qld1",
      "type": "float",
      "seriesKey": true,
      "colour": "#FD4E4E"
    },
    {
      "name": "SA1",
      "key": "sa1",
      "type": "float",
      "seriesKey": true,
      "colour": "#FED600"
    },
    {
      "name": "TAS1",
      "key": "tas1",
      "type": "float",
      "seriesKey": true,
      "colour": "#40A967"
    },
    {
      "name": "VIC1",
      "key": "vic1",
      "type": "float",
      "seriesKey": true,
      "colour": "#1965C6"
    }
  ],
  "sensitivities": [
    {
      "name": "High Demand (+10%)",
      "key": "high-demand",
      "query": "queries/sensitivities/high-demand.sql"
    }
  ],
  "inputAggregations": [
    {
      "name": "Native Demand",
      "key": "native-demand",
      "query": "queries/input-aggregations/native-demand.sql",
      "description": "Regional demand by demand_and_nonshedgen",
      "colours": ["#008000", "#009900", "#00B300", "#00CC00", "#00E600"]
    }
  ]
}

Next Steps