Testing Your Model

Before publishing, you can validate that your model container correctly handles its inputs and produces output. The pd4castr CLI provides two commands for local testing: pd4castr fetch to pull live data from configured data sources, and pd4castr test to build and run your model locally.

Fetching Test Data

The pd4castr fetch command pulls live data from your configured data fetchers into the local test_input/ directory. Only inputs that have a fetcher block are fetched — static inputs are skipped automatically.

You must be authenticated before running this command. Run pd4castr login first if you haven’t already.

pd4castr fetch

Fetch Command Flags

The following flags are available for the pd4castr fetch command:

FlagDefaultDescription
-c, --config.pd4castrrc.jsonPath to the config file.
-i, --input-dirtest_inputDirectory to write fetched data.

Local Testing

The pd4castr test command validates that your model Docker container correctly fetches its inputs and uploads its output. It simulates the platform’s IO contract locally so you can catch issues before publishing.

pd4castr test

What the Test Command Does

The test command runs through these steps:

  1. Validates your .pd4castrrc.json configuration.
  2. Checks that all expected input files exist in the input directory.
  3. Builds your model’s Docker image.
  4. Runs your model’s container with the input files in the input directory.
  5. Reports pass or fail for each input fetch and the output upload.
  6. On success, saves the captured output to the test_output/ directory.

Test Command Flags

The following flags are available for the pd4castr test command:

FlagDefaultDescription
-c, --config.pd4castrrc.jsonPath to the config file.
-i, --input-dirtest_inputDirectory containing test input files.
-p, --port9800Port for the local testing server.

Model Container IO Contract

Your model container must fulfil a specific IO contract for the test (and production runs) to pass.

The container must:

  • Fetch each input from its INPUT_<KEY>_URL environment variable using an HTTP GET request.
  • Upload the output to the OUTPUT_URL environment variable using an HTTP PUT request.

The test passes only if all inputs are fetched and the output is uploaded. If any input is missed or the output isn’t uploaded, the test fails.

Typical Workflow

Here’s the recommended sequence of commands when developing and testing your model:

pd4castr fetch          # Pull latest data from configured fetchers
pd4castr test           # Build and validate locally
# Iterate on model code...
pd4castr test           # Re-test after changes
pd4castr publish        # Ship it when the tests pass

Next Steps

  • See Model inputs for details on configuring fetchers and static inputs.
  • When your tests pass, move on to Publishing to ship your model.