Uploading with the Pennsieve Agent

Details on how to upload file with the Pennsieve Agent

This document assumes you have the Pennsieve Agent installed and configured.


1. Confirm the Pennsieve Agent is running

  1. In your terminal, enter:

pennsieve agent

  1. Confirm you see one of the following messages:
  • Pennsieve Agent started on port: 9000

  • Pennsieve Agent is already running on port: 9000


2. Check agent configuration

  1. Run:

pennsieve whoami

  1. This confirms your agent is correctly configured with an API key.

It should display details such as your name, user ID, organization, and organization ID.


3. Find your dataset in the Pennsieve web app

  1. Log in to Pennsieve in your web browser.

  2. Go to Workspaces.

  3. Open the your workspace.

  4. Locate the dataset you want to upload to.

    1. If it's not created, create a New Dataset
  5. Once loaded, find the Dataset node ID in the header.

Example:

N:dataset:XXXXXX-XXXX-XXXX-XXXX-XXXXXX

  1. Copy this ID.

4. Set your active dataset

  1. In your terminal, run:

pennsieve dataset use N:dataset:XXXXXX-XXXX-XXXX-XXXX-XXXXXX

(Paste in the ID you copied in the previous step.)


5. Create a manifest

  1. A manifest is a list of files and folders you want to upload.

  2. Run:


pennsieve manifest create "/FULL/PATH/TO/YOUR/DATA"

Example output:

Manifest ID: 15 Message: Successfully indexed 20 files.

  • Note the Manifest ID (e.g., 15).

  • On Windows, the command might look like:


pennsieve manifest create "C:\FULL\PATH\TO\YOUR\DATA"

  • The path can be a single file or an entire folder.

6. Upload the manifest

  1. Run:

pennsieve upload manifest MANIFEST_ID

Example:


pennsieve upload manifest 15


7. Monitor the upload

  • The files will begin uploading and will soon appear in your dataset on the Pennsieve website.

8. Verify the upload

  1. Log in to the Pennsieve website.

  2. Go to WorkspacesYOUR WORKSPACE.

  3. Select your group’s dataset.

  4. Click Activity in the left navigation menu.

  5. Click the Upload Manifests tab.

  6. Expand the relevant upload manifest.

  7. Expand Show all Files.

  8. Check for any Failed or In Progress files.

  9. If there are failures, simply re-run:


pennsieve upload manifest MANIFEST_ID

The upload will resume where it left off.