Changelog
DiscoverWorkspaces
These docs are for v1.0. Click to read the latest docs for v3.0.
Back to All
added

April 1st, 2025 - Timeseries Streaming Acces

1 day ago by Joost Wagenaar

We just released the latest Pennsieve Agent, and Pennsieve Python client with support for timeseries streaming. It is now possible to directly stream time-ranges of data from timeseries files directly into Panda's Data Frames or CSV files (using the CLI). The figure below outlines the overall structure of the new service.

Simplified process for streaming time-series data into Python data frames. When an uploaded file is processed on Pennsieve, it is stored as a set of compressed blocks with a time-range index. A request from the client for a specific range downloads the corresponding blocks, caches those locally, and streams the data into a Python Data Frame.

Simplified process for streaming time-series data into Python data frames. When an uploaded file is processed on Pennsieve, it is stored as a set of compressed blocks with a time-range index. A request from the client for a specific range downloads the corresponding blocks, caches those locally, and streams the data into a Python Data Frame.

For more information, see the Python example here: Accessing Timeseries Data in Python