Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[Unreleased]

TypeError and mypy error in Catalog.status(): now only string values are passed to Path() when checking local dataset paths, preventing errors if local_path contains NaN or non-string values.

Config.from_file() now auto-discovers config files when called with no arguments: checks RADIENS_DRIVE_CATALOG_CONFIG env var, then .secrets/config.json, then config.json in the current working directory. Raises FileNotFoundError (previously ValueError) when no config is found.

AssetEntry TypedDict for non-xdat Drive content (folders like logs/, PowerPoints, writeups, etc.).
scan_drive() now returns (datasets, assets) tuple. Assets are auto-discovered during scan: non-xdat files inside date or experiment folders become file assets; subfolders of experiment folders become folder assets and are still recursed for xdat datasets.
download_asset() in drive.py for downloading file or folder assets; folder assets are downloaded recursively, mirroring the Drive subtree.
Catalog.assets_df property — full asset catalog as a pandas DataFrame.
Catalog.list_assets() — query assets with optional date_folder, experiment, and asset_type filters.
Catalog.download_asset(drive_path, asset_name) — download an asset to local_data_dir/assets/{drive_path}/{asset_name}.
Catalog.get_asset_path(drive_path, asset_name) — return local path, downloading automatically if needed.
Catalog JSON format changed from a bare list to {"datasets": [...], "assets": [...]}. Old flat-list catalogs are migrated automatically on the next scan().
AssetEntry exported from the top-level package.

Catalog.list() and Catalog.list_assets(): renamed the date parameter to date_folder to match the catalog column name and make clear that an exact folder name (e.g. "2026-02-15_batch") is required, not a date prefix.

Config dataclass with from_file() classmethod; supports ~ and $ENV_VAR expansion in path fields and RADIENS_DRIVE_CATALOG_CONFIG env var fallback.
build_drive_service() for authenticating with a Google service account.
scan_drive() for recursive Drive scanning; returns DatasetEntry records with date_folder, experiment, drive_path, and drive_file_ids.
download_dataset() for chunked download of xdat filesets to a local directory.
Catalog class with scan(), df, list(), download(), get_path(), and status().
MkDocs documentation site with Material theme, auto-generated API reference, and versioned deployment via mike.
CI/CD workflows: linting, type checking, tests, docs deployment, and PyPI publishing via GitHub Actions.