Parquet

SignalK Parquet Data Store

Export, query, and explore your SignalK data archived as Parquet files

⚙️ Path Configuration

Manage which SignalK paths to collect data from:

▼ 🏠 Home Port Location (Used for proximity-based thresholds)

Add New Path Configuration

Filter by specific data source. Leave empty to accept all sources.
Only applicable when context is "vessels.*". Leave empty to include all vessels.
Loading path configurations...

🎮 Regimen/Commands Manager

Register and manage SignalK commands for remote control:

Register New Command

Separate multiple keywords with commas
🎯 Threshold-Based Activation

Edit Command

Separate multiple keywords with commas
🎯 Threshold-Based Activation
Loading commands...

📋 Command History

Loading command history...

🧠 AI Analysis with Claude

EXPERIMENTAL

Analyze your maritime data using Claude AI for insights, patterns, and recommendations.

⚓ Vessel Context Document

Click to expand - context automatically included with every AI analysis

▶

📊 Auto-Extracted Vessel Information

Loading vessel information...

✏️ Custom Context & Notes

Add any additional context about your vessel, operations, or specific information you want Claude to consider during analysis:

🎯 Custom Analysis

Enhanced: Claude explores your database interactively (more powerful, complete historical access)

Choose the Claude model for analysis. Sonnet provides the most detailed insights.

▶ Selection Options (Advanced options for legacy mode)
Loading available paths...
0 path(s) selected

📈 Analysis History

View and manage your previous Claude AI analyses.

🔍 Data Validation

Validate parquet file schemas against SignalK metadata and schema guidelines:

☁️ Cloud Status

Test your cloud storage connection (Amazon S3 or Cloudflare R2) and sync files:

📋 Key Prefix Explanation

Key Prefix organizes your uploaded files in the bucket with a directory structure:

  • Without prefix: Files upload as tier=raw/context=vessels__urn.../path=navigation__position/year=2025/day=193/file.parquet
  • With prefix "marine-data": Files upload as marine-data/tier=raw/context=vessels__urn.../path=navigation__position/...
  • With prefix "boat-123/": Files upload as boat-123/tier=raw/context=vessels__urn.../path=navigation__position/...

This allows organizing multiple vessels or data sources in the same bucket. Works identically for S3 and R2.

🔄 Cloud Sync Status

Compare local files with cloud storage and sync missing files.

🗄️ Query Database

Available SignalK data paths with Parquet files:

Loading available paths...

Query Data

Run a query to see results here...

🗺️ Map Explorer

Spatial querying and visualization of historical SignalK data. Draw a search area, configure your query, and explore results on the map.

Query Configuration

📊 Store Status & Migration

Parquet store overview, SQLite buffer status, and data migration tools.

📊 Parquet Store

Loading store stats...

💾 SQLite Buffer Status

Loading buffer status...

📁 Migrate to Hive Partitioning

Convert existing flat-structure Parquet files to Hive-style partitioned structure for better query performance.

📥 Import GPX Files

Import historical GPS tracks from .gpx files into the parquet store. Each track point is expanded into SignalK records for the selected paths and written as raw-tier parquet files.

Click to pick files or drag & drop .gpx files here
No files selected
Advanced: import from a server-side directory instead
Path is evaluated on the Signal K host — useful for bulk imports from mounted USB drives.
Leave blank to import for this vessel. Only change this if the data belongs to another vessel already known to Signal K (advanced).
Values are stored in SignalK's canonical units (m/s, rad, m). Tools that read the parquet files will display them in your configured display units, just like live data.

🗜️ Compact old years

Merges per-day parquet files within each (tier, context, path, year) group into a single per-year file, then deletes the source day-files. Run this on a long-running store to keep DuckDB queries fast and the filesystem light. Only completed years (strictly before the cutoff) are touched.