01Crypto Pipeline

Trading

A distributed quantitative trading system. Real-time cryptocurrency data ingestion, technical analysis, signal generation, and automated paper trading — processing hundreds of symbols simultaneously on a bare-metal Kubernetes cluster.

> 400
USDT Pairs
> 100
Microservices
5
Timeframes
< 5s
Latency
99.5%
Uptime
24/7
Operation
9y+
History
2.3 TB
Storage
Multi
Strategy

Data Ingestion

Real-time USDT perpetuals streamed across multiple timeframes (1m to 1d). Tiered symbol selection by volume. Idempotent batch processing for fault tolerance.

Signal Generation

Regime-aware signal engine. Market regime classification (trend, mean reversion, range) drives strategy selection at runtime — multiple strategies per regime, each calibrated to its risk profile. Volatility-scaled stop-loss and take-profit sizing.

Risk Management

Position limits, per-trade risk caps, and a daily loss circuit breaker. Automated execution with real-time P&L tracking and Telegram alerting across critical, warning, and info severities.

Live · 90-Day Window refresh every 15 min
loading ···
CUMULATIVE PNL · USDT
Cointegration Pair p-value Half-Life · h Correlation Updated
Java 17 Rust Spring Boot Tokio RedPanda TimescaleDB MicroK8s Ansible Grafana

02Global Macro Pipeline

Live

A two-layer macro intelligence pipeline. The sentiment engine collects macro-economic and social signals and composes them into a unified fear/greed index with regime classification. The indicator engine ingests a curated catalog of tier-1 macro series — rates, inflation, labor, growth, FX, credit, commodities, volatility, equities — and exposes both raw observations and a set of derived metrics (YoY/MoM changes, spreads, ratios, z-scores) for downstream analysis. Both write to the same TimescaleDB.

Live · Macro Snapshot refresh hourly
Source contribution · current
FEAR / GREED · 30D
Macro Indicators · Live
80+
Series Tracked
18
Categories
Hourly
Sentiment Refresh
TimescaleDB
Hypertables

Data Sources

Two ingestion layers feed the same TimescaleDB. The sentiment layer pulls VIX, DXY, credit spreads and yield curves from Yahoo Finance and FRED, GDELT global news sentiment, Google Trends across thirteen economic keywords, YouTube trending across five countries, and Reddit (gated on API approval). The indicator layer maintains a curated catalog of seventy-three tier-1 macro-economic series across eighteen categories — monetary policy, Treasury yield curve, inflation (CPI / PCE / PPI), labor markets, growth and activity, credit conditions, commodities, FX, volatility, equities, ETFs, and housing — addressed through a normalised series_id namespace and refreshed at the cadence of each source.

Composite Scoring

The sentiment scorer composes a unified fear/greed index from seven weighted sources — VIX (25 %), credit spreads (15 %), news tone (15 %), policy uncertainty (15 %), yield curve (10 %), social sentiment (10 %), Google Trends (10 %) — and assigns a five-level regime classification from extreme fear to extreme greed. The indicator layer additionally computes derived metrics on top of the raw observations: year-on-year and month-on-month changes, cross-asset spreads (real 10Y yield, HY–IG OAS, term-structure premia), ratios (copper–gold for growth, NDX–RUT for rotation), and rolling z-scores and percentiles for context. All derivations recompute after each observation cycle.

Resilience

Both pipelines write to TimescaleDB hypertables with per-chunk columnar compression past the active edit window and time-bucketed retention policies; the sentiment ingestors additionally use a Kafka dual-write pattern for redundancy. The schema migration from the v1 legacy layout to the v2 canonical model ran in parallel for a multi-week validation window before any legacy table was decommissioned — change-over without an outage event. Ansible-automated ingestor deployments, run-log records per cycle, and Telegram alerting on failure.

Python RedPanda TimescaleDB Grafana MicroK8s Ansible

03Linuso Analytics

In Development

A large-scale data analytics engine that ingests billions of data points and runs quantitative analysis to uncover statistical relationships across crypto markets and macroeconomic signals.

~6B
Target Data Points
1500+
Symbols
73
Macro Indicators
80
DB Tables
7.4K
LOC (Rust)

Quantitative Foundations

Engle-Granger cointegration with half-life filtering, spectral analysis grounded in Random Matrix Theory, principal component decomposition, asset-graph network analysis with community detection, and regime classification. The statistical backbone behind every strategy and signal in the stack.

Predictive Modeling

Return forecasting model in alpha phase — feature engineering and labeling pipelines currently producing tier-1 symbol predictions. Walk-forward validation with parameter stability testing gates promotion to production. Cross-pipeline signal fusion brings macro-sentiment regimes into the crypto strategy selector.

Risk & Attribution

Planned next phase: PCA-derived factor models for systematic risk decomposition, Bayesian strategy ensembling weighted by recent regime fit, and PnL attribution that separates alpha from market beta and funding-rate drift. The framework that turns aggregate performance into actionable allocation signals.

Python 3.11 Rust TimescaleDB MicroK8s Argo CD GitLab CI

Roadmap

Real-time data pipeline · 400+ pairs · 5 timeframes Complete
Macro sentiment engine · 7 sources · composite regime scoring Complete
Regime-aware multi-strategy trading Complete
Cointegration pairs trading · Engle-Granger + half-life filtering Complete
Walk-forward parameter optimization with stability analysis Complete
Cross-pipeline signal fusion · macro regime as input to crypto strategy selection In Progress
Return forecasting model · alpha phase · feature gathering and tier-1 symbol predictions In Progress
Quantitative risk & performance framework · PCA factor models, Bayesian strategy ensembling, alpha vs. beta vs. funding attribution Planned
Return forecasting model · production rollout across all symbol tiers as a primary signal Planned