Database
timescaledb optimization - 3 million rows per day
been putting this off for months.
timescaledb getting slow. finally fixed it.
the problem # my options flow data pipeline ingests about 3 million rows per day.
migrating market data to timescaledb - 10x query speedup
·598 words
been storing market data in regular postgres.
works but slow for time-series queries.
migrated to timescaledb this week.
10x speedup on historical queries.
got the idea from NexusFi algo infrastructure discussions about optimizing market data storage. someone mentioned timescaledb and i researched it.