THE SUMFIZZ LIBRARY

Data engineering and databases calculators

Explore 13 free tools for data engineering and databases. Find data pipeline freshness budget, data ingestion batch watermark, data stream out-of-order profile and more. Each calculator explains its inputs and method, with examples you can try using your own numbers.

THE SUMFIZZ LIBRARY

What are we working out?

13 calculators

⌕Browse all calculators →

Data pipeline freshness budget

Each stage timestamp is the newest usable data time, using one shared elapsed-time origin.

Data engineering and databases

Data ingestion batch watermark

Conceptual continuous-time watermark before an event is maximum timestamp of previous arrivals minus allowed lateness; engine-specific millisecond offsets are not modeled.

Data engineering and databases

Data stream out-of-order profile

Event and arrival timestamps use synchronized clocks and the same origin.

Data engineering and databases

Data join cardinality forecast

Enter the union of keys, using zero for absent keys; null matching follows your preprocessing policy.

Data engineering and databases

Data column encoding size estimate

Compares fixed-width raw storage with an ideal bit-packed dictionary index plus one raw dictionary entry per distinct value.

Data engineering and databases

Data partition skew audit

Partition sizes use one unit; empty partitions remain in the denominator.

Data engineering and databases

Data shuffle memory budget

The listed tasks run simultaneously on one worker; expansion and overhead are user-measured assumptions.

Data engineering and databases

Data compaction job planning

Assumes records can be repacked freely across files and one task writes each output file.

Data engineering and databases

Data small-file overhead

One metadata request and one serial setup per file per scan.

Data engineering and databases

Data snapshot incremental growth

Independent incremental storage model: the full baseline is retained and only the most recent specified increments consume additional space.

Data engineering and databases

Data migration cutover window

Changes continue during copy and cease before validation.

Data engineering and databases

Data row-count reconciliation

Positive discrepancy means expected rows are missing at destination; negative means extra destination rows.

Data engineering and databases

Data pipeline retry budget

Stop after first success or the cap.

Data engineering and databases