📊 Detailed Query Results

Exasol vs ClickHouse Performance Comparison on TPC-H SF30

Author: Oleksandr Kozachuk, Principal Architect at Exasol AG Date: 2025-10-24 15:46:50 Environment: AWS eu-west-1

Overview

This report presents the complete query-by-query performance results for 4 database systems tested using the TPC-H benchmark at scale factor 30.

Systems Under Test

Exasol 2025.1.0

Environment & Hardware

  • Cloud: AWS eu-west-1
  • Instance: r5d.4xlarge
  • CPU: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz (16 vCPUs)
  • Memory: 124.4GB RAM

Software

  • Database: exasol 2025.1.0

Clickhouse 25.9.4.58

Environment & Hardware

  • Cloud: AWS eu-west-1
  • Instance: r5d.4xlarge
  • CPU: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz (16 vCPUs)
  • Memory: 124.4GB RAM

Software

  • Database: clickhouse 25.9.4.58

Clickhouse_tuned 25.9.4.58

Environment & Hardware

  • Cloud: AWS eu-west-1
  • Instance: r5d.4xlarge
  • CPU: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz (16 vCPUs)
  • Memory: 124.4GB RAM

Software

  • Database: clickhouse 25.9.4.58

Clickhouse_stat 25.9.4.58

Environment & Hardware

  • Cloud: AWS eu-west-1
  • Instance: r5d.4xlarge
  • CPU: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz (16 vCPUs)
  • Memory: 124.4GB RAM

Software

  • Database: clickhouse 25.9.4.58

Performance Summary

Key Findings

  • exasol was the fastest overall with 165.9ms median runtime
  • clickhouse_stat was 10.0× slower
  • Tested 616 total query executions across 22 different query types

Performance Visualizations

Detailed Analysis

Performance by Query Type

The benchmark results reveal distinct performance characteristics across different query categories:

The following table shows the median performance for each query category across all systems:

Query Type clickhouse clickhouse_stat clickhouse_tuned exasol Winner
Aggregation 217.20 275.30 530.90 63.40 exasol
Join-Heavy 3,484.60 1,414.90 3,477.00 138.40 exasol
Complex Analytical 2,445.00 2,744.90 2,472.30 213.50 exasol

Query-by-Query Results

The following table shows the median execution time for each query across all systems:

query baseline_system comparison_system baseline_ms comparison_ms ratio speedup faster
Q01 exasol clickhouse_tuned 622.30 1,613.60 2.59 0.39 0
Q02 exasol clickhouse_tuned 51.90 615.30 11.86 0.08 0
Q03 exasol clickhouse_tuned 213.50 2,440.40 11.43 0.09 0
Q04 exasol clickhouse_tuned 48.00 4,707.00 98.06 0.01 0
Q05 exasol clickhouse_tuned 154.40 5,313.80 34.42 0.03 0
Q06 exasol clickhouse_tuned 32.30 128.30 3.97 0.25 0
Q07 exasol clickhouse_tuned 177.60 2,951.50 16.62 0.06 0
Q08 exasol clickhouse_tuned 60.70 5,712.70 94.11 0.01 0
Q09 exasol clickhouse_tuned 696.80 7,658.80 10.99 0.09 0
Q10 exasol clickhouse_tuned 343.70 1,652.00 4.81 0.21 0
Q11 exasol clickhouse_tuned 121.00 400.80 3.31 0.30 0
Q12 exasol clickhouse_tuned 63.40 530.90 8.37 0.12 0
Q13 exasol clickhouse_tuned 449.10 2,443.70 5.44 0.18 0
Q14 exasol clickhouse_tuned 57.70 131.40 2.28 0.44 0
Q15 exasol clickhouse_tuned 205.90 191.30 0.93 1.08 1
Q16 exasol clickhouse_tuned 377.50 441.20 1.17 0.86 0
Q17 exasol clickhouse_tuned 21.60 811.80 37.58 0.03 0
Q18 exasol clickhouse_tuned 418.90 6,865.30 16.39 0.06 0
Q19 exasol clickhouse_tuned 22.20 3,895.40 175.47 0.01 0
Q20 exasol clickhouse_tuned 228.70 847.90 3.71 0.27 0
Q21 exasol clickhouse_tuned 261.90 9,568.80 36.54 0.03 0
Q22 exasol clickhouse_tuned 78.80 362.40 4.60 0.22 0
Q01 exasol clickhouse 622.30 1,592.20 2.56 0.39 0
Q02 exasol clickhouse 51.90 611.20 11.78 0.08 0
Q03 exasol clickhouse 213.50 2,435.00 11.41 0.09 0
Q04 exasol clickhouse 48.00 1,410.40 29.38 0.03 0
Q05 exasol clickhouse 154.40 5,338.40 34.58 0.03 0
Q06 exasol clickhouse 32.30 126.70 3.92 0.25 0
Q07 exasol clickhouse 177.60 2,920.10 16.44 0.06 0
Q08 exasol clickhouse 60.70 5,646.50 93.02 0.01 0
Q09 exasol clickhouse 696.80 7,560.30 10.85 0.09 0
Q10 exasol clickhouse 343.70 1,615.70 4.70 0.21 0
Q11 exasol clickhouse 121.00 389.90 3.22 0.31 0
Q12 exasol clickhouse 63.40 528.80 8.34 0.12 0
Q13 exasol clickhouse 449.10 2,431.70 5.41 0.18 0
Q14 exasol clickhouse 57.70 129.00 2.24 0.45 0
Q15 exasol clickhouse 205.90 182.00 0.88 1.13 1
Q16 exasol clickhouse 377.50 338.30 0.90 1.12 1
Q17 exasol clickhouse 21.60 2,589.90 119.90 0.01 0
Q18 exasol clickhouse 418.90 2,556.20 6.10 0.16 0
Q19 exasol clickhouse 22.20 1,618.70 72.91 0.01 0
Q20 exasol clickhouse 228.70 217.20 0.95 1.05 1
Q21 exasol clickhouse 261.90 20,869.60 79.69 0.01 0
Q22 exasol clickhouse 78.80 379.70 4.82 0.21 0
Q01 exasol clickhouse_stat 622.30 1,750.80 2.81 0.36 0
Q02 exasol clickhouse_stat 51.90 531.50 10.24 0.10 0
Q03 exasol clickhouse_stat 213.50 2,801.30 13.12 0.08 0
Q04 exasol clickhouse_stat 48.00 1,614.40 33.63 0.03 0
Q05 exasol clickhouse_stat 154.40 5,460.10 35.36 0.03 0
Q06 exasol clickhouse_stat 32.30 158.00 4.89 0.20 0
Q07 exasol clickhouse_stat 177.60 3,063.20 17.25 0.06 0
Q08 exasol clickhouse_stat 60.70 1,113.60 18.35 0.05 0
Q09 exasol clickhouse_stat 696.80 3,163.10 4.54 0.22 0
Q10 exasol clickhouse_stat 343.70 1,736.30 5.05 0.20 0
Q11 exasol clickhouse_stat 121.00 401.30 3.32 0.30 0
Q12 exasol clickhouse_stat 63.40 669.30 10.56 0.09 0
Q13 exasol clickhouse_stat 449.10 2,440.90 5.44 0.18 0
Q14 exasol clickhouse_stat 57.70 243.30 4.22 0.24 0
Q15 exasol clickhouse_stat 205.90 236.10 1.15 0.87 0
Q16 exasol clickhouse_stat 377.50 347.30 0.92 1.09 1
Q17 exasol clickhouse_stat 21.60 2,805.50 129.88 0.01 0
Q18 exasol clickhouse_stat 418.90 2,755.60 6.58 0.15 0
Q19 exasol clickhouse_stat 22.20 2,800.30 126.14 0.01 0
Q20 exasol clickhouse_stat 228.70 275.30 1.20 0.83 0
Q21 exasol clickhouse_stat 261.90 21,243.20 81.11 0.01 0
Q22 exasol clickhouse_stat 78.80 396.70 5.03 0.20 0

Detailed Statistics

The complete performance statistics for all queries and systems:

query system warmup runs median_ms mean_ms std_ms min_ms max_ms
Q01 clickhouse 1,603.80 7 1,592.20 1,597.40 16.20 1,580.20 1,618.20
Q01 clickhouse_stat 1,759.40 7 1,750.80 1,755.90 9.10 1,746.10 1,768.00
Q01 clickhouse_tuned 1,611.50 7 1,613.60 1,616.40 9.50 1,605.90 1,633.80
Q01 exasol 621.50 7 622.30 622.50 1.00 621.40 623.90
Q02 clickhouse 836.10 7 611.20 613.40 15.60 597.20 636.80
Q02 clickhouse_stat 663.80 7 531.50 530.90 7.50 518.30 538.40
Q02 clickhouse_tuned 824.70 7 615.30 622.60 15.10 601.50 639.50
Q02 exasol 67.40 7 51.90 52.00 0.50 51.20 52.50
Q03 clickhouse 2,683.90 7 2,435.00 2,423.90 27.60 2,379.30 2,445.50
Q03 clickhouse_stat 3,171.30 7 2,801.30 2,817.10 55.10 2,744.90 2,908.50
Q03 clickhouse_tuned 2,698.70 7 2,440.40 2,437.90 34.20 2,389.20 2,487.80
Q03 exasol 219.10 7 213.50 210.20 7.50 200.70 220.50
Q04 clickhouse 1,482.40 7 1,410.40 1,386.60 40.40 1,336.40 1,427.20
Q04 clickhouse_stat 1,676.70 7 1,614.40 1,613.50 24.10 1,579.70 1,638.80
Q04 clickhouse_tuned 5,293.90 7 4,707.00 4,685.30 158.30 4,406.20 4,930.70
Q04 exasol 49.50 7 48.00 48.30 1.00 47.20 50.30
Q05 clickhouse 5,639.20 7 5,338.40 5,324.90 59.90 5,252.40 5,402.40
Q05 clickhouse_stat 6,255.90 7 5,460.10 5,534.60 177.60 5,357.00 5,882.00
Q05 clickhouse_tuned 5,811.40 7 5,313.80 5,319.90 76.00 5,231.70 5,438.40
Q05 exasol 207.20 7 154.40 154.40 0.80 153.10 155.50
Q06 clickhouse 132.30 7 126.70 127.60 4.90 122.70 136.70
Q06 clickhouse_stat 334.20 7 158.00 162.40 9.90 153.70 182.20
Q06 clickhouse_tuned 276.80 7 128.30 128.30 3.00 124.80 134.10
Q06 exasol 32.80 7 32.30 32.20 0.30 31.60 32.50
Q07 clickhouse 3,212.40 7 2,920.10 2,898.00 77.70 2,789.70 2,973.20
Q07 clickhouse_stat 3,340.70 7 3,063.20 3,064.80 26.50 3,036.90 3,112.00
Q07 clickhouse_tuned 3,241.60 7 2,951.50 2,947.10 73.20 2,828.70 3,025.10
Q07 exasol 183.20 7 177.60 177.60 1.20 176.40 179.50
Q08 clickhouse 5,644.90 7 5,646.50 5,661.70 66.90 5,566.50 5,757.20
Q08 clickhouse_stat 1,116.10 7 1,113.60 1,111.40 23.80 1,080.90 1,149.90
Q08 clickhouse_tuned 5,676.70 7 5,712.70 5,702.90 54.30 5,610.20 5,773.00
Q08 exasol 71.20 7 60.70 66.80 17.00 59.90 105.40
Q09 clickhouse 7,980.70 7 7,560.30 7,544.30 90.00 7,372.70 7,653.50
Q09 clickhouse_stat 3,635.70 7 3,163.10 3,149.80 63.70 3,051.40 3,221.20
Q09 clickhouse_tuned 8,137.70 7 7,658.80 7,640.90 90.60 7,540.00 7,751.10
Q09 exasol 727.50 7 696.80 697.30 1.30 696.20 699.50
Q10 clickhouse 1,892.80 7 1,615.70 1,633.60 47.70 1,573.70 1,716.80
Q10 clickhouse_stat 1,874.10 7 1,736.30 1,741.90 41.60 1,679.90 1,794.30
Q10 clickhouse_tuned 1,901.00 7 1,652.00 1,649.00 54.00 1,589.70 1,722.30
Q10 exasol 348.80 7 343.70 342.60 5.60 333.80 348.50
Q11 clickhouse 456.40 7 389.90 393.10 11.90 378.40 410.80
Q11 clickhouse_stat 462.60 7 401.30 400.30 7.30 389.10 409.20
Q11 clickhouse_tuned 459.20 7 400.80 403.30 10.10 387.10 417.80
Q11 exasol 117.50 7 121.00 120.80 1.80 118.70 123.70
Q12 clickhouse 1,321.70 7 528.80 526.70 13.00 505.80 540.70
Q12 clickhouse_stat 817.50 7 669.30 659.20 34.20 583.20 684.70
Q12 clickhouse_tuned 1,294.00 7 530.90 532.50 10.50 517.60 549.70
Q12 exasol 65.10 7 63.40 63.30 0.50 62.60 64.00
Q13 clickhouse 2,631.60 7 2,431.70 2,452.00 47.20 2,407.50 2,536.30
Q13 clickhouse_stat 2,692.00 7 2,440.90 2,449.50 64.10 2,359.80 2,574.10
Q13 clickhouse_tuned 2,674.40 7 2,443.70 2,463.20 66.70 2,371.20 2,555.20
Q13 exasol 451.60 7 449.10 448.50 2.00 445.10 451.30
Q14 clickhouse 129.50 7 129.00 129.30 2.60 126.00 134.60
Q14 clickhouse_stat 250.50 7 243.30 249.80 14.00 235.00 268.50
Q14 clickhouse_tuned 130.90 7 131.40 130.70 2.10 127.30 133.10
Q14 exasol 57.60 7 57.70 57.80 0.40 57.30 58.30
Q15 clickhouse 215.90 7 182.00 180.10 24.60 154.30 212.60
Q15 clickhouse_stat 290.60 7 236.10 236.60 4.00 231.90 242.80
Q15 clickhouse_tuned 216.50 7 191.30 189.70 19.40 169.50 215.50
Q15 exasol 208.40 7 205.90 205.60 2.40 200.40 207.70
Q16 clickhouse 331.80 7 338.30 338.60 1.80 336.70 341.30
Q16 clickhouse_stat 335.30 7 347.30 349.40 9.50 339.80 362.80
Q16 clickhouse_tuned 499.90 7 441.20 442.50 10.30 433.80 464.30
Q16 exasol 385.10 7 377.50 378.60 5.60 373.50 390.10
Q17 clickhouse 2,784.80 7 2,589.90 2,580.00 24.10 2,543.70 2,609.20
Q17 clickhouse_stat 3,027.00 7 2,805.50 2,796.90 40.90 2,709.80 2,841.40
Q17 clickhouse_tuned 701.00 7 811.80 814.30 7.10 805.30 823.30
Q17 exasol 22.10 7 21.60 21.40 0.50 20.70 22.00
Q18 clickhouse 2,571.20 7 2,556.20 2,543.10 49.90 2,464.50 2,597.90
Q18 clickhouse_stat 2,784.20 7 2,755.60 2,760.30 72.10 2,651.60 2,887.80
Q18 clickhouse_tuned 7,973.30 7 6,865.30 6,884.10 122.30 6,743.00 7,133.70
Q18 exasol 419.80 7 418.90 418.90 1.30 417.20 421.20
Q19 clickhouse 1,597.70 7 1,618.70 1,621.80 9.80 1,609.90 1,636.60
Q19 clickhouse_stat 2,754.20 7 2,800.30 2,803.10 33.90 2,761.30 2,861.40
Q19 clickhouse_tuned 4,301.40 7 3,895.40 3,903.50 17.50 3,891.70 3,939.60
Q19 exasol 22.00 7 22.20 22.20 0.30 21.80 22.60
Q20 clickhouse 248.90 7 217.20 217.30 2.00 213.70 219.40
Q20 clickhouse_stat 332.20 7 275.30 274.90 4.60 266.00 280.90
Q20 clickhouse_tuned 1,094.30 7 847.90 847.20 24.70 827.80 897.70
Q20 exasol 230.40 7 228.70 227.70 1.50 225.80 229.10
Q21 clickhouse 21,315.70 7 20,869.60 20,892.90 122.70 20,749.50 21,093.30
Q21 clickhouse_stat 21,772.80 7 21,243.20 21,235.40 175.20 20,921.70 21,416.40
Q21 clickhouse_tuned 11,408.70 7 9,568.80 9,638.00 182.40 9,425.10 9,982.50
Q21 exasol 263.70 7 261.90 268.30 18.30 260.30 309.70
Q22 clickhouse 395.80 7 379.70 393.80 28.70 368.40 446.50
Q22 clickhouse_stat 412.50 7 396.70 395.40 9.20 383.40 410.60
Q22 clickhouse_tuned 404.80 7 362.40 358.30 32.50 315.60 394.10
Q22 exasol 80.70 7 78.80 78.70 0.30 78.20 79.10

System Rankings

Based on median query execution time:

Rank System Median Runtime Average Runtime Range (Min - Max)
1 Exasol 165.9ms 214.4ms 20.7ms - 699.5ms
2 Clickhouse 1608.8ms 2794.5ms 122.7ms - 21093.3ms
3 Clickhouse_tuned 1615.2ms 2698.1ms 124.8ms - 9982.5ms
4 Clickhouse_stat 1659.3ms 2549.7ms 153.7ms - 21416.4ms

Benchmark Methodology

Workload Configuration

TPC-H Benchmark:

  • Scale Factor: 30
  • Data Format: CSV
  • Data Generator: dbgen

Execution Parameters

  • Warmup Runs: 1
  • Measured Runs: 7
  • Metric Reported: Median execution time

Performance Measurement

All queries were executed with the same data and parameters across all systems. The median execution time from 7 runs is reported for each query to minimize the impact of system variance and outliers.

Conclusion

This benchmark provides a detailed, query-level comparison of 4 database systems on analytical workloads. The results demonstrate the performance characteristics and trade-offs of each system when processing TPC-H queries.

While exasol demonstrated the strongest overall performance in this test, the optimal choice for a specific use case depends on multiple factors including workload characteristics, operational requirements, and system integration needs.

Query Details