📊 Detailed Query Results

Exasol vs ClickHouse Performance Comparison on TPC-H SF10

Author: Oleksandr Kozachuk, Principal Architect at Exasol AG Date: 2025-10-24 14:55:06 Environment: AWS eu-west-1

Overview

This report presents the complete query-by-query performance results for 4 database systems tested using the TPC-H benchmark at scale factor 10.

Systems Under Test

Exasol 2025.1.0

Environment & Hardware

  • Cloud: AWS eu-west-1
  • Instance: r5d.4xlarge
  • CPU: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz (16 vCPUs)
  • Memory: 124.4GB RAM

Software

  • Database: exasol 2025.1.0

Clickhouse 25.9.4.58

Environment & Hardware

  • Cloud: AWS eu-west-1
  • Instance: r5d.4xlarge
  • CPU: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz (16 vCPUs)
  • Memory: 124.4GB RAM

Software

  • Database: clickhouse 25.9.4.58

Clickhouse_tuned 25.9.4.58

Environment & Hardware

  • Cloud: AWS eu-west-1
  • Instance: r5d.4xlarge
  • CPU: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz (16 vCPUs)
  • Memory: 124.4GB RAM

Software

  • Database: clickhouse 25.9.4.58

Clickhouse_stat 25.9.4.58

Environment & Hardware

  • Cloud: AWS eu-west-1
  • Instance: r5d.4xlarge
  • CPU: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz (16 vCPUs)
  • Memory: 124.4GB RAM

Software

  • Database: clickhouse 25.9.4.58

Performance Summary

Key Findings

  • exasol was the fastest overall with 63.6ms median runtime
  • clickhouse_tuned was 8.7× slower
  • Tested 616 total query executions across 22 different query types

Performance Visualizations

Detailed Analysis

Performance by Query Type

The benchmark results reveal distinct performance characteristics across different query categories:

The following table shows the median performance for each query category across all systems:

Query Type clickhouse clickhouse_stat clickhouse_tuned exasol Winner
Aggregation 114.00 125.60 181.60 27.30 exasol
Join-Heavy 1,016.40 442.50 1,054.40 55.90 exasol
Complex Analytical 732.10 745.20 825.70 95.30 exasol

Query-by-Query Results

The following table shows the median execution time for each query across all systems:

query baseline_system comparison_system baseline_ms comparison_ms ratio speedup faster
Q01 exasol clickhouse_tuned 207.00 563.60 2.72 0.37 0
Q02 exasol clickhouse_tuned 31.30 252.30 8.06 0.12 0
Q03 exasol clickhouse_tuned 95.30 827.70 8.69 0.12 0
Q04 exasol clickhouse_tuned 20.80 1,179.40 56.70 0.02 0
Q05 exasol clickhouse_tuned 60.00 1,587.90 26.46 0.04 0
Q06 exasol clickhouse_tuned 13.70 55.70 4.07 0.25 0
Q07 exasol clickhouse_tuned 68.90 848.00 12.31 0.08 0
Q08 exasol clickhouse_tuned 30.70 1,705.30 55.55 0.02 0
Q09 exasol clickhouse_tuned 174.50 2,158.90 12.37 0.08 0
Q10 exasol clickhouse_tuned 165.10 538.20 3.26 0.31 0
Q11 exasol clickhouse_tuned 52.20 141.00 2.70 0.37 0
Q12 exasol clickhouse_tuned 27.30 181.60 6.65 0.15 0
Q13 exasol clickhouse_tuned 148.80 770.70 5.18 0.19 0
Q14 exasol clickhouse_tuned 23.20 57.30 2.47 0.40 0
Q15 exasol clickhouse_tuned 76.60 103.50 1.35 0.74 0
Q16 exasol clickhouse_tuned 222.70 220.10 0.99 1.01 1
Q17 exasol clickhouse_tuned 13.90 331.10 23.82 0.04 0
Q18 exasol clickhouse_tuned 146.50 1,941.10 13.25 0.08 0
Q19 exasol clickhouse_tuned 11.90 1,362.10 114.46 0.01 0
Q20 exasol clickhouse_tuned 67.40 335.40 4.98 0.20 0
Q21 exasol clickhouse_tuned 106.70 3,001.60 28.13 0.04 0
Q22 exasol clickhouse_tuned 33.60 124.90 3.72 0.27 0
Q01 exasol clickhouse 207.00 556.90 2.69 0.37 0
Q02 exasol clickhouse 31.30 256.70 8.20 0.12 0
Q03 exasol clickhouse 95.30 802.10 8.42 0.12 0
Q04 exasol clickhouse 20.80 411.70 19.79 0.05 0
Q05 exasol clickhouse 60.00 1,531.30 25.52 0.04 0
Q06 exasol clickhouse 13.70 58.30 4.26 0.23 0
Q07 exasol clickhouse 68.90 824.50 11.97 0.08 0
Q08 exasol clickhouse 30.70 1,629.40 53.07 0.02 0
Q09 exasol clickhouse 174.50 2,108.70 12.08 0.08 0
Q10 exasol clickhouse 165.10 515.10 3.12 0.32 0
Q11 exasol clickhouse 52.20 139.00 2.66 0.38 0
Q12 exasol clickhouse 27.30 193.60 7.09 0.14 0
Q13 exasol clickhouse 148.80 760.70 5.11 0.20 0
Q14 exasol clickhouse 23.20 55.00 2.37 0.42 0
Q15 exasol clickhouse 76.60 93.50 1.22 0.82 0
Q16 exasol clickhouse 222.70 192.70 0.87 1.16 1
Q17 exasol clickhouse 13.90 732.10 52.67 0.02 0
Q18 exasol clickhouse 146.50 719.70 4.91 0.20 0
Q19 exasol clickhouse 11.90 547.80 46.03 0.02 0
Q20 exasol clickhouse 67.40 114.00 1.69 0.59 0
Q21 exasol clickhouse 106.70 6,315.80 59.19 0.02 0
Q22 exasol clickhouse 33.60 141.40 4.21 0.24 0
Q01 exasol clickhouse_stat 207.00 535.10 2.59 0.39 0
Q02 exasol clickhouse_stat 31.30 210.40 6.72 0.15 0
Q03 exasol clickhouse_stat 95.30 808.10 8.48 0.12 0
Q04 exasol clickhouse_stat 20.80 402.10 19.33 0.05 0
Q05 exasol clickhouse_stat 60.00 1,531.90 25.53 0.04 0
Q06 exasol clickhouse_stat 13.70 55.40 4.04 0.25 0
Q07 exasol clickhouse_stat 68.90 828.50 12.02 0.08 0
Q08 exasol clickhouse_stat 30.70 353.70 11.52 0.09 0
Q09 exasol clickhouse_stat 174.50 897.80 5.14 0.19 0
Q10 exasol clickhouse_stat 165.10 524.40 3.18 0.31 0
Q11 exasol clickhouse_stat 52.20 144.90 2.78 0.36 0
Q12 exasol clickhouse_stat 27.30 199.80 7.32 0.14 0
Q13 exasol clickhouse_stat 148.80 745.60 5.01 0.20 0
Q14 exasol clickhouse_stat 23.20 71.30 3.07 0.33 0
Q15 exasol clickhouse_stat 76.60 100.90 1.32 0.76 0
Q16 exasol clickhouse_stat 222.70 191.40 0.86 1.16 1
Q17 exasol clickhouse_stat 13.90 733.70 52.78 0.02 0
Q18 exasol clickhouse_stat 146.50 745.90 5.09 0.20 0
Q19 exasol clickhouse_stat 11.90 821.10 69.00 0.01 0
Q20 exasol clickhouse_stat 67.40 125.60 1.86 0.54 0
Q21 exasol clickhouse_stat 106.70 6,283.70 58.89 0.02 0
Q22 exasol clickhouse_stat 33.60 135.60 4.04 0.25 0

Detailed Statistics

The complete performance statistics for all queries and systems:

query system warmup runs median_ms mean_ms std_ms min_ms max_ms
Q01 clickhouse 556.80 7 556.90 559.10 7.40 551.00 573.30
Q01 clickhouse_stat 534.70 7 535.10 536.60 6.00 531.40 548.50
Q01 clickhouse_tuned 565.20 7 563.60 566.60 10.00 554.70 580.30
Q01 exasol 209.10 7 207.00 207.30 1.10 206.30 209.50
Q02 clickhouse 302.40 7 256.70 255.20 3.70 249.50 259.80
Q02 clickhouse_stat 229.00 7 210.40 210.20 6.10 203.70 220.00
Q02 clickhouse_tuned 302.50 7 252.30 251.40 3.80 246.60 256.50
Q02 exasol 81.80 7 31.30 31.30 0.50 30.60 31.90
Q03 clickhouse 855.20 7 802.10 807.80 17.90 787.30 840.50
Q03 clickhouse_stat 889.60 7 808.10 805.70 15.40 787.40 829.00
Q03 clickhouse_tuned 891.80 7 827.70 827.90 18.10 801.30 849.30
Q03 exasol 100.50 7 95.30 95.90 1.80 93.20 98.20
Q04 clickhouse 458.00 7 411.70 414.50 8.70 405.60 428.40
Q04 clickhouse_stat 451.10 7 402.10 402.00 2.60 398.80 406.20
Q04 clickhouse_tuned 1,290.20 7 1,179.40 1,168.20 165.50 963.60 1,486.50
Q04 exasol 23.10 7 20.80 20.80 0.20 20.50 21.10
Q05 clickhouse 1,734.30 7 1,531.30 1,534.10 28.90 1,495.10 1,570.90
Q05 clickhouse_stat 1,688.60 7 1,531.90 1,537.90 30.80 1,512.30 1,604.30
Q05 clickhouse_tuned 1,790.40 7 1,587.90 1,596.20 45.20 1,557.40 1,685.40
Q05 exasol 111.30 7 60.00 59.90 0.60 59.30 61.20
Q06 clickhouse 111.30 7 58.30 58.80 2.60 56.60 64.20
Q06 clickhouse_stat 103.90 7 55.40 57.10 7.00 52.80 72.70
Q06 clickhouse_tuned 106.40 7 55.70 58.00 3.60 55.20 64.80
Q06 exasol 14.00 7 13.70 13.70 0.10 13.60 13.80
Q07 clickhouse 844.70 7 824.50 839.90 48.40 805.10 946.50
Q07 clickhouse_stat 845.00 7 828.50 845.50 33.20 817.10 908.70
Q07 clickhouse_tuned 895.70 7 848.00 848.50 20.30 823.00 871.40
Q07 exasol 73.10 7 68.90 68.80 0.70 67.70 69.70
Q08 clickhouse 1,669.60 7 1,629.40 1,636.50 31.10 1,611.10 1,705.30
Q08 clickhouse_stat 364.30 7 353.70 355.20 6.60 347.70 366.90
Q08 clickhouse_tuned 1,686.40 7 1,705.30 1,700.80 27.10 1,652.10 1,731.50
Q08 exasol 32.40 7 30.70 33.90 8.10 30.40 52.30
Q09 clickhouse 2,305.80 7 2,108.70 2,099.00 23.80 2,070.20 2,124.60
Q09 clickhouse_stat 988.20 7 897.80 895.90 26.80 860.10 933.30
Q09 clickhouse_tuned 2,261.10 7 2,158.90 2,169.10 28.00 2,128.70 2,205.00
Q09 exasol 183.30 7 174.50 174.50 0.50 174.00 175.40
Q10 clickhouse 609.20 7 515.10 517.00 9.60 508.50 537.70
Q10 clickhouse_stat 547.20 7 524.40 532.30 16.10 518.10 556.40
Q10 clickhouse_tuned 629.90 7 538.20 535.40 13.70 511.00 551.40
Q10 exasol 167.20 7 165.10 165.30 7.00 153.20 176.20
Q11 clickhouse 180.30 7 139.00 140.30 2.30 138.20 143.80
Q11 clickhouse_stat 182.90 7 144.90 145.10 1.20 143.40 147.00
Q11 clickhouse_tuned 184.50 7 141.00 143.60 6.70 137.30 155.30
Q11 exasol 53.40 7 52.20 51.50 1.10 50.10 52.50
Q12 clickhouse 300.40 7 193.60 192.00 7.10 181.70 200.60
Q12 clickhouse_stat 237.90 7 199.80 200.50 10.00 185.60 218.80
Q12 clickhouse_tuned 336.50 7 181.60 182.70 8.00 175.90 199.00
Q12 exasol 42.20 7 27.30 27.30 0.50 26.80 28.20
Q13 clickhouse 791.60 7 760.70 754.30 31.60 685.70 780.00
Q13 clickhouse_stat 779.40 7 745.60 753.50 13.50 738.20 771.80
Q13 clickhouse_tuned 792.90 7 770.70 762.60 30.40 708.90 808.60
Q13 exasol 148.40 7 148.80 148.60 0.60 147.80 149.40
Q14 clickhouse 57.80 7 55.00 55.10 1.00 53.40 56.80
Q14 clickhouse_stat 70.80 7 71.30 72.30 2.40 69.80 75.50
Q14 clickhouse_tuned 65.00 7 57.30 56.90 2.60 54.10 61.30
Q14 exasol 29.30 7 23.20 23.20 0.10 23.10 23.50
Q15 clickhouse 103.50 7 93.50 93.40 0.50 92.70 94.20
Q15 clickhouse_stat 111.30 7 100.90 101.40 0.90 100.30 102.80
Q15 clickhouse_tuned 127.70 7 103.50 103.60 3.30 97.90 108.70
Q15 exasol 78.60 7 76.60 77.00 1.40 75.50 79.00
Q16 clickhouse 197.20 7 192.70 192.60 2.40 188.70 196.80
Q16 clickhouse_stat 194.90 7 191.40 193.70 7.20 188.90 209.20
Q16 clickhouse_tuned 246.20 7 220.10 221.90 4.80 215.30 227.90
Q16 exasol 230.00 7 222.70 225.50 7.20 218.90 241.00
Q17 clickhouse 805.80 7 732.10 734.30 7.20 727.80 749.70
Q17 clickhouse_stat 830.70 7 733.70 737.10 9.40 729.50 757.00
Q17 clickhouse_tuned 255.80 7 331.10 331.30 3.10 327.30 335.30
Q17 exasol 15.50 7 13.90 13.90 0.20 13.60 14.20
Q18 clickhouse 825.20 7 719.70 721.40 15.50 705.60 751.40
Q18 clickhouse_stat 781.60 7 745.90 750.20 16.80 730.10 772.80
Q18 clickhouse_tuned 2,396.00 7 1,941.10 1,944.30 46.40 1,888.20 2,010.40
Q18 exasol 145.40 7 146.50 146.00 0.90 144.90 147.00
Q19 clickhouse 545.20 7 547.80 550.40 7.40 543.70 566.10
Q19 clickhouse_stat 834.80 7 821.10 823.50 22.10 792.50 863.70
Q19 clickhouse_tuned 1,450.40 7 1,362.10 1,367.40 17.70 1,351.70 1,401.90
Q19 exasol 14.60 7 11.90 12.10 0.50 11.60 13.10
Q20 clickhouse 125.80 7 114.00 113.70 3.30 108.50 118.00
Q20 clickhouse_stat 140.40 7 125.60 127.70 4.80 122.20 134.80
Q20 clickhouse_tuned 475.30 7 335.40 329.90 9.20 316.30 338.20
Q20 exasol 66.40 7 67.40 67.30 0.90 66.00 68.50
Q21 clickhouse 6,334.80 7 6,315.80 6,332.20 203.30 6,003.20 6,578.90
Q21 clickhouse_stat 6,232.60 7 6,283.70 6,234.70 85.50 6,130.20 6,319.00
Q21 clickhouse_tuned 3,861.50 7 3,001.60 3,004.90 48.50 2,932.10 3,074.90
Q21 exasol 103.40 7 106.70 111.10 14.50 102.60 143.30
Q22 clickhouse 157.10 7 141.40 144.30 7.40 137.80 158.50
Q22 clickhouse_stat 153.20 7 135.60 138.00 7.30 130.80 150.50
Q22 clickhouse_tuned 171.10 7 124.90 124.20 7.90 114.50 135.90
Q22 exasol 34.70 7 33.60 33.60 0.30 33.10 34.00

System Rankings

Based on median query execution time:

Rank System Median Runtime Average Runtime Range (Min - Max)
1 Exasol 63.6ms 82.2ms 11.6ms - 241.0ms
2 Clickhouse_stat 462.1ms 748.0ms 52.8ms - 6319.0ms
3 Clickhouse 540.7ms 852.1ms 53.4ms - 6578.9ms
4 Clickhouse_tuned 553.0ms 831.6ms 54.1ms - 3074.9ms

Benchmark Methodology

Workload Configuration

TPC-H Benchmark:

  • Scale Factor: 10
  • Data Format: CSV
  • Data Generator: dbgen

Execution Parameters

  • Warmup Runs: 1
  • Measured Runs: 7
  • Metric Reported: Median execution time

Performance Measurement

All queries were executed with the same data and parameters across all systems. The median execution time from 7 runs is reported for each query to minimize the impact of system variance and outliers.

Conclusion

This benchmark provides a detailed, query-level comparison of 4 database systems on analytical workloads. The results demonstrate the performance characteristics and trade-offs of each system when processing TPC-H queries.

While exasol demonstrated the strongest overall performance in this test, the optimal choice for a specific use case depends on multiple factors including workload characteristics, operational requirements, and system integration needs.

Query Details