Welcome Stranger to OCC!Login | Register

Serious Statistics Review

   -   
» Discuss this article (1)

OpenGL – Thebes – Karnak:

With Vulkan we saw Thebes performed a little worse than the other two maps, at least for the course I ran, so it is not surprising that OpenGL is also a bit slower here.

 

It is kind of interesting how many of these first runs on OpenGL happen to also have more outliers than the other two. Anyway, averages:

Averages Frame Time (ms) Framerate (FPS)
Run 1 8.414881 118.8363
Run 2 8.367178 119.5133
Run 3 8.357456 119.6532

By now we should all know that averages only tell part of the story while percentiles can help reveal a lot more.

Percentile 0.1% 1% 99% 99.9%
Run 1 5.074 ms (197.08 FPS) 5.494 ms (182.02 FPS) 15.434 ms (64.79 FPS) 25.915 ms (38.59 FPS)
Run 2 5.106 ms (195.86 FPS) 5.497 ms (181.90 FPS) 16.091 ms (62.15 FPS) 21.163 ms (47.25 FPS)
Run 3 4.708 ms (212.41 FPS) 5.186 ms (192.83 FPS) 15.321 ms (65.27 FPS) 20.021 ms (49.95 FPS)

Now each of the 99th percentiles are in the sixties, and while 99% is still at the far end of the range, we can clearly see here, and with the other courses that OpenGL is well behind Vulkan for speed.

Flipping around the percentiles to see where 60 FPS and other framerates are, we get these values:

  16.667 ms / 60 FPS 20.000 ms / 50 FPS 33.333 ms / 30 FPS 50.000 ms / 20 FPS
Run 1 0.54713805% 0.17396184% 0.06734007% 0.05611672%
Run 2 0.764316996% 0.156210773% 0.008368434% --
Run 3 0.520992951% 0.103084167% 0.005572117% 0.002786059%

It is worth remembering that what this table represents is all outlier data as it is all fractions of a percent. All the table really goes to show is that I am able to pull these numbers out of the data, so we can move on to the QQ plots now.

 

As can be expected, the difference data is a little worse on this course than on Hatsheput or Dunes, but I think it is still in a safe area.

Diff Percentile 0.1% 1% 99% 99.9%
Run 1 -9.512264 ms -3.911720 ms 4.024240 ms 9.772810 ms
Run 2 -8.944978 ms -4.151650 ms 4.081530 ms 8.818273 ms
Run 3 -6.610085 ms -3.745450 ms 3.738450 ms 6.699592 ms

Frequency plot time.

 

 

 

 

At last the display time graphs and then we move on to DirectX 11, where things will get more interesting.




Related Products
Random Pic
© 2001-2017 Overclockers Club ® Privacy Policy
Elapsed: 0.1119079590   (xlweb1)