THE SQL Server Blog Spot on the Web

Welcome to SQLblog.com - The SQL Server blog spot on the web Sign in | |
in Search

Kevin Kline

Read the New TPC Database Benchmarking Series

Let's talk about database application benchmarking.

This is a skill set which, in my opinion, is one of the major differentiators between a journeyman-level DBA and a true master of the trade. In this article published in my monthly column at Database Trends & Applications magazine, I'll give you a brief introduction to TPC benchmarks and, in future articles, I'll be telling you how to extract specific pieces of valuable information from the published benchmark results.

But let's get started with an overview … read more.

Many thanks,

-Kevin

- Follow me on Twitter!
- Google Author

Published Monday, April 22, 2013 2:17 PM by KKline

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

 

jchang said:

hello Kevin, nice to know there are still other people talking about benchmarks. I second that there is useful information or hints of information in the full reports. Its too bad we have to dig for it. The benchmark reports document, per full disclosure requirements, all the tuning details, but provide very little explanation.

One thing I would like is perhaps a non-official result detailing the impact of each of the special tricks, which are 1% and which are 20%.

One item people can note is that almost all reports do not use SAN storage systems. (exception is HP likes to use the P2000 MSA for the logs, but not data. reason?) SAN adds a whole lot of cost, and will not improve performance on the benchmarks. More than likely if the SAN features (auto-tier, flash cache) are employed, performance will be degraded. Sure, the SAN systems have useful features, but none contribute to performance.

On TPC-H, I have bugged HP to include the sqlplan file (in XML format). I think they provide the text format sometimes. I prefer actual plan, but would accept estimated.

April 22, 2013 3:53 PM
 

KKline said:

Great input, Joe!  An especially good point about SANs. So many people I encounter think that SANs are designed to provide great IO performance. They are not. Simple as that.  It's just not what they're designed to do.

In terms of stuff I'd like in benchmarks, I'd like a series of benchmarks that have real-world budgets.  For example, who posts the best benchmark with hardware at a $10,000 budget, at $50,000 budget, at the $100,000 budget level, and so on.

April 24, 2013 10:11 AM

Leave a Comment

(required) 
(required) 
Submit

About KKline

Kevin Kline is a well-known database industry expert, author, and speaker. Kevin is a long-time Microsoft MVP and was one of the founders of PASS, www.sqlpass.org.

This Blog

Syndication

Powered by Community Server (Commercial Edition), by Telligent Systems
  Privacy Statement