Search results matching tag 'Administration'

Use TPC Database Benchmarks to Save Money

KKline — Mon, 29 Apr 2013 14:47:00 GMT

Last month, I began a series of articles describing database application benchmarking. In the first article, I told you about different ways that you can construct your own database application benchmark. However, you don’t have to reinvent the wheel. The Transaction Processing Council (www.tpc.org) has already created a large number of database benchmarks that are extremely useful and informative.

I also described last month how the TPC provides several different types of benchmark tests. For example the TPC-C and TPC-E benchmarks are extremely useful for measuring transaction throughput. On the other hand, the TPC – H benchmark is useful for measuring business intelligence workloads.

Today, I would like to give you a primer on how to read the benchmark reports that are published by the major database and hardware vendors. You never know when a vendor will publish a new benchmark. There’s no set schedule for them to publish their test findings. Of course, you can always look for new advertisements from many of the vendors. But that’s very imprecise. I prefer to find out if there are new results on my own and so I typically start at http://tpc.org/information/results.asp. There, I’ll check to see if my favorite hardware or database vendors have published any new test results.... read more ...

Many thanks,

-Kevin

- Follow me on Twitter!

- Google Author

Read the New TPC Database Benchmarking Series

KKline — Mon, 22 Apr 2013 18:17:00 GMT

Let's talk about database application benchmarking.

This is a skill set which, in my opinion, is one of the major differentiators between a journeyman-level DBA and a true master of the trade. In this article published in my monthly column at Database Trends & Applications magazine, I'll give you a brief introduction to TPC benchmarks and, in future articles, I'll be telling you how to extract specific pieces of valuable information from the published benchmark results.

But let's get started with an overview … read more.

Many thanks,

-Kevin

- Follow me on Twitter!
- Google Author

Squishy Limits in SQL Server Express Edition

KKline — Thu, 28 Mar 2013 12:19:00 GMT

It's an old story you've probably heard before. Provide a free version of your software product with strict limitations on performance or other specific capabilities so that folks can give it a try without risk, while you minimize the chance of cannibalizing sales of your commercial products. Microsoft has take this strategy with SQL Server Express Edition, not only to increase adoption in the student market but also to counter the threat of open-source (i.e. free) relational databases like MySQL for entry-level applications.

One such limitation of SQL Server Express Edition is that it supports no more than 1GB of RAM for the instance. Of course, you could have many Express Edition instances on a single Windows server, each with its own 1GB of RAM.

But what does that metric of 1GB of RAM actually mean? The key thing to remember is that the restriction is for buffer cache. Since SQL Server has many other caches, even when not counting the plan cache, there are plenty of other caches within SQL Server. (Run a query against sys.dm_os_memory_clerks if you'd like to see some of the others). Because only the buffer cache has the strict 1GB limitation, you can actually watch SQL Server Express Edition's memory working set size grow to around 1.4-1.5GB due to the other memory caches at play.

Pawel Potasinski, a SQL Server MVP from Poland (Twitter | Blog), once posted an interesting repro for this behavior:

-- Assess amount of databases resident in buffer cache

SELECT
 CASE
 WHEN database_id = 32767 THEN 'mssqlsystemresource'
 ELSE DB_NAME(database_id)
 END AS [Database],
 CONVERT(numeric(38,2),(8.0 / 1024) * COUNT(*)) AS [MB in buffer cache] 
FROM sys.dm_os_buffer_descriptors 
GROUP BY database_id 
ORDER BY 2 DESC; 
GO

-- Assess amount of tables resident in buffer cache
SELECT
 QUOTENAME(OBJECT_SCHEMA_NAME(p.object_id)) + '.' +
 QUOTENAME(OBJECT_NAME(p.object_id)) AS [Object],
 CONVERT(numeric(38,2),(8.0 / 1024) * COUNT(*)) AS [MB In buffer cache] 
FROM sys.dm_os_buffer_descriptors AS d 
 INNER JOIN sys.allocation_units AS u ON d.allocation_unit_id = u.allocation_unit_id 
 INNER JOIN sys.partitions AS p ON (u.type IN (1,3) AND u.container_id = p.hobt_id) OR (u.type = 2 AND u.container_id = p.partition_id) 
WHERE d.database_id = DB_ID() 
GROUP BY QUOTENAME(OBJECT_SCHEMA_NAME(p.object_id)) + '.' + QUOTENAME(OBJECT_NAME(p.object_id))
ORDER BY [Object] DESC;
GO

-- Fill up Express Edition's buffer allocation
IF OBJECT_ID(N'dbo.test', N'U') IS NOT NULL
 DROP TABLE dbo.test;
GO

CREATE TABLE dbo.test (col_a char(8000));
GO

INSERT INTO dbo.test (col_a)
 SELECT REPLICATE('col_a', 8000)
 FROM sys.all_objects 
 WHERE is_ms_shipped = 1;

CHECKPOINT; 
GO 100

The bottom line for the hard memory limit of SQL Server Express Edition is "Yes, it's limited. But it's a squishy limit. Not a hard limit."

Although your mileage may vary, I'd bet a dollar that you'll find more than 1GB in the active working set for your instance of SQL Server Express Edition. I am curious, however, if you're seeing much variation between versions and even service packs of SQL Server? Let me know if you try this out on more than one version and/or service pack level of SQL Server. Did it change much between versions? Let me know!

Enjoy,

-Kevin

-Follow me on Twitter!

Google Author

SQLintersection!

KKline — Wed, 27 Mar 2013 13:47:00 GMT

The best emotion to describe how I'm feeling is 'astounded'. I'm astounded that I'm in such august company to be speaking the SQLIntersection (#iSQL) conference. Read the blog post from my first SQL Server mentor, Kimberly Tripp, which tells you all about SQLintersection.

Check out this list of speakers:

Aaron Bertrand, Sr. Consultant, SQL Sentry, Inc. [blog | twitter]
Andrew J. Kelly, Mentor, SolidQ [blog | twitter]
Bob Ward, Principal Architect Escalation Engineer, Microsoft [blog | twitter]
Brent Ozar, Brent Ozar Unlimited [blog | twitter]
Conor Cunningham, Principal Architect, SQL Server, Microsoft [blog]
Grant Fritchey, Product Evangelist, Red Gate Software [blog | twitter]
Jeremiah Peschka, Brent Ozar Unlimited [blog | twitter]
Joseph Sack, Principal Consultant, SQLskills.com [blog | twitter]
Kendra Little, Managing Director, Brent Ozar Unlimited [blog | twitter]
Kevin Kline, Director of Engineering Services, SQL Sentry, Inc. [blog | twitter]
Kimberly L. Tripp, President/Founder, SQLskills.com [blog | twitter]
Mat Young, Senior Director of Products, Fusion-io [blog | twitter]
Paul S. Randal, CEO / Owner, SQLskills.com [blog | twitter]
Paul White, SQL Kiwi Limited [blog | twitter]
Steve Jones, Editor, SQLServerCentral.com [blog | twitter]
Sumeet Bansal, Principal Solutions Architect, Fusion-io [blog | twitter]

Read the list of SQL Server sessions here. On top of the list of outstanding sessions to attend, I'll be giving a keynote on Tuesday afternoon. Witness:

So the only thing between the attendees and the booze in the reception hall is our keynote address?!? Oh yeah, that's going to go down real smooth, isn't it? I'll last about as long as a puny henchman between James Bond and the villain of the movie. Sumeet Bansal, from Fusion-IO, will have to survive until the credits roll. We'll be talking about high performance computing on SQL Server 2012 with an eye towards high availability, AlwaysOn, and Availability Groups.

If you're in Las Vegas, I hope to see you there! If not, you should consider coming to this excellent conference.

-Kevin

-Follow me on Twitter!

SQL Server 2008R2 / 2012 Standard & Backup Compression

manowar — Mon, 25 Mar 2013 13:17:06 GMT

This is something that is totally overlooked, in my experience, with SQL Server 2008 R2 and SQL Server 2012. On the contrary to what happens with SQL Server 2008, the Standard version of SQL Server 2008R2 & SQL Server 2012 supports backup compression:

SQL Server 2008 R2 BOL
http://msdn.microsoft.com/en-us/library/cc645993(v=sql.105).aspx
SQL Server 2012 BOL
http://msdn.microsoft.com/en-us/library/cc645993(v=sql.110).aspx

Unfortunately a bug in the documentation said the opposite in the past, but it has been fixed quite a long ago now:

http://social.msdn.microsoft.com/Forums/en-US/sqldocumentation/thread/b4f846e8-a339-422c-bb0b-91751e6c8560/

Just keep it mind

Is Microsoft SQL Server Supported By ...?

KKline — Tue, 19 Mar 2013 14:50:00 GMT

One of the types of question you get after speaking at a conference about virtualization, like I did at the 2012 PASS Summit with my buddy David Klee (Twitter | Blog), might go down like this:

"Is SQL Server version X supported on hypervisor platform Q?" or something even more specific like "Is SQL Server 2012 supported on VMWare vSphere ESX 4.1 Update 2? Or do I have to upgrade to ESX 5.0?".

Now, when I'm asked a question like this, I usually drool and act like an ape, hoping the the questioner will flee in terror. If they insist on hanging around to hear a real answer, I now refer them to the Windows Server Catalog site thanks to a tip from my NASCAR buddy and Microsoft MVP, Geoff Hiten (Twitter | Blog). For some reason, this very useful site is unknown to most - but it provides the most up-to-date and comprehensive information on what Microsoft supports. Once you've determined which hypervisor you want to check for support, you can simply search the site for your area of interest, say “Microsoft Server Virtualization Validation”.

Since Microsoft certifies OS's for virtualization platforms, you can by extension be assured that any supported application for that OS is also supported on that virtualization platform. So, to answer the early question about VMWare VSphere ESX, you'll find the entry for VMWare VSphere ESX 4.1 (Update 2) at http://www.windowsservercatalog.com/item.aspx?idItem=698bb582-b1ca-7124-05e4-256558d39e68&bCatID=1521.

Make sense?

Now, you know the rest of the story about why I drool and make monkey sounds at some conferences. That's my story, and I'm sticking to it.

-Kevin

Follow me on Twitter!

The Year That Was - 2012

KKline — Mon, 31 Dec 2012 19:31:00 GMT

2012 was, simply stated, a year that kicked my butt. When I wasn't struggling professionally, I was struggling personally. Health issues, culminating in a diagnosis of Type II diabetes, and the passing of my father soon after Thanksgiving marked my biggest struggles. I apologize to those of you who are normally on my Christmas card list for not sending any this year. The wind was not in my sails. On the positive side of the ledger, I made a scary but exciting leap to SQL Sentry midyear. This was a huge shake-up after 10 years with my previous employer, but one which has been met with unbridled enthusiasm everywhere I've gone. Thank you for the handshakes, high-fives, and hugs! We're doing some really exciting things at SQL Sentry (such as SQLPerformance.com and Plan Explorer Pro) and I hope to engage with you more than ever in 2013.

Blogging Activity, Plus Leadership Skills & Professionalism

2012 marked a bit of a shift in my content creation direction. I've seen an uptick in struggles in the non-IT part of our career - communications, leadership, motivation, goal-keeping, all of those sort of things. I feel like I have some wisdom to contribute in that space. So, in addition to technical blog posts, I been putting down more of my experiences and lessons learned on the interpersonal side of the IT career path. My top ten blog posts for the year reflect some of that new direction:

Do You Have One of "the Three W’s" to Sit on a Board of Directors? -- Important tips for any IT pro considering a role in strategy and executive leadership.
Timewarp: What Is a Relational Database? -- With all the talk about NoSQL databases, let's go back to the fundamentals.
Want Another Reason to Hate iTunes? -- A throw-away article that precipitated a maelstrom of comments. Them Apple fanboys are passionate!
Why Do IT Pros Make Awful Managers? -- Not all IT pros make awful managers, but when they're awful it's often for similar reasons.
High-Availability White Papers and Resources for SQL Server -- Read the latest about AlwaysOn Availability Groups, and more.
New White Paper: SQL Server Extended Events and Notifications -- SQL Server 2012 great augments the Extended Events feature set. Find out how.
Build Your Own Microsoft Operations Management Pack -- Resources to build out your own SCOM management pack.
Help Me Update the History of SQL Server -- I started with SQL Server when it was still an OS/2 product. Jeesh! Lots of versions have come out since then.
TIE: Recorded Webcast Available: Extend SCOM to Optimize SQL Server Performance Management and The Expert's Conference (TEC) - For AD, SharePoint, Exchange, PowerShell and Other Admins -- Pointers to a webcast about extending SCOM and the TEC conference.
A Fond Farewell to Quest Software -- I learned so much in 10 years at Quest Software.

As I mentioned in the opening paragraph about blogging, I'm putting more energy into best practices for professional growth among IT pros. Along those lines of thought, I started a website called ForITPros.com with my long-time friend Joe Webb (Twitter | Blog) and, in partnership with SSWUG, developed a 2-DVD set and streaming media class called Leadership Skills for IT Professionals containing 14 hours of leadership and soft skills training specifically crafted for IT teams.

I've also been working with PASS on the Professional Development Virtual Chapter (VC), led by Mark Caldwell (Twitter). We've already got a full year of content schedule and are trying to figure out how fit in more sessions. Maybe moving to more than one webcast per month? The PASS Professional Development VC archive has lots of great content for you to review and future sessions are detailed at the PASS Professional Development VC homepage.

In-Person Activity

2012 was busy where I actually appeared in person or put in a big effort to write or create content. Here's a run-down: Articles (2), Conference Spoken (12), Customer Calls (88), Customer Visits (4), Magazine Columns (14) at SQLMag.com and DBTA.com, New Books (1) with Ross Mistry, PASS Chapter Presentations (12), Pre-cons/Full-day Seminars (4), SQL Saturdays (4), SSWUG Sessions (4), TechNet Radio Broadcasts (2), Technical Book Reviews (3), and Webcasts (10).

In 2013, I expect to travel a bit less. But I also expect to do many more webcasts. Let me know if you have some ideas about what you'd like to learn! One business trip that I refuse to give up, though, is SQLCruise. (Register!) I know it sounds like the worst possible way to learn. I mean who'd want to learn on a cruise ship in the Caribbean?!? (I hope you could detect the sarcasm dripping from those two sentences.) But here are two favorite aspects of of SQLCruise that are totally ferreals - 1) You simultaneously can relax and focus on learning. You are disconnected from the mainland. You don't have to worry about the mobile phone going off. 2) You get extended ours in a intimate setting with the top talent in the SQL Server world. It's always a pleasure to attend a conference session from the best in the industry. But you'll get hours of time to talk with these veterans of the industry about your specific problems and situations. It just doesn't get better than that.

Social Media

It's hard to believe that only a year ago, 2011, was my first year on Twitter. By years end, here's where my stats had moved: 5,507 tweets (up from 3,452 tweets), 661 following (up from 531), and 3,720 followers (up from 2,656) . I didn't check my social media numbers last year, so I've got no point of comparison. But I'm currently sitting at 2,327 LinkedIn connections and 1,157 Facebook friends. One of my standing policies on Facebook is that I don't "friend" someone who I haven't personally met. That doesn't help detangle the hopeless mess I've created by having only one identify on Facebook, both personal and public. So, on the one hand, I owe all of my longtime friends a big apology for all of the SQL talk and, on the other hand, a big apology to all of my professional friends for not posting enough news and advice while dilute my status updates with personal minutia. Oh well - it is what it is.

My blogging activity for 2012 was the lowest it's been in many years, down to 44 entries, down from 77 in 2011 and well into the hundreds in 2010. My answer to that sort of doldrums for 2013 is to get sloppy! And by that, I mean less of a perfectionist and more of a content machine that just cranks it out! Most of you, as my readers, have been very forgiving of a misplaced verb, a missing punctuation, or -heck- a totally malformed sentence that makes no sense at all. So I'm going to try much harder to churn through the 700+ nascent blog posts in my notes folder and get those ideas out there!

I hope to see you following me on Twitter soon! Thanks,

-Kevin

Learn More About SQL Server IO and Query Tuning in These Webcasts

KKline — Fri, 14 Dec 2012 18:50:00 GMT

I'm doing two new webcasts next week on Wednesday, December 19th, one in the morning and the other after lunch.

SSDs are a Game Changer for SQL Server Storage

No, session is not exclusively about SSDs. But this is my first session on IO and storage tuning that emphasizes SSDs over hard disks. As Bob Dylan said "Times, they are a'changin'". This session on Wednesday, December 19th at 11:30 AM EST, sponsored by Astute Networks, takes you through all of the basics of storage and IO tuning, regardless of the underlying storage technology. I'll show you how SQL Server handles storage structures, how to identify IO activity on Windows and SQL Server, and best practices for minimizing IO bottlenecks. Register now for: Storage IO Best Practices for SQL Server and a New Approach to Solving Application Performance Issues.

Write Better SQL Queries

The next webcast on Wednesday, December 19th at 2 PM EST, is with me, Aaron Bertrand (Twitter | Blog) and SQLCruise Impresario & Microsoft MVP Tim Ford (Twitter | Blog) as we take you through the query tuning process, discussing important DMVs to use during query tuning, as well as demonstrating several essential query tuning techniques that every SQL developer should know. Not only are we presenting an hour of top quality technical content, we’ll also be giving away some cool prizes, including the grand prize of a paid registration for the upcoming SQLCruise Miami, a $1,395 value! Register now for: SQL Server Query Tuning Best Practices, Hosted by Kevin Kline and Aaron Bertrand with special guest Tim Ford

I hope to see you at both of these sessions next week! Best regards,

-Kev

-Follow me on Twitter!

Let's Talk Licensing and Virtualization for SQL Server

KKline — Thu, 13 Dec 2012 19:23:00 GMT

I have two new articles up on Database Trends & Applications magazine. I'd love to get your thoughts and feedback!

Welcome to the Weird, Wild World of SQL Server Licensing

Not long in the past, SQL Server licensing was an easy and straightforward process. You used to take one of a few paths to get your SQL Server licenses. The first and easiest path was to buy your SQL Server license with your hardware. Want to buy a HP Proliant DL380 for a SQL Server application? Why not get your SQL Server Enterprise Edition license with it at the same time? Just pay the hardware vendor for the whole stack, from the bare metal all the way through to the Microsoft OS and SQL Server....

DBTA E-Edition - December 2012 Issue

Virtualization Conquers the Database

I was privileged to deliver a session entitled Managing SQL Server in a Virtual World at the PASS Summit 2012, the largest annual conference for Microsoft SQL Server. It was a packed house, literally at standing-room-only capacity. I delivered the session with my friend David Klee and we were swarmed by attendees after the session wrapped up. With almost 600 people in the room, we conducted one of those informal polls that speakers like to do along the lines of "Raise your hands if …" and the informal findings were very telling. Probably around 90% of the attendees used VMware and SQL Server in some capacity and at least 60% used it in production environments. Another important fact was that only 10% of the attendees were actually able to get information on the performance of the actual VMs themselves. Most had to get all of their information and support from the VM / System administration staff....

DBTA E-Edition - November E-Edition Issue

Follow me on Twitter!

Quick Tip - Speed a Slow Restore from the Transaction Log

KKline — Wed, 14 Nov 2012 15:59:00 GMT

Here's a quick tip for you:

During some restore operations on Microsoft SQL Server, the transaction log redo step might be taking an unusually long time. Depending somewhat on the version and edition of SQL Server you've installed, you may be able to increase performance by tinkering with the readahead performance for the redo operations. To do this, you should use the MAXTRANSFERSIZE parameter of the RESTORE statement. For example, if you set MAXTRANSFERSIZE=1048576, it'll use 1MB buffers.

If you change the MAXTRANSFERSIZE, keep an eye on the PerfMon objects for Buffer Manager and Readahead IO. You may also wish to keep an eye on LOGBUFFER wait stats.

I'd love to hear your feedback. Have you tried this technique? Did it work as advertised? Did it require some changes to work on a specific version or edition?

Many thanks,

-Kev

-Follow me on Twitter!