I have been working with SQL long enough that I have built my personal “toolbox” for SQL related tools that I use on a regular basis. They range from FREE to minimal cost (by that I mean mostly under $100; yeah, I know I am cheap).
You can find my tools here, Padre’s Toolbox and I hope to keep it updated as I test drive and use more and more different SQL programs. For now, I will briefly introduce my favorite tools (in no particular order). In the future, I hope to write a post on how and why I am using these tools.
Since my initial review of this software, Richard Fryar has even further enhanced his product to include Query Plan analysis.
This is from Brent Ozar Unlimited. Enough Said! You not only get their excellent diagnostic scripts, but e-books, whitepapers, and posters Oh My!
DMV Diagnostic Queries
A collection of free SQL tools, I find my self using these more and more for “spot checking” issues or problems.
Not technically a SQL Tools, but as a DBA we have to sometimes manage the OS itself. This tool is crucial for me to be able to remote into multiple servers without having to minimize RDP session to switch between servers.
My newest tool in my arsenal, is one that quite frankly scared the hell out of me at first. Just like Cache Plans in general. But I am mudding through the learning process and I am coming to rely more and more on this program. I haven’t purchased the “Pro” version yet, so I am still evaluating the usefulness of this program and see if I can justify the cost to my “powers-that-be”
We all are aware of the “standard practice” of enabling the Security Policy “Lock Page in Memory” for your SQL Server service account. Just about everywhere you read, it is pretty much standard practice, and so like an red-blooded “Accidental DBA”, I have always used it.
Until today…, well at least for one particular machine!
Let me preface this blog post by saying: I can’t prove nor do I know how to prove that my solutions was the answer to the problem; but it hasn’t been a problem since the change.
I have a physical 32 core, 448 GB RAM, SQL Server 2012 Enterprise Edition, her after referred to as “The Beast”! Unfortunately the Beast got it’s legs chopped off at the knees. Sometime ago, my company bought a new SAN for this server and other shared servers as well. This new SAN, would be 10K drives with loads of storage. The Beast was used to 15K drives which would hide a myriad of query problems. This new SAN also had what the vendor called “tiered storage”. A SSD that would be refreshed every night with ~100GB of the most used files actually read from the SAN since the previous 24 hour check to allow quick access. I personally don’t believe this is a wise configuration for a SQL server with multiple MDF files greater than 400 GB, just sayin’! We have disabled this feature for now.
Anyway, since the new SAN went online, every so often, especially on larger READ queries, the SQL Server would crash and burn. OS RAM was maxed out to the point RDP was not accessible, SQL Server would create a SQL Mini dump referencing page latch issues and the only way to revive it was to execute a remote SHUTDOWN /r command. This went on for a couple of months.
Then I read, Jonathan Kehayias’ article Great SQL Server Debates: Lock Pages In Memory. It is a little old, but it is still a good read. Now this got me thinking, quite possibly this policy may not be for every server. So I researched and researched the whole concept of storing data in memory, dirty pages, and everything I could about how the SQL Engine manage memory, drives and data.
So, with the thought process that my SQL server engine was trying to take more memory from the OS and literally strangle the Beast out of any life by consuming and trying to add more data pages to the Buffer and not releasing older pages, I disabled the policy Lock Pages In Memory.
Since then, my Beast has been happy . I have noticed more writes to the MDF file in the last three weeks, not a steady increase just bursts here and there. I am thinking that is SQL writing dirty pages back to disk, which wasn’t happening before. The Buffer cache is being swapped out with data being used vs. old data at a more consistent rate now.
At least that’s my story and I’m sticking to it!
A very hard lesson that I am seriously still having problems with, is learning to spend some time away from work. I would not necessarily categorize myself as a “workaholic”, I do leave work at work unless called upon; but I don’t spend enough time way from the office as I probably should. I’m talking Vacations!
So, after work today my wife, my kids and I are all heading to Florida for the Mardi Gras weekend. Yes, in Louisiana we (most people) get Monday and Tuesday off for Mardi Gras. Whereas a lot of people are coming into Louisiana, specifically New Orleans for Mardi Gras; true Louisiana natives try and get the hell away from it all!
I am looking forward to a little break away from work and some valuable time with my kiddos before they get too old to want to do anything with their parents!
Get ready Disney World, the BISHOPS are coming!
I would like to discuss something that has been missing in my professional career, mentoring. With a degree in psychology and a master’s in counseling, I stumbled into the IT field after 10 years of food service management. As a member of Generation-X, I have pretty much grown up with the personal computer (although it wasn’t always an IBM clone). So computer technology has always interested me. But it wasn’t until I developed a Food Inventory Tracking system using SQL Express 2005 and Visual Basic 2005 Express edition, that realized that I could actually make a career out of being a developer. Fast forward 10 or so years, now I am a Database Administrator for a local hospital managing almost 100 SQL Server instances.
Over the years, I have played with all every Express edition Microsoft had to offer (either VB or SQL). I have learned from doing (and breaking), reading articles, reading online forums, and reading blogs. All of these were an attempt to try and further my understanding of SQL Server; but the one that that was missing in all my 10 years of IT work? A mentor.
A mentor is such a valuable gift and it should be treated as such. Growing up, I had one of the world greatest mentors in my Scoutmaster. Mr. Emile Oestriecher, was and is to this day the best mentor one could have for life lessons. Things he taught me by being an example are things that I live by today: honesty, integrity, loyalty and never give up.
In the SQL Server world, a mentor is just as valuable. Someone to pass on knowledge, tips, and experience. Of course throwing questions at him would be the simplest way to learn; but getting the chance to discuss SQL Server and how to further my knowledge of it would be priceless. Sometimes the hardest part of learning something, if figuring out the best source of knowledge, especially since there are several hundreds of people who write on the subject of SQL Server.
A SQL Server mentor in my mind would be the type of person who would not give you the answers, but turn you in the right direction so you can figure out the answers yourself. Not making you drink but definitely leading you to the water!
Learning is a never ending task in the world of SQL Server and life! Having started may career as an “accidental” IT person, more importantly as an “Accidental DBA”, sometimes I feel I am way behind the curve of knowledge. I am hoping a mentor can help straighten that curve by at least putting me down the correct path.
So Paul Randal, I submit my blog post as a request for mentorship! I look forward to discussing with you the topic of “ways to learn”.
I/O, Input/Output, Reads/Writes what ever you want to call it. It is one of the most aggravating aspects of SQL Server. The physical spinning hard drives of your SAN can bring your entire database server to its knees, no matter how powerful a beast of a server you have.
When you as the DBA are at the mercy of the SAN Administrator (or better yet 3rd party SAN administrator), your hands are somewhat tied on configuration changes. So what do you do? Bang your head against a wall and shout, “It’s not my fault, it’s not my fault!” Then the big burly guys in white shirts will come visit your cubicle, ask you some questions and then take you on a little “vacation”.
That’s not the path I want to go down.
Not having any type of 3rd party monitoring solution, I needed a way to prove which drive was having trouble and just how much work it had to do!
Now I have done my due diligence and have read about I/O stalls, I/O Latency, other I/O measurements and such; but most everything I found, because the way SQL Server works, were cumulative information. Glenn Berry’s DMV Diagnostic Information Queries is great place to learn where to get this information. But again, it is based on SQL Server cumulative information. I hope my Read Latency is not 150+ ms!
I needed a way to say, “for this sample period” this was the read latency of a drive?
Then I found Jon Gurgul b|t, his post titled Delta and Cumulative IO Stats was a great read; however it wasn’t exactly what I needed. But it did get me thinking about his method of capturing two result sets with a time delay and finding the difference. So why couldn’t I do this for Glenn Berry’s Read/Write Latency script.
Below is what I came up with. It probably is not perfect, but it works for me. I have setup a SQL Agent job to run this code every 15 minutes with a 5 min delay between result sets. Then the results are stored in a Diagnostic database so I can chart and report on trends.
I am eager to see the trending over time and truly see what my Latency time for my SAN drives are!
No, I am not talking about Powerball or Mega-millions, if I had won either of those I don’t think there would be any reason to carry on with SQL as a career! Just sayin’
Anyway, in an attempt to break down, track down or map out the evil of Nested Views, I came across a 4 year old post, titled Detangling Nested Views from @JenniferMcCown, 1/2 of the @MidnightDBA team.
This nifty little script, provides exactly what I need to show “the powers that be” how convoluted some nested views can be. Armed with this and SEVERAL execution plans, I hope I can convince my bosses to allow me to restrict some access around here!
Thank you Jennifer McCown!
Last night, I had the privilege of presenting to the Baton Rouge SQL Server User Group (@BRSSUG). This was my 2nd time presenting to the group and I hope it was as informational as it was enjoyable for me.
The Nuts and Bolts of the presentation
The whole premise of the presentation was to outline and layout what to do when you are given a SQL Server to manage. In some cases you may “discover” a new SQL Instance on your network and not have access to it. I presented one method of gaining access through what I call a “hidden door”.
I am a big supporter (even though I don’t do it as often as I should) of documentation! Knowledge is Power and as our friendly neighborhood Spiderman would say “With great power comes great responsibility”.
What type of information do you need to collect and document on? I explained several bits of information that I gather on a regular basis and gave several tips and demonstrated some wonderful scripts from people much smarter than I am on how to collect this information. I have been using these scripts in “My SQL Toolbox” for a long time.
Here is the slide-deck I used last night with all the links to the various tools of “people smarter than me” that I use on a regular basis.
On September 10th, I will be presenting at the Baton Rouge SQL Server Users Group (@BRSSUG) on a topic that is near and dear to me.
Since becoming the DBA at Woman’s Hospital a year ago, I have used these techniques and processes almost every day in taking “ownership” of over 90 SQL Server instances. After a year, I still have some instances I have to “deal with”; but I am using these steps to implement my “Hostile takeover”!
I will be discussing my tips, processes and SQL tools I use to gather as much information about the SQL Server instances that I have now become administrator.
I will upload my slide deck after the presentation and will give a debriefing here.
BTW, this is my 2nd time presenting to the User Group, maybe next time I will update my SQL Jeopardy and we can play again!
I have been asked, I agreed, and my topic has been accepted.
I am the September Presenter at the Baton Rouge SQL Server User Group meeting!
–A SQL Server instance was just handed to you to manage. OK, great, now what? What are the logical steps and/or best practices in taking over the management of a SQL Server instance.
I will provide more info on my presentation after I present it.
Microsoft has listened to the out cry of SQL DBAs everywhere!
New service packs will be released for SQL Server 2008 and SQL Server 2008 R2 extending it’s lifecycle for another 12 months!
I am not sure about you but I for one am happy. That give me more time to plan!