Search results matching tag 'Business Intellience'

PASS Business Analytics Conference (BAC) Recap

KKline — Sun, 14 Apr 2013 14:15:00 GMT

The PASS Business Analytics Conference (PASS BAC) is PASS' first foray into an event that is dedicated to business intelligence, big data, data visualization, and business analytics. And it totally makes sense for PASS to move in this direction, over and above the flagship community work centered on database management and application development. Why? Because business analytics is all about how to apply the data being collected and managed by all of those developers and DBAs. And, at the end of the day, how we use and apply our data is really the nexus of its value. That's what matters to business. You can read the speech from the standing president, Bill Graziano (Twitter | Blog), or watch it online at the PASS website.

The day one highlight, introduced by the SQL Server team's best presenter - Amir Netz (Twitter), is the release of a new BI data visualization tool called Project “GeoFlow” for Excel. GeoFlow is a 3D visualization and storytelling tool that helps you map, explore and interact with both geographic and chronological data for visualizing data which is difficult to identify in traditional 2D tables and charts. With GeoFlow, you can plot up to a million rows of data in 3D on Bing Maps, see data changes over time and share findings through appealing screenshots and cinematic, guided video tours of the data. It's really something you have to see to understand – check out the video demo and screenshots below. You can also download and try it out firsthand today. It’s an entirely new way to experience and share insights – one you’ll probably enjoy. For more information on GeoFlow, check out the Excel team’s blog and visit the BI website.

The highlight for me, aside from connecting with so many friends and colleagues in the exhibit hall at the SQL Sentry booth, was the day 2 keynote address by Dr. Steve Levitt of Freakonomics fame. Freakonomics is both a brilliant blog and the number one business book in America. His insights are well documented in a variety of places, not just in his own channels, but also in places such as TEDtalks. I'm also really enjoying his new website, https://www.freakonomicsexperiments.com/.

Steve presented an outstanding keynote, full of funny anecdotes and insights into the world of data analytics and interpretation. A couple of his comments really resonated with me which are worth repeating. In one story, he pointed out how some of the greatest insights came from corporate data which was collected incidentally or coincidentally. The data that help provide the greatest and most valuable revelations were from data that was basically a corporate afterthought. Another revelation - he's only now starting to make much use of relational databases. He primarily uses spreadsheets, flat files, and the Stata statistical analysis tool. Another insight, which I've known and proselytized as "the Fresh Pair of Eyes" approach, is that it really helps him to gain insights in a problem by knowing as little about the problem as possible. As it turns out, if you know the industry or the challenge at the core of the problem, you make a lot of assumptions that limit your means of interpreting data. By knowing nothing or next to nothing about a particular problem, you can ask the questions that insiders never ask. Here's an example (not from the keynote though) - let's say you're an energy company CEO. You might spend a lot of time thinking about how to accommodate the expected huge increase in energy consumption due to lots of people driving electric cars. You might tell your data analysts to figure out when and how to ensure peak electrical usage is available at the times when consumers are recharging their electric vehicles. But a fresh pair of eyes would point out that electric cars, in their present form, are a huge energy boondoggle compared to hybrid and plain ol' cheap, high-mileage models like the Honda Civic. Consumers will never recoup their investment in a high-priced, all-electric car compared to a cheap, gas sipping model.

At the heart of his presentation is the fact that data is meaningless when it doesn't answer important questions! Many times, data professionals spend so much time devising elegant SQL statements and clever user-interfaces that they forget about using a fresh pair of eyes when they look at business questions. Our session, Operational Excellence for the BI Pro, focused on the trails and travails of successfully implementing and growing the footprint of a business intelligence project.

In addition, we had a fun and very informative panel discussion breakfast on Thursday of the PASS BAC. At right is a picture of Nick Harshbarger, Justin Randal, and me prior to the session. The audience was very engaged and, despite having no slides, there was a whole lot of wisdom goin' on. The panel included Chris Webb (Twitter | Blog), Craig Utley, Jen Stirrup (Twitter | Blog), Paul Turley (Blog), and Stacia Misner (Twitter | Blog). I served as the moderator and facilitator of the session. We recorded the session, with a little HD Flip camera, and although I haven't checked out the file yet, we're hopeful we can post it or at least a transcript soon.

Do you have a "fresh eyes" story? I'd love to hear it! Post a comment here!

Many thanks,

-Kevin

-Follow me on Twitter!
- Google Author

SQL Server Data Tools - Business Intelligence for Visual Studio 2012 Released!

KKline — Fri, 08 Mar 2013 12:33:00 GMT

SSDTBI for Visual Studio 2012 enables customers to use the Analysis Services, Integration Services, and Reporting Services project templates within the Visual Studio 2012 shell. The components are delivered as a web download on the Microsoft Download center and will be available through Web Platform Installer. This release is the equivalent functionality to SSDTBI (BIDS) for Visual Studio 2010 that shipped in the SQL Server 2012 box. The team adapted the UI to meet the new Visual Studio 2012 UI design. This release delivers on the SQL commitment to provide BI Project Templates supporting the latest version of Visual Studio, a much anticipated capability. The downloads are publicly available on the Microsoft downloads website now:

Download: http://www.microsoft.com/en-us/download/details.aspx?id=36843

More details from specific Microsoft BI teams at:

RS team blog: http://blogs.msdn.com/b/sqlrsteamblog/archive/2013/03/06/sql-server-data-tools-business-intelligence-for-visual-studio-2012-released-online.aspx

AS team blog: http://blogs.msdn.com/b/analysisservices/archive/2013/03/06/sql-server-data-tools-business-intelligence-for-visual-studio-2012-released-online.aspx

Enjoy,

-Kevin

-Follow me on Twitter!

What's It Like on a SQLCruise?

KKline — Tue, 05 Feb 2013 19:25:00 GMT

I always seem to get a question or two along the lines of "What's it like on a SQLCruise?" as I present at various conferences, SQL Saturdays, and user group meetings. Since we just finished up the 2013 Miami SQLCruise, I thought it'd be a good time to recap so that you can judge for yourself if you'd ever want to do it yourself. Personally, I think that Tim Ford (Twitter | Blog), together with his wife Amy, are doing better than ever in making the cruise both a top-quality learning experience and fantastic social experience. I've heard from many attendees that they learned enough in the first day or two to make the whole trip worthwhile and, keep in mind, some of these attendees paid for the trip out of their own pocket.

Loads of pictures at http://sqlcruise.com/cruise/past-cruises/sql-cruise-caribbean-2013/.

SQLCruise Content

SQLCruise is, first and foremost, a training event. On each cruise, Tim usually pulls together four or five very well known experts in the industry who, in turn present several hours training. Each day the ship is at sea is a day spent in class. Example of the agenda is on the lower right. When the ship is in port, it's a day of activity and adventures. Tim spends quite a bit of time coordinating with the speakers so that the curriculum is both unique and well tailored to the students.

But each and every night, whether at sea or in port, is spent in 'office hours'. For many attendees, office hours are their favorite part of the learning experience. Since Tim caps registration at 15 students, that means the students get virtually unfettered access to the experts. If you've ever attended a conference, you've probably encountered that common scenario where the speakers are busy with presentations and, at the conclusion of their session, are mobbed by attendees with questions. They're lucky to get 3-4 minutes of the speaker's time. On the other hand, the students get hours and hours to talk about whatever is on their mind. And since we're on a cruise ship in the tropics, office hours usually look like the image at top right. It's both very relaxing and very educational.

Another aspect of the content on SQLCruise that makes it unique is the amount of time spent on personal and professional development. The majority of attendees are not newbies. They're mid-career professionals who are doing well and their career and want to take it to a higher level. But as we often find, our earlier years in IT are spent learning how to be really good at the technology part of our career. We like technology and, sensibly, it's the immediate problem we face in day-to-day productivity. But as the years progress and we earn a few promotions, we come to find that rising in the ranks means a lot of communication and, gasp, office politics. The speakers, in many cases, have careers the students would like to emulate. This is where SQLCruise really shines. Imagine being able to pick the brains of senior technologists and managers in a friendly and welcoming environment. How great is that? In fact, many SQLCruise attendees (I know of several from each cruise I have attended) have used the professional counseling they received on the cruise to enact an energetic new phase in their career with big pay raises, exciting new jobs, high-profile blogs, and all sorts of other really cool things like that.

You'll have to suffer through excursions like Trunk Bay on St. John's in the US Virgin Islands.

SQLCruise Experience

Now that I've told you about the grueling educational side of SQLCruise, did I mention that we do all of this ON A CRUISE SHIP IN THE CARIBBEAN?!? The cruise ships are, if you will, an enormous Vegas hotel on the water. There are casinos, a constant parade of entertainment, live music, comedy, pools and water slides, discos and dancing, live game shows - the works. Ask Neil Hambly (Twitter | Blog) about the dancing!

Several of the sponsors also help to put on really fun contests and activities, some of which produce some really funny antics. There are fun scavenger hunts and other team relays which, if you can get over your inhibitions, are a ton of fun. Another aspect that makes the SQLCruise a unique experience is the fact that most attendees bring at least one other person, if not their entire family. That means that there are plenty of people for your significant other to hang out with while you're in class. Kids have built-in playmates, over and above the kids' activities that the cruise line keeps running around the clock. Lots of folks, including me, have also brought along a parent or several parents. They all have a great time and, in many cases, look forward to meeting their new friends again on a future cruise. Would it surprise you if I mentioned that most of the parents are not the type to start emailing each other as soon as they get off the ship?

Perhaps the most enjoyable aspect of SQLCruise for many attendees is that you're on a cruise ship in the Caribbean hundreds of miles from bandwidth. That means very limited connectivity. Although I've witnessed a student or two have to miss a class to put out some sort of fire back at the office, this is a really rare occurrence. In fact, it's much less common than what I've seen at the big conferences because you're so disconnected from all fast forms of bandwidth. Yes, there is an expensive sort of satellite connectivity on the ship. But your boss would have to be pretty desperate to keep you on the front lines while on one of these trips. Now I don't know about you, but my training events are always more enjoyable when I don't have the cares of the office weighing on my mind.

SQLCruise Instructor Allen White (Twitter | Blog) teaches about PowerShell for the SQL Server professional at right. Notice his casual but totally appropriate attire. Shorts, sandals, and comfy shirts are the norm even in class.

SQLCruise Cost

SQLCruise costs less than $200/day for the training. That compares to more than $300-400/day training costs of most commercial training centers who use the Microsoft Official Curriculum (MOC). On the other hand, there's the cost of the cruise itself. But again, the cruise is all-inclusive for lodging and meals (but not alcohol). So, for me at least, the cost of cruise itself was actually a little cheaper than a standard, nice American hotel chain like a Hilton, Marriott, or Sheraton.

Another, less tangible benefit of the expense of the SQLCruise is that the instructors are never unable to answer your questions, compared to many training centers whose trainers have never actually had a career built around the topic they're teaching. It's a huge difference.

Finally, if you're weighing the idea of paying for a trip like this out of your own pocket, consider that training expense are tax deductible. In my experience, probably a third of attendees cover their own costs. In a few cases, employers cover the training and the attendee covers their travel expenses. And for the rest, their employers cover the cost. Check out the FAQ and other resources on the website for tips on convincing your boss that this is the right training for you. As an aside, SQL Sentry gave away a full registration to the event - winner Mickey Stuewe is in the center of the picture at right. Congrats Mickey!

It's a great event and a great way to spend a week. I hope to see you at a future SQLCruise!

-Kev

-Follow me on Twitter

ETL Demo With Data from Data.Gov

KKline — Fri, 05 Aug 2011 21:45:00 GMT

A little over a month ago, I wrote an article (Is There Such a Thing as Easy ETL) about expressor software and their desktop ETL application, expressor Studio. I wrote about how it seemed much easier than the native ETL tools in SQL Server when I was reading up on the tool, but that the "proof would be in the pudding" so to speak when I actually tried it out loading some free (and incredibly useful) data from the US federal data clearinghouse, Data.Gov.

If you'd rather not read my entire previous article - quick recap, expressor Studio uses “semantic types” to manage and abstract mappings between sources and targets. In essence, these types are used for describing data in terms that humans can understand—instead of describing data in terms that computers can understand. The idea of semantic abstraction is quite intriguing and it gave me an excuse to use data from data.gov to build a quick demo. You can download the complete data set I used from the following location: International Statistics. (Note: I have this dream that I'm going to someday download all of this free statistical data sets, build a bunch of amazing and high-value analytics, and make a mint. If, instead, YOU do all of those things, then please pay to send at least one of my seven kids to college in repayment for the inspiration. I'm not kidding. I have SEVEN kids. God help me).

The federal government, to their credit, has made great progress in making data available. However, there is a big difference between accessing data and understanding data. When I first looked at one of the data files I downloaded, I figured it was going to take me years to decrypt the field names. Luckily, I did notice an Excel file with field names and descriptions. Seriously, there are single letter field names in these files where the field name “G” has a description of “Age group indicator” (Oh Wow). See the figure below.

It's stuff like this that reminds me why we have data quality and master data management tools. Ok, back to expressor Studio. I quickly mapped a couple of files into expressor Studio using their “Read File” operator. It was fairly simple and easy to use. My data included files with country area information, population, and gender information by year. Once I mapped these files I quickly wanted to shed the default cryptic, nay, nonsensical names. I could have just renamed the fields when I initially mapped them into the system but that would mean I would have to manage the names in three separate locations. Bah! It made more sense to create a common semantic type and reuse it across all three files.

There are two flavors of semantic types within expressor Studio to handle your mappings, atomic types or composite types. An atomic type is simply a single field name whereas a composite type is a combination of one more atomic types. Since the data files had many common fields, I decided to create a core set of atomic types that I could then roll up into composite types based on the files I was mapping. This kept the mappings simple and easy to understand and most importantly the whole exercise took about 5 minutes. Once the types were created I simply mapped the cryptic names from the files to the business friendly names in my semantic type. (I can't even begin to imagine how long this would've taken using native tools, but certainly not 5 minutes).

Now I was ready to move my data. I took the data from three files and combined them into one master dataset. From there, my international statistics from Data.Gov were pumped right into my waiting SQL Server database. Note that I could've used Excel or just about any other database as my target instead of SQL Server.

Now, you might be saying to yourself "That looks easy because you read all the help files first." Actually, no. In fact, some of my buddies like to lovingly tell me to "RTFM" from time to time. It's not that it offends my masculinity to read a manual. I just usually like to have a go first and then, if needed, go back to the manual. In fact, all I really used was this 5-minute demo video that in noticed when I was downloading the tool.

If you're tackling ETL and you want it fast and easy, then you might want to check out their website, www.expressor-software.com, to learn more about the expressor company and products.

Enjoy!

-Kev

P.S. Follow me on Twitter!

What I'm Reading, July 22 2011

KKline — Thu, 21 Jul 2011 14:43:00 GMT

I read too much, and that, my friends, is an entirely separate topic for a blog post. But I thought I'd share with you a little more about what I'm reading because sometimes, if I'm lucky, it might be something you'd enjoy too. So I'm going to start sharing what I'm reading at least once per week, partly so that I don't firehose too many reading links directly into your brain (where I to do it say once per month) and partly to solidify in my own mind the information that I'm reviewing. So here are a few good links for the seven days leading up to July 22, 2001:

Microsoft and Whitehouse partnership on BigData: BigData isn't a particularly new concept. But I was intrigued to learn that the National Science Foundation, Microsoft, and 13 other teams were partnering on developing better BigData analytics for lots of government data from activities such as healthcare, economic development, education, transportation, and the power grid. Cools stuff! Plus, Microsoft has developed a new tool called Project Daytona to better harness the power of the cloud, in general, and Windows Azure, specifically.
While we're on the topic of Federal IT in the Cloud be sure to read this linked article from ComputerWorld. Say what you will about our government, but putting government IT in the cloud and increasing both its transparency and availability will make a huge difference in how the Federal government will be able to service the public. We're talking as big a difference as corporations experienced between the "catalog on the web" experience of the 1990's to the Web2.0 experience of today.
If you're the social media type, give this article a read discussing the Power of Hashtags in Social Media.
The Register, of the UK, whose tagline is "Biting the hand that feeds IT" has a great article on a spat over database technologies between the IT sage Michael Stonebreaker and Google. It's a great read if for no other reason than to prove that databases are worth fighting over.
And if you think Microsoft is still towing the relational database barge without thinking about other technologies, you need to read up on Projects Dryad and Daytona.
Finally, I'm still getting lots of questions about when and where to limit SQL Server's Max Degrees of Parallelism. Be sure to read Microsoft's Recommendations and Guidelines for 'max degree of parallelism' configuration option here.

And just because so many of us in IT are closet or former musicians, there's Live Guitar Lessons with Steven Krenz, sponsored by my hometown boyz at Gibson Guitar. Got a favorite article or tool tip? Let me know! Enjoy,

-Kev

Follow me on Twitter.

Getting Ahead of the Curve – Big Data

KKline — Thu, 14 Jul 2011 14:41:00 GMT

I have to confess that I'm incredibly excited about BigData. I haven't been this excited about new innovations in IT since relational databases first appeared on the scene early in my career. But what is BigData? Back in those days, I can still feel the echos of adrenaline when I was hired to work on a NASA project that would involve over 100Mb of data. ONE HUNDRED MEGABYTES! Good grief, that was fantastically huge to us on the team. (That database was over 130Mb when I finally moved on to another project). And remember - PC software was installed using 640Kb floppy disks at the time. In fact, my Oracle v5 instance required shuffling through about a dozen floppy disks to get the thing installed on a 286 IBM PC. BigData today takes on an entirely meaning as database sizes scale into the petabytes. But the emphasis is still the same today as it was back in the 1980's - turning data into actionable information. However, with BigData, we can achieve amazing new insight from this data and mine for tidbits that would never have seen the light of day with smaller data sets. The two major themes to remember about big data are 1) the more data you have on a given domain, the more power you have, 2) the better the analysis you can perform on the data, the more power you have. In fact, theme 2 might be the most important thing to consider because lots of data is meaningless unless you can extract knowledge from it. And that's where better analytical techniques come into play. Here are some articles about Big Data that you might enjoy:

Let me know what you think. Best regards, -Kev

Follow me on Twitter at kekline

Business Intelligence Careers SearchSQLServer.com Interview

KKline — Fri, 29 Apr 2011 14:37:00 GMT

I had a very interesting conversation recently with a good friend of mine. She's at the top of her game as a first class enterprise DBA in a major medical institution. She was interested in my career advice because she'd recently received an unsolicited invitation for a higher paying job in the business intelligence (BI) field. While I won't talk much more about the specifics of that conversation, it's not a unique conversation. In fact, I gave an interview to SearchSQLServer.com a while back about how DBA career paths are more and more leading into an even better paying career in business intelligence. Check out the interview HERE.

~~~

Enjoy!

-Kev

Twitter at kekline