Search results matching tags 'tools' and 'Business Intellience'

SQL Server Data Tools - Business Intelligence for Visual Studio 2012 Released!

KKline — Fri, 08 Mar 2013 12:33:00 GMT

SSDTBI for Visual Studio 2012 enables customers to use the Analysis Services, Integration Services, and Reporting Services project templates within the Visual Studio 2012 shell. The components are delivered as a web download on the Microsoft Download center and will be available through Web Platform Installer. This release is the equivalent functionality to SSDTBI (BIDS) for Visual Studio 2010 that shipped in the SQL Server 2012 box. The team adapted the UI to meet the new Visual Studio 2012 UI design. This release delivers on the SQL commitment to provide BI Project Templates supporting the latest version of Visual Studio, a much anticipated capability. The downloads are publicly available on the Microsoft downloads website now:

Download: http://www.microsoft.com/en-us/download/details.aspx?id=36843

More details from specific Microsoft BI teams at:

RS team blog: http://blogs.msdn.com/b/sqlrsteamblog/archive/2013/03/06/sql-server-data-tools-business-intelligence-for-visual-studio-2012-released-online.aspx

AS team blog: http://blogs.msdn.com/b/analysisservices/archive/2013/03/06/sql-server-data-tools-business-intelligence-for-visual-studio-2012-released-online.aspx

Enjoy,

-Kevin

-Follow me on Twitter!

ETL Demo With Data from Data.Gov

KKline — Fri, 05 Aug 2011 21:45:00 GMT

A little over a month ago, I wrote an article (Is There Such a Thing as Easy ETL) about expressor software and their desktop ETL application, expressor Studio. I wrote about how it seemed much easier than the native ETL tools in SQL Server when I was reading up on the tool, but that the "proof would be in the pudding" so to speak when I actually tried it out loading some free (and incredibly useful) data from the US federal data clearinghouse, Data.Gov.

If you'd rather not read my entire previous article - quick recap, expressor Studio uses “semantic types” to manage and abstract mappings between sources and targets. In essence, these types are used for describing data in terms that humans can understand—instead of describing data in terms that computers can understand. The idea of semantic abstraction is quite intriguing and it gave me an excuse to use data from data.gov to build a quick demo. You can download the complete data set I used from the following location: International Statistics. (Note: I have this dream that I'm going to someday download all of this free statistical data sets, build a bunch of amazing and high-value analytics, and make a mint. If, instead, YOU do all of those things, then please pay to send at least one of my seven kids to college in repayment for the inspiration. I'm not kidding. I have SEVEN kids. God help me).

The federal government, to their credit, has made great progress in making data available. However, there is a big difference between accessing data and understanding data. When I first looked at one of the data files I downloaded, I figured it was going to take me years to decrypt the field names. Luckily, I did notice an Excel file with field names and descriptions. Seriously, there are single letter field names in these files where the field name “G” has a description of “Age group indicator” (Oh Wow). See the figure below.

It's stuff like this that reminds me why we have data quality and master data management tools. Ok, back to expressor Studio. I quickly mapped a couple of files into expressor Studio using their “Read File” operator. It was fairly simple and easy to use. My data included files with country area information, population, and gender information by year. Once I mapped these files I quickly wanted to shed the default cryptic, nay, nonsensical names. I could have just renamed the fields when I initially mapped them into the system but that would mean I would have to manage the names in three separate locations. Bah! It made more sense to create a common semantic type and reuse it across all three files.

There are two flavors of semantic types within expressor Studio to handle your mappings, atomic types or composite types. An atomic type is simply a single field name whereas a composite type is a combination of one more atomic types. Since the data files had many common fields, I decided to create a core set of atomic types that I could then roll up into composite types based on the files I was mapping. This kept the mappings simple and easy to understand and most importantly the whole exercise took about 5 minutes. Once the types were created I simply mapped the cryptic names from the files to the business friendly names in my semantic type. (I can't even begin to imagine how long this would've taken using native tools, but certainly not 5 minutes).

Now I was ready to move my data. I took the data from three files and combined them into one master dataset. From there, my international statistics from Data.Gov were pumped right into my waiting SQL Server database. Note that I could've used Excel or just about any other database as my target instead of SQL Server.

Now, you might be saying to yourself "That looks easy because you read all the help files first." Actually, no. In fact, some of my buddies like to lovingly tell me to "RTFM" from time to time. It's not that it offends my masculinity to read a manual. I just usually like to have a go first and then, if needed, go back to the manual. In fact, all I really used was this 5-minute demo video that in noticed when I was downloading the tool.

If you're tackling ETL and you want it fast and easy, then you might want to check out their website, www.expressor-software.com, to learn more about the expressor company and products.

Enjoy!

-Kev

P.S. Follow me on Twitter!

What I'm Reading, July 22 2011

KKline — Thu, 21 Jul 2011 14:43:00 GMT

I read too much, and that, my friends, is an entirely separate topic for a blog post. But I thought I'd share with you a little more about what I'm reading because sometimes, if I'm lucky, it might be something you'd enjoy too. So I'm going to start sharing what I'm reading at least once per week, partly so that I don't firehose too many reading links directly into your brain (where I to do it say once per month) and partly to solidify in my own mind the information that I'm reviewing. So here are a few good links for the seven days leading up to July 22, 2001:

Microsoft and Whitehouse partnership on BigData: BigData isn't a particularly new concept. But I was intrigued to learn that the National Science Foundation, Microsoft, and 13 other teams were partnering on developing better BigData analytics for lots of government data from activities such as healthcare, economic development, education, transportation, and the power grid. Cools stuff! Plus, Microsoft has developed a new tool called Project Daytona to better harness the power of the cloud, in general, and Windows Azure, specifically.
While we're on the topic of Federal IT in the Cloud be sure to read this linked article from ComputerWorld. Say what you will about our government, but putting government IT in the cloud and increasing both its transparency and availability will make a huge difference in how the Federal government will be able to service the public. We're talking as big a difference as corporations experienced between the "catalog on the web" experience of the 1990's to the Web2.0 experience of today.
If you're the social media type, give this article a read discussing the Power of Hashtags in Social Media.
The Register, of the UK, whose tagline is "Biting the hand that feeds IT" has a great article on a spat over database technologies between the IT sage Michael Stonebreaker and Google. It's a great read if for no other reason than to prove that databases are worth fighting over.
And if you think Microsoft is still towing the relational database barge without thinking about other technologies, you need to read up on Projects Dryad and Daytona.
Finally, I'm still getting lots of questions about when and where to limit SQL Server's Max Degrees of Parallelism. Be sure to read Microsoft's Recommendations and Guidelines for 'max degree of parallelism' configuration option here.

And just because so many of us in IT are closet or former musicians, there's Live Guitar Lessons with Steven Krenz, sponsored by my hometown boyz at Gibson Guitar. Got a favorite article or tool tip? Let me know! Enjoy,

-Kev

Follow me on Twitter.