THE SQL Server Blog Spot on the Web

Welcome to SQLblog.com - The SQL Server blog spot on the web Sign in | |
in Search

Andy Leonard

Andy Leonard is CSO of Linchpin People and SQLPeople, an SSIS Trainer, Consultant, and developer; a Business Intelligence Markup Language (Biml) developer; SQL Server database and data warehouse developer, community mentor, engineer, and farmer. He is a co-author of SQL Server 2012 Integration Services Design Patterns. His background includes web application architecture and development, VB, and ASP. Andy loves the SQL Server Community!
Note: Comments are moderated. Spam shall not pass! </GandalfVoice>

SSIS 2008 Data Profiling Task

Jamie Thomson has posted a great series on the SSIS 2008 Data Profiling Task.

The Data Profiling Task allows developers to quickly assess key statistics about data in a database table. When I say "statistics" I mean things like column value and length distribution, column null ratio, column patterns, and functional dependencies. You can learn more in Jamie's series or at MSDN.

One very cool feature is the ability to set up a Single Table Quick Profile to quickly configure and capture desired statistical data.

Once you capture the data, you use a separate stand-alone tool for viewing the results: the Data Profile Viewer.

SQL Server 2008 CTP6 (February 2008) includes a functioning version of the Data Profiling Task in SSIS 2008.

:{> Andy

Published Thursday, March 13, 2008 12:01 AM by andyleonard

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

 

John Welch said:

At the risk of being completely self-promoting, if you like the data profile task but want to have an easier way to control what tables it profiles, take a look at this:

http://agilebi.com/cs/blogs/jwelch/archive/2008/03/11/using-the-data-profiling-task-to-profile-all-the-tables-in-a-database.aspx

Basically, it walks through how to make the task a bit more dynamic, using expressions and a "hidden" property.

March 13, 2008 2:11 PM
 

andyleonard said:

John,

  You do outstanding work sir. Promote away!

:{> Andy

March 13, 2008 2:53 PM
 

Tim said:

How does one query out a column in a table using the Data Profiling task?

What I mean by this, is you have table with Column ABC which has data A, B, C repeatidly and you want ot query it out to only have data with A under Column ABC. How does one do that using SSIS and using the Data Profiling Task tool?

July 15, 2008 6:25 PM
 

Ira Warren Whiteside said:

I would like to share the new Melissa Data SSIS Total Data Quality Toolkit TDQ-IT, including SSIS Data Profiling 2005/2008.

Melissa Data SSIS Total Data Quality Toolkit TDQ-IT offers a wide range of data transformation and cleansing functionality including data profiling, parsing, cleansing, matching and monitoring functionality built right in to SSIS. And, TDQ-IT leverages SSIS to provide a flexible, effective solution for your organization’s data quality and master data management (MDM) initiatives. Request a free trial today.

http://www.melissadata.com/dqt/total-data-quality-integration.htm

March 15, 2009 1:00 AM

Leave a Comment

(required) 
(required) 
Submit

This Blog

Syndication

My Company


Other Blog

Check out my personal blog...
http://andyleonard.me

Contact Me

Twitter: @AndyLeonard
Email: andy.leonard@gmail.com

Powered by Community Server (Commercial Edition), by Telligent Systems
  Privacy Statement