Introduction A few months back I received an email from a nice lady who was beginning to work with SSIS. She was trying to use SSIS to automate metadata collection in her enterprise and she had made a good start in the package she attached to the email. She had a few questions so I opened the package and began poking around some to answer ...

Introduction  On Thursday, 24 Jan 2008, I presented New Features In SSIS 2008 to the Richmond SQL Server Users Group. Most of the presentation was dedicated to demonstrating Change Data Capture (CDC) interacting with SQL Server 2008 Integration Services. I started seriously working on this demo the first week of January, thinking ...

Introduction This post is part of a series of posts on ETL Instrumentation. In Part 1 we built a database to hold collected SSIS run time metrics and an SSIS package to deomnstrate how and why we would load metrics into the database. In Part 2 we expanded on our database and the SSIS package to annotate version metadata, manage error metrics ...

Introduction  This post is part of a series of posts on ETL Instrumentation. In Part 1 we built a database to hold collected SSIS run time metrics and an SSIS package to deomnstrate how and why we would load metrics into the database. In Part 2 we expanded on our database and the SSIS package to annotate version metadata, manage error ...

Introduction This post is part of a series of posts on ETL Instrumentation. In Part 1 we built a database to hold collected SSIS run time metrics and an SSIS package to deomnstrate how and why we would load metrics into the database. In Part 2 we will expand on our database and the SSIS package to annotate version metadata, manage error ...

Introduction One of the things I appreciate about SSIS is the script elements. There is a lot of functionality built into the engine out of the box but I like the idea of having a Script Task on the Control Flow and a Script Component on the Data Flow just in case. Last month I used a Script Task to build a more flexible FTP ...

Introduction   SSIS is a fantastic ETL engine. When I build an ETL solution in SSIS, I like to collect runtime metrics. Why? I use the data initially to determine a baseline for performance and to determine, in some cases, if I'm loading within a defined window.   I refer to this process of collecting ...

Introduction I sometimes miss the ActiveX task in DTS. It was cool because ''if you could see it, you could change it.'' I used the ActiveX Task to generate dynamic SQL. When To Use Dynamic SQL In SSIS There are lots of uses for dynamic SQL in SSIS. If you find yourself using the same SQL statements over and over again with minor ...

Introduction   Loading data from a data source to SQL Server is a common task. It's used in Data Warehousing, but increasingly data is being staged in SQL Server for non-Business-Intelligence purposes.   Maintaining data integrity is key when loading data into any database. A common way of accomplishing this is to ...