THE SQL Server Blog Spot on the Web

Welcome to SQLblog.com - The SQL Server blog spot on the web Sign in | |
in Search

Browse by Tags

All Tags » SSIS   (RSS)
Showing page 49 of 49 (490 total posts)
  • Mantaining order in SSIS flow, problems with Merge

    In a previous post I spoke about the advantages of having sorted flows in SSIS to greatly speed up data insertion using fastload. The need to have a sorted flow brings some severe problems to the SSIS programmer that he need to be aware of and that IMHO Microsoft should address with a future implementation of SQL Server. Let’s have a look at the ...
    Posted to Alberto Ferrari (Weblog) by AlbertoFerrari on April 10, 2007
  • FastLoad option on SSIS with int identity as primary key

    Alberto Ferrari posted some test we made working on performance optimization loading data in very large dimension tables. When we discovered that an int identity primary key is not handled by SQL Server just as an ordered set of data in a bulk operation... we had to triple check the whole thing. I would like to know if there is a way to bulk ...
    Posted to SQLBI - Marco Russo (Weblog) by sqlbi on April 8, 2007
  • Making Fast Load really fast on clustered indexed tables with SSIS

    I have been so used to use int identity fields as primary key for any table and to believe it’s the fastest way to define a clustered primary key that I never thought this can cause serious performance problems to SSIS. Until I tested it and discovered that int identity primary keys are among the slowest way to insert huge amount of data with ...
    Posted to Alberto Ferrari (Weblog) by AlbertoFerrari on April 8, 2007
  • Enable multi-phase data pump in DTS editor (Management Studio)

    If you edit a legacy DTS package with SQL Server Management Studio, you may want to know how we can show the multi-phase data pump operations. I haven't found an option to do this with SQL Server Management Studio. However, when you need to do something, you find a way to do that thing... I found that necessary setting can be controlled through ...
    Posted to SQLBI - Marco Russo (Weblog) by sqlbi on March 11, 2007
  • How to get Distinct Count in SSIS

    Almost one month ago I made a post about a brand new Distinct component for SSIS made by Alberto Ferrari and freely available on SQLBI.EU. The most used way to get distinct rows in a Data Flow  that I've seen is to use the Sort component, asking only for distinct rows (there is a check box for that in the standard edit dialog box). The Sort ...
    Posted to SQLBI - Marco Russo (Weblog) by sqlbi on March 9, 2007
  • A Distinct Component for SSIS

    Alberto Ferrari has published on SQLBI.EU a Distinct component for SSIS. The big advantage is less memory used when you have few distinct values extracted from a large set of data. Component and source code are freeware. Now the challenge is: how to improve the algorithm? Goals: more fast, less memory consumption...
    Posted to SQLBI - Marco Russo (Weblog) by sqlbi on February 12, 2007
  • SSIS: ForEach Looping through a recordset

    I was trying to find a way to repeatedly run the same MDX CREATE GLOBAL CUBE statement 70 times, building 70 different offline cubes for sales rep type folks to carry around for a client, and I just couldn't get it. I have some experience with SSIS, mostly from writing a tutorial on how to do RSS feeds with SSIS earlier that I am not sure ...
    Posted to Louis Davidson (Weblog) by drsql on January 19, 2007
  • XML Data Type Methods and SSIS Package Variables

    This is a follow-up to a posting from several months ago (Using XML Data Type Methods to query SSIS Packages). I included a temp table (based on information I found in the Microsoft.SqlServer.Dts.Runtime.VarTypeConvert class's constructor) which gives the conversion of the numeric data type value to the appropriate TypeCode (System.TypeCode). ...
    Posted to Peter DeBetta's SQL Programming Blog (Weblog) by Peter DeBetta on December 18, 2006
  • Data Flow Components, constructors and SSIS

    Yesterday I had to fix a simple still subtle bug in TableDifference, I think sharing the experience will be useful for everybody involved in custom component creation. The component has some fields that are initialized in the component constructor, at the end of the work the component does not clear them as I would expect the object to be ...
    Posted to Alberto Ferrari (Weblog) by AlbertoFerrari on July 31, 2006
  • Threads and custom components: FlowSync 1.0

    Several people downloaded TableDifference to handle SCD faster, some of them, especially using it on huge table (more than 10 millions rows) noticed memory problems. The problem is that of a flow running too fast and making TableDifference cache data, we know of it and now we decided to solve it creating a new component called ''FlowSync''. ...
    Posted to Alberto Ferrari (Weblog) by AlbertoFerrari on July 6, 2006
Privacy Statement