DTLoggedExec Wiki & Documentation Rss Feed

Updated Wiki: Home

manowar — Tue, 15 Mar 2011 10:21:48 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data, including dataflow profiling information. In brief it allows to fully log and instrument package execution. Here's some samples of what you can do with all the data that DTLoggedExec is able to produce at runtime for any package, new or existing:

Why you created DTLoggedExec?
If you're using Sql Server 2005/2008 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!

Another missing feature that I really missed a lot is the ability to profile dataflow tasks. To do a proper profiling you should add "Row Count" wherever you need to know how many rows has been processed, take the start and the end time of each transformation and put everything in a database for later analysis. This is a highly time consuming way to work IMHO, since package instrumentation should be something provided right from the execution tool, and not by who creates the pakages. Also, putting the instrumentation logic within the package make it more complex and long to develop.

So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement, putting into it all the thing I need to work at my best.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console, CSV). Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2008 (Support of 2005 has been dropped from version 1.1.2008.4)
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.
Log to CSV
Import Log and Profiling Data into SQL Server for further analysis automatically
Add parameters support to packages
Samples for all DTLoggedExec features (12 samples provided)
Logging of events that happened during package loading
Autoconfigurable packages

Under which license is released?
The code and the application are licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Italy License: http://creativecommons.org/licenses/by-nc-nd/2.5/it/.
The "NoDerives" licensing limitation just means that if you want to contribute to the project you have to join codeplex and/or contact me so that I can add you to official authors list.
The "NonCommercial" licensing limitation just means that you cannot take the code and the executable and sell it. Of course, if you want to use it in your production eviroment, that's fine.

Where I can see some screenshot and have more some help and/or more information
Here: http://dtloggedexec.davidemauri.it

Updated Wiki: Home

manowar — Wed, 10 Nov 2010 23:41:12 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console, CSV). Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.
Log to CSV
Import Log and Profiling Data into SQL Server for further analysis automatically
Add parameters support to packages
Sample Reporting
Logging of events that happened during package loading

Updated Wiki: Home

manowar — Sat, 28 Nov 2009 16:30:54 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console; CSV coming soon) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.
Log to CSV
Import Log and Profiling Data into SQL Server for further analysis automatically
Add parameters support to packages
Sample Reporting
Logging of events that happened during package loading

Updated Wiki: Home

manowar — Sat, 28 Nov 2009 16:30:25 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console; CSV coming soon) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.
Log to CSV
Import Log and Profiling Data into SQL Server for further analysis automatically
Add parameters support to packages
Sample Reporting
Logging of events that happend during package loading

Updated Wiki: Home

manowar — Sat, 28 Nov 2009 16:28:45 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console; CSV coming soon) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.
Log to CSV
Import Log and Profiling Data into SQL Server for further analysis automatically
Add parameters support to packages
Sample Reporting
Logging of events that happend during package loading

Updated Wiki: Home

manowar — Sat, 28 Nov 2009 16:24:42 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console; CSV coming soon) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.
Log to CSV
Import Log and Profiling Data into SQL Server for further analysis automatically
Add parameters support to packages
Sample Reporting
Logging of events that happend during package loading

Updated Wiki: Home

manowar — Sun, 28 Jun 2009 21:39:01 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console; CSV coming soon) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.
Log to CSV
Import Log and Profiling Data into SQL Server for further analysis automatically
Add parameters support to packages

Updated Wiki: Home

manowar — Sun, 28 Jun 2009 21:38:20 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console; CSV coming soon) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.
Log to CSV
Import Log and Profiling Data into SQL Server for further analysis automatically

Updated Wiki: Home

manowar — Tue, 06 Jan 2009 10:35:50 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console; CSV coming soon) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.

Updated Wiki: Home

manowar — Fri, 02 Jan 2009 16:55:15 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console, CSV) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.

Updated Wiki: Home

manowar — Fri, 02 Jan 2009 16:53:12 GMT

Enable / Disable logging on the fly for any package, just right from the command line
Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console, CSV) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.

Under which license is released?
The code and the application are licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Italy License: http://creativecommons.org/licenses/by-nc-nd/2.5/it/.
The "NoDerives" licensing limitation just means that if you want to contribute to the project you have to join codeplex and/or contact me so that I can add you to official authors list.
The "NonCommercial" licensing limitation just means that you cannot take the code and the executable and sell it. Of course, if you want to use it in your production eviroment, that's fine.

*Where I can see some screenshot and have more some help and/or more information
Here: http://dtloggedexec.davidemauri.it

Updated Wiki: Home

manowar — Fri, 02 Jan 2009 16:52:14 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data, including dataflow profiling information. In brief it allows to fully log and instrument package execution. Here's some samples of what you can do with all the data that DTLoggedExec is able to produce at runtime for any package, new or existing:

Why you created DTLoggedExec?
If you're using Sql Server 2005 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!
So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

Enable / Disable logging on the fly for any package, just right from the command line

Log Variables value
Log Values of Properties bound to Expressions
In case of error, log all properties along with related connection properties of the erroneous task. This is IDEAL for post-mortem debugging
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console, CSV) Add your own log providers to customize logging
Choose which event you want to log
DTExec parameters emulation (not yet 100% finished)
Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Support for Integration Services 2005 or 2008 through assembly binding
DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time.

Under which license is released?
The code and the application are licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Italy License: http://creativecommons.org/licenses/by-nc-nd/2.5/it/.

The "NoDerives" licensing limitation just means that if you want to contribute to the project you have to join codeplex and/or contact me so that I can add you to official authors list.

The "NonCommercial" licensing limitation just means that you cannot take the code and the executable and sell it. Of course, if you want to use it in your production eviroment, that's fine.

Where I can see some screenshot?
Here: http://www.davidemauri.it/DTLoggedExec.aspx

Updated Wiki: Home

manowar — Mon, 20 Oct 2008 06:33:53 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data.

Why you created DTLoggedExec?
If you're using Sql Server 2005 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!
So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

v 0.1.0.0

Enable / Disable logging on the fly for any package, just right from the command line
Variables value logging
DTExec parameters emulation (not yet 100% finished)

v 0.1.2.0

Values of Properties bound to Expressions
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console)
Add your own log providers to customize logging
Choose which event you want to log

v 0.1.3.2

Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Updated the ConsoleLogProvider to add a more detailed logging of OnError events. Now all properties, along with related connection properties of the erroneous task are logged. This is IDEAL for post-mortem debugging
Corrected a little bug that prevented the abilility to load packages from SQL Server using SQL Authentication
Display loaded package version
Added Help File
Added Samples Packages
Added Usage Samples

v 0.2.x.x -- COMING IN LATE 2008

DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time. This will allows you to fully instrument your DataFlow tasks so that you can monitor your ETL process through time, and you can also detect how many rows has been sent to error flow without having to specifically create a package to do it since everything will be handled by DTLoggedExec. This means that the whole instrumentation process will be transparent to your packages which also means less time to develop packages and a better way to monitor their performances.

The DTLoggedExec architecture has been designed with expandibility in mind, and so it is very easy to extened it with custom log providers.

Under which license is released?
The code and the application are licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 2.5 Italy License: http://creativecommons.org/licenses/by-nc-nd/2.5/it/.

The "NoDerives" licensing limitation just means that if you want to contribute to the project you have to join codeplex and/or contact me so that I can add you to official authors list.

The "NonCommercial" licensing limitation just means that you cannot take the code and the executable and sell it. Of course, if you want to use it in your production eviroment, that's fine.

Where I can see some screenshot?
Here: http://www.davidemauri.it/DTLoggedExec.aspx

Updated Wiki: Home

manowar — Sat, 09 Aug 2008 07:53:07 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data.

Why you created DTLoggedExec?
If you're using Sql Server 2005 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!
So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

v 0.1.0.0

Enable / Disable logging on the fly for any package, just right from the command line
Variables value logging
DTExec parameters emulation (not yet 100% finished)

v 0.1.2.0

Values of Properties bound to Expressions
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console)
Add your own log providers to customize logging
Choose which event you want to log

v 0.1.3.2

Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Updated the ConsoleLogProvider to add a more detailed logging of OnError events. Now all properties, along with related connection properties of the erroneous task are logged. This is IDEAL for post-mortem debugging
Corrected a little bug that prevented the abilility to load packages from SQL Server using SQL Authentication
Display loaded package version
Added Help File
Added Samples Packages
Added Usage Samples

v 0.2.x.x -- COMING IN SEPTEMBER 2008

DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time. This will allows you to fully instrument your DataFlow tasks so that you can monitor your ETL process through time, and you can also detect how many rows has been sent to error flow without having to specifically create a package to do it since everything will be handled by DTLoggedExec. This means that the whole instrumentation process will be transparent to your packages which also means less time to develop packages and a better way to monitor their performances.

Updated Wiki: Home

manowar — Sat, 09 Aug 2008 07:52:36 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data.

Why you created DTLoggedExec?
If you're using Sql Server 2005 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!
So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

v 0.1.0.0

Enable / Disable logging on the fly for any package, just right from the command line
Variables value logging
DTExec parameters emulation (not yet 100% finished)

v 0.1.2.0

Values of Properties bound to Expressions
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console)
Add your own log providers to customize logging
Choose which event you want to log

v 0.1.3.2

Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Updated the ConsoleLogProvider to add a more detailed logging of OnError events. Now all properties, along with related connection properties of the erroneous task are logged. This is IDEAL for post-mortem debugging
Corrected a little bug that prevented the abilility to load packages from SQL Server using SQL Authentication
Display loaded package version
Added Help File
Added Samples Packages
Added Usage Samples

v 0.2.x.x -- COMING IN SEPTEMBER 2008

DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time. This will allows you to fully instrument your DataFlow tasks so that you can monitor your ETL process through time, and you can also detect how many rows has been sent to error flow without having to specifically create a package to do it since everything will be handled by DTLoggedExec. This means that the whole instrumentation process will be transparent to your packages which in turn means less time to develop packages and a better way to monitor their performances.

Updated Wiki: Home

manowar — Sat, 09 Aug 2008 07:51:21 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data.

Why you created DTLoggedExec?
If you're using Sql Server 2005 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!
So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

v 0.1.0.0

Enable / Disable logging on the fly for any package, just right from the command line
Variables value logging
DTExec parameters emulation (not yet 100% finished)

v 0.1.2.0

Values of Properties bound to Expressions
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console)
Add your own log providers to customize logging
Choose which event you want to log

v 0.1.3.2

Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Updated the ConsoleLogProvider to add a more detailed logging of OnError events. Now all properties, along with related connection properties of the erroneous task are logged. This is IDEAL for post-mortem debugging
Corrected a little bug that prevented the abilility to load packages from SQL Server using SQL Authentication
Display loaded package version
Added Help File
Added Samples Packages
Added Usage Samples

v 0.2.x.x -- COMING IN SEPTEMBER 2008

DataFlow Profiling: log DataFlow performance data, how many rows each component has processed in how much time. This will allows you to fully instrument your DataFlow tasks so that you can monitor your ETL process through time, and you can also detect how many rows has been sent to error flow without having to specifically create a package to do it, everything will be handled by DTLoggedExec. so that the whole instrumentation process will be transparent to your packages! This means less time to develop packages and a better way to monitor their performances.

UPDATED WIKI: Home

manowar — Thu, 03 Apr 2008 17:56:02 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data.

Why you created DTLoggedExec?
If you're using Sql Server 2005 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!
So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

v 0.1.0.0

Enable / Disable logging on the fly for any package, just right from the command line
Variables value logging
DTExec parameters emulation (not yet 100% finished)

v 0.1.2.0

Values of Properties bound to Expressions
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console)
Add your own log providers to customize logging
Choose which event you want to log

v 0.1.3.2

Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Updated the ConsoleLogProvider to add a more detailed logging of OnError events. Now all properties, along with related connection properties of the erroneous task are logged. This is IDEAL for post-mortem debugging
Corrected a little bug that prevented the abilility to load packages from SQL Server using SQL Authentication
Display loaded package version
Added Help File
Added Samples Packages
Added Usage Samples

UPDATED WIKI: Home

manowar — Thu, 03 Apr 2008 17:54:38 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data.

Why you created DTLoggedExec?
If you're using Sql Server 2005 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!
So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

v 0.1.0.0

Enable / Disable logging on the fly for any package, just right from the command line
Variables value logging
DTExec parameters emulation (not yet 100% finished)

v 0.1.2.0

Values of Properties bound to Expressions
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console)
Add your own log providers to customize logging
Choose which event you want to log

v 0.1.3.2

Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Updated the ConsoleLogProvider to add a more detailed logging of OnError events. Now all properties, along with related connection properties of the erroneous task are logged. This is IDEAL for post-mortem debugging
Corrected a little bug that prevented the abilility to load packages from SQL Server using SQL Authentication
Display loaded package version
Added Help File
Added Samples Packages
Added Usage Samples

UPDATED WIKI: Home

manowar — Thu, 03 Apr 2008 17:53:04 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data.

Why you created DTLoggedExec?
If you're using Sql Server 2005 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!
So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

v 0.1.0.0

Enable / Disable logging on the fly for any package, just right from the command line
Variables value logging
DTExec parameters emulation (not yet 100% finished)

v 0.1.2.0

Values of Properties bound to Expressions
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console)
Add your own log providers to customize logging
Choose which event you want to log

v 0.1.3.2

Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Updated the ConsoleLogProvider to add a more detailed logging of OnError events. Now all properties, along with related connection properties of the erroneous task are logged. This is IDEAL for post-mortem debugging
Corrected a little bug that prevented the abilility to load packages from SQL Server using SQL Authentication
Display loaded package version
Added Help File
Added Samples Packages
Added Usage Samples

UPDATED WIKI: Home

manowar — Tue, 05 Jun 2007 19:22:01 GMT

News Feeds
What is DTLoggedExec?
DTLoggedExec is a tool that allows you to run a Sql Server Integration Services (SSIS) Package producing a full and detailed logging informations of execution status and package runtime data.

Why you created DTLoggedExec?
If you're using Sql Server 2005 Integration Services, you should know that the packages you've created can be launched via DTExec or SQL Server Agent. In both cases you'll find that, though an extensive logging infrastucture seems to be present, logged information doesn't really help you to understand why and how a package that has always run correctly someday decides to go wrong.

In addition to this big limitation you may also have already discovered that logging can't just be switch on or off right from the execution tool. Though it seems possibile, if you want to log on a text file your package MUST contain a connection manager that points to the file you want, otherwise logging cannot be used. This means that you should engineer your packages so that they support the logging infrastructure, BEFORE you need it. This also means that you have to take care of preparing the way for logging in ALL of your packages.

This is really not how logging should work for me. I need something that can be switched on or off as I desire, without having me to do anything during package development; in addition I need ALL the data and the information I can have, since when I have to understand why a package didn't run succesfully in a production enviroment, well, I can't run the package in debug mode from Visual Studio right from the production server (otherwise I'll be doing debugging on production machines, not an healthy way of working from my point of view)!
So I decided to leverage all the power hidden in the Integration Services Object Model (which is really cool) and I created the DTLoggedExec tool, which aims to be a DTExec replacement.

What are the features of DTLoggedExec?
DTLoggedExec has a lot of interesing features:

v 0.1.0.0

Enable / Disable logging on the fly for any package, just right from the command line
Variables value logging
DTExec parameters emulation (not yet 100% finished)

v 0.1.2.0

Values of Properties bound to Expressions
Fully pluggable architecture: decide where to log informations (natively supported: No Log, Console)
Add your own log providers to customize logging
Choose which event you want to log

v 0.1.3.2

Compiled to support 32bit and 64bit platforms (32bit and 64bit executables are available in the zipped file)
Updated the ConsoleLogProvider to add a more detailed logging of OnError events. Now all properties, along with related connection properties of the erroneous task are logged. This is IDEAL for post-mortem debugging
Corrected a little bug that prevented the abilility to load packages from SQL Server using SQL Authentication
Display loaded package version
Added Help File
Added Samples Packages
Added Usage Samples