Datasheet

Chapter 1: SSIS Solution Architecture
31
Advanced ETL: Scripting, High Availability,
and Performance
The final three chapters of this book deal with the advanced topics of scripting, high availability, and
scaling your package. Chapter 10, for example, dives into how to build a scale - out SSIS solution for high -
availability solutions.
One of the most powerful tools within SSIS is the scripting engine. Often, the out - of - the box tasks and
transformations cannot handle a unique situation effectively. However, the Script Task and Script
component can often be the perfect solution to a complicated problem. Chapter 11 demonstrates
examples (both control flow and data flow) where SSIS scripting can solve challenging requirements
effectively.
Finally, Chapter 12 addresses the problem of performance and scalability. Data volumes and complexity
can sometimes inhibit SSIS package performance. In fact, even SSIS packages designed for simpler
requirements can have performance challenges, and if you are dealing with tight data - processing
windows, or you want to limit the impact of packages, then scaling and tuning your packages is
important. Chapter 12 delves into the best practices for tuning, as well as isolating and resolving
performance problems.
Summary
Enterprise environments are often difficult to work in, given the complexities of system dependencies.
Even if your organization ’ s data nervous system is limited, or your SSIS project is only a small part of
your bigger environment, you must carefully plan how your solution integrates into it. In fact, you
should use your ETL project as an opportunity to demonstrate how to build a solution the right way,
from the infrastructure, to the processes, to the package design, and management. Approach your project
with an overall architecture in mind, be diligent about documenting data elements, plan for the right
infrastructure and process execution strategy, and consider solution and data growth as the project is
expanded, or more data is loaded or integrated.
When you launch your project in the right direction, the very next thing you should do is implement an
SSIS management structure. Chapter 2 examines building an ETL management framework for your
packages.
c01.indd 31c01.indd 31 9/24/09 11:26:44 AM9/24/09 11:26:44 AM