Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
8022421
Starting Member
45 Posts |
 Posted - 2008-11-21 : 09:20:49
|
| I have created a ssis package.In the dataflow task i have a oledb source and a flat file destination. I have given the procedure in the oledb source,The procedure returns 1 billion rows which affects the performance.Is it possible to run two procedures(two oledb sources) concurrently and merge the output to the flat file, In other words is there a possibility to run two stored procedures simultaneously in ssis and merge the output to a flat file destination. |
|
|
visakh16
Very Important crosS Applying yaK Herder
52326 Posts |
Posted - 2008-11-21 : 09:42:43
|
| its possible. define two oledb tasks in parallel and join their output onto a merge join task. make usre you've column to be linked appearing from both the stored procedure as resultset. Also make sure data comes sorted from both oledb sources based on linking column. |
 |
|
|
8022421
Starting Member
45 Posts |
Posted - 2008-11-21 : 10:19:19
|
| Vishak,You are right I also thought about it.Actually the first procedure and the second procedure are the same expect I have a one different condition in the second procedure. I create a sample package for one procedure alone which returns around 65 coulmns as output and 89 million rows.The inital validation before the package execution,alone takes around 4 to 5 minutes.If have another OLE DB source with different procedure same number of columns..Will the initial validation will take more time or will it be the same.. |
|
|
|
visakh16
Very Important crosS Applying yaK Herder
52326 Posts |
Posted - 2008-11-21 : 10:27:35
|
quote:
Originally posted by 8022421
Vishak,You are right I also thought about it.Actually the first procedure and the second procedure are the same expect I have a one different condition in the second procedure. I create a sample package for one procedure alone which returns around 65 coulmns as output and 89 million rows.The inital validation before the package execution,alone takes around 4 to 5 minutes.If have another OLE DB source with different procedure same number of columns..Will the initial validation will take more time or will it be the same..
i doubt whether you will have much boost in performance here running them in parallel as still they are using same objects. |
|
|
|
8022421
Starting Member
45 Posts |
Posted - 2008-11-21 : 10:34:43
|
| Do you suggest any other better approach rather this one.. |
|
|
|
visakh16
Very Important crosS Applying yaK Herder
52326 Posts |
Posted - 2008-11-21 : 10:36:36
|
| what's procedure doing basically? did you had a look into performance of procedure and tried spotting any bottle necks? Try using execution plan and identify costly steps. |
|
|
|
|
|
|
OLEDB Source - Running procedures Concurrently