DSXchange

Hi All, We have a requirement of running a query on a huge DB table (100 million records or more) to get the required information. We do not have any filtering criteria to reduce the amount of data to be brought in to DS. Also we need to join this huge data with little less(less than a million recor...

Thanks for the reply.. We are using SQL 2005, need to check if it supports sparse look up.

In the meanwhile, we decided to go with the approach I mentioned in the post and do a performance testing and observe the results and time taken

Sample Source data:

earabcrt
qewtuy
ghruo
ehraabc
abcrtch
anmnoas
mnopwwas
asdasmno
asdad
asdas
ryrED

Reference dataset
abc
mno

Output results:
earabcrt
ehraabc
abcrtch
anmnoas
mnopwwas
asdasmno

'abc' and 'mno' sub strings should be available in the source column

Thanks for the quick reply. The issue is that the substring to match is dynamic rather than static. The substring values to be looked for come from the reference dataset.

Hi All, We have a requirement where in after the look up, not only the records with exact match but also any source records matching the pattern in the look up dataset should also pass. We used the below option however there can be performance issues as the source data cann be huge: Have a left oute...

hi all, we are using sql server database as the target and source. the connections are established properly as we are able to connect both through odbc enterprise as well as odbc connector stage. but we are facing problem while loading the data. we have the source as sequential file stage followed b...

I have the following requirement: i have a perl script generating a list of values in a file as output. these values are available under one field in the file. i want to send this field (along with values) as a column in the column list while using select clause on some table. the select clause also...

Dear All, Can anyone help me to understand the steps to establish connection between DB2 server and DS client. The DB2 and DS servers are on two different linux servers. Also the DS server and client are on different m/c. DS client is on windows machine. Let me know in case more details need to be f...

Please post the exact error message. Your description of it is not clear. ... Thanks wurlod. My requirement is to pass a file path as parameter. We are running the jobs from the script in the following syntax: opt/isproj/Abc/Scripts/ sh script1.sh parameterfile.parm Here parameterfile.parm is the p...

Hi All, I want to pass some directory paths as parameters to the sequencer job. This runs fine when i run the job manually from dataStage. However when i run the job from the script (which takes parameter file as a parameteri., ./ scriptname paramfilename), it says DSJE_BADParm and points to error i...

Hi All, My job design is as follows: dataset--->transformer---->aggreagator---->ODBC conector I have hash partiitoning and perform sort on the aggregator. I have 4 key columns(Not Null) and one column whose sum I am finding out. Somehow I get different count coming from the aggregator stage everytim...

Hello All,

How can we run 2 seperate sequencers with diferent param file list from a single unix shell script?

You cannot FTP a remote Excel file from inside DataStage and be able to parse the contents. Do you have an ODBC or other driver on your Linux server which can read excel files? ... Thanks for the quick reply. Do you mean to say that with ODBC connector we can connect to a remote m/c without actuall...

Hello All, I have an excel file(.xls) lying on a remote m/c. i am trying to use FTP plug in stage to bring it to my server which is a linux box. Now this remote m/c is a windows based application. How shall i define the format and metadata in the ftp stage to be able to ftp the file from the remote....

I have a FTP enterprise stage ftping the files from another site. the site is something like ://testwebsite. how can i pass this value from the unix box. Do i need to use escape characters for it. shall i have to define it as \:\/\/testwebsite in the param file. Since it is a path do i need to defin...