DSXchange

You can do data quality checking before, during and after ETL load. The most effective data quality checking up front is profiling, with ProfileStage being the obvious choice for a DataStage project and the upcoming releases making it even better. In a banking domain where your amounts must tally th...

I would never put a sql function into a column derivation, no point have an ETL tool if you are going to do the T part in your SQL select statement. Better off doing it in a transformer. I think you hit the nail on the head, you cannot use a job parameter within the columns derivation field but you ...

Is it showing up in the transformer as red text? What is the compilation error you are getting? Have you tried adding it in the transformer via the right mouse click menu?

In the transformer stage your right mouse click menu is your friend and guide. On it you will see the "Job Parameter" option and selecting the job parameter will show you that it gets inserted into the derivation or constraint field without any surrounding characters. Eg. $FLAG

You need to do some sluething, DSCAPIOP__DB2_DBNAME needs to be a job parameter in your container and it needs to be a job parameter in your calling job and on the container properties stage in your host job the container DSCAPIOP__DB2_DBNAME parameter needs to be set to DSCAPIOP__DB2_DBNAME.

Excellent thread. Did you create your bulk load dat files via an Oracle stage? You can usually get faster performance by sending zero rows to the Oracle load stage and sending all your data rows to a sequential file stage. This gives you a faster dat file and a complete control file. Your stats show...

Another way is a multiple instance job that is run for each country. - Write a job that reads the file, removes duplicates from the country field and writes it to a sequential file. - Write a BASIC routine that receives a row number and opens the sequential file and returns the text on that row. - W...

The filter stage is a copy stage. Only rather then copying down each output link unconditionally you can put a filter on each link. Refer to the Parallel Job Developers Guide for the correct filter syntax, unlike server jobs where DataStage BASIC is used throughout, the filter stage has its own synt...

It can also include the basics, how to tell if the server is running, how to stop and start the server, how to view error logs (if you don't have error messages delivered by email), how to restart a failed job etc.

Jet, try deleting the parameter from your job and adding it again. Maybe it was added when the project specific field was a string and it has since been changed to encrypted. Also whenever I set an encrypted password field to $PROJDEF I type it out in notepad and paste it into the encrypted field en...

If I have a lot of columns from multiple tables I start with the SQL builder to build a column list and then switch across to generated or user-defined SQL straight afterwards. The SQL builder may be poor at table joins and where clauses but it is very fast for finding multiple tables and choosing t...

There are a couple good chapters on parallel processing and partitioning in the Parallel Job Developers Guide. According to Ray there is a new training course starting after Live Int 2005 on parallel edition for server developers. A lot of tips are spread through the forum. Some of the key discussio...

Of course, I had it back to front, trying to modify the generated code instead of the underlying objects.

Don't think so, Parameter Manager and the parameter copy routine only modify job parameters, not job activity stages. Job parameters are easy to get to within the DataStage repository, job activity stages are buried in the job control code field with some fairly cryptic parameter naming. For example...

Agree, the time consuming setting of parameters in job activity stages is one of the worst parts of sequence jobs. Plus in 7.5.1 they took away the ability to copy and paste a job activity, change the job name and retain parameter settings. Plus the cancel button on job activity stages does not alwa...