DSXchange

The problem is that I don't get my sequence unique across all partitions. I did the following: Stage Variable (SVCount) = @PARTITIONNUM - @NUMPARTITIONS + 1 Column (SVRow) = SVCount + @NUMPARTITIONS So when I see SVRow in the output file, I get SVRow = 1 for the first 24287 records and then SVRow = ...

I would'nt want to disturb the current design, its better I do it in Transformer and most importantly I want to learn how to do this in a transformer. Running the transformer in sequential is giving me a drawback in performance. I am trying to process around 140 Million records in the job.

Hi Guys I want to generate sequential numbers in a parallel job with configuration file using 4 nodes. I have done the following posted by vmcburney in the transformer stage. 1) Created a stage variable for the counter named SVCounter . with the value as "@PARTITIONNUM - @NUMPARTITIONS + 1"...

Ok I have used the Join stage (hash partitioned sorted on key fields) and made the transformer to parallel default per vmcburney's logic of generating surrogate key. The run time drops down to 15' from 18'30". The data speed reduces when moving from Join stage to the transformer and then to the...

Hi Guys I did a parallel job which reads data from two tables residing in an Oracle 8 platform. I used the Dynamic RDBMS stage to read the two tables. Table 1 has around 2.5 Million records (15 columns) and table 2 has around 5.3 million records (10 columns). I use a lookup stage(Auto partition) to ...

Sorry for replying late. I am V 8.0.1 When I installed the Datastage Client, I had installed the following two fix patches. patch_e119863 : Run-time error 5 when attempting to save an OCI stage table definition to the repository patch_e124328 : Information Server Parallel job with FTP EE stage recei...

Values in the environment variable are the correct, my Client has opened a ticket with IBM.

The Job works even with Job level parameters apart from hardcoded values, only the Project Level parameters are not being accepted. I am still not able to identify the problem ?

They look identical as below Using Parameterization: $RDWID=reliunix $RDWPWD=LL;@1;VA=9BN0FEI49J52KI6B<< $RDWDB=rdwp With Parameterization job aborts. ==================================== Using Hardcoded Values: $RDWID=reliunix $RDWPWD=LL;@1;VA=9BN0FEI49J52KI6B<< $RDWDB=rdwp With Hardcoded credentia...

Actually when I hardcode the DB, ID and PWD values in the stage the job runs fine but when I put the DB, ID and PWD as a parameterized value then the stage fails with the following error.

Failure due to illogical operator

Is this IBM tools issue ?

Hi All I am trying to extract data from an Oracle table. I can see the data when I put the connection credentials of the database and view the data from the Oracle Enterprise stage. I also see the database connection parameters present in the TNSNAMES.ORA file on the unix server. But when I try to r...

I kind of figured out myself. Solution to make the SUBSTR to work is to put the SUBSTR function in the Derivatives of the OCI stage. Rather than building a Custom Query.

Thanks

Hi I am trying to fetch data from an reference Oracle Table using OCI stage to do a Lookup. I had put a custom query in the reference table as follows: SELECT SUBSTR(NAME,7,11) NAME, DESC1, VALUE1, DBSTATUS FROM IX_FLR_FLOORPLAN WHERE NAME = :1 and DBSTATUS = 1 and NAME like 'STORE%' Using this quer...

My bad. I missed the $ in the parameter. It should have been #$ME_FTP_DIR# but I actually put #ME_FTP_DIR#. Datastage does not give invalid path or parameter error, in this case ?

Hi I have an issue in one of my jobs. The purpose of the job is to extract from Oracle Table (OCI stage) and load into a pipe delimited flat file. The job runs successfully with one warning as follows: DataStage Job 39 Phantom 29686 Program "JOB.1682910495.DT.1504041097.TRANS1": Line 265, ...