DSXchange

Hi , I am getting the below fatal error while trying to use File Connector stage. Can anyone knows about it. I am trying to read from hive tables(hdfs) using file connector stage. File_Connector_0: com.ascential.e2.common.CC_Exception: java.lang.Exception: java.lang.RuntimeException: java.lang.Runti...

Hi .. just wanted to know if you are able to read the hive tables or hdfs files using Big data file stage...Even I have a similar requirement and doing research on the configuration part.

Thats right... At run time we can use only on value file set. But my question was.. Is there any limit on the number of value file set that we can define with one parameter set?

Hope my question is clear.

is there any maximum limit on the number of Value Files that we can define in Parameter Set?

Hi,

I have created a script to import list of DSX to datatsage which is running through Command Prompt. Let me know which error return code I can capture in case job is unsuccessful while importing or failed to import.

Hi,

Can Someone help me with a Script to Combine Multiple DSX into one DSX.

Thanks
Atul Goel

Hi, Some one please let me know how to find the Project Directory? Means how to go to Project Directory in UNIX..

Hi, Suppose I have 2 jobs. One is creating a Dataset and second job is reading the dataset (created by first job). After creating the dataset by first job, If configuration file get changed, will second job be able to read the dataset created by first job. Is there any option in configuration file ,...

Thanks All, It solved the issue. After CAT the source file, execute below code in User Variable Trim(Convert(@FM,',',MOVE_TO_SOURCE.$CommandOutput),',','T') above will convert all new lines to comma and remove the last comma. And then start the loop on list of values from user variable stage. Thanks

Yes Craig. I created delimited list of values as below: 1|A 2|B 3|C (There is no enter after C) I am reading this file using Command Activity stage in sequencer using below Command: paste -s -d ',' <File Name> This will give below output: 1|A,2|B,3|C After this I am using Loog start Activity having ...

Thanks for the reply Craig.

Yeah. I have used looping in sequencers. But I am not sure how to create looping on 'value files' in parameter set and paas next value file to a job.

I will be very thankful if you can help me.

Thanks

Hi, I have around 30 Value Files in my Parameter Set. I want to run my job for the values present in 30 Value Files. I have made my job as Multiple Instance job and I have created a sequencer with 30 JOB ACTIVITY which is calling this job with different Invocation Id and Value file. Is there any way...

Try Below function in transformer in Datastage 8.5 version:

DateOffsetByComponents(%basedate%,%yearoffset%,%monthoffset%,%dayoffset%)

DateOffsetByComponents(CurrentDate(),-38,0,0)

Functionality of Preserve Partition 'SET' is equivalent to explicitly specifying SAME partitioning or not?. If we put Preserve Partition as 'SET' in any stage example (Transformer, Join stage ), the downstream/subsequent stages will use the same partition of upstream or I can choose my partition on...

Currently I am facing the performance issue in one of the table load. This job has the CDC stage to compare source and target records based on Key fields (2 fields). Initially job worked fine and was completing in few minutes. Now data has been increased (5M) and it is taking very long time (7Hrs) t...