DSXchange

Please let me know how can I access the following data source for ETL work, using Datastage.

1. Twitter
2. Google Analytics
3. LinkedIn

Thanks.

Can anyone please let me know if Datastage (11.3) jobs can be invoked from Oracle DAC scheduler, if 'Yes', what is the process.

Thanks.

I am not able to find 'File Connector' stage in Datastage 11.3 in Palette. Please let me know if there is any special configuration required. I am supposed to get it under Palette -> File, but don't see it.

Thansks.

Thanks for the clarification. Still curious about the following.

ODBC/JDBC for Hive/HBase tables and calling it in Datastage

Ray or Others, Is there any stage called 'HDFS stage' in DS 11.3. I thought it is 'Big Data' File stage to access files sitting on Hadoop. Curious to know if one can set up the following. 1. ODBC for Hive tables and calling it in Datastage 2. JDBC for HBase tables and calling it in Datastage. Thanks.

Hi Ray,
Thanks for your reply. I havn't used it ever, so wondering using HDFS stage I can access files on HDFS. Will I be able to access tables in Hive or HBase using 'HDFS stage' ?

Thanks.

Please let me know If DS 11.3 can connect to Hadoop file system (Cloudera 5) and to Hive/HBase tables. If 'Yes' how to configure.

Thanks in advance.

So, can I invoke the DS job for each of the param set value file like this below.

- param pS1 = pS1_VF1
- param pS1 = pS1_VF2
- param pS1 = pS1_VF3
so on

?

I need to run a DS job from command line. The job uses param set with multiple value files. In that case what would be the '-param' argument.

For example - if the param set 'pS1' has value file names pS1_VF1, pS1_VF2, pS1_VF3 so on.

what would be the '-param' arguments in dsjob command.

Thanks.

Hi,
I am using DS 8.1 and am not seeing any of the database (DB2, Oracle) connector stages appearingly correctly, they are appearing as 'generic stage' symbol. However the enterprise, API stages are appearing fine.

Please advice.

Thanks.

Please let me know when to choose one over the other.

Insert then update
Update then insert

Thanks.

So, for large volume data loads, one should prefer Enterprise stage, right ?
And whats is the best use case for using the Connector stages.

Please let me know the difference between connector and enterprise DB stages in general (when to choose one as opposed to other). I am looking for large data loads (Oracle, DB2, Netezza).
Thanks.

I am talking about the 'Change Capture' stage in DS. Is it anyway detrimental to performance when it comes huge data volume.

Looking for some advise on best practise to capture 'changed data' for huge data volume. Assuming I have a Base table with huge data volume and I get a full dump of the source data in some Staging table. So, will the 'Change Capture' stage be good enough (performance wise) to find the changed data (...