Search found 103 matches
- Thu Jun 05, 2014 5:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Passing partition number to DB2 via the Connector
- Replies: 1
- Views: 2370
Thanks for the reply, but in our case we need to run the WLM_SET_CLIENT_INFO procedure in the DB2Connector before reading the database, i.e. there is no prior Transformer stage, and I do not know how to access the @PARTITIONNUM value from within a Before-SQL statement. The value really needs to be a...
- Mon Sep 09, 2013 7:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Invalid character(s) ([xFC]) found converting string
- Replies: 2
- Views: 8431
The fix was to add a User Variable to the project: DB2CODEPAGE and assign it the value: 1208 Some of John's wisdom: This [encoding] is decided not by DataStage but by the client software in between DataStage and the the Server database, with DB2 it is DB2CODEPAGE or your default locale, with Oracle ...
- Mon Sep 09, 2013 7:46 pm
- Forum: General
- Topic: WebSphere errors during fixpack install
- Replies: 3
- Views: 5883
- Thu Jul 11, 2013 7:06 pm
- Forum: General
- Topic: WebSphere errors during fixpack install
- Replies: 3
- Views: 5883
- Sun Jul 07, 2013 8:37 pm
- Forum: General
- Topic: Parallel vs Server
- Replies: 4
- Views: 2972
- Sun Jul 07, 2013 7:14 pm
- Forum: General
- Topic: Parallel vs Server
- Replies: 4
- Views: 2972
Parallel vs Server
Apologies if this has already been discussed. I looked through posts for the last 12 months and did not see anything. Having arrived relatively late on the DataStage scene, I know very little about Server. Why do people choose to write some jobs as Server jobs rather than as Parallel jobs? What are ...
- Wed Feb 20, 2013 10:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Defining Range Lookup lists only stream columns
- Replies: 0
- Views: 1382
Defining Range Lookup lists only stream columns
I've just spent the last few hours finding a workaround to some unexpected behaviour, and thought I'd share my findings here... Scenario: We have a job with multiple lookup stages (separated by copy stages), each doing a range lookup using the snapshot date. Problem: The first range lookup can be de...
- Sun Jan 20, 2013 7:44 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Ignoring duplicate entry warning despite only 1 matching row
- Replies: 1
- Views: 7874
Ignoring duplicate entry warning despite only 1 matching row
I just learned another thing about DataStage, and thought it might help others: the lookup stage seems to check for duplicates in the reference stream before trying to match them to the incoming data stream. Symptoms: The job log showed a warning message for the lookup stage: lkupOrgHierKey,0: Ignor...
- Tue Jan 15, 2013 1:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: <FIELD> in input data set 0. Design Time Info error
- Replies: 6
- Views: 15908
- Mon Jan 07, 2013 4:45 pm
- Forum: General
- Topic: Large DSParams File
- Replies: 7
- Views: 3229
I don't know if this helps, but we use a mixture of parameter sets and parameter files, to pass values at runtime. e.g. dsjob -run -mode NORMAL -jobstatus -paramfile Params20130108.txt <project> <job|jobid> We can then use a script to build Params20130108.txt to contain something like: ParamSet_JobS...
- Mon Dec 10, 2012 11:00 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Count Distinct within aggregation
- Replies: 3
- Views: 3933
- Mon Dec 10, 2012 4:55 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Count Distinct within aggregation
- Replies: 3
- Views: 3933
How to Count Distinct within aggregation
Requirement: We are building a summary table with pre-aggregated data. The table has 10 "key" columns, and we aggregate on 20 different combinations of these (e.g. on keys 1/2/3/4 and keys 1/2/5/6). The trick is that we need to count the number of distinct items that were "rolled up&...
- Fri Nov 02, 2012 2:19 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP and performing a database update
- Replies: 7
- Views: 10865
Being my first time using the Generic stage, I am a bit lost. The Score didn't show me much; I assume you meant $OSH_DUMP But I'm having a bit of trouble transcribing what I see in the OSH dump into the Generic stage. If you have a moment, would you please post a copy of a few of the items as you sa...
- Wed Jun 06, 2012 11:36 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: SCD Type 2 producing incorrect inserts
- Replies: 7
- Views: 4994
Yes, I've had a couple of other sets of eyes look at it, but none of us could identify the problem. I force-compiled the job, but it didn't fix things. The sort order looks okay to me. See the above Score dump. The job does not use RCP. On the positive side, I have learned much more about the SCD st...
- Wed Jun 06, 2012 11:22 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Invalid character(s) ([xFC]) found converting string
- Replies: 2
- Views: 8431
Thanks for the suggestion Venki, but it won't work in our case. I forgot to explain the job design. Job1: Reads the given db2 table using RCP, and writes it to a dataset (e.g. <tablename>.ds Job2: Reads this dataset, with the columns explictly defined (as ustring). So we have no opportunity to chang...