Search found 763 matches

by bcarlson
Wed Apr 13, 2005 12:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Split file to respect limit of records
Replies: 3
Views: 2500

As Ray said, you can use the Unix split command on the output. That is probably your best bet, since you can specify 150,000 records per file and not have to know anything about the input file itself. If you need to it in DX, you can try exporting to a file-set. While you cannot specify the number o...
by bcarlson
Wed Apr 13, 2005 12:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key generator
Replies: 5
Views: 4185

Basically the Surrogate Key generates a unique number to each record using a counter. By default the counter starts at 0, but you can specify another number if necessary. For example, if you were generating keys to a table that gets appended daily, you may want to get the max id in the table, and us...
by bcarlson
Wed Apr 13, 2005 11:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with join stage
Replies: 2
Views: 1590

If what you say is true that you have 2 rows from left and from right, with the same keys, then the output of the join is correct. Take the following rows, for example (ignore code reference, just used code formatting to keep data formatted)... Row Left Right 1 a a 2 a a In the join (inner or left-o...
by bcarlson
Mon Apr 11, 2005 11:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Creating config for accessing Teradata
Replies: 11
Views: 12443

Creating config for accessing Teradata

I am reposting this message (from http://www.dsxchange.com/viewtopic.php?t=92057 ) to see if I can stir up some more info: We are trying to resolve the following warning message from DS: Teradata_Enterprise_0: There will be some skew in the usage of the server because the number of players (3) is no...
by bcarlson
Fri Apr 01, 2005 3:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Mianframe
Replies: 4
Views: 1489

If you have a copy of the COBOL copybook, you can use readcobol (in the <your Ascential Root Dir>/DataStage/PXEngine/bin/ directory). That will convert the copybook to a schema which can then be imported into DataStage Manager (Import/Table Definitions/Orchestrate Table Definitions...). You can also...
by bcarlson
Fri Apr 01, 2005 2:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error in reading fix length sequential file
Replies: 3
Views: 5703

Re: Error in reading fix length sequential file

Sounds like the column definition may not match the file exactly. Assuming this is an ASCII file with newline record delimiter, then the record-level and Field Default parameters look good. Double check your column definitions. The sum of the lengths of each field should total the overall record len...
by bcarlson
Fri Apr 01, 2005 1:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning message from Teradata Enterprise stage on read
Replies: 4
Views: 2979

How is the number of players related to the number of nodes? We have a number of different config files with node definitions ranging between 8 and 12 nodes. Here's a sample: { node "myserver" { fastname "myserver" pool "" resource disk "/mydir/DataStage_work/1&quo...
by bcarlson
Fri Apr 01, 2005 11:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Export data from DB2 (MAINFRAME) table into flat file
Replies: 4
Views: 3458

We recieve files from the mainframe that are complete extracts of DB2 tables. I don't know the specifics, but our mainframe people refer to a utility called DB2 Unload.

Hope this helps.
by bcarlson
Fri Apr 01, 2005 10:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning message from Teradata Enterprise stage on read
Replies: 4
Views: 2979

Sorry about the server vs. parallel forum, didn't realize where my message was being posted. Is it possible to move the posting? As for the player config, how do I specify how many players to use? We use DB2 and DataStage a lot, and I know that we have a configuration that was setup the described th...
by bcarlson
Thu Mar 31, 2005 5:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Is there any DB2 SQL Builtin Conversion from EBCDIC - ASCII
Replies: 3
Views: 2321

Re: Is there any DB2 SQL Builtin Conversion from EBCDIC - AS

I agree with Ray, do it in DataStage - if it isn't a standard database function, let something else do the work. In this case, converting EBCDIC to ASCII is not a normal database function, but it is normal for DataStage. Use the tool (or tools) most appropriate for the work to be done. Also, the ASC...
by bcarlson
Thu Mar 31, 2005 5:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning message from Teradata Enterprise stage on read
Replies: 4
Views: 2979

Warning message from Teradata Enterprise stage on read

We have been using DS with DB2 for a long time and are now starting to use Teradata. I just created a simple program to test connectivity from our Teradata database. It is a read, using the Teradata Enterprise stage, to a dataset. I can read the table okay, but get the following warning in the log: ...
by bcarlson
Thu Feb 17, 2005 6:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data model of Universe database
Replies: 3
Views: 1957

Data model of Universe database

Is there such thing as a data model of the DataStage Universe database? I am especially interested in the tables containing job logs, but would prefer a complete model. Is there one out there? Even DDL would help.
by bcarlson
Fri Oct 01, 2004 3:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Retrieving log sum/dtl of a single invocation
Replies: 2
Views: 2180

Retrieving log sum/dtl of a single invocation

I am running up to 12 concurrent instances of a parallel job. These are kicked off from CA Autosys (scheduler) and all logs need to be written out to files. How do I get the log summary and details of 1 specific instance/invocation? When I use dsjob -logsum to get the log summary, it returns the log...