Search found 53125 matches

by ray.wurlod
Tue Jul 25, 2006 6:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Need help How to Concatenate Data from two flat files .
Replies: 8
Views: 3185

But, presumably, combine the contents of row N from file 1 with row N from file 2 to form row N in the output file.

Otherwise your answer is simply cat file2 >> file1
by ray.wurlod
Tue Jul 25, 2006 6:43 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Variable-length record
Replies: 15
Views: 11546

COBOL is not "smart enough" to do that automatically. You have to define your column definitions as fixed width (and accurately!) in the file definition. DataStage BASIC (we're comparing programming languages now, not ETL tools) can also quite happily deal with variable length unterminated records, ...
by ray.wurlod
Tue Jul 25, 2006 6:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Empty Date field Export to Seq File
Replies: 10
Views: 3824

"" is not a valid value for a date data type. Therefore you can not write "" into a date. What you might be able to do is to represent NULL as "" (Null Field Value property) provided you make the output field nullable, and feed it nulls where you want "".
by ray.wurlod
Tue Jul 25, 2006 6:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Set Usage
Replies: 3
Views: 881

Do you want eight columns per row in the target, or three? This is not clear from the original statement of requirement, but will certainly affect your choice of stage types in your design.
by ray.wurlod
Tue Jul 25, 2006 6:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Backup and recovery on failure
Replies: 3
Views: 1532

Job sequences have "automatically restart from point of failure" as a compilation option in the job properties dialog. Anything else, such as handling a partially-committed load, you have to design in.
by ray.wurlod
Tue Jul 25, 2006 6:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Can we achieve version control in DSPX
Replies: 11
Views: 3458

Be more precise what you mean by version control. In DataStage, Version Control has nothing whatsoever to do with job type, so your "in DSPX" is either misleading or moot.
by ray.wurlod
Tue Jul 25, 2006 6:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to get latest value in sequence generator.
Replies: 3
Views: 895

Enrol in some training; it's a fairly common requirement. Or search the forum, as suggested.

If you want one-on-one training, you need to engage someone professionally.
by ray.wurlod
Tue Jul 25, 2006 6:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Incorporating Parallelism
Replies: 19
Views: 4556

Yes you can. Give each instance of the job a unique invocation ID. Start them all from a job sequence, with no dependencies. That's as close to exactly parallel as you can get without using a scheduler of some kind. Beware that ten instances of a parallel job is quite likely to swamp your server wit...
by ray.wurlod
Tue Jul 25, 2006 1:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Incorporating Parallelism
Replies: 19
Views: 4556

OK, I needed to establish that. It is sound advice, but you didn't mention DB2/390 in your original post. You do need the API stage. Have you set it to execute in Sequential mode? Multi-instance running is enabled via a check box in the job properties dialog. But you will need to have WHERE clauses ...
by ray.wurlod
Tue Jul 25, 2006 1:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Need help How to Concatenate Data from two flat files .
Replies: 8
Views: 3185

Welcome aboard. :D

Ask yourself how you would do it if they were SQL tables. Probably the easiest way is to add an artificial key (line number) to each using something like sed, then use this as the join key.
by ray.wurlod
Tue Jul 25, 2006 1:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Concatenating Timestamp With a Sequential file
Replies: 33
Views: 9458

Either make sure there are no delimiters or spaces in that job parameter, or use a different job parameter that has the same timestamp but without delimiters in the file name.
by ray.wurlod
Tue Jul 25, 2006 1:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to get latest value in sequence generator.
Replies: 3
Views: 895

Search the forum, this has been discussed a few times already. There are at least four techniques. Easiest is to do it before you start this job, and pass the start value as a job parameter that you can use in the Column Generator (or Surrogate Key Generator) stage.
by ray.wurlod
Tue Jul 25, 2006 1:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: not able to use load method
Replies: 9
Views: 4008

Did you misspell "scratch" as "scretch" in one node definition within your configuration file?
by ray.wurlod
Tue Jul 25, 2006 1:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Incorporating Parallelism
Replies: 19
Views: 4556

Is there some reason you're not using the DB2 Enterprise stage, the one with inbuilt parallelism?
by ray.wurlod
Mon Jul 24, 2006 9:56 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error during lookup
Replies: 17
Views: 5419

Metadata management

#SchemaName#.TableName

Never make the table name a job parameter. Following this advice means that things like lineage analysis and usage analysis will work properly.