Page 1 of 1

Cosort Plug-In with DataStage Problem

Posted: Tue Apr 26, 2005 12:29 am
by Sukanya2004
We have been trying to use cosort with datastage but faced the following problem:

1. The data donot get sorted.
2. If sorted data is provided the data becomes unsorted.

Four instances of run is given below :
1. An input file containing 4 3 2 1 was fed with the sort condition as x des none no no. The output file contained 4 1 2 3
2. An input file containing 1 2 3 4 was fed with the sort condition as x des none no no. The output file contained 1 4 3 2
3. An input file containing 4 3 2 1 was fed with the sort condition as x asc none no no. The output file contained 4 1 2 3
4. An input file containing 1 2 3 4 was fed with the sort condition as x asc none no no. The output file contained 1 4 3 2


The following is the datstage log warning message:

DataStage Job 139 Phantom 2400
CoSORT Version 8.2.2 D8050210-1400 Copyright 1978-2005 IRI, Inc. www.cosort.com
IST 10:54:57 AM Tuesday, April 26 2005. #05104.7683
Expires May 20, 2005 Monitor Level 1
<00:00:00.00> event (66): cosort() process begins
<00:00:00.05> event (67): cosort() process ends
DataStage Phantom Finished

Posted: Tue Apr 26, 2005 12:53 am
by ray.wurlod
Are you perhaps reading from a Sequential File stage with the "first line is column names" property set? (However, that does not explain your case number 4.)

Posted: Tue Apr 26, 2005 1:12 am
by Sukanya2004
No Iam reading from a sequential file with "first line is column names property" not checked. My data stage job structure is as follows :

Sequential File1 -> Cosort -> Sequential File2

where the metadata for both the Files is one integer field.
I am not using direct mode.


Following are the few stage properties I have set...rest of the properties are blank:

Sort Specification: x asc none no no
Stage uses direct mode : no
Fixed width file: no
stable sort: no
eliminate duplicates : no
work areas : c:/
max no of threads : 1
min no of threads:1
sort block size: 320 KB
Memory per thread:25 MB
Tracing level: 0
Set Tunable parameters from cosortc file :yes