We have been trying to use cosort with datastage but faced the following problem:
1. The data donot get sorted.
2. If sorted data is provided the data becomes unsorted.
Four instances of run is given below :
1. An input file containing 4 3 2 1 was fed with the sort condition as x des none no no. The output file contained 4 1 2 3
2. An input file containing 1 2 3 4 was fed with the sort condition as x des none no no. The output file contained 1 4 3 2
3. An input file containing 4 3 2 1 was fed with the sort condition as x asc none no no. The output file contained 4 1 2 3
4. An input file containing 1 2 3 4 was fed with the sort condition as x asc none no no. The output file contained 1 4 3 2
The following is the datstage log warning message:
DataStage Job 139 Phantom 2400
CoSORT Version 8.2.2 D8050210-1400 Copyright 1978-2005 IRI, Inc. www.cosort.com
IST 10:54:57 AM Tuesday, April 26 2005. #05104.7683
Expires May 20, 2005 Monitor Level 1
<00:00:00.00> event (66): cosort() process begins
<00:00:00.05> event (67): cosort() process ends
DataStage Phantom Finished
Cosort Plug-In with DataStage Problem
Moderators: chulett, rschirm, roy
-
Sukanya2004
- Participant
- Posts: 3
- Joined: Mon Apr 25, 2005 6:24 am
-
ray.wurlod
- Participant
- Posts: 54595
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
Sukanya2004
- Participant
- Posts: 3
- Joined: Mon Apr 25, 2005 6:24 am
No Iam reading from a sequential file with "first line is column names property" not checked. My data stage job structure is as follows :
Sequential File1 -> Cosort -> Sequential File2
where the metadata for both the Files is one integer field.
I am not using direct mode.
Following are the few stage properties I have set...rest of the properties are blank:
Sort Specification: x asc none no no
Stage uses direct mode : no
Fixed width file: no
stable sort: no
eliminate duplicates : no
work areas : c:/
max no of threads : 1
min no of threads:1
sort block size: 320 KB
Memory per thread:25 MB
Tracing level: 0
Set Tunable parameters from cosortc file :yes
Sequential File1 -> Cosort -> Sequential File2
where the metadata for both the Files is one integer field.
I am not using direct mode.
Following are the few stage properties I have set...rest of the properties are blank:
Sort Specification: x asc none no no
Stage uses direct mode : no
Fixed width file: no
stable sort: no
eliminate duplicates : no
work areas : c:/
max no of threads : 1
min no of threads:1
sort block size: 320 KB
Memory per thread:25 MB
Tracing level: 0
Set Tunable parameters from cosortc file :yes