Can't read column from compressed dataset using orachadmin

[karteek]

Hi Everyone,


I am unable to read compressed data using orachadmin command.

orchadmin dump -feild ABC TGT_FILE.ds |sort|uniq

error: ##E IIS-DSEE-TOPK-00007 06:33:07(004) <APT_PeekOperator> Error when checking operator: Input dataset does not have field: "ABC"

i am able to see describe the file, file has column ABC.

how to read compress dataset using orchadmin command.

Thanks,
Karteek

[karteek]

HI all,

any suggestion on below thread.

[ray.wurlod]

Yes. Learn patience.

[asorrell]

orchadmin dump -feild ABC TGT_FILE.ds |sort|uniq

If that's a cut and paste you have a typo in the command (it is spelled field)

I don't understand what you mean by "compressed". Compressed how?

Can you use the describe option to check the schema? The command works for me (if everything is spelled correctly).

/dev/transfer/DataSets $ orchadmin describe -s Test.ds
##I IIS-DSEE-TFCN-00001 12:20:52(000) <main_program>
IBM InfoSphere DataStage Enterprise Edition 11.3.0.7457
Copyright (c) 2001, 2005-2014 IBM Corporation. All rights reserved

##I IIS-DSEE-TFCN-00006 12:20:52(001) <main_program> conductor uname: -s=AIX; -r=1; -v=7; -n=dev01; -m=00CF5FD64C00
##I IIS-DSEE-TFSC-00001 12:20:52(002) <main_program> APT configuration file: /tmp/aptoa50724998246ab1e1
Name: Test.ds
Version: ORCHESTRATE V11.3.0 DM Block Format 6.
Time of Creation: 2016-11-17 04:04:24
Number of Partitions: 2
Number of Segments: 1
Valid Segments: 1
Preserve Partitioning: false

Schema:
record
( COMPANY_KEY: string;
COMPANY_ID: string;
COMPANY_DESC: string;
)
##I IIS-DSEE-TOIX-00059 12:20:53(000) <APT_RealFileExportOperator in APT_FileExportOperator,0> Export complete; 3 records exported successfully, 0 rejected.
##I IIS-DSEE-TFSC-00010 12:20:53(000) <main_program> Step execution finished with status = OK.

/dev/transfer/DataSets $ orchadmin dump -field COMPANY_ID Test.ds > XX
##I IIS-DSEE-TFCN-00001 12:28:46(000) <main_program>
IBM InfoSphere DataStage Enterprise Edition 11.3.0.7457
Copyright (c) 2001, 2005-2014 IBM Corporation. All rights reserved

##I IIS-DSEE-TFCN-00006 12:28:46(001) <main_program> conductor uname: -s=AIX; -r=1; -v=7; -n=dev01; -m=00CF5FD64C00
##I IIS-DSEE-TFSC-00001 12:28:46(002) <main_program> APT configuration file: /tmp/aptoa3427537020f081db
##I IIS-DSEE-TOIX-00059 12:29:07(000) <APT_RealFileExportOperator in APT_FileExportOperator,0> Export complete; 1553124 records exported successfully, 0 rejected.
##I IIS-DSEE-TFSC-00010 12:29:07(000) <main_program> Step execution finished with status = OK.

/dev/transfer/DataSets $

[karteek]

Hi Andy,

Sorry, it is a typo mistake.

orchadmin dump -field ABC TGT_FILE.ds |sort|uniq

Using compress stage we compressed the dataset.

I am able to describe the schema using orchadmin describe -s TGT_FILE.ds but unable to view the data using orchadmin dump -field ABC TGT_FILE.ds


Thanks,
Karteek M

[chulett]

In other words, compressed using "the UNIX compress or GZIP utility" according to the manual. Meaning you would need to uncompress it first - to standard out and pipe it to orchadmin command. I assume.

[asorrell]

Craig is correct.

Once a dataset is compressed, it can't be read until it is uncompressed. You are able to read the schema because the descriptor file that holds the schema is separate (and uncompressed) from the compressed data files on the resource disks.