UnZipping of files using Datastage

[Kalyana Chakravarthy]

I have a requirement where in need of unzip the files using Unix/through datastage execute command.

Please let me know is this possible and give me the syntax for that and properties related to this execute command activity.

Kalyan

[keshav0307]

use execute command

read the datastage online manual , designer guide

[chulett]

Do you mean the Execute Command stage in a Sequence job? If so, you use the exact same syntax there that you would from the command line. Only wrinkle that comes in is if you need to use Job Parameters in the call, any such need to be in the Parameters prompt for them to be 'expanded' properly.

[battaliou]

If you unzip directly into a named pipe, you can read it directly as a sequential file without landing the data.

[chulett]

Let's stay on topic here. So far this is just about unzipping with no mention of a need to read anything, nor that these are sequential files that are zipped up. Let's solve one problem before we introduce any new ones, ok?

[owen3]

Exec_Command_Stage-------------->Job_Activity

At ExecCommand\Command pass following unix command:

gzip -d /path_of_zipped_file/zipped_file_name

[nash]

we need to parse and transform a .tar.gz file in memory. So I used a external source stage and tried to use the following command to tar, gzip and read a specific file inside the tar file.
tar -xzf xyz.tar.gz xx.tsv

Its not importing any records form it. The format is fine as I unzipped manually and then tried to import it. It works. So i used the same format with this command and it should wokr. But it isnt. Am I missing something??? Any suggestions please???? I need a solution asap. Thanks in advance.

More detail:

Need to untar (tar -xzf <tar_file> <specific file in tar>) only a specific file and then read & transform on the fly .

1: Using seq file to read.
2 : Using filter option in seq file stge and using the cmd (tar -xzf xyz.tar.gz xx.tsv)
3: not sure what to give in actual filename property

When i execute the job its not aborting but saying 0 rows imported/rejected.

If you unzip directly into a named pipe, you can read it directly as a sequential file without landing the data.

[battaliou]

Ok, you need to direct the output of you tar to a named pipe. So create a named pipe called "np" by doing the following:

mkfifo np

When you're ready to run the job, simply go:
tar -xzf xyz.tar.gz xx.tsv > np

In datastage, your sequential file is called np and the data should stream through. You will need to run your job shortly after issuing the tar command, else the named pipe will time out.

[miwinter]

Couldn't you just use the Expand stage?

[chulett]

If it was just gzipped, I would think so. The need to then extract a single file from the uncompressed tar archive is the extra wrinkle here.