Sequential file: spaces between two characters in all fields

adityavarma · Post by **adityavarma** » Fri Feb 05, 2016 4:36 pm

Hi DS Gurus,

I am reading a tab delimited file using a sequential file stage. When I view the file every character has a space between them.
When I view the file in Excel, Textpad or UNIX the file looks good.

For example:
Sample source file looks like below
OrderReadyForPickup_EN_QA Bounced

But when I read in sequential file stage it is showing as below. I also loaded the file into a DataStage Dataset and even in the Dataset it is showing as below:

O r d e r R e a d y F o r P i c k u p _ E N _ Q A B o u n c e d

The below are the settings I used in sequential file stage:
Final Delimiter = End
Delimiter = tab
Quote= none

I tried with all type of delimiters and null field value but could not read correctly. I even tried with DOS format but still no luck

Can you please provide your guidance on this issue ?

Thanks,
Aditya K

chulett · Post by **chulett** » Fri Feb 05, 2016 4:44 pm

You see them that way where exactly? If it is having an issue reading / parsing the file it can show you the 'raw' data and it does that with spaces between everything inside curly braces like so:

{O r d e r R e a d y F o r P i c k u p _ E N _ Q A B o u n c e d}

Is that what you are seeing?

adityavarma · Post by **adityavarma** » Fri Feb 05, 2016 4:47 pm

Hi Craig,

It is showing as below without braces
O r d e r R e a d y F o r P i c k u p _ E N _ Q A B o u n c e d

it is same for all the 15 columns

chulett · Post by **chulett** » Fri Feb 05, 2016 4:51 pm

Again, showing where exactly?

adityavarma · Post by **adityavarma** » Fri Feb 05, 2016 5:11 pm

Hi Craig,

It is showing when i read the data in sequential file and Dataset view data.

Now I have loaded the file into another sequential file, when i view the file in UNIX it is showing correctly which is good.

but my other issue is with the transformation, when i do substring to 10 characters
it is loading as below and remaining characters are been stripped off
O r d e r

Original: OrderReadyForPickup
Expected: OrderReady

adityavarma · Post by **adityavarma** » Mon Feb 08, 2016 8:48 am

The issue is with the source file. it is having hex 00 (UTF-16)
I have changed it to UTF-8 and it is loaded sucessfully

iconv -f UTF-16le -t UTF-8 testsample.txt > sampletest.txt

chulett · Post by **chulett** » Mon Feb 08, 2016 9:18 am

This hex 00, is that what was between all of the characters? If so, you need to thank whomever sent that to you for the wonderful puzzle.