Amazon S3 output

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sjfearnside
Premium Member
Premium Member
Posts: 278
Joined: Wed Oct 03, 2007 8:45 am

Amazon S3 output

Post by sjfearnside »

When writing to Amazon S3 we have the fields delimited by a comma (,). The rows are enclosed in double quotes. The Quotation Mark property in the S3 stage controls the column quotations. is there a property or setting that will turn off the double quotes for the rows?

Ex: this is what Amazon S3 admin is seeing in the S3 files
"LCLS,306048214593355542501394290,20-JAN-20 02.39.14.565007 PM"
"LCLS,994570338530973782655923294,20-JAN-20 02.43.28.350008 PM"
"LCLS,234645550397601429848923658,20-JAN-20 03.24.18.888892 PM"

Thanks
jhmckeever
Premium Member
Premium Member
Posts: 301
Joined: Thu Jul 14, 2005 10:27 am
Location: Melbourne, Australia
Contact:

Post by jhmckeever »

You need to specify the 'Row delimiter' under the 'File format' section on the Stage - Properties tab.

Options are:
  • Carriage return <CR>
    Line feed <LF>
    New line <NL>
    Tab <TAB>
    Unicode escape string
For double quotation mark I believe you need to use the \u0022
<b>John McKeever</b>
Data Migrators
<b><a href="https://www.mettleci.com">MettleCI</a> - DevOps for DataStage</b>
<a href="http://www.datamigrators.com/"><img src="https://www.datamigrators.com/assets/im ... l.png"></a>
sjfearnside
Premium Member
Premium Member
Posts: 278
Joined: Wed Oct 03, 2007 8:45 am

Post by sjfearnside »

Thanks
Post Reply