Handling accented characters

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Handling accented characters

Post by mydsworld »

I am trying to insert accented characters into a DB2 table using ODBC Ent stage.The accented character records are getting rejected. Is there any way we can insert them (without using Datastage 'convert').

Thanks.
kandyshandy
Participant
Posts: 597
Joined: Fri Apr 29, 2005 6:19 am
Location: Singapore

Post by kandyshandy »

You mean something like this? āk'sěnt'
Kandy
_________________
Try and Try again…You will succeed atlast!!
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Post by mydsworld »

My job design is following :

Seq File -> Transformer -> ODBC Ent (with Reject link)

I have set 'UTF-8' in only ODBC Ent stage. The error due to the accented char is shown below :

Character data, right truncation occurred; for example, an update or insert value is a string that is too long for the [odbcUtils.C:1289]

Records with accented char go to Reject link due to the above.When I convert those accented char into English, data gets loaded.

Please advise what NLS option I have to use and in which stage.
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Post by mydsworld »

Has anyone encountered this problem earlier and can advise me.

Thanks.
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

Post by jdmiceli »

I have an issue where my source databases can have all kinds of high ASCII characters (general from cut and paste operations) and since I use a src --> text file --> target, I end up with all kinds of problems. I borrowed a routine from some of the great minds here and then modified it to interpret certain high ASCII chars to standard ASCII(32-127). This may not be what you want, but it is pretty efficient and stops all kinds of problems on the processing end. If you would like to see the routine, I'll be happy to post it. Just let me know.
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Post by mydsworld »

Actually I dont want to convert these accented characters into something else and load, rather would like to load them as is.
Thanks for your response.
Post Reply