Search found 9 matches

by holygrail
Thu Apr 14, 2005 11:49 pm
Forum: IBM QualityStage
Topic: Which stages to use?
Replies: 4
Views: 4234

Better still create a routine that goes like Transform1 = Change(A_RawData,"'","&apos;") Transform2 = Change(Transform1,"&","&") Transform3 = Change(Transform2,"<","<") Transform4 = Change(Transform3,">",">")...
by holygrail
Tue Apr 05, 2005 10:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling ML data.... contd
Replies: 0
Views: 916

Handling ML data.... contd

I used a UTF-8 encoded file (with Jap and Eng chars) for processing. Direct Mapping using a transformer works fine. But in sort, join or other collating activities the encoding gets lost and the output shows junk chars. I used a JP NLS locale but the director showed the following warning: main_progr...
by holygrail
Tue Apr 05, 2005 4:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling Multi-lingual data
Replies: 10
Views: 5903

I used a UTF-8 encoded file (with Jap and Eng chars) for processing. Direct Mapping using a transformer works fine. But in sort, join or other collating activities the encoding gets lost and the output shows junk chars. I used a JP NLS locale but the director showed the following warning: main_progr...
by holygrail
Tue Apr 05, 2005 3:56 am
Forum: IBM QualityStage
Topic: Multilingual files processing
Replies: 2
Views: 3064

Hi

From what I've gathered, there is a separate server installation for a ML-supporting QS instance. Is that true? Are there any settings required during such installation?

Also the rule sets you talk about - where are these available and how can they be applied?

Thnx
by holygrail
Mon Apr 04, 2005 2:28 am
Forum: IBM QualityStage
Topic: Multilingual files processing
Replies: 2
Views: 3064

Multilingual files processing

Hi All,

Need some info regarding settings required for QS if I need to process mutli-lingual files. e.g. if I need standardisation and matching of fields in some Asian Language e.g.Chinese what special settings/control tables might be required?

TIA
by holygrail
Fri Apr 01, 2005 3:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling Multi-lingual data
Replies: 10
Views: 5903

No Goma, I have to do more than just direct mappings. the Transformations might cover all sorts - substring, concatenate et al. If the input data is UTF-8 encoded, the final DB also UTF-8 enabled and all necessary columns (if not all) have UTF-8 as their extended char set, then how will it matter wh...
by holygrail
Fri Apr 01, 2005 2:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling Multi-lingual data
Replies: 10
Views: 5903

Goma,

The source data will be UTF-8. So I think that is cleared up.
by holygrail
Fri Apr 01, 2005 2:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling Multi-lingual data
Replies: 10
Views: 5903

Thanks again, Roy and Arnd. Arnd, I do not think it will be necessary to go back to non-NLS from an NLS setup. However I would like some details regarding what are the reasons due to which going back can be tough. Roy, I have already researched and worked using NLS settings per column as well as oth...
by holygrail
Fri Apr 01, 2005 12:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling Multi-lingual data
Replies: 10
Views: 5903

Handling Multi-lingual data

I do ETL type transformations on data from legacy systems of different countries and feed it to a central database. Now with Western European and Asian countries data, I might need to enable multi-lingual handling capabilities. How can this be done? What do I have to do at the level of reading multi...