RTI Export for integration of MDM and IIS

Dedicated to DataStage and DataStage TX editions featuring IBM<sup>®</sup> Service-Oriented Architectures.

Moderators: chulett, rschirm

Post Reply
divstands
Participant
Posts: 128
Joined: Wed Jun 03, 2009 9:48 am

RTI Export for integration of MDM and IIS

Post by divstands »

I am integrating IIS with MDM where i have build few ISD jobs for Mexican Data standardization. How can i get the RTI export for the integration
Divya
Top
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

ISD has a project level export....
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
Top
divstands
Participant
Posts: 128
Joined: Wed Jun 03, 2009 9:48 am

Post by divstands »

eostic wrote:ISD has a project level export....
There was a sample project that came along with IIS enterprise addition names MDMQS. Also attached was an RTI export file which gives the output schema for all the ISD jobs in the MDMQS in QualityStage. The sample Schema was for US data.

I tested, MDMQS was working perfectly. What it was doing originally was : MDM calls the ISD job-
ISM_MDMQS_Address_Standardization ( for US addresses standardization) and send back the result through WISD input/output.

What i did was:

1. replaced the US Address Stan. Rules with Mexican Rules,
2. mapped the output schema to the Sample Schema(for US data).

However, things dont work. In the MDM log, the xml input has phone data and address data. The phone standardization works. But not address. The log indicates reaching the job ISD_MDMQS_Address_Standardization but it does not give the desired Address output in the output xml to MDM. What comes is the exact data as sent in the input xml.

What could be the miss?
Divya
Top
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Contact ray.wurlod

Post by ray.wurlod »

Is the Standardization stage still using USADDR/USAREA rule set but trying to apply to Mexican data?

Are the Mexican rule sets properly provisioned?

What, precisely, do you mean by "not working"?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Top
divstands
Participant
Posts: 128
Joined: Wed Jun 03, 2009 9:48 am

Post by divstands »

ray.wurlod wrote:Is the Standardization stage still using USADDR/USAREA rule set but trying to apply to Mexican data?

Are the Mexican rule sets properly provisioned?

What, precisely, do you mean by "not working" ...
I am using MXADDR and MXAREA.

Not working = MDM sends the input, but in the output no change is happening. Output at MDM= Input provided by MDM.

Same job
tested as standalone
with same input data as sent by MDM
is producing a desired standardized result.
Divya
Top
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

If I remember correctly, MDM server uses the EJB binding. Deploy also with SOAP over HTTP and test with a tool like SOAPscope. See if it fails in that unit test.

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
Top
divstands
Participant
Posts: 128
Joined: Wed Jun 03, 2009 9:48 am

Integration of MDM and IIS in real time

Post by divstands »

The input xml we tested contains data for two components: Address and Phone.
From the generated MDM log, i have extracted few lines separately for Address and Phone:

Address:

[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/Party/Standardizer/Address/className , Item Value is com.ibm.mdm.thirdparty.integration.iis8.adapter.InfoServerStandardizerAdapter
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration




Phone:

[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Converter/className , Item Value is com.ibm.mdm.thirdparty.integration.iis8.converter.PhoneNumberInfoServerConverter
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Service/basicPackageName , Item Value is com.ibm.isd.MDMQS.MDMQSService
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/AttributesMap/Input/dataType , Item Value is PhoneNumberInput
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/operationName , Item Value is standardizePhoneNumber
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - Constructing input object for datatype:com.ibm.isd.MDMQS.MDMQSService.PhoneNumberInput
[7/27/09 16:34:30:645 GMT] 00000015 SystemOut O DEBUG - Constructed input object for datatype:com.ibm.isd.MDMQS.MDMQSService.PhoneNumberInput
[7/27/09 16:34:30:645 GMT] 00000015 SystemOut O DEBUG - Converting business object to ISD input object.
[7/27/09 16:34:30:645 GMT] 00000015 SystemOut O DEBUG - setting object: fieldName:referencenumber value:4165551215 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberInput
[7/27/09 16:34:30:645 GMT] 00000015 SystemOut O DEBUG - Converted business object to ISD input object.
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/initialContextFactory , Item Value is com.ibm.websphere.naming.WsnInitialContextFactory
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/providerURL , Item Value is iiop://Servername052:2809
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - Getting service EJB, PROVIDER_URL:iiop://Servername052:2809
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Service/name , Item Value is MDMQSService
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Service/jndi , Item Value is ejb/MDMQS/MDMQSService
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Service/basicPackageName , Item Value is com.ibm.isd.MDMQS.MDMQSService
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - Looking up service EJB, PROVIDER_URL:iiop://Servername052:2809,serviceJNDI:ejb/MDMQS/MDMQSService
[7/27/09 16:34:30:941 GMT] 00000015 SystemOut O DEBUG - Done looking up service.
[7/27/09 16:34:31:050 GMT] 00000015 SystemOut O DEBUG - Time before run: 2009-07-27 16:34:31.05 functionKeyName:/IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - Time after run: 2009-07-27 16:34:32.112
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - Converting ISD output object to business object.
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:unhandleddata_mnphone value:null className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:exceptiondata_mnphone value:null className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:invaliddata_mnphone value:null className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/Party/LocationNormalization/enabled , Item Value is TRUE
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:countrycode_mnphone value:1 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:areacode_mnphone value:416 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:exchange_mnphone value:555 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:number_mnphone value:1215 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:extension_mnphone value:null className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - Convertted ISD output object to business object.
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/Party/LocationNormalization/enabled , Item Value is TRUE
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/KeyGeneration/instancePKIdentifier , Item Value is
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/SynchronizeTransactionTime/enabled , Item Value is false
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/DataBase/TimeStampPrecisionIndicator/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/Party/LocationNormalization/enabled , Item Value is TRUE
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - addPhoneNumber_COMPONENT level preExecute is started.
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/InternalValidation/enabled , Item Value is true
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getPhoneNumber_COMPONENT level preExecute is started.
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/ExtensionFramework/enabled , Item Value is true
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/RedundantUpdate/enabled , Item Value is false
[7/27/09 16:34:33:110 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:33:110 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:33:110 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:33:157 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration


So, clearly for Address, the package of the ISD job is not at all visible. What can be the issue?

Additional Information:-
in the RTI export of the project(where input and output definitions for all Address, Phone, Part, Person, etx are given, we have provided the following information:

<rtiProject description="MDMQS" name="MDMQS">
<rtiService basePackage="com.ibm.isd.#app#.#svc#" contactEmail="" contactName="dsadmin" excluded="false" name="MDMQSService">

rtiProject description="MDMQS" name="MDMQS">
<rtiApplication contactEmail="" contactName="dsadmin" deployDate="Mon Oct 15 16:03:44 EDT 2007" deployId="1ba67.8dbe8c89.70eda95.1146a328e85.521f9a89.118d0" name="MDMQS">
<rtiService basePackage="com.ibm.isd.#app#.#svc#" contactEmail="" contactName="dsadmin" excluded="false" name="MDMQSService">



<referenceProvider activationDelay="1000" activationThreshold="3" agent="Servername:31531" alwaysRunning="true" description="MDMQS - Address Standardization (ISD)" excluded="false" maxActive="5" maxIdle="0" maxRuntime="0" minActive="1" minIdle="60" name="ISD_MDMQS_Address_Standardization" path="MDMQS\MDMQS\Jobs\ISD\ISD_MDMQS_Address_Standardization" requestLimit="5" stuckTimeout="0" usedAsDefault="false">
<property name="DS_DESCRIPTION" value="MDMQS - Address Standardization (ISD)"/>
<property name="DS_PASSWORD" value="QbUrRmabmA7RQlsgdJNdUzsfAartnbXBJZCfT00pqcBrSG09x+7BqLhgXMm4WRwChWFM1P9t9S/K&#xa;vqJmnLnIoYQrZeMzXtywv8Kgt07QwbSmyrin9tYS8z1YA4YICkyMnhc20qwGmKiwJpoDz9iF7aoK&#xa;/HOGEMDSzCxwE4W2OVU=&#xa;"/>
<property name="DS_JOBNAME" value="ISD_MDMQS_Address_Standardization"/>
<property name="DS_HOST" value="Servername"/>
<property name="DS_PORT" value="31538"/>
<property name="DS_PROJECT_NAME" value="MDMQS"/>
<property name="CONNECTION_NAME" value="DSServer at Servername052:31538"/>
<property name="DS_USERID" value="dsadmin"/>
</referenceProvider>
Divya
Top
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

It's not clear at this point what the issue is. I'd first figure out why this service isn't working, fix it and then determine why perhaps the export/import has a problem.

Re-deploy it (the QS job) from scratch...do you still have the problem? Deploy it instead with the SOAP binding....debugging it from MDM is way too difficult.

Is this a config issue or a migration issue?

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
Top
Post Reply

Return to “IBM<sup>®</sup> SOA Editions (Formerly RTI Services)”