DSXchange

When you use NullToValue function you have to give some default value. Usually NullToValue(Column,'') if you want to default it to empty string. As far as your original error message, are you doing any transformation on the field HENCL like using a Trim function etc without null handling. APT_Combin...

Write a simple Sleep routine and include it in your loop. That should do it.

What function are you using to set the NULL value?

first field is like as I sent in the example..next are fields with tabs Again, if you can provide an example for people to you help you correctly, you will get an answer fast. As Craig had asked, provide a sample record for all the 20 fields that are coming in so that we can chip in with our sugges...

Not sure how you will end up with 5 fields if you read it as a fixed width file :? If you know the layout of the file, it should work just fine. Are you expecting blanks within your data where you intend to just add commas? You can read it as a single column and split them in a transformer stage as ...

You need to only partition on the key field but sort on the Timestamp field within the Remove Duplicates stage to achieve the required results. Based on what data you want to retain, you can sort ascending/descending on the TimeStamp field.

Hope that helps.

You would need to use StageVariables to do what Andy suggested. Another way to do is to use a Sort stage and set Create Key Change Column Property to True and Allow duplicates property to True. Then after the Sort stage, put a filter stage and filter on the key change column to grab the duplicates a...

Yes. you need to use UNIX commands. But you don't have to create a header file separately. You can create the header and write it to the output file. In the parallel job, set your Update to Append rather overwrite within the sequential file and in the after job, create your trailer record and append...

Couple of ways: 1. Create your header as part of before job subroutine, append the data to the flat file in your job and create the trailer in the after job subroutine. 2. Have a Transformer with three output links going into a Funnel Stage. Select sequential operation within your funnel stage. Crea...

That should do it.

Try to capture all the distinct values from the source by using a Remove Duplicates stage and try scanning them through to see if there are any data quality issues. We had a similar issue where business users started manually entering dates into the field and used their own formats such as 2010/03/1...

It is telling you to handle NULL values that might come from the source. Because you are mapping a nullable field from the source table to a not nullable field on target there is every possibility that you might get NULL values from source. You need to define a default value for NULL's that are comi...

Are you doing any transformation on the field Ref_Mainframe_Time_Stamp. If so, are you handling NULL's explicitly? If not, you need to do so to avoid dropping records.

Usually, within the transformer stage, Null handling should be done for all nullable fields.

Yes. You can do that within the LookUp Stage Condition.

mhester wrote: Seriously?

I have done it in the past successfully with low volume of the data.