DSXchange

Are the hash files containing more columns than you absolutley need? This is just wasting cpu time reading all characters in a row of data. Investigate eliminating solumns from your hash lookups. Did you look at the data and overflow files for the hash lookups? A lot of data inthe overflow portion r...

Make sure there's no runaway threads out there. Do a "ps -ef |grep LdTouchpoint" to see if any pieces and parts are interfering. If they are, do a kill on them to get rid of them.

Hi, I did one thig, While trying to load in to Oracle using OCI9 and I started copying the data in to a sequential file at the same time to see if there is an issue with data, When I do that I have no issue. Does that trigger anything??? How do I turn off row buffer? RC Ahhh. Go to Job Properties a...

Hi Bland what's this "database rollback segment issues, snapshot too old" error,one of my jobs are aborting giving this message and if i reset it and run again it just runs fine without failing.. thanks You're hijacking this thread. Start a new one so we know more information about your OS, DS rele...

rrcreddy4 wrote:I think we are using row buffering.

RC

See my previous comments about this sometimes being flaky. Turn it OFF and try your job.

Are you using any row buffering or IPC stages?

Please describe your job design and row counts. Your question is too vague. Hash files can be extremely efficient if utilized correctly. In addition, multiple cpu servers can be under utilized if you do not build a job in a fashion to support multiple cpus. Either thru IPC or job instances you can d...

How did you specify the server name in the .odbc.ini file? If you're running SQL-Server on a persons desktop and they're using DHCP, make sure you are using the workstation name in the .odbc.ini and not the IP, as it changes. Yes it worked the day you set it up, but rebooting that workstation or per...

ketfos ran out of disk space on the project filesystem, so there's a lot of bits and pieces that could be a mess. When this happens, sometimes it's easiest to export all your jobs (and verify) then delete the project and recreate it. Then import your jobs again and continue. Don't run out of disk sp...

Thanks Andrew. What I'm trying to do is read data from an Oracle database (9.2) and produce one XML file which will be measured in tens of gigabytes. I know that DataStage uses the Xalan XSLT processor for reading and transforming but I don't know anything about the way it creates XML documents. Ha...

You are going to either write every rownumber of your input stream (BAD IDEA UNLESS YOUR DATA IS EXPLICITLY ORDERED per my previous comments) to a secure location, such as a hash file, or write the last rownumber to a secure location, such as a hash file. In the event of failure this hash file can c...

The problem with your request is the concept of a COMMIT setting. If you're committing every 10K rows, blowing up on row 19876 rolls you back to row 10000. So, you are either going to take a performance penalty for commit every row, or, complicate your restart. But furthering this idea, if you have ...

A DSS is a data collection that is used by executive management to help make operational decisions about the direction the company will take with regards to sales plans, manufacturing, marketing, etc. DataStage is a tool for moving data. Thus, DSS is like a book, and DataStage is like a laser printe...

You are obviously an old customer of DataStage. The product was originally made by Ardent Software (who I used to work for). Your site setup a filesystem called ardent to be the location for the installation of probably your DS Engine and projects. A little history, Ardent DataStage came out in Spri...

I should point out that I'm not trying in any way to use DataStage as a SQL generator - This was implemented successfully in pl/sql (it's all Oracle), however we have a corporate DBA policy forbidding database links in production. Not my idea... By SQL generator, I mean that the GRAPHIC you see whe...