DSXchange

Search the forum for examples and explanations of the API DSExecute and usage in a custom function/routine/Batch job. You can use the existing routine ExecSH in a before/after job/transformer call or Routine stage in a Sequence job.

Yep, happens all the time. One simple job SEQ --> XFM --> HASH can hog a poor disk/controller design. Try running two jobs like that at the same time, forget about it. Put a database on top of that layout, go brew a pot of coffee and send out for donuts. We see this on linux and Windows boxes a lot,...

I'm not making fun of you, but you're using a $30/user near-shareware desktop PC scheduling program to run your $250,000 ETL tool? Your best option is to develop your own secure rsh script to handle a remotely authorized command execution on your Unix server. You'll be able to schedule that script t...

DO NOT USE DATASTAGE. A DS job using the folder stage won't rename a file. It will READ the ENTIRE CONTENTS of each file and write new files. The folder stage allows you to read the entire file as a single row. You need to fully understand that you are using the wrong tool for the job. It will garba...

Look at your DS_JOBS file using any of the methods for getting to the DS command line (dssh, uvsh, DS Admin, etc). You can execute the command "DELETE DS_JOB 'yournamejobname' ". WARNING! I take NO responsibility if you do this command. You will need to make sure you have proper backups. Once this i...

When you export a job and then import, the act of importing attempts to delete all components of the job and then recreates all new components. When it does this, it assigns a new internal number for the job. If the old copy of the job fails to properly delete because of structure integrity issues, ...

I am having a similar problem. I copied an existing RT_CONFIG file and copied it to the missing file name. I am still unable to delete the job or import the job. You need to start your own post, state your version and operating system, and post YOUR error messages. This thread and its solutions are...

Use Remote Desktop Computing or Citrix or some solution that lets you "steer" a PC from afar, where the PC is within a more stable network.

Other than that, make sure you save your job changes often.

Search the forum for discussions on SETFILE.

You might find this information helpful regarding hash files:
http://www.dsxchange.com/viewtopic.php?t=85364

There is no hope, this is an OS issue with buffered writes. Remember your C days and flushing? Your attempting to view data can have errant results, because data is writing in blocks, not "rows". Rows are a database concept, files are blocks of bytes. Odds are that the last row will be partial becau...

AFAIK, there's no switch, but Ray hasn't spoken yet. Consider using a master set of parameters for all jobs, including ones like a sysdate or processdate. Derive it once in the job control and pass it to all jobs preformatted, that way you don't have to OCONV+CHANGE everytime you access @DATE.

The link monitor shows rows/second based on rows traveled on that link divided by the time that the link connected to that transformer has been open. So, if the link opens at 1:00pm it will start with the status of WAITING as the query is being prepared by the source database. Then, when the databas...

Your issue is database related 99%. Your query is ugly, and not a DS issue. The only point DS comes into play is spooling and writing the data to the output file. I would look to load on the server, degree of parallelism requested, minimum, and actual, and other factors that will vary the performanc...

kcbland wrote:I'm looking for it, where is it? A new post means a NEW POST, not a reply on an existing message thread.

Here it is for those reading this chain:

http://www.dsxchange.com/viewtopic.php?p=125936#125936