Help files seem to indicate that this should work, however....
to test things a bit further I added some input to my test base and it seems that the cut command works fine on all but the first and last files produced. Those files are still left empty and the job never ends on its own.
Search found 195 matches
- Wed Oct 19, 2016 10:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Filter option of Sequential Files stage hanging
- Replies: 2
- Views: 2984
- Wed Oct 19, 2016 7:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Filter option of Sequential Files stage hanging
- Replies: 2
- Views: 2984
Filter option of Sequential Files stage hanging
Having searched for a solution to a problem I was facing, fortunately I found someone else had the same problem. JeroenDmt described the situation identical to the situation I was facing. So I was excited to find a solution as well. See: http://www.dsxchange.com/viewtopic.php?t=151550 However, upon ...
- Wed Jul 08, 2015 1:13 pm
- Forum: General
- Topic: Environment Variable Import
- Replies: 11
- Views: 7468
- Tue Jul 07, 2015 3:17 pm
- Forum: General
- Topic: Environment Variable Import
- Replies: 11
- Views: 7468
Environment Variable Import
I'm working on developing a routine (script) for setting environment variables. I know there are the dsadmin commands of envadd, envset and envdelete. I also find now that export and import are available via the DS Administrator GUI. Has anyone found a way to initiate the import from a command line?...
- Thu May 21, 2015 12:30 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: load Leveler Error: There is no active resource manager job.
- Replies: 1
- Views: 3321
load Leveler Error: There is no active resource manager job.
Recently we have been having jobs fail very intermittently with the following messages: <Dynamic_grid.sh>Error: There is no active resource manager job with name pj_crt_fact_pr_invstmnt_pr_intrm_stg_files_4186, or this job has been already terminated. Exiting... <Dynamic_grid.sh>Error: Job error, su...
- Thu May 01, 2014 11:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Physical Vs. Virtual Head nodes on a grid
- Replies: 3
- Views: 4096
Paul, Thanks for your comments. It's obvious you have been around this block a time or two. You are correct about the IO on the head node. We have experienced problems in the past due to excessive IO on the head node and when the head node gets bogged down so goes the entire grid. We are currently d...
- Fri Apr 25, 2014 12:53 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Physical Vs. Virtual Head nodes on a grid
- Replies: 3
- Views: 4096
Physical Vs. Virtual Head nodes on a grid
We are in the process of desigining our architecture for a new 9.1.2 install on a grid. What major considerations are there, other than cost, when deciding between virtual and physical head nodes? All of the compute nodes will be physical servers, but there is some debate here over whether performan...
- Mon Feb 24, 2014 12:51 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Exadata and Balanced Optimization
- Replies: 7
- Views: 4687
- Fri Feb 21, 2014 2:21 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Exadata and Balanced Optimization
- Replies: 7
- Views: 4687
- Fri Feb 21, 2014 1:50 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Exadata and Balanced Optimization
- Replies: 7
- Views: 4687
Exadata and Balanced Optimization
Is it possible to use Balanced Optimization with Databases on Exadata?
- Thu Jan 16, 2014 3:49 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataDirect OEM
- Replies: 2
- Views: 3129
DataDirect OEM
I've searched but didnt see this error discussed in other posts which surprises me but... Any idea why this message would suddenly show up between one run of a job and the next? The job ran at 4 am without this warning being displayed then at 10am it spewed these warnings; it appears the warning was...
- Thu Dec 12, 2013 4:11 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC Connector w/ SQL Server Stored Proc in Before SQL hangs
- Replies: 5
- Views: 7261
The reason I am asking is because I was just asked to research why several of our jobs have LONG startup time. 10-20 minutes startup time. All of them have before SQL in the Oracle connector stage. And, from what I can see in the Dir log, it appears that SQL is what is taking the so much time. I jus...
- Thu Dec 12, 2013 3:47 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC Connector w/ SQL Server Stored Proc in Before SQL hangs
- Replies: 5
- Views: 7261
- Thu Nov 14, 2013 9:46 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Anyway to force job to run on all compute nodes on a grid?
- Replies: 11
- Views: 7169
Well, 2 reasons basically: 1 - If you are referring to a Unix Admin, because they have no way to see what the vaule of ulimit is as seen from a DataStage job. It is often different from what is seen by just issuing commands on the unix command line. and 2 - If you are referring to a DataStage Admin,...
- Wed Nov 13, 2013 11:56 am
- Forum: General
- Topic: On a Grid, where can ulimit be changed?
- Replies: 2
- Views: 2476
I've just learned from a rep at IBM Support that on a grid ulimit values on the head node come from root user and on the compute nodes come from the user that submitted the job. I don't understand yet why that is, but that does seem to be what we are experiencing. The solution seems to be to always ...