Search found 4605 matches
- Fri May 20, 2016 4:03 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How do I add business days to a timestamp?
- Replies: 8
- Views: 8628
14 days is not the same as 10 business days. A business day depends on if the business is open. So a holiday does not count as a business day. You have the check every day where it is open. Let us say you have a date dimension with BIZ_DAY = 'Y' then the SQL is a little tricky. You need count record...
- Fri May 20, 2016 3:40 pm
- Forum: General
- Topic: How to determine if a job is hung?
- Replies: 4
- Views: 6471
If a job is hung then several things might help figure it out. If you are getting blocked at the database then the DBA can help figure that out. When a UNIX process gets hung then the RAM size stays the same sometimes. If you have a memory leak then it grows until it fails or job runs out of rows. I...
- Fri May 20, 2016 3:25 pm
- Forum: General
- Topic: How to pass parameters to a generic job script?
- Replies: 12
- Views: 10390
dsjob -lparams $DSProject $JobName Will give you a list of parameters. If you send in a parameter to a job that does not exist in the job then it will fail. We put the parameter values in files. We would look for a parameter in jobname.prm. If it existed in this then we would run the job. If not th...
- Thu May 05, 2016 6:46 pm
- Forum: General
- Topic: Why ETL is hard
- Replies: 13
- Views: 9969
Awesome answer Craig. I too wish Ernie would start a new topic or use this one to expand on what these new tools are trying to address and solve. What questions are coming that we had no idea were even issues. Please educate us Ernie to what is out there. If there are cool concepts or tools being di...
- Thu May 05, 2016 6:31 pm
- Forum: General
- Topic: Happy Star Wars Day !
- Replies: 3
- Views: 4088
- Tue May 03, 2016 9:56 pm
- Forum: General
- Topic: Happy Star Wars Day !
- Replies: 3
- Views: 4088
- Tue May 03, 2016 9:54 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: SQL query character limit
- Replies: 7
- Views: 6156
- Tue May 03, 2016 9:50 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Parameter Set Value File Question
- Replies: 4
- Views: 4813
- Tue May 03, 2016 9:44 pm
- Forum: General
- Topic: Why ETL is hard
- Replies: 13
- Views: 9969
Great topic to bring back. I miss Ken Bland. He always added a level of deep thought. I still see developers using DataStage poorly. Their SQL takes forever to come back which tells me they did very little testing. It also means they are probably doing too much in SQL. Doing too many joins in their ...
- Fri Apr 08, 2016 8:25 am
- Forum: General
- Topic: How to generate custom status report for job
- Replies: 2
- Views: 3311
- Sun Apr 03, 2016 8:56 pm
- Forum: General
- Topic: Way to generate automated Excel templates?
- Replies: 8
- Views: 7407
- Thu Mar 31, 2016 2:56 pm
- Forum: General
- Topic: Way to generate automated Excel templates?
- Replies: 8
- Views: 7407
It can be done. You need to build your header or read it in from sequential file. Then build table tag. Then row tag. Field tag. Field value. Close field tag. Close row tag. Next row. Loop. Close table tag and all header tags. Each row needs a value to sort by. Start header rows with 10,000. Start r...
- Wed Mar 30, 2016 2:41 pm
- Forum: General
- Topic: Sanity Check Poll
- Replies: 12
- Views: 10270
- Tue Mar 29, 2016 1:33 pm
- Forum: General
- Topic: Sanity Check Poll
- Replies: 12
- Views: 10270
- Tue Mar 29, 2016 1:25 pm
- Forum: General
- Topic: Sanity Check Poll
- Replies: 12
- Views: 10270
Thanks. Someone said why would I pay for that. It is just a few SQL statements. If your data warehouse has 200 tables and 5 sources then you need to 400 simple SQL statements to do a simple sanity check. You can't really do any trending based on those numbers because you do not store results. Is you...