Search found 3045 matches

by vmcburney
Sun Sep 06, 2020 3:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic job to convert ebcdic files to ascii.
Replies: 3
Views: 13277

I don't think this is possible because there are usually several manual design steps required to convert an EBCDIC file into a delimited data file. There can be multiple outputs for different record types. I think it is possible to convert a file format an hour manually with someone who has access t...
by vmcburney
Wed Oct 31, 2018 7:31 pm
Forum: General
Topic: IBM Products nice to have
Replies: 1
Views: 3056

If you are using DataStage 11.5 already then I would look at adding IGC for an Enterprise Glossary with Business Terms and a Data Policy and Rules tree. This would let you define the rules and business terms for a data management standard. It will help if you need to roll out additional information ...
by vmcburney
Wed Oct 31, 2018 7:22 pm
Forum: General
Topic: What's new in 11.7 Fix Pack 2
Replies: 3
Views: 4030

Interesting to note that there are no enhancements to old IGC and lots of enhancements to new IGC including workflow. IBM are slowly weaning off old IGC to the new one. I am not sure where the Business Glossary sits in these plans. Is the Glossary going to be added at some point to new IGC? A few ne...
by vmcburney
Mon Oct 01, 2018 5:02 pm
Forum: IBM QualityStage
Topic: Quality Stage on GRID - License
Replies: 5
Views: 15118

I am pretty sure that if you got audited by IBM you would be found to be in breach of your license and they would stick you with a sizable bill for back payment of QualityStage licenses at list cost price for every year you had it installed. This could be tens of millions of dollars. You have VMs wh...
by vmcburney
Tue Aug 14, 2018 5:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataStage MD5 Implementation
Replies: 12
Views: 10521

You do have to add the pipes to do a proper checksum. Without a separator between fields your checksum could get false positive matches. The main issue is that it adds the pipe onto the end of the string you are performing the checksum on. Most manually coded MD5 functions will only add separators b...
by vmcburney
Tue Jul 31, 2018 5:28 pm
Forum: General
Topic: Can you interface Information Analyzer with Informatica?
Replies: 3
Views: 3593

This should be okay. You can just remove all your DataStage projects other than the InformationAnalyzer one so you are not in breach of license and keep using IA. You can use IA thin client to let Informatica developers browse the results. You don't lose anything from the data analysis capabilities....
by vmcburney
Sun Jul 22, 2018 10:52 pm
Forum: Information Analyzer (formerly ProfileStage)
Topic: Can you run data quality rules against Microsoft SQL DW?
Replies: 0
Views: 11242

Can you run data quality rules against Microsoft SQL DW?

Does anyone know if Information Analyzer is supported for use against Microsoft Azure SQL Data Warehouse? I am getting an error when I try to run a simple DQ rule and its looks like IA is trying to use query cursors via the ODBC or JDBC connector which is not supported by the database: pxbridge(0),0...
by vmcburney
Tue Jul 17, 2018 8:24 pm
Forum:
Topic: Test driving new Custom Attribute Filter option in IGC 11.7
Replies: 1
Views: 3590

Test driving new Custom Attribute Filter option in IGC 11.7

There was a new feature added in IGC 11.7.0.1 Fix Pack 1: While creating custom attributes, you can add restrictions when you do not want a custom attribute to be available for all assets of the selected type. This is functionality I have been waiting for a long time because when you add a lot of cu...
by vmcburney
Thu Jun 14, 2018 6:28 pm
Forum:
Topic: Anyone know why you cannot assign external assets in 11.7?
Replies: 2
Views: 3816

Thanks Ernie. I got a similar response from IBM support - the feature is deprecated and customers should use open IGC instead. I am going to create some Documentation metadata objects to hold URL and descriptions.
by vmcburney
Thu Jun 14, 2018 5:08 pm
Forum: General
Topic: What's new in 11.7 Fix Pack 1
Replies: 6
Views: 6348

You may be unfamiliar with some of the products listed if you are migrating from an earlier version of Information Server. * Information Governance Catalog New: is a new web application introduced in 11.7 that is a new take on IGC - it is less focused on the Glossary (no Category Hierarchy or Policy...
by vmcburney
Mon Jun 11, 2018 7:25 pm
Forum:
Topic: Anyone know why you cannot assign external assets in 11.7?
Replies: 2
Views: 3816

Anyone know why you cannot assign external assets in 11.7?

Just noticed that the "Assign External Assets" no longer shows up in 11.7 - the part of an IGC Business Term where you could add URL links. This isn't listed as a deprecated function in the 11.7 release notes and it may wipe out some important links during IGC upgrades. The Administration ...
by vmcburney
Mon May 14, 2018 11:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle connector stage not rejecting data truncations errors
Replies: 6
Views: 5491

I assume DataStage is truncating the data before it sends it to Oracle and thus avoiding the error. Do you see any truncate warning messages in the DataStage job log?
by vmcburney
Tue May 01, 2018 11:32 pm
Forum:
Topic: Data Lineage v Business Lineage v Blueprints
Replies: 6
Views: 8108

I loved Blueprint Director as an easy architecture diagram tool however it was in an Eclipse user interface and Information Server is moving everything to web based interface - as shown by the new web interfaces for Information Analyzer and DataStage. So Blueprint Director was quietly dropped and ha...
by vmcburney
Tue May 01, 2018 10:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CDC stage in Datastage 11.7
Replies: 10
Views: 12157

The DataStage CDC stage has been discontinued and while it is in the DataStage 11.7 release it will be removed from future DataStage releases. I believe this is due to problems they had with performance and data consistency. The recommendation is that you land the data to file or database first and ...
by vmcburney
Mon Feb 26, 2018 9:52 pm
Forum:
Topic: metadata workbench User base
Replies: 2
Views: 4168

I don't see much Metadata Workbench any more and to be honest it was a difficult product to get to know with lots of configuration steps to get lineage working. The Information Governance Catalog that replaced it got lineage right in release 11.3 onwards - it shows data lineage across DataStage jobs...