Search found 524 matches

by stuartjvnorton
Mon Nov 27, 2017 5:12 pm
Forum: Information Analyzer (formerly ProfileStage)
Topic: IA Custom DataClass not returning example data
Replies: 5
Views: 14563

Hi Ray, thanks for the reply. This is just in column analysis. I have the DataClass defined and enabled in IGC, and it's listed in the IA analysis settings and selected. It's also a regex-based DataClass. I have a few thousand records in the table, and about 500 are identified as my DataClass, along...
by stuartjvnorton
Thu Nov 23, 2017 11:01 pm
Forum: Information Analyzer (formerly ProfileStage)
Topic: IA Custom DataClass not returning example data
Replies: 5
Views: 14563

IA Custom DataClass not returning example data

Hi all, Hopefully this is just me missing a step in the process somewhere, but here goes... I have created a custom DataClass in IGC. It's a regex and has been tested externally to work just fine. It has been enabled. It appears and is enabled in IA under the analysis settings I run CA over a column...
by stuartjvnorton
Tue Jul 26, 2016 6:34 pm
Forum: IBM QualityStage
Topic: Matching Frequencies/cutoff value
Replies: 6
Views: 17876

Ok, it's been a little while, but I'll have a crack: 1 - param1 is a parameter for the type of comparison you are using, and different comparisons obviously require different parameters (either 0, 1 or 2). In the case of the 850 and 800, they would be for one of the uncert functions, and tells the f...
by stuartjvnorton
Thu Jun 30, 2016 6:29 pm
Forum: General
Topic: DataStage Certifications
Replies: 9
Views: 6564

WoW?
Isn't that taken already? ;-)
by stuartjvnorton
Thu May 12, 2016 9:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Metadata Driven ETL
Replies: 7
Views: 7529

You might be able to create a tool that generates OSH based on your information and then run that through the command line, but how to do that is way beyond my level of knowledge in that area.
by stuartjvnorton
Tue Mar 15, 2016 10:49 pm
Forum: General
Topic: suite usage - who is using what and when?
Replies: 6
Views: 3239

The thing about the ISAuditLog..N.log files is that they don't get down to project level, only the client app.
by stuartjvnorton
Thu Feb 04, 2016 6:16 pm
Forum: IBM QualityStage
Topic: USNAME clarification
Replies: 20
Views: 17967

If you have your I and O records split into 2 streams as you suggested earlier, the STAN stage the I records are sent to should probably be set to Default to Individual and the STAN for the O stream should be set to Default to Organisation. Then I records with + + would be handled by default as Firs...
by stuartjvnorton
Tue Feb 02, 2016 6:54 pm
Forum: IBM QualityStage
Topic: Data duplicate result set from 2 source matching
Replies: 3
Views: 5555

You're currently getting the Reference Duplicates.
Did you select the option to output Data Duplicates?
by stuartjvnorton
Thu Dec 17, 2015 4:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: datastage scenario
Replies: 5
Views: 4563

Thanks, OP. I needed a chuckle this morning.
by stuartjvnorton
Tue Dec 15, 2015 5:04 pm
Forum: IBM QualityStage
Topic: USNAME clarification
Replies: 20
Views: 17967

Hi, not sure if there's a Brazillian set of rulesets. You may be able to create your own. I know they're not the same but the ES rulesets might be close enough to help somewhet. You can split the names by Individual and Organisation if you already have them categorised. It would tend to be as reliab...
by stuartjvnorton
Wed Dec 09, 2015 5:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Confusion on Partitioning for Join stage
Replies: 14
Views: 8754

If it were me, I would take the 2 seconds and pick Same.
I should be telling DS what to do. That's what people pay me for.
by stuartjvnorton
Mon Dec 07, 2015 5:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Confusion on Partitioning for Join stage
Replies: 14
Views: 8754

I would think it makes you think about what you're doing. If you just take the easy way out and Auto everything, you stop taking note of what you're doing and soon you find your job is repartitioning the data numerous times (and sometimes needlessly), and performance will suffer. If you make yoursel...
by stuartjvnorton
Sun Nov 29, 2015 10:46 pm
Forum: IBM QualityStage
Topic: Match Frequency
Replies: 8
Views: 7758

Define "performance". Number of matches, "quality" of matches (lower false positives / negatives), execution time? As Ray said, the quality of score may improve a little by using accurate frequency data. As for execution time, the number of records and number of match passes woul...
by stuartjvnorton
Mon Nov 23, 2015 5:12 pm
Forum: IBM QualityStage
Topic: USNAME clarification
Replies: 20
Views: 17967

+1 for Ray and Robert's approaches. - Token analysis to understand the + and whether they would add value to classify. This can often direct a lot of records to existing patterns for very little effort. - Further character analysis to see what's up with the @ tokens. You might need to split some or ...