Search found 297 matches

by jhmckeever
Thu Mar 10, 2022 4:20 am
Forum: General
Topic: Server job to parallel job conversion
Replies: 9
Views: 20531

Re: Server job to parallel job conversion

It's a super-old topic, but anyone stumbling over this question many years later may be pleased to know that an automated conversion is about to be released. Read more at: http://s2px.mettleci.io/
by jhmckeever
Sun May 17, 2020 2:25 am
Forum: General
Topic: API datastage Python
Replies: 2
Views: 11840

Hi thurmy34, Can you tell us which example you're trying? What version of Python are you using? Can you show us the traceback in case that helps point the way? Your best initial resolution might come from raising an issue on the library, if you think that might be in error: https://github.com/reijnn...
by jhmckeever
Tue Apr 14, 2020 9:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Amazon S3 output
Replies: 2
Views: 7991

You need to specify the 'Row delimiter' under the 'File format' section on the Stage - Properties tab.

Options are:
  • Carriage return <CR>
    Line feed <LF>
    New line <NL>
    Tab <TAB>
    Unicode escape string
For double quotation mark I believe you need to use the \u0022
by jhmckeever
Wed Aug 21, 2019 9:49 pm
Forum: General
Topic: Thank you everyone!
Replies: 6
Views: 6795

Hey Ernie,

I'm so sorry to see you leave IBM, and hope we get a chance to work together again sometime soon. Can I assume you won't be at the NY user group meeting on September 10? I was hoping we'd get a chance to catch up then.

J.
by jhmckeever
Wed Sep 27, 2017 11:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to validate a string of code
Replies: 11
Views: 22637

You might find this post help you:
viewtopic.php?t=107882
by jhmckeever
Thu Jul 27, 2017 8:29 pm
Forum: General
Topic: AVI and other options for geocoding
Replies: 5
Views: 5723

It's an old thread, but I'll update my response for clarity: I mentioned QAS Batch because geocoding is available by licensing additional datasets (e.g. Mosaic) which can all be accessed via QAS.
by jhmckeever
Thu Jul 27, 2017 12:31 am
Forum: General
Topic: git/RTC/ISM with Datastage projects
Replies: 3
Views: 9362

Those following this thread might be interested to know that my organisation's solution for implementing DevOps approaches with DataStage development (called 'MettleCI') has now been announced on the Atlassian Marketplace: https://marketplace.atlassian.com/plugins/com.datamigrators.atlassian.bitbuck...
by jhmckeever
Thu Jul 27, 2017 12:29 am
Forum: General
Topic: Automated build with Ant/Gradle/Maven
Replies: 3
Views: 4528

DataStage Continuous Integration for Atlassian

Those following this thread might be interested to know that my organisation's solution for implementing DevOps approaches with DataStage development (called 'MettleCI') has now been announced on the Atlassian Marketplace: https://marketplace.atlassian.com/plugins/com.datamigrators.atlassian.bitbuck...
by jhmckeever
Thu Jul 27, 2017 12:25 am
Forum: General
Topic: datastage development process
Replies: 6
Views: 10521

DataStage Continuous Integration for Atlassian

Those following this thread might be interested to know that my organisation's solution for implementing DevOps approaches with DataStage development (called 'MettleCI') has now been announced on the Atlassian Marketplace: https://marketplace.atlassian.com/plugins/com.datamigrators.atlassian.bitbuck...
by jhmckeever
Thu Jan 12, 2017 6:04 pm
Forum: General
Topic: AVI and other options for geocoding
Replies: 5
Views: 5723

Re: AVI and other options for geocoding

We use Experian's 'QAS Batch' called from a custom DataStage stage. See more about it here: https://www.youtube.com/watch?v=UKihsDecQ2w It can enhance your address with a heap of additional enrichment information. See the Experian site for all the additional stuff it can provide, beyond a simple 'cl...
by jhmckeever
Thu Jan 12, 2017 6:01 pm
Forum: General
Topic: git/RTC/ISM with Datastage projects
Replies: 3
Views: 9362

It's an old post but I'll comment anyway in case the issue is relevant to anyone else with the same question: We've created a custom menu item in the DataStage Designer client which invokes a checkin-process. The process is execute by Atlassian Bamboo (a build automation tool similar to Jenkins or H...
by jhmckeever
Thu Jan 12, 2017 5:55 pm
Forum: General
Topic: Source control for datastage
Replies: 3
Views: 4279

We've created a custom menu item in the DataStage Designer client which invokes a checkin-process. The process is execute by Atlassian Bamboo (a build automation tool similar to Jenkins or Hudson) which extracts the currently open DataStage job from XMETA, invokes a set of unit tests, then checks th...
by jhmckeever
Thu Jan 12, 2017 5:55 pm
Forum: General
Topic: Automated build with Ant/Gradle/Maven
Replies: 3
Views: 4528

We've automated the build process using Atlassian Bamboo (a build automation tool similar to Jenkins or Hudson) which extracts the currently open DataStage job from XMETA, invokes a set of unit tests, then checks the job into Stash (Atlassian's wrapped version of Git). The unit tests involve loading...
by jhmckeever
Wed Aug 24, 2016 8:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Orchadmin - Unix error 10,061
Replies: 4
Views: 5327

SURA wrote:Have you tried this?
Set $APT_USE_IPV4=1 as the default in all projects ...

*** or set this as Windows default environment.***
Ha! That was the problem. We'd set it up in our projects but had totally forgotten to set it in the console. Thanks very much SURA!

J.
by jhmckeever
Wed Aug 24, 2016 7:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Orchadmin - Unix error 10,061
Replies: 4
Views: 5327

Thanks, but we don't see anything funny in our setup ... E:\IBM\InformationServer\Server\PXEngine\bin>env <SNIP> APT_CONFIG_FILE=E:\IBM\InformationServer\Server\Configurations\default.apt APT_ORCHHOME=E:\IBM\InformationServer\Server\PXEngine <SNIP> E:\IBM\InformationServer\Server\PXEngine\bin>sh -c ...