DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
vgupta88
Participant



Joined: 01 Aug 2013
Posts: 32
Location: Mumbai
Points: 396

Post Posted: Wed Sep 06, 2017 12:43 am Reply with quote    Back to top    

DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Hi All,

I have a requirement where I need to read data from csv file (e.g. file_one.csv), apply some transformations on the data and then load that data into a new csv file (e.g. file_two.csv).
I tried using Unstructured Data stage as my Target but it shows me an error that "it doesn't support input links". Is it possible to achieve above requirement using Unstructured Data stage (version 9.1)?

Appreciate anyones help on the above query.

Thanks!

_________________
Vaibhav
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42218
Location: Denver, CO
Points: 216764

Post Posted: Wed Sep 06, 2017 6:01 am Reply with quote    Back to top    

There's nothing "unstructured" about your data so why use that stage? Use the normal Sequential File stage.

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
UCDI



Group memberships:
Premium Members

Joined: 21 Mar 2016
Posts: 267

Points: 2686

Post Posted: Wed Sep 06, 2017 8:08 am Reply with quote    Back to top    

csv files are simple text files that happen to have commas between data blobs that represent 'columns'. Nothing more.

You can process them just fine with a flat file & transformer stage.
Rate this response:  
vgupta88
Participant



Joined: 01 Aug 2013
Posts: 32
Location: Mumbai
Points: 396

Post Posted: Wed Sep 06, 2017 11:21 pm Reply with quote    Back to top    

Craig,

I have multiple tabs in the csv file which needs to be processed which I suppose makes it "Unstructured"

Thanks!

_________________
Vaibhav
Rate this response:  
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54038
Location: Sydney, Australia
Points: 293144

Post Posted: Thu Sep 07, 2017 3:49 am Reply with quote    Back to top    

There are no tabs in a CSV file. It is a regular text file. Can you please be more specific?

_________________
RXP Services Ltd
Melbourne | Canberra | Sydney | Hong Kong | Hobart | Brisbane
currently hiring: Canberra, Sydney and Melbourne
Rate this response:  
vgupta88
Participant



Joined: 01 Aug 2013
Posts: 32
Location: Mumbai
Points: 396

Post Posted: Thu Sep 07, 2017 4:15 am Reply with quote    Back to top    

My bad.. So to clear out confusion and to explain better - I have excel spreadsheets which are saved as .csv file format. Wink These spreadsheets have multiple client specific tabs in it.
So now, I want to process these spreadsheets data, transform them and create a new excel spreadsheet with similar client specific details in separate tabs.

_________________
Vaibhav
Rate this response:  
anudeepdasari001
Participant



Joined: 14 Dec 2015
Posts: 55
Location: Arizona
Points: 449

Post Posted: Thu Sep 07, 2017 6:24 am Reply with quote    Back to top    

Its not supported Writing to the spreadsheets using the unstructured Data Stage in 9.1 version, You can always do that in 11.5 version, Where you have ability to write to a single or all the sheets in a workbook.

_________________
anudpETL
Rate this response:  
vgupta88
Participant



Joined: 01 Aug 2013
Posts: 32
Location: Mumbai
Points: 396

Post Posted: Thu Sep 07, 2017 7:32 am Reply with quote    Back to top    

So, any other method to achieve this?
The basic thing that I am looking after is generating new excel spreadsheet. I can manage with basic one single tab also.

Any help would be much appreciated!

Thanks!

_________________
Vaibhav
Rate this response:  
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42218
Location: Denver, CO
Points: 216764

Post Posted: Thu Sep 07, 2017 7:45 am Reply with quote    Back to top    

Without access to the latest version, the typical answer for a "basic one single tab" would be simply another csv file. Excel will automatically open them as a spreadsheet, it would be up to the user to save it back as an xls.

You may be able to leverage ODBC for this, there are UNIX drivers specifically for Excel from what I recall. You would have to purchase them, however.

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
vgupta88
Participant



Joined: 01 Aug 2013
Posts: 32
Location: Mumbai
Points: 396

Post Posted: Mon Sep 11, 2017 12:24 am Reply with quote    Back to top    

Thanks Craig!
Just one more concern, does metadata in different tabs present in excel sheet needs to same in Unstructured Data Stage?

Thanks in advance.

_________________
Vaibhav
Rate this response:  
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42218
Location: Denver, CO
Points: 216764

Post Posted: Mon Sep 11, 2017 6:43 am Reply with quote    Back to top    

Not that I am aware of, each is treated as a separate 'table' in essence from what I recall.

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
vgupta88
Participant



Joined: 01 Aug 2013
Posts: 32
Location: Mumbai
Points: 396

Post Posted: Mon Sep 11, 2017 8:18 am Reply with quote    Back to top    

It seems like the metadata needs to be same. Otherwise it throws an error - Different number of columns in the sheets <sheet_name>.

_________________
Vaibhav
Rate this response:  
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42218
Location: Denver, CO
Points: 216764

Post Posted: Mon Sep 11, 2017 8:33 am Reply with quote    Back to top    

That seems oddly... restrictive... to me. Confused

Let's see what others have to say.

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
vgupta88
Participant



Joined: 01 Aug 2013
Posts: 32
Location: Mumbai
Points: 396

Post Posted: Thu Sep 14, 2017 7:10 am Reply with quote    Back to top    

No inputs from anyone?

Thanks!

_________________
Vaibhav
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42218
Location: Denver, CO
Points: 216764

Post Posted: Thu Sep 14, 2017 7:39 am Reply with quote    Back to top    

Open a support case.

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours