nameless folder appears, project corrupt?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

telenet_bi
Premium Member
Premium Member
Posts: 33
Joined: Wed Jul 23, 2008 7:33 am
Location: Mechelen, Belgium
Contact:

Post by telenet_bi »

below the first page and the last lines of the output (in total there are 127 pages):
\\NextNumber
\\\
\\\0_Workflows
wDailyClean
waarborg
\\\0_Workflows\A
VAYA
wLoad_Avaya_Data
wLoad_Avaya_Data
_old
MonthlyRevenueAg
gregate
MonthlyRevenueAg
gregate_22101
MonthlyRevenueAg
gregate_Test
\\\0_Workflows\A
ggregates
CopyOfLoadARBORC
DR_1
LoadARBORCDR
LoadArbor
LoadArborLine
\\\0_Workflows\A
rbor
wArborBmf
wArborBmf_200806
02
wArborBmf_Detail
wArborCreditCard
Details
wImportArbor
wImportArbor_200
70816
wImportArbor_200
70830
wImportArbor_200
70831
wImportArbor_200
70913
wImportArbor_new
20070910
wLoadAccount
wLoadAggr_Mobile
_BundleMV
wLoadAggr_Zoomit
wLoadArborBalanc
e
wLoadArborBalanc
e_old
wLoadArborBill
wLoadArborBill_2
0080313
wLoadArborBillde
tail
wLoadArborBrrDet
ails
wLoadArborCol_Su
mmary



3963 records listed.
"" not found.
"" not found.
"" not found.
"" not found.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Looks like a broken CATEGORY index, please try "LIST DS_JOBS ID.SUP EVAL 'OCONV(@ID,"MCP")' WITH CATEGORY UNLIKE \... NO.INDEX CATEGORY"
telenet_bi
Premium Member
Premium Member
Posts: 33
Joined: Wed Jul 23, 2008 7:33 am
Location: Mechelen, Belgium
Contact:

Post by telenet_bi »

first lines of output below, the list is 134 pages long



LIST DS_JOBS ID.SUP EVAL "OCONV(@ID,"MCP")" WITH CATEGORY UNLIKE \... NO.INDEX CATEGORY 04:35:32pm 22 Jul 2009 PAGE 1
OCONV(@ID,"MCP") Category............

CDM_CUSTOMERAPPO 3_Facts\CDM
INTMENT_03
\\\3_Facts\Arbor 3_Facts\Arbor\E2E
\E2E
D_TSD_PRODUCT_00 2_Dimensions\TSD\Sal
esAndO2B_Iter1
CDM_INTERNETLOGI 3_Facts\CDM
NS
wSalesAndO2B_Dim
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

I expected 3 entries in your output, not many pages.

What is the output of "COUNT DS_JOBS WITH JOBNO EQ ''"
and "COUNT DS_JOBS" and "COUNT DS_JOBS WITH EVAL 'OCONV(@ID,"MCP")' UNLIKE @ID"
telenet_bi
Premium Member
Premium Member
Posts: 33
Joined: Wed Jul 23, 2008 7:33 am
Location: Mechelen, Belgium
Contact:

Post by telenet_bi »

>COUNT DS_JOBS WITH JOBNO EQ ""

328 records counted.
>COUNT DS_JOBS

3971 records counted.
>COUNT DS_JOBS WITH EVAL 'OCONV(@ID,"MCP")' UNLIKE @ID
OCONV ( @ID , MCP )

8 records counted.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

ArndW wrote:I expected 3 entries in your output, not many pages.
There was a quote character missing around "\...".

Equivalently you could have used DataStage/SQL:

Code: Select all

SELECT CATEGORY FMT '64L', COUNT(*) COL.HDG 'Count' FMT '5R' FROM DS_JOBS WHERE NAME NOT LIKE '\%' GROUP BY CATEGORY EXPLAIN;
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

328 records in the DS_JOBS file that don't have a job number looks far too big - those would normally be category names (or structure paths, to be more precise). The second query with the MCP conversion shows that you have 8 records with undisplayable characters in the key, something that shouldn't ever occur.

How far along is your backup and restore process? I still don't see what caused your DS_JOBS issues so don't know if correcting the obvious problems will actually solve your problems or if there is more corruption hidden elsewhere.
telenet_bi
Premium Member
Premium Member
Posts: 33
Joined: Wed Jul 23, 2008 7:33 am
Location: Mechelen, Belgium
Contact:

Post by telenet_bi »

While we were having these discussions I also had a case with support open. They've asked me to send the DS_JOBS folder and then there was no reaction for 2 days. After that they came back with the response below:
1) Change the category name of the job MSG_CONTACT_cr60552_ANU
ED DS_JOBS MSG_CONTACT_cr60552_ANU
- then type : 3
- and then execute "R 3_Facts\Messagent"
-type "FI" to save the change

2) to delete incorrects categories, executes :
SELECT DS_JOBS WITH CATEGORY LIKE \...
(3 records should be selected)
DELETE DS_JOBS
(confirme the deletion by typing Y)

3) Reindex the file
DS.REINDEX DS_JOBS
Since the job was just a temporary one I just skipped step 1 and went straight to the delete. This solved our issue.

So thanks for your responses, you were definately on the right track.


off topic: I had Rene Schiebeck with me yesterday and today and he says you have to focus more on your other assignments ArndW! ;-)
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

No worries, and tell Rene that I'll do my best 8)
Post Reply