DSXchange

Welcome aboard. What is the data type of column C? This error suggests that it is a string with a particular maximum length, and that there are data arriving that are larger than that size.

Depends how it's been corrupted, of course. You might begin by reindexing the local repository database (which is done on a project-by-project basis).

Don't stint on disk space for the IA database; plan for at least five times the volume of data to be profiled. The more CPU and memory you have on the server, the faster your profiling jobs can run.

Perhaps something like the following will do it.

How about Shane's suggestion to generate a SELECT statement based on the system table entries? I've done this a number of times in the past (with Oracle sources, primarily) with great success.

Firstly, the correct nomenclature is "hashed" file, not "hash" file. It's perfectly OK for non-key fields to contain NULL, just as it would be in a database join. The hashed file even allows for part of the key to be null, in a multi-column key. (You may disagree with this, but i...

The biggest had the Everyone group given BG User role. This contained about 33,000 users, but we did not collect information on how many users actually used BG.
For that site there were five author/administrators (named user licensing).

The values in those variables are NOT stored in the format you specified. They are stored in an internal format. Details may be found in Chapter 2 of the Parallel Job Developer's Guide. The function to convert an internal time to a string in a Transformer stage is TimeToString() while in a Modify st...

Good governance requires that it be done through some kind of approved implementation task, even if that task ends up being a global search and replace in a DSX file or XML export file. Be very careful that you only change the required attributes.

Yes, obtain a MySQL Enterprise or Commercial. Or, perhaps, use ODBC.

Yes, it means precisely that.

No other thoughts - this is a binary choice and the other alternative is not possible.

Yes, but only by using two Lookup stages with Reject links, and mechanisms on each of those (e.g. Column Generator stage) to add the description of which lookup it was rejected by.

Welcome aboard.

Use a design with two Web Service Client stages instead of one. The output of the first becomes the input to the second. You may require a Modify or Transformer stage between them to get your data "just so".

5 GB/hour isn't too bad on a small configuration. How many nodes are you using, and what kinds of (how powerful) processors?

Are you the same user as vamsi.4a6, who has over 330 posts? Anyway, and irrespective of that, think about the present problem this way: what is the purpose of constructing Start:End and End:Start columns? The answer to that is that, if they are the same, then the records belong in the same group. Fr...