I work for an organization which receives numerous contracts from
numerous clients. Now, with each new contract comes new flatfiles
needing importing (with differing formats and fields, etc...), faulty
data, etc... It's not as easy as just telling all the contractors "ok,
we now need all the data you send us in a generic universal format" as
many of the contractors have contracts dating back years, and they only
provide what their contract specifies they provide, nothing more. Also,
it's not as easy as saying "get on board with this new format or the
contract is cancelled" as many of the contracts carry steep
cancellation fees and/or actually breaking the relationship is just not
feasible, given the services some provide.
So basically, does anyone out there have experience with constructing a
flexible method of dealing with routine introduction of new data
formats, and a constant barrage of change?
Any tips, links, or books you can recommend? Thanks!Have you looked at any third-party ETL tools? There are a lot of products
that exist to meet this kind of requirement. Here are a few of the leading
vendors.
http://www.pervasive.com
http://www.datawatch.com
http://www.ascential.com
http://www.informatica.com
http://www.embarcadero.com
http://www.datamirror.com
--
David Portas
SQL Server MVP
--
No comments:
Post a Comment