XML to SQL Data maintenance

Introduction:?

Our customer is responsible for sales and distribution of product throughout northAmerica.? In order to improve customerservice, we developed and launched a web portal that allows their customers to checkstock, order, and credit status.? Theproject consists of two primary components: (1) a windows service(DFiles) that takes xml input files that originate from the AS400 in germanyand are transferred via FTP periodically to the web server, and imports theminto a MS SQL Express 2005 DB. (2) a .NET web site that allows customers toaccess and filter this information.

?

Current goal: transition from fullreplacement to incremental updating? ofportal data.

Right now as xml data is available, theDFiles service creates a new table and imports the necessary information,it then drops the old table and renames the new table.? The benefits to this are that the site isquickly and easily updated.? The problemis that when we get “bad?? data, the site may have no data available.? We have had a number of instances of bad datatypically invalid characters in the .xml or files that are not uploadedcompletely

We want to change the DuravitFiles programso that instead of wiping out and replacing data each time we get new files, wewill update data as new data comes [url removed, login to view] way, a problem from the data feed will have a less dramatic impacton the end user experience.

## Deliverables

The current program consists of one procedure with approximately 1300 lines of code including comments. ? there are 9 possible xml input files that get translated into 7 SQL tables

The DFiles service monitors the upload folder and activates when new files appear in the upload folder. ? When files are processed, they are copied to an archive folder that contains a certain number of archive files.

Code is already in place to properly import data. ? The trick in the new routine is going to be looking for records that are no longer in the source data that need to be deleted. ? this may need to be done as a separate cleanup routine that could run nightly. ? If we add an updated datetime stamp to each record, then we could delete records that have not been updated in the past X days, that would be fine

.NET tekniikka Microsoft MySQL Projektinhallinta Tietojärjestelmäarkkitehtuuri Ohjelmistojen testaus SQL Visual Basic Windows Desktop

Projektin tunnus: #3475720

Tietoa projektista