Critical Procedures
This is a list of the critical procedures and functions used in maintaining USMS Archives
at present. Most of these do not need to be addressed in proposals written in response to
the USMS H&A RFP. They are listed for reference and to begin the documentation process
both for Committee and/or User activity
and for others who may wish to rewrite or acquire these facilities in a better way.
This list of procedures will not be carefully documented for the RFP,
but they must be included in the User Interface and in documentation.
In general, it is the Client's job to assure that these work properly,
though in a few cases the Consultant may be requested to consider solving certain problems.
Each procedure to be included in the user interface will be identified from the list below.
For planning purposes, the following is suggested.
If the proposal is a Windows MDI solution,
the MDI form will have 7 child forms each of which will call 3 to 12 procedures.
The child forms will have names like:
e.g. File, Edit, View, Process, Review, Tools, Help.
Further refinement of this list may be made before the RFP is publicized.
It is expected that the "Client" will modify the user interface
as it evolves on the basis of the experiences of "Users".
(100.....) Steps that precede the use of the registrar file: Top Ten
(120....U) determine where data will go, build files if needed, or EMPTYFILE
(........).. fcns needed are 0 (21 rows), 1 4 5 7 9 11 12 13 14
(140....U) make sure 4200 3 is right, & hardwired TNF„ in IMPORTWALT
(160....U) run EMPTYFILE for best protection against errors
(180....U) ImportTopTen
(180.03..) identify destination files (TNS[;1]=individual, TNS[;2]=relay)
(180.06..) identify source file(s) and key variables
(180.09..) identify next source file to process within loop of source files
(180.12..) obtain data for current source file
(180.15..) convert delimited literal vector to a nested array
(180.18..) add columns for missing fields
(180.21..) split Name into FNAME MI LNAME
(180.24..) delete number sign and leading zeros from Place
(180.27..) extract MI from FNAME
(180.31..) combine FNAME MI LNAME into Name
(180.33..) define Distance, Course, Stroke from Event Number
(180.36..) define Agegrp from Age
(180.39..) convert SEX from integer to alpha
(180.42..) assign SwimmerID, LMSC, Club from the SwimmerID registry
(180.45..) ensure required fields are in incoming data
(180.48..) identify swimmers not in SwimmerID Registry & add them
(180.51..) protect existing LMSC data where empty cell will overwrite
(180.54..) make sure leading zeros are present on Birthyear if SwimmerID exists
(180.57..) add a space in case it is needed
(180.59..) loop thru each SEX/Agegrp/Event to place data on html support file
(180.63..) sort by "Time" & post "Place" (handling ties)'
(180.66..)
(180.69..) write data to appropriate place for storage
(180.72..) build FDIR based on FMV[16]
(.......U) TTDBUTIL © make sure place is ¼1†½M in every FCN, to verify the import process
(........).. cannot be run again later, this is to catch Pieter's mistakes after import
(.......U) TTDBUTIL © not defaults, insert "Place" & impose conventions (elim lead 0's)
(.......U) remove periods in LNAME FNAME Name fields & "DUS" (must revise to do this)
(.......U) make sure settings on what is "preliminary" are correct (4200 14) 1999LCM ; TTDBEXPORT[344]
(........) make sure LMSC designations in Pieter's file are not lost where they do not exist in 4289
(........) a newly imported file still must have POSTTEAM run to allow comparison to prior file
(........) preliminary Top Ten run at this point (TTDBEXPORT) required 2 hours for 1999LCM 11/9/99,
(200.....) Steps that precede the use of the registrar file: other core databases
(220....U) AAH_UTIL for files /aah/ and /ash/ (4510 & 4519)
(300.....) Steps that use the registrar file
(320....U) USMS_REG (now ImportEsther): import USMS Registrar file via dBASE‘IMPORT & place in TNT (if new Reg file)
(........) see instructions in the fn: USMS_REG
(........) SWIMMERID to assign duplicated swimmer ids & SEX errors in Registrar file
(........) more work to do to handle dups & handle all troublesome 4253 4254 4255 4256
(340....U) make sure all names/ages in 4289,
(360....U) MOVE_DATA_ uses MOVE_DATA_M (move data in one batch based on SwimmerID), also see TTDB_REG
(........) FIXSWIMMERID & MOVE_DATA_ may be to be run in iteration while fixing swimmer ids
(.......U) USMS_REG (now ImportEsther) is the procedure for importing REGISTRAR files (also tells how to clean it up)
(........) REGISTRAR (to carefully match names & select SwimmerID)
(380....U) LMSC & club in, & then
(400.....) Steps that follow use of the registrar file
(410....U) update FLS_TTDB
(420....U) create files 4111 4406 per files
(........).. add new files 4221 4222 to 4200 3 for POSTTEAM in manner of ¯2+
(........) update lines 28-33 of TTLMSCDATA for new files (if new year)
(........).. prepare file 4242 to accept the database from file 4221
(440....U) POSTTEAM (if no new Registrar file, then POSTTEAM only changes new names in 4289)
(460....U) create file 4112
(462.....) TTLMSCDATA (ERAS'LMSC' ª 3 TTLMSCDATA ‘RE[16]) create summary & detail by LMSC
(464....U) TTDBEXPORT (run at end of POSTTEAM for det, lmsc & age if needed)
(........).. SWIMMER © post the database to file 4242
(470....U)
(490.....) update 4200 5 & 6 (if new year)
(.......U) add another year to home pages for cgi files (4501 4502 4503) (if new year)
(.......U) every year WWW_TT_LMSC must be run to add a new year to /tt/ LMSC pages
(........) was probably written out to each 4504,FCN by WWW_TT_LMSC
(500.....) Data tables derived from the core databases
(510....U) TTDB_HTM_INDEX
(520....U) TTDB_HTM_NAMES
(540....U) AAH_UTIL for files /aae/ and /ase/ (4515 & 4514)
(560....U) ALLAMERICANS TTDB_MinText (especially important to run 3rd part if there is a SwimmerID change)
(580....U) AATTDBMENU (creates list of #1 swims & AA menus by LMSC & Agegrp)
(600.....) Compiling webpages that are dependent on the databases
(610....U) qkw_Master
(630....U) TabulateTopSwims - tabulate # of #1 swims for #1 swims folder
(640....U) qkw_htm_xref 0
(660....U) make sure all valid swimmer ids in file 4289 are in file 4260
(700.....) Cataloguing images (including annotation, ImageCatalogue)
(740....U) PHOTOGALLERYMENU
(760....U) WWWUTIL post summary of FMV vectors from all Text Element files to TTDBMV[5],3
(800.....) Special projects
(........) LMSCWebPages
(........) LMSC_URL
(........) The USMS Archives Catalogue
(........) The SwimmerID Registry
(........) encoding birthdays, how the SwimmerID is formulated
(........) TTDB_RANK (calling qkw_index) processes FINA & USMS records
(900.....) Proliferation
(920.....) uploading to the server, and synchronizing the server with the source computer(s)
(940.....) install procedure
(960.....) error handling
The encoding of e-mail addresses to deter "harvesting" gave us an opportunity to discover how many HTML pages each major function creates or maintains. This was possible because every HTML file was changed to use encoded e-mail and the number of files uploaded after each procedure was noted. Here are the results.
qkw_Master - 3067 HTML files were changed in a
1:55 (2 hour) run and 57 minutes were required to upload the revised files.
qkw_htm_xref - 545 HTML files were changed in a
6 minute run and 14 minutes were required for upload.
TTLMSCDATA - no HTML files were changed, the run (inc. POSTTEAM) took 20 minutes.
TTDBEXPORT - 2936 HTML files were changed in a
39 minute run (inc. POSTTEAM & TTLMSCDATA) and 55 minutes were required for upload.
TTDB_HTM_INDEX - no HTML files were changed, the run took ?? minutes.
TTDB_HTM_NAMES - no HTML files were changed, the run took :03 seconds.
LMSCWebPages - 54 HTML files were changed in a
:45 second run and :30 seconds were required for upload (for the top folder only).
ServerSync - a complete ServerSync verification with no actual uploading takes about 6 minutes.
Backup - a complete backup verification with no actual copying takes about 2 minutes.
