Date: September 23, 1994 FROM: Tim McClanahan, Sandy Kramer (update - 12/20/94, 03/06/95) SUBJECT: Voyager EDR to CDROM Production ----- Voyager EDR Migration to CD ROM ----- Introduction: ------------- The purpose of the proposed CD-ROM production system is to provide a data archive system for the Voyager I and Voyager II Experimental Data Records (EDR) library. The Voyager I and Voyager II EDR library currently resides on approximately 2200, 3480 tape cartridges. The EDR library is split into two sublibraries. Library 1 resides in the NASA Goddard Space Flight Center, building 28 Tape Library System(TLS). Library 2 resides in NASA Goddard Space Flight Center, building 2 room W124 and is not maintained electronically. Due to limitations in tape cartridge slot space in the TLS facility, it will be neccessary to revolve slots in the TLS system as they are needed in the course of CD-ROM production. Data Flow Diagram ----------------- a. Identify EDR's and times to be processed. b. Move EDR's (if needed) to Bldg 28 library. (Bldg 2 EDR Library) (Bldg 28 EDR Library) c. On PC issue C:\> CLEAND to \ / clear all files on D: \ / \ / d. Use EDR_COPY (ALPHA) to move \ / EDR's to IBM disk. The files \ / are then copied to the PC ------------------ as a backend FTP process | IBM 9021 DISK | to the EDR to disk copies. ------------------ (Process can be run class A - | high priority or class E,F - | low priority) | --------------------------- e. On PC: CDVERIFY the data | PC D:\VOYAGER\V?\EDR\Y??| (see detailed instructions) --------------------------- | f. On PC: Examine the file | D:\VOYAGER\FILEDESC.DAT | Verify statistics ----------------- | Write CD | g. On PC: C:\>BATCHCD ----------------- Batch job creates, writes \ and fixes virtual image \ ---------------------- | CD Verify on Alpha | i. Final EDR data verification ---------------------- Process Overview ---------------- 1. Identify year and coverage information for next CD-ROM production interval. Information Needed: a. Space Craft ID (V1 or V2) b. Start date of CD-ROM coverage. i. Year, day. c. End date of CD-ROM coverage. i. Year, day. 2. Identify all EDR cartridges that will cover the production interval. Information Needed: * If the EDR's to be processed do not reside in bldg 28 they must be moved to the bldg 28 library and entered in TLS. Consult TLS for status of EDR tapes and time intervals. a. All Cartridges with 1991 dates or later are 30 day cartridges. b. All other cartridges are 5 day cartridges. c. Names of EDR's in coverage period. d. Number of EDR's in coverage period. e. Data Set Names (DSN) for EDR cartridges to be copied -- Use ZFATSCAN(IBM) to determine DSN for production interval. -- You may want to dump several cartridges to get the DSN's for the interval. f. If using EDR_COPY(ALPHA) Step (4) all DSN's must be identical for all EDR's in interval. 3. PC SETUP 1. BOOT UP PC 2. C:\> CLEAND * Will delete all files on the D: drive, this will * allow the user to free space on D: drive for Step 6. * -- WARNING -- Don't use this until EDR postprocessing * on the previous EDR interval is * complete. - User will be asked if deletion of files is intended or if CLEAND is to be aborted. Answer appropriately. - CLEAND.BAT uses the CHKDSK DOS utility to generate a list of files directories and attributes of the D: drive. - This list is then filtered down into a list of files that reside on the D: Drive. - KILL.BAS is then invoked to delete all files on the drive regardless of location. - Leaves the directory structure intact on the drive. 4. COPY EDR'S to PC a. Notify Marty Bonnefond Bldg. 28 Operations staff 286-6015 i. Total Number of copy jobs to be submit. ii. All copies will be set up to run overnight. b. Copy Step IF the EDR's in the production interval are standard day increments (5 or 30) and the DSN's are identical then EDR_COPY.COM(ALPHA) can be used to copy the EDR's to IBM Disk. Can also be used for single copies. This job will be set up to run overnight. 1. Log onto ALPHA 2. $ @edr_copy * begins edr_copy batch file. EXAMPLE: ALPHA EDR_COPY SESSION: =================================================== ===== CREATE EDR EDR COPY JCL ==================== =================================================== * Will copy 1 year of EDR's on IBM 9021 to disk * EDR names must be on standard increments 5 or 30 Enter the IBM 9021 (GIBBS) ID: XRTPM Enter the PASSWORD: Enter Spacecraft ID: V1 = A, OR V2 = B : B Enter Year of Coverage (2 Digits) : 90 Enter FILE #1 Day extension, ex. 001 = 1 : 126 Enter LAST FILE Day extension : 141 Enter 5 or 30 day EDR's : 5 Enter DSname on tape (MAG,MAGEDR,MAG31,MAG32): MAGEDR Are these PARAMETERS correct? IBM 9021 (GIBBS) ID = XRTPM FILE #1 = 90B126 FILE #2 = 90B131 FILE #3 = 90B136 FILE #4 = 90B141 DSNAME = MAGEDR Enter (Y/N): Y Enter run class (A,E,F) Enter message class (A,X) - EDR_COPY.COM will create the JCL to copy any number of standard named EDR's ie. 90b001,90b006,90b011 5 or 30 day increments to IBM DISK. - Data Set Names (DSN) must be identical for all files in batch submit - Back end processing then places the IBM DISK files on the PC:(LEPVGRCD) D: drive in the correct EDR SPACECRAFT and YEAR directory. - EDR_COPY.COM can also be used for single EDR's by using the same start and end dates. This will generate 1 copy job. 5. PC Verification Processing a. Verify all EDR'S have been successfully copied to the Correct EDR SPACECRAFT and YEAR Directory. On PC: ------ C:\> DIR D:\VOYAGER\V(1or2)\EDR\Y(YR) /O /P *pages through directory (/P) in sorted order (/O) - will generate a list of all EDR's in the directory - Visually verify byte counts should be greater than 4 MB - Visually verify Total # of EDR's and stated coverage b. Transfer Verification: 1. When transfers complete verify existence and space used 2. Make copy of directory to text file in D:\VOYAGER directory. -- The verification software will use this file as part PC CDROM verification process. 3. The following command line will generate a copy of the edr directory containing the data for Voyager 2 1990 and create an indexfile named e90b001.idx the day extension will reflect the day of first EDR file. a. This file must correctly reference the name of the EDR Directory and is an essential part of the system. -- BE CAREFUL !!!! -- EXAMPLE on PC: -------------- C:\> DIR D:\VOYAGER\V(1or2)\EDR\Y(YR) /O > D:\VOYAGER\E(YR)B(DAY).IDX 4. Run on PC: C:\> CDVERIFY to ascertain. -- 10 minutes a. Path names and file existence. b. Sizes of each EDR transferred anything under 4MB Will be flagged and the user will be warned as to short EDR. c. EDR directory will be checked for exact path and file ID verification. d. Write general file statistics to D:\VOYAGER\FILDESC.TXT e. Verify Space craft ID f. Dump every 100 time tags to verify time coverage g. Directory space over bounds. h. File sizes EXAMPLE on PC: -------------- C:\> CDVERIFY * will start verification process 5. Print D:\VOYAGER\FILEDESC.TXT and look for any descrepancies or problems. C:\> PRINT D:\VOYAGER\FILEDESC.DAT ***************************************************************** * * * ANY DESCREPANCIES MUST BE BROUGHT TO MY ATTENTION AND CLEARED * * BEFORE CONTINUING!!!!! * * * ***************************************************************** 7. Creating the CD Image ( PC process ) a. On Philips writer, press open to open drawer * Place the raw CD platter with numbers in hub facing up. * The write will not work if they face down. b. Run BATCHCD EXAMPLE: -------------- C:\>BATCHCD * Will make,write and fix CD image Batch job information will be printed upon completion 8. ALPHA Verification: a. On all CD's: 1. Mount CD 2. Look at index file and move to EDR working directory 3. Visually verify contents of directory. 4. Randomly run EDRREAD to verify file contents.