What types of files make up a NuGenesis file data record in TE_TEMP? - WKB2647

ENVIRONMENT

• NuGenesis 9 SDMS
• NuGenesis 8 SDMS

ANSWER

For each file (or group of files) archived by NuGenesis, the TE_TEMP folder contains the following:

• One NGD: This is the "manifest" file that has all the info and metadata for the files being captured.

• One CLOB: This file contains the searchable data for the captured data.

• One or more data files: These files have no extension and are a compressed copy of the data from the instrument. There is one raw data file per file in the captured data.

ADDITIONAL INFORMATION

The NGD file is renamed "servername_portnumber" when the NuGenesis RPC service is preparing to move the files into the database or Managed Storage.  Usually these files are processed quickly by the TE and are renamed or deleted, but it can happen that a file is left stuck in the "servername_port" state.  The most likely scenario for this error is a sudden failure/stoppage of the NuGenesis RPC service while the files are in this state.  When the service restarts SDMS won't automatically resume processing these files.  These "orphaned" files can be manually renamed to .NGD to resume the transport process.  Starting in NuGenesis 9.1, there is new functionality to handle these orphaned files.  By default, the NG 9.1 RPC service will consider a file as "orphaned" if it at least 48 hours after the file's modification date.  The timeout can be controlled by a registry key: HKLM\Software\Wow6432Node\NuGenesis Technologies Corp.\NuGenesis\TE

• Name: OrphanUploadTime
• Type: REG_DWORD

The key does not exist in 9.1 by default, and in that case, the criteria is 48 hours after last modification.  If the key exists then the value determines the interval, in hours, that the RPC service uses to check for orphaned files.

If seven or more errors occur for any one NGD file, the NGD file is renamed .mark_bad. Copies of the error messages are written to the .mark_bad file. Open the file in Notepad to view the error messages.

When you see old files in TE_TEMP (a creation date that is prior to the current day), you need to first see what type of files they are:

• If they are RAW data or CLOB files without any NGD files, you can safely remove these files from TE_TEMP with no other action needed.
• If these files are NGD, you can move them to another folder to verify that the files that NGD represents were captured in a subsequent run.