Set Up Batch Processing - SuperCROSS

You can use SuperCROSS to carry out batch processing.

When SuperCROSS is configured to use this mode, it acts like a server. It will regularly poll a specific directory (referred to as the "interchange directory") to check for any new TXD or SCS format files. If it finds a new file in the interchange directory, SuperCROSS will automatically process the job, running the cross tabulation and creating output files with the results of the tabulation. When you set up batch processing, you can specify which output formats you want to generate and SuperCROSS will automatically create output files in all of these formats.

Tip

If you make the interchange directory a shared network directory, then other users in your organisation will be able to use SuperCROSS for batch processing; they can copy their source TXD file to the shared network directory, wait for SuperCROSS to process the tabulation and then collect the tabulated files from the output directories. 

This section describes how to set up SuperCROSS for batch processing.

Step 1 - Create the Interchange Directory

The first step is to create a directory for use as the interchange.

When you configure batch processing, SuperCROSS will automatically can four sub directories inside this directory, as follows:

Folder	Description
Error	Used if there is an error during table processing. If an error occurs, SuperCROSS moves the source file to this directory, and creates a log file in this directory with details of the error.
Input	This is the input directory. SuperCROSS will check this directory at regular intervals for new TXD and SCS files to process. Although both SCS and TXD formats are accepted as input, the TXD file format is the recommended table definition format for batch processing. SuperCROSS removes the source file from this directory when processing is complete.
Mandatory	You can choose which output formats you want to create by specifying them as mandatory. After running the cross tabulation, SuperCROSS creates all these output formats and saves them in this directory.
Output	After SuperCROSS has run the cross tabulation, it saves the file in SuperCROSS SCS format in this directory.

Step 2 - Create the Batch Processing Configuration File

1. Check if there is a cs.ini configuration file in the SuperCROSS program data Catalogue directory (if you installed to the default location, then the location of this directory will be C:\ProgramData\STR\SuperCROSS\Catalogue).
2. If the file does not already exist, create a new text file called cs.ini in this directory.
3. Open cs.ini in a text editor.

4. Add the following section (or edit the existing section if it already exists):

   CODE

   [BatchProcessing]
   InterchangeDirectory=D:\STR\Interchange
   Catalogue=C:\ProgramData\STR\SuperSERVER SA\databases

   

   Make sure the directory paths match the appropriate locations on your system:

   • InterchangeDirectory is the location of the interchange directory you just created.
   • Catalogue is the location of the SXV4 databases used for cross tabulation.
5. Save your changes to the file.

Step 3 - Configure Batch Processing in SuperCROSS

1. Start SuperCROSS and select File > SuperSTAR I Server Connection.

   The SuperSTAR I Server Connection dialog displays.

2. In the SuperCROSS Mode section, select Server.
3. Select the Use Specific Work Group File check box.
4. Click Browse and select your cs.ini file.
5. In the Current Work Group drop-down list, select BatchProcessing.

6. In the Check For Tables Every section, enter a value greater than 0, for example 60.

   This specifies how frequently SuperCROSS will check for new source files to process (if it is set to 0, SuperCROSS will not check for new files).

7. Click OK.

   

Step 4 - Select the Output Formats

1. In SuperCROSS, select File > SuperSTAR I Server Monitor. The SuperSTAR I Server Monitor - Server dialog displays.
2. Click Set Mandatory Output Formats. The Mandatory Output Formats dialog displays.
3. Make sure that Global Settings is selected from the Database drop-down list.

4. Select all of the output formats that you want to be created each time SuperCROSS process a job, then click OK.

   For example:

   

Step 5 - Disable the SDMX Save Dialog

If you intend to use batch processing to create SDMX output, then you should make sure that you have configured SuperCROSS not to show the Saving to SDMX options dialog.

If SuperCROSS is configured to display this dialog then it will interrupt the batch processing, as it will pop up and wait for your input:

To ensure that the dialog does not display:

1. Edit the super.ini configuration file in a text editor. If you installed to the default location, this file is located in C:\ProgramData\STR\SuperCROSS

2. Search the file for the [SDMX] section and make sure that the ShowDialog setting is set to 0:

   TEXT

   [SDMX]
   ShowDialog=0

   

   If there is no [SDMX] section, add the section to the end of the file.

3. Save your changes.

Step 6 - Test the Batch Processing

SuperCROSS is now ready to run in batch processing mode. Test the configuration by copying a TXD file to the Input directory. If everything has been configured correctly, it will process the source file and create the output files in the Mandatory and Output directories.

The SuperCROSS application must be running in order for batch processing to take place.