User guide

Data flow in the data subdirectories
Access the data directory from here: /opt/IBM/InformationServer/Server/
Projects/UDM/udm/data.
The data directory contains all the data files. The different subdirectories in the
data directory are as follows:
in When there is a file available message from the SAM server, DataStage job
fetches the XML files and places it in the in directory.
done After the DataStage job processes these XML files, it moves them into the
done directory. You must clean these XML files to free the space for storage.
cache This directory contains the temporary data that is required by the job for
its processing. This directory contains a set of socket files for
intercommunication, map files for sharing the memory among the different
stages, and litedb files are where the data is buffered and stored
temporarily even when the job is shut down to avoid data loss.
out The CSV files are created in the out directory that is based on the
information in the XML files and JMS messages if any.
Important: The files from the cache directory are used by the DataStage job for
internal use. You must not delete or alter any file from the subdirectory while the
job is running. Otherwise, the job might fail.
Configuring the DataStage job for Secure File Transfer support
About this task
To add Secure File Transfer support for DataStage job, follow these steps:
Procedure
1. In the IBM InfoSphere DataStage and QualityStage Designer, click the Job
Properties button, and then click the Parameters tab.
2. Change the default value for the SECURE_FILE_TRANSFER to TRUE.
3. Create the SSH private key file by name sshkey_file.
4. Copy the SSH private key file to this location:
/opt/IBM/InformationServer/Server/Projects/UDM/udm/cfg/sshkey_file
5. Or, link the sshkey_file to the target private key file by using the following
commands as dsadm:
$ pwd
/opt/IBM/InformationServer/Server/Projects/UDM/udm/cfg
$ ls -l sshkey_file
lrwxrwxrwx 1 dsadm dstage 23 Nov 7 21:47 sshkey_file ->
/home/dsadm/.ssh/id_rsa
Chapter 5. Deploying Alcatel-Lucent 5620 SAM LogToFile 2.3.0.0 DataStage jobs 35