Automating Flat file Aggregation using File Upload Utility

Introduction Of File Upload Utility

The File Upload Utility from SailPoint simplifies data and identity synchronization between several platforms. However, it can take a lot of time to manually launch the upload application. likewise, manually aggregating each flat file can be challenging if there are hundreds of them. It is quite convenient to manage large-scale flat file processing in SailPoint IdentityNow by scheduling the file upload utility, which ensures that flat data are uploaded and aggregated automatically at specific times.

The guide covers the installation procedure, directory configuration, troubleshooting advice, alternate methods, and real-world examples of setting up Task Scheduler to automate SailPoint's File Upload Utility.

Why Should File Uploads Be Automated?
1. Time Efficiency: prevents significant time by doing away with manual execution.
2. Consistency: Guarantees frequent uploads free from human error.
3. Scalability: Easily manages repeated uploads even as data amounts increase.

Requirements
1. Installed File Upload Utility: Go to the official SailPoint IdentityNow resources and download the File Upload Utility. Install it in a directory, like C:\SailPoint\FileUploadUtility, after extracting it.
2. Valid Authentication: You have run tests on the tool and used command-line execution to confirm successful uploads.
3. Configuration and File Paths: To keep flat files and configuration information in an organized manner, arrange your directories. For instance:
Directory for utilities is C:\SailPoint\FileUploadUtility.
Directory for flat files is C:\SailPoint\FlatFiles.
Directory for logs: C:\SailPoint\Logs

Step-by-Step Guide to Automating File Uploads

1. Prepare the Command Script

• Navigate to the directory containing the utility.

• Test the following command in the terminal:

• $ java -jar sailpoint-file-upload-utility.jar –url – clientId – clientSecret –file/path -R

Example: $ java -jar sailpoint-file-upload-utility.jar --url https://example.api.identitynow.com --clientId d0b28ce1b2694b64949dd546de1ff574 --clientSecret a34...1df --file /Users/neil.mcglennon/test/resources/ -R

Replace the placeholders with your credentials and file paths.

2. Open Task Scheduler

1. Press Win + R, type taskschd.msc, and press Enter.

2. In the left-hand panel, select Task Scheduler Library.

3. Click Create Task in the right-hand panel.

3. Configure the Task

General Tab:

• Name: Provide a meaningful name like "SailPoint File Upload Task."

• Description: Add a brief explanation, e.g., "Automates the file upload process for SailPoint."

• Select Run whether user is logged on or not.

• Check Run with highest privileges to handle administrative requirements.

Triggers Tab:

1. Click New.

2. Choose a trigger type, such as:

   • Daily: Schedule the task to run every day at a specific time.

   • On an event: Automate uploads when a particular event (e.g., file creation) occurs.

3. Configure the start time and recurrence interval.

Actions Tab:

1. Click New.

2. Set the action to Start a Program.

3. Browse to the Java executable and input the required command arguments. For example:

java -jar C:\SailPoint\FileUploadUtility\FileUploadUtility.jar -u admin -p secret -url https://example.identitynow.com -f C:\SailPoint\FlatFiles\upload.csv

Conditions and Settings Tabs:

• Uncheck Start the task only if the computer is on AC power for laptops.

• Enable Allow task to be run on demand.

• Set retry parameters under the Settings tab.

4. Test the Task

• Right-click the task and select Run.

• Check the utility’s log or the upload destination to confirm execution.

Common Issues and Troubleshooting
1. Task Fails to Run:

• Verify that the utility's command is configured and tested successfully.

• Confirm that the user account is authorized.

• They need to be able to access the source at least as an administrator.

2. Authentication Issues:

• Verify that the credentials meet SailPoint's specifications.

3. File Not Found:

• Verify the file path in the command and ensure the file exists before execution.

Alternative Approaches

If Task Scheduler does not meet your requirements, consider these alternatives:

1. PowerShell Script: PowerShell offers greater flexibility for scripting and error handling. For example:

java -jar $jarPath --url $tenant_url --clientid $client_id --clientsecret $client_secret --filepath $d

Practical Use Cases

1. Nightly Data Uploads: Configure Task Scheduler to upload files during non-business hours.

2. On-Demand Execution: Pair the utility with a file creation trigger for real-time uploads.

3. Error Notifications: Combine with email scripts to notify administrators of failed uploads.

Conclusion

Automating SailPoint’s File Upload Utility using Task Scheduler is a straightforward way to enhance efficiency and reliability. This setup ensures consistent file uploads, freeing up resources for other critical tasks.

With the options of PowerShell scripting or third-party tools, you can extend automation capabilities as your requirements evolve.