User`s guide

xi
Run mapreduce on a Hadoop Cluster . . . . . . . . . . . . . . . . . . 6-61
Cluster Preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-61
Output Format and Order . . . . . . . . . . . . . . . . . . . . . . . . . . 6-61
Calculate Mean Delay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6-61
Partition a Datastore in Parallel . . . . . . . . . . . . . . . . . . . . . . 6-64
Program Independent Jobs
7
Program Independent Jobs . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-2
Program Independent Jobs on a Local Cluster . . . . . . . . . . . 7-3
Create and Run Jobs with a Local Cluster . . . . . . . . . . . . . . 7-3
Local Cluster Behavior . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-6
Program Independent Jobs for a Supported Scheduler . . . . 7-8
Create and Run Jobs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-8
Manage Objects in the Scheduler . . . . . . . . . . . . . . . . . . . . 7-13
Share Code with the Workers . . . . . . . . . . . . . . . . . . . . . . . . 7-16
Workers Access Files Directly . . . . . . . . . . . . . . . . . . . . . . . 7-16
Pass Data to and from Worker Sessions . . . . . . . . . . . . . . . 7-17
Pass MATLAB Code for Startup and Finish . . . . . . . . . . . . 7-19
Program Independent Jobs for a Generic Scheduler . . . . . 7-21
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-21
MATLAB Client Submit Function . . . . . . . . . . . . . . . . . . . . 7-22
Example Write the Submit Function . . . . . . . . . . . . . . . . 7-25
MATLAB Worker Decode Function . . . . . . . . . . . . . . . . . . . 7-27
Example Write the Decode Function . . . . . . . . . . . . . . . . 7-29
Example — Program and Run a Job in the Client . . . . . . . . 7-29
Supplied Submit and Decode Functions . . . . . . . . . . . . . . . 7-33
Manage Jobs with Generic Scheduler . . . . . . . . . . . . . . . . . 7-34
Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7-37