

### To build a fat jar:

sbt assembly

### To Run locally:

1. Download spark 2.0.2 for Hadoop 2.6, and unpack it.  Believe it or not, you now have a working version of spark and can run in local mode.
2. Determine the exact version of hadoop-core located in that package, as we will need that to pull in the correct S3 jar.  Look in the jars directory of that package.
     - Note: use the correct hadoop version for the aws package. 2.6.4 is shown here.
3. Put S3 credentials in the <spark dir>/conf/spark-defaults.conf, or otherwise set these properties:
``` 
spark.hadoop.fs.s3a.access.key <key>
spark.hadoop.fs.s3a.secret.key <secret key>
```
As s3a may hang on a mac, set up the s3n credentials as well ...  
```
spark.hadoop.fs.s3n.awsAccessKeyId <key>
spark.hadoop.fs.s3n.awsSecretAccessKey <secret key>
```
4. ~/spark/bin/spark-submit --packages org.apache.hadoop:hadoop-aws:2.6.4 target/scala-2.11/DynamoETL-assembly-1.0.jar 