Intro to Apache Spark ! http://databricks.com/ download slides: http://cdn.liber118.com/workshop/itas_workshop.pdf 00: Getting Started Introduction installs + intros, while people arrive: 20 min Intro: Online Course Materials Best to download the slides to your laptop: cdn.liber118.com/workshop/itas_workshop.pdf Be sure to complete the course survey: http://goo.gl/QpBSnR In addition to these slides, all of the code samples are available on GitHub gists: gist.github.com/ceteri/f2c3486062c9610eac1d gist.github.com/ceteri/8ae5b9509a08c08a1132 gist.github.com/ceteri/11381941 Intro: Success Criteria By end of day, participants will be comfortable with the following: open a Spark Shell use of some ML algorithms explore data sets loaded from HDFS, etc. review Spark SQL, Spark Streaming, Shark review advanced topics and BDAS projects follow-up courses and certification developer community resources, events, etc. return to workplace and demo use of Spark! Intro: Preliminaries intros – what is your background? who needs to use AWS instead of laptops? key, if needed? See tutorial: PEM Connect to Your Amazon EC2 Instance from Windows Using PuTTY 01: Getting Started Installation hands-on lab: 20 min Installation: Let’s get started using Apache Spark, in just four easy steps… spark.apache.org/docs/latest/ (for class, please copy from the USB sticks) Step 1: Install Java JDK 6/7 on MacOSX or Windows oracle.com/technetwork/java/javase/downloads/ jdk7-downloads-1880260.html follow the license agreement instructions then click the download for your OS need JDK instead of JRE (for Maven, etc.) (for class, please copy from the USB sticks) Step 1: Install Java JDK 6/7 on Linux this is much simpler on Linux…! sudo apt-get -y install openjdk-7-jdk Step 2: Download Spark we’ll be using Spark 1.0.0 see spark.apache.org/downloads.html 1. download this U

阅读全文