The MySQL Connector Do you already have all the libraries to connect MySQL? Get the hands on your spark-shell and check with: Class.forName("com.mysql.jdbc.Driver") If you get an exception, the...

As I’m learning Spark (and Scala) some of the topics are a little bit too difficult for me. One of them is the User-Defined Aggregation Functions, a topic discussed in Chapter 5 of the Spark: The d...

I really enjoy working with the spark-shell. It provides a quick way to experiment with code snippets. However, there are times when you might prefer to write those snippets in a proper file and ha...