nsaclubs.blogg.se

Type in expressions to have them evaluated. Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_79) Once the Spark shell is running, let’s establish a connection to mySQL db and read the baby_names table: Welcome to $ SPARK_HOME / bin / spark - shell -jars /home/example/jars/mysql-connector-java-5.1.26.jarĢ. If it is not, you can specify the path location such as: This example assumes the mySQL connector JDBC jar file is located in the same directory as where you are calling spark-shell. $ SPARK_HOME / bin / spark - shell -jars mysql-connector-java-5.1.26.jar Start the spark shell with – jars argument Spark SQL with MySQL (JDBC) Example Tutorialġ. To build and deploy and Spark application with mySQL JDBC driver you may wish to check out the Spark cluster deploy with extra jars tutorial. This is a getting started with Spark mySQL example. (In a Spark application, any third party libs such as a JDBC driver would be included in package.)įrom Spark shell we’re going to establish a connection to the mySQL db and then run some queries via Spark SQL. We need to pass in the mySQL JDBC driver jar when we start up the Spark Shell. If you have any questions about the environment setup, leave comments on this post. `id` int(11) unsigned NOT NULL AUTO_INCREMENT, The SQL to create the baby_names table: DROP TABLE IF EXISTS `baby_names`