In earlier releases, an Apache Spark service was available by default for IBM Watson Studio (formerly Data Science Experience). This was often not needed and inefficient, so the default Spark service was removed on March 20, 2018. However, if you do need the Spark service, this tutorial explains how you can add it.
Learning Objectives
To set up a Spark service for use in Jupyter notebooks on Watson Studio.
Prerequisites
Log in or create an account for Watson Studio.
Estimated Time
This will take no more than 15 minutes.
Steps
Add a Spark service to your project
In your project, go to the Settings tab. Scroll down to Associated Services, and choose + Add service > Spark.
Either choose an Existing Spark service or create a New one.
Create a notebook, and select the Spark service
When you create a notebook, select the Spark runtime that you’ve associated with this project.
Click the Create Notebook button.
Summary
You should now be able to use an Apache Spark service in your notebook.