Because the Spark dispatcher persists its state in ZooKeeper, upgrading the DC/OS Apache Spark package requires you to complete the following steps:
- Remove the DC/OS Apache Spark package from ZooKeeper.
- Uninstall your current DC/OS Apache Spark package.
- Install the DC/OS Apache Spark upgrade.
To upgrade DC/OS Apache Spark, do the following:
Delete the znode corresponding to your instance of Spark. By default, the znode instance is
Select the Spark service from the list of Services in the DC/OS GUI and click Delete or run the following command from the DC/OS CLI:
dcos package uninstall --app-id=<app-id> spark
Verify that you no longer see your Spark service on the Services page.
Reinstall the new Spark package by running the following command:
dcos package install spark