SparkModel API

[source]

SparkModel

elephas.spark_model.SparkModel(model, mode=<Mode.ASYNCHRONOUS: 'asynchronous'>, frequency='epoch', parameter_server_mode='http', num_workers=None, custom_objects=None, batch_size=32, port=4000, *args, **kwargs)

load_spark_model

elephas.spark_model.load_spark_model(file_name: str, from_hadoop: bool = False)

Load an elephas model from a h5 or keras file. Assumes file is located locally by default, but can be toggled to load from a network-connected Hadoop cluster as well.

:param file_name: String, name or full path of the model file to be loaded :param from_hadoop: Boolean, toggles between local or Hadoop cluster file loading, default is False :return: SparkModel or SparkMLlibModel, loaded elephas model