edu.stanford.nlp.tmt.learn

ThreadedModeler

class ThreadedModeler [ModelParams, Model, ModelState, DatumParams, Datum, DatumState] extends Modeler[ModelParams, Model, ModelState, DatumParams, Datum, DatumState]

Runs data parallel models as multiple threads on a single machine.

go to: companion
linear super types: Modeler[ModelParams, Model, ModelState, DatumParams, Datum, DatumState], AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Hide All
  2. Show all
  1. ThreadedModeler
  2. Modeler
  3. AnyRef
  4. Any
Visibility
  1. Public
  2. All
Impl.
  1. Concrete
  2. Abstract

Instance constructors

  1. new ThreadedModeler (companion: DataParallelModelCompanion[ModelParams, Model, ModelState, DatumParams, Datum, DatumState], numShards: Int =)

Value Members

  1. def != (arg0: AnyRef) : Boolean

    attributes: final
    definition classes: AnyRef
  2. def != (arg0: Any) : Boolean

    o != arg0 is the same as !(o == (arg0)).

    o != arg0 is the same as !(o == (arg0)).

    arg0

    the object to compare against this object for dis-equality.

    returns

    false if the receiver object is equivalent to the argument; true otherwise.

    attributes: final
    definition classes: Any
  3. def ## () : Int

    attributes: final
    definition classes: AnyRef → Any
  4. def $asInstanceOf [T0] () : T0

    attributes: final
    definition classes: AnyRef
  5. def $isInstanceOf [T0] () : Boolean

    attributes: final
    definition classes: AnyRef
  6. def == (arg0: AnyRef) : Boolean

    o == arg0 is the same as if (o eq null) arg0 eq null else o.equals(arg0).

    o == arg0 is the same as if (o eq null) arg0 eq null else o.equals(arg0).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    attributes: final
    definition classes: AnyRef
  7. def == (arg0: Any) : Boolean

    o == arg0 is the same as o.equals(arg0).

    o == arg0 is the same as o.equals(arg0).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    attributes: final
    definition classes: Any
  8. def addData (dps: Iterable[DatumParams]) : Unit

    Adds the given data items.

    Adds the given data items.

    definition classes: ThreadedModelerModeler
  9. def asInstanceOf [T0] : T0

    This method is used to cast the receiver object to be of type T0.

    This method is used to cast the receiver object to be of type T0.

    Note that the success of a cast at runtime is modulo Scala's erasure semantics. Therefore the expression1.asInstanceOf[String] will throw a ClassCastException at runtime, while the expressionList(1).asInstanceOf[List[String]] will not. In the latter example, because the type argument is erased as part of compilation it is not possible to check whether the contents of the list are of the requested typed.

    returns

    the receiver object.

    attributes: final
    definition classes: Any
  10. def clearData () : Unit

    Clears all data items.

    Clears all data items.

    definition classes: ThreadedModelerModeler
  11. def clearDataState () : Unit

    Clears the state of all data items (but does not remove them).

    Clears the state of all data items (but does not remove them).

    definition classes: ThreadedModelerModeler
  12. def clearModelState () : Unit

    Clears the model state (re-initializes).

    Clears the model state (re-initializes).

    definition classes: ThreadedModelerModeler
  13. def clone () : AnyRef

    This method creates and returns a copy of the receiver object.

    This method creates and returns a copy of the receiver object.

    The default implementation of the clone method is platform dependent.

    returns

    a copy of the receiver object.

    attributes: protected
    definition classes: AnyRef
  14. val companion : DataParallelModelCompanion[ModelParams, Model, ModelState, DatumParams, Datum, DatumState]

    Model companion used by this modeler.

    Model companion used by this modeler.

    definition classes: ThreadedModelerModeler
  15. def data : Sharded[Datum]

    Sharded view of data.

    Sharded view of data. ListBuffer's toList does not make a copy.

  16. def description : String

    Description of the model being trained.

    Description of the model being trained.

    definition classes: ThreadedModelerModeler
  17. def eq (arg0: AnyRef) : Boolean

    This method is used to test whether the argument (arg0) is a reference to the receiver object (this).

    This method is used to test whether the argument (arg0) is a reference to the receiver object (this).

    The eq method implements an [http://en.wikipedia.org/wiki/Equivalence_relation equivalence relation] on non-null instances of AnyRef: * It is reflexive: for any non-null instance x of type AnyRef, x.eq(x) returns true. * It is symmetric: for any non-null instances x and y of type AnyRef, x.eq(y) returns true if and only if y.eq(x) returns true. * It is transitive: for any non-null instances x, y, and z of type AnyRef if x.eq(y) returns true and y.eq(z) returns true, then x.eq(z) returns true.

    Additionally, the eq method has three other properties. * It is consistent: for any non-null instances x and y of type AnyRef, multiple invocations of x.eq(y) consistently returns true or consistently returns false. * For any non-null instance x of type AnyRef, x.eq(null) and null.eq(x) returns false. * null.eq(null) returns true.

    When overriding the equals or hashCode methods, it is important to ensure that their behavior is consistent with reference equality. Therefore, if two objects are references to each other (o1 eq o2), they should be equal to each other (o1 == o2) and they should hash to the same value (o1.hashCode == o2.hashCode).

    arg0

    the object to compare against this object for reference equality.

    returns

    true if the argument is a reference to the receiver object; false otherwise.

    attributes: final
    definition classes: AnyRef
  18. def equals (arg0: Any) : Boolean

    This method is used to compare the receiver object (this) with the argument object (arg0) for equivalence.

    This method is used to compare the receiver object (this) with the argument object (arg0) for equivalence.

    The default implementations of this method is an [http://en.wikipedia.org/wiki/Equivalence_relation equivalence relation]: * It is reflexive: for any instance x of type Any, x.equals(x) should return true. * It is symmetric: for any instances x and y of type Any, x.equals(y) should return true if and only if y.equals(x) returns true. * It is transitive: for any instances x, y, and z of type AnyRef if x.equals(y) returns true and y.equals(z) returns true, then x.equals(z) should return true.

    If you override this method, you should verify that your implementation remains an equivalence relation. Additionally, when overriding this method it is often necessary to override hashCode to ensure that objects that are "equal" (o1.equals(o2) returns true) hash to the same scala.Int (o1.hashCode.equals(o2.hashCode)).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    definition classes: AnyRef → Any
  19. def finalize () : Unit

    This method is called by the garbage collector on the receiver object when garbage collection determines that there are no more references to the object.

    This method is called by the garbage collector on the receiver object when garbage collection determines that there are no more references to the object.

    The details of when and if the finalize method are invoked, as well as the interaction between finalizeand non-local returns and exceptions, are all platform dependent.

    attributes: protected
    definition classes: AnyRef
  20. implicit val ft : FutureTaskRunner

    attributes: protected implicit
  21. def getClass () : java.lang.Class[_]

    Returns a representation that corresponds to the dynamic class of the receiver object.

    Returns a representation that corresponds to the dynamic class of the receiver object.

    The nature of the representation is platform dependent.

    returns

    a representation that corresponds to the dynamic class of the receiver object.

    attributes: final
    definition classes: AnyRef
  22. def getData : Sharded[Datum]

    Returns all data items.

    Returns all data items.

    definition classes: ThreadedModelerModeler
  23. def getDataSize () : Int

    Returns the number of data items available.

    Returns the number of data items available.

    definition classes: ThreadedModelerModeler
  24. def getDataState () : LazyIterable[DatumState]

    Returns the state of all data items.

    Returns the state of all data items.

    definition classes: ThreadedModelerModeler
  25. def getModelParams () : ModelParams

    definition classes: ThreadedModelerModeler
  26. def getModelState () : ModelState

    Gets the current model state.

    Gets the current model state.

    definition classes: ThreadedModelerModeler
  27. def hashCode () : Int

    Returns a hash code value for the object.

    Returns a hash code value for the object.

    The default hashing algorithm is platform dependent.

    Note that it is allowed for two objects to have identical hash codes (o1.hashCode.equals(o2.hashCode)) yet not be equal (o1.equals(o2) returns false). A degenerate implementation could always return 0. However, it is required that if two objects are equal (o1.equals(o2) returns true) that they have identical hash codes (o1.hashCode.equals(o2.hashCode)). Therefore, when overriding this method, be sure to verify that the behavior is consistent with the equals method.

    returns

    the hash code value for the object.

    definition classes: AnyRef → Any
  28. def initialize (mp: ModelParams) : Unit

    Clears all documents and begins using the given model.

    Clears all documents and begins using the given model.

    definition classes: ThreadedModelerModeler
  29. def isInstanceOf [T0] : Boolean

    This method is used to test whether the dynamic type of the receiver object is T0.

    This method is used to test whether the dynamic type of the receiver object is T0.

    Note that the test result of the test is modulo Scala's erasure semantics. Therefore the expression1.isInstanceOf[String] will return false, while the expression List(1).isInstanceOf[List[String]] will return true. In the latter example, because the type argument is erased as part of compilation it is not possible to check whether the contents of the list are of the requested typed.

    returns

    true if the receiver object is an instance of erasure of type T0; false otherwise.

    attributes: final
    definition classes: Any
  30. def learnIteration () : Unit

    Does one iteration of learning.

    Does one iteration of learning.

    definition classes: ThreadedModelerModeler
  31. val lists : List[ListBuffer[Datum]]

    The shards that will contain the data.

    The shards that will contain the data.

  32. def model : Option[Model]

    Returns the current model, if one has been initialized.

    Returns the current model, if one has been initialized.

    definition classes: ThreadedModelerModeler
  33. var models : IndexedSeq[Model]

    Each model is created independently.

    Each model is created independently.

  34. def ne (arg0: AnyRef) : Boolean

    o.ne(arg0) is the same as !(o.eq(arg0)).

    o.ne(arg0) is the same as !(o.eq(arg0)).

    arg0

    the object to compare against this object for reference dis-equality.

    returns

    false if the argument is not a reference to the receiver object; true otherwise.

    attributes: final
    definition classes: AnyRef
  35. def notify () : Unit

    Wakes up a single thread that is waiting on the receiver object's monitor.

    Wakes up a single thread that is waiting on the receiver object's monitor.

    attributes: final
    definition classes: AnyRef
  36. def notifyAll () : Unit

    Wakes up all threads that are waiting on the receiver object's monitor.

    Wakes up all threads that are waiting on the receiver object's monitor.

    attributes: final
    definition classes: AnyRef
  37. def synchronized [T0] (arg0: T0) : T0

    attributes: final
    definition classes: AnyRef
  38. def toString () : String

    Returns a string representation of the object.

    Returns a string representation of the object.

    The default representation is platform dependent.

    returns

    a string representation of the object.

    definition classes: AnyRef → Any
  39. def train (mp: ModelParams, data: Iterable[DatumParams], output: File =null, saveDataState: Boolean =true, maxIterations: Int =-1, outputIterations: Option[Int] = ...)(implicit msrw: ReadWritable[ModelState], mprw: ReadWritable[ModelParams], dr: TableRowReadable[DatumState], dw: TableRowWritable[DatumState]) : Unit

    Train the model on the given data.

    Train the model on the given data.

    definition classes: Modeler
  40. def useDataState (dss: Iterable[DatumState]) : Unit

    Uses the given data state.

    Uses the given data state.

    definition classes: ThreadedModelerModeler
  41. def useModelState (ms: ModelState) : Unit

    Uses the given ModelState in the current model.

    Uses the given ModelState in the current model.

    definition classes: ThreadedModelerModeler
  42. def wait () : Unit

    attributes: final
    definition classes: AnyRef
  43. def wait (arg0: Long, arg1: Int) : Unit

    attributes: final
    definition classes: AnyRef
  44. def wait (arg0: Long) : Unit

    attributes: final
    definition classes: AnyRef

Inherited from Modeler[ModelParams, Model, ModelState, DatumParams, Datum, DatumState]

Inherited from AnyRef

Inherited from Any