xgboost4j-spark_2.12 1.4.1 API < Back
 

# Packages

-  package root
  Definition Classes
    root
-  package org
  Definition Classes
    root
-  package apache
  Definition Classes
    org
-  package spark
  Definition Classes
    apache
- SparkParallelismTracker
- TaskFailedListener

c

org.apache.spark

# SparkParallelismTracker 

###

#### class SparkParallelismTracker extends AnyRef

A tracker that ensures enough number of executor cores are alive. Throws an exception when the number of alive cores is less than nWorkers.

Linear Supertypes
AnyRef, Any
 
Ordering

1. Alphabetic
2. By Inheritance

Inherited

1. SparkParallelismTracker
2. AnyRef
3. Any

1. Hide All
2. Show All

Visibility

1. Public
2. All

### Instance Constructors

1.  new SparkParallelismTracker(sc: SparkContext, timeout: Long, numWorkers: Int, killSparkContextOnWorkerFailure: Boolean = true)

   sc

     The SparkContext object

   timeout

     The maximum time to wait for enough number of workers.

   numWorkers

     nWorkers used in an XGBoost Job

   killSparkContextOnWorkerFailure

     kill SparkContext or not when task fails

### Value Members

1.  final def !=(arg0: Any): Boolean
   Definition Classes
     AnyRef → Any
2.  final def ##(): Int
   Definition Classes
     AnyRef → Any
3.  final def ==(arg0: Any): Boolean
   Definition Classes
     AnyRef → Any
4.  final def asInstanceOf[T0]: T0
   Definition Classes
     Any
5.  def clone(): AnyRef
   Attributes
     protected[java.lang]
   Definition Classes
     AnyRef
   Annotations
     @native() @throws( ... )
6.  final def eq(arg0: AnyRef): Boolean
   Definition Classes
     AnyRef
7.  def equals(arg0: Any): Boolean
   Definition Classes
     AnyRef → Any
8.  def execute[T](body: ⇒ T): T

   Execute a blocking function call with two checks on enough nWorkers:

   Execute a blocking function call with two checks on enough nWorkers:

   - Before the function starts, wait until there are enough executor cores.
   - During the execution, throws an exception if there is any executor lost.
   T

     Return type

   body

     A blocking function call

   returns

     The return of body

9.  def finalize(): Unit
   Attributes
     protected[java.lang]
   Definition Classes
     AnyRef
   Annotations
     @throws( classOf[java.lang.Throwable] )
10.  final def getClass(): Class[_]
    Definition Classes
      AnyRef → Any
    Annotations
      @native()
11.  def hashCode(): Int
    Definition Classes
      AnyRef → Any
    Annotations
      @native()
12.  final def isInstanceOf[T0]: Boolean
    Definition Classes
      Any
13.  final def ne(arg0: AnyRef): Boolean
    Definition Classes
      AnyRef
14.  final def notify(): Unit
    Definition Classes
      AnyRef
    Annotations
      @native()
15.  final def notifyAll(): Unit
    Definition Classes
      AnyRef
    Annotations
      @native()
16.  val sc: SparkContext
17.  final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
      AnyRef
18.  def toString(): String
    Definition Classes
      AnyRef → Any
19.  final def wait(): Unit
    Definition Classes
      AnyRef
    Annotations
      @throws( ... )
20.  final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
      AnyRef
    Annotations
      @throws( ... )
21.  final def wait(arg0: Long): Unit
    Definition Classes
      AnyRef
    Annotations
      @native() @throws( ... )

### Inherited from AnyRef

### Inherited from Any

### Ungrouped