transforms.api.ComputeBackend

class transforms.api.ComputeBackend(*values)

Enum class for representing the different compute backends for use in configure().

The following are available backends:

• SPARK
• VELOX

VELOX will run Spark with native acceleration. See Native Acceleration ↗ for more information.

Example

Copied!
1
2
3
4
>>> @configure(backend=ComputeBackend.SPARK)
... @transform(...)
... def my_compute_function(...):
...     pass