2.11.1
Polars
Directory
Classes
| Class | Description |
|---|---|
ParquetToPolarsDecodingHandler |
|
ParquetToPolarsLazyFrameDecodingHandler |
|
PolarsLazyFrameToParquetEncodingHandler |
|
PolarsToParquetEncodingHandler |
Methods
| Method | Description |
|---|---|
get_polars_storage_options() |
Get storage options in a format compatible with Polars. |
register_polars_df_transformers() |
Register Polars DataFrame encoders and decoders with the DataFrameTransformerEngine. |
Variables
| Property | Type | Description |
|---|---|---|
PARQUET |
str |
Methods
get_polars_storage_options()
def get_polars_storage_options(
protocol: typing.Optional[str],
anonymous: bool = False,
) -> typing.Dict[str, str]Get storage options in a format compatible with Polars.
Polars requires storage_options to be a flat dict with string keys and values, unlike fsspec which accepts nested dicts and complex objects.
| Parameter | Type | Description |
|---|---|---|
protocol |
typing.Optional[str] |
|
anonymous |
bool |
register_polars_df_transformers()
def register_polars_df_transformers()Register Polars DataFrame encoders and decoders with the DataFrameTransformerEngine.
This function is called automatically via the flyte.plugins.types entry point when flyte.init() is called with load_plugin_type_transformers=True (the default).