2.0.0b57

flyteplugins.polars.df_transformer

Directory

Classes

Class Description
ParquetToPolarsDecodingHandler
ParquetToPolarsLazyFrameDecodingHandler
PolarsLazyFrameToParquetEncodingHandler
PolarsToParquetEncodingHandler

Methods

Method Description
get_polars_storage_options() Get storage options in a format compatible with Polars.

Variables

Property Type Description
PARQUET str

Methods

get_polars_storage_options()

def get_polars_storage_options(
    protocol: typing.Optional[str],
    anonymous: bool,
) -> typing.Dict[str, str]

Get storage options in a format compatible with Polars.

Polars requires storage_options to be a flat dict with string keys and values, unlike fsspec which accepts nested dicts and complex objects.

Parameter Type Description
protocol typing.Optional[str]
anonymous bool