Skip to content

kedro_datasets_experimental

kedro_datasets_experimental

Dataset Classes

Name Description
databricks.ExternalTableDataset ExternalTableDataset implementation to access external tables in Databricks.
langchain.ChatAnthropicDataset ChatAnthropicDataset loads a ChatAnthropic langchain model.
langchain.ChatCohereDataset ChatCohereDataset loads a ChatCohere langchain model.
langchain.ChatOpenAIDataset OpenAI dataset used to access credentials at runtime.
langchain.OpenAIEmbeddingsDataset OpenAIEmbeddingsDataset loads a OpenAIEmbeddings langchain model.
netcdf.NetCDFDataset NetCDFDataset loads/saves data from/to a NetCDF file using an underlying filesystem (e.g.: local, S3, GCS). It uses xarray to handle the NetCDF file.
prophet.ProphetModelDataset ProphetModelDataset loads/saves Facebook Prophet models to a JSON file using an underlying filesystem (e.g., local, S3, GCS). It uses Prophet's built-in serialisation to handle the JSON file.
pytorch.PyTorchDataset PyTorchDataset loads and saves PyTorch models' state_dict using PyTorch's recommended zipfile serialization protocol. To avoid security issues with Pickle.
rioxarray.GeoTIFFDataset Loads and saves raster data files as xarray DataArrays. Supports single and multiband GeoTIFFs with CRS validation.
safetensors.SafetensorsDataset Loads and saves data using the SafeTensors library with support for multiple backends like numpy and torch.
video.VideoDataset Loads and saves video data as a sequence of images using OpenCV, supporting various codecs and formats.