deltaio/delta-sharing-server repository overview

⁠Delta Sharing: An Open Protocol for Secure Data Sharing

Delta Sharing⁠ is an open protocol for secure real-time exchange of large datasets, which enables organizations to share data in real time regardless of which computing platforms they use. It is a simple REST protocol⁠ that securely shares access to part of a cloud dataset and leverages modern cloud storage systems, such as S3, ADLS, or GCS, to reliably transfer data.

With Delta Sharing, a user accessing shared data can directly connect to it through pandas, Tableau, Apache Spark, Rust, or other systems that support the open protocol, without having to deploy a specific compute platform first. Data providers can share a dataset once to reach a broad range of consumers, while consumers can begin using the data in minutes.

This repo provides pre-built docker images for Delta Sharing Server which is a reference implementation server for the Delta Sharing Protocol for development purposes. Users can deploy this server to share existing tables in Delta Lake and Apache Parquet format on modern cloud storage systems.

⁠Config the Delta Sharing Server

Get the config template from the Delta Sharing GitHub repo⁠ and follow its instructions⁠ to config your server.

⁠Start the Delta Sharing Server

Run the following command to start the Delta Sharing Server with your own server config file.

docker run -p <host-port>:<container-port> --mount type=bind,source=<the-server-config-yaml-file>,target=/config/delta-sharing-server-config.yaml deltaio/delta-sharing-server:0.2.0 -- --config /config/delta-sharing-server-config.yaml

Note that <container-port> should be the same as the port defined inside the config file. See