datachain-ai/datachain: The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure - datachain-ai/datachain
Cloud Infrastructure Service
Summary
S2 is a serverless API that provides unlimited, durable, and real-time data streams by treating logs as first-class web resources. It combines the characteristics of object storage and streaming platforms to offer low-latency appends and strongly consistent, resumable reads.
Highlights
- Provides unlimited, bottomless streams that can be managed at any granularity, such as per user or per session.
- Supports low-latency appends and real-time updates via standard web protocols like REST, SSE, and HTTP/2.
- Offers strongly consistent, resumable reads using sequence numbers, timestamps, or offsets.
- Includes a robust developer toolkit featuring multi-language SDKs, a CLI, and granular access control via tokens.
auto-generated
Context
Audience
Software Engineers, Backend Developers, and Cloud Architects
DomainCloud Data Infrastructure
FormatProduct Website
AccessCloud Service
Source Overview
S2 is a serverless API that provides unlimited, durable, real-time data streams as a cloud storage primitive, allowing append-only logs with low latency and high throughput.
Streams are directly backed by object storage, can be created and managed at arbitrary granularity, and support atomic record ordering, resumable reads, and real-time updates via standard web protocols. Access controls, SDKs for multiple languages, and a CLI are included, and there are no practical limits on number or size of streams.
Topics
Related
Apache KafkaAmazon S3Event SourcingServerless ComputingReal-time Data Pipelines
