Helping developers
build the future
with data
We're on a mission to free developers from infrastructure sludge.
Software developers are often blocked because the database where some data lives either has incomplete data or the wrong query engine for their needs. This leads them, or more likely their data team, to set up more pipelines and more databases and move a new copy of the data so that an application can query it the way it needs to.
At Optimizely, we computed our billing and stats pipelines in Snowflake and we needed to combine them with data from our operational stores and event streams to deliver interactive billing reports, user notifications, AI-based services, and programmatic data access.
As we prototyped solutions, we found that there was a considerable amount of pipeline setup, database & cache tuning, and API development. Our Node & Python devs then had to write tons of boilerplate and adapt their CI/CD workflow.
Building production apps with data warehouses today is often solved by moving data to the developer’s database. This exposes them to pipeline breakages, unannounced schema changes, and unnecessary infra cost and complexity.
Our goal is to enable developers to leverage any data with production-grade infrastructure, right in their code.
At Optimizely, we computed our billing and stats pipelines in Snowflake and we needed to combine them with data from our operational stores and event streams to deliver interactive billing reports, user notifications, AI-based services, and programmatic data access.
As we prototyped solutions, we found that there was a considerable amount of pipeline setup, database & cache tuning, and API development. Our Node & Python devs then had to write tons of boilerplate and adapt their CI/CD workflow.
Building production apps with data warehouses today is often solved by moving data to the developer’s database. This exposes them to pipeline breakages, unannounced schema changes, and unnecessary infra cost and complexity.
Our goal is to enable developers to leverage any data with production-grade infrastructure, right in their code.
Supported by world-class investors
The power of abstraction
To solve the many organizational and technical challenges related to building data features, we had to identify the right level of abstraction. While engineers need to understand and trust the platform, we aimed to remove complexity from their workflows and stacks. Data packages enable developers to import data access into their code as a library, just like the many tools they work with every day.
Meet the data package manager, better known as dpm.
dpm is the first open protocol for defining, packaging and distributing live datasets as code packages with standard metadata and query interfaces.
