Dants

Screenshots

Problem Statement

This project creates the infrastructure to allow data engineers and data science to collaborate on finding insights into the data while monetizing and reusing their job. Data engineers can automate the data feeding from the graph, create ETLs in a no-code way and store this data in LightHouse as a data lake, then this data can be transformed by executing compute to data over the data, and used as input to other pipelines where the data analysts can find insights,

Solution

We have created two connectors on airbyte protocol to automate the data extraction from The graph and write them to LightHouse, which is encrypted and stored in Filecoin. This allows the creation, access control, and monetization of the data, where only those who pay the access can reuse the pipelines. Data is transformed using compute to data, leveraging bacalhau technology to execute the jobs directly on the network. To create a Dapp and a marketplace where Data DAOs can send requests we have deployed the front using Spheron Network.