FileDAG

Problem Statement

FileDAG is a decentralized storage solution based on IPFS. It will provide high-quality and efficient IPFS Pin Service and customized network service based on customer requirements. An easy-to-use front-end user interface and a more developer-friendly API service will minimize the technical thresholds and make IPFS usable. The SDK will be available in the near future.FileDAG can be regarded as one of the necessary technical components for the Filecoin retrieval market, and a part of the storage infrastructure for Web 3.0. Every file pined by FileDAG could be stored as a backup onto Filecoin through Web3.Storage, at the user's discretion.Go-Datastore-Cluster is one of the most significant parts of FileDAG, which aims to gather FileDAG’s distributed key-value datastores into a cluster, to increase the function of data split, and improve the management of data in key-value datastores. It’s the storage layer of FileDAG.In particular scenarios, the user wants to store a large amount of data on IPFS and backup a few copies on Filecoin. At this point, Go-Graphsplit, as a component of FileDAG, could be the right tool used for splitting large datasets into graph slices fit for making deals on the Filecoin network, which will streamline data retrieval.

Solution

FileDAG:IPFS for data sharingGin for API frameworkPostgreSQL for service data storageGRPC for internal service communicationDatastore-Cluster:Hash Slots for data shardingLibp2p for data and information sharingCRDT for the consensus modelGraphsplit:IPLD for build or split file directory tree