ETHGlobal Explorer

Problem Statement

hETHGlobal project showcase page with filters so you can easily find past Finalists and bounty winners. Features 14,500+ projects from 50+ events. There have been 300+ prize sponsors!Use the search bar or the events/prizes/tags filters to find a specific project.

Solution

Scraping Scripts → JSON Data → Upload Scripts → Supabase DB → API Routes → Next.js FrontendBackend Data PipelinePython scripts using Selenium (Chrome WebDriver) + BeautifulSoup4 for web scrapingSelenium handles dynamic JavaScript content and page navigation on ETHGlobal showcase pagesBeautifulSoup parses HTML to extract project data (titles, descriptions, prize URLs, events)Supabase-py library for database operationsData flow: Selenium scraping → JSON files → Upload scripts → Supabase tablesFrontendNext.js (React) web application with TypeScriptTailwind CSS for stylingAPI routes that query SupabaseClient-side filtering using constants