ZenPass

Problem Statement

ZenPass is a next-generation POAP (Proof of Attendance Protocol) platform that transforms event participation into a dynamic, interactive digital experience. By combining geo-fencing, augmented reality (AR), AI-Agent powered booth recognition, and multi-chain support via NodIt, CCIP/Chainlink, ZenPass enables attendees to collect unique, branded POAPs that serve as verifiable proof of their participation—minted on the ideal blockchain network based on the intent.

Solution

ZenPassis a full-stack, geo-fenced, AR-powered, multichain POAP platform designed for real-world event engagement. It bridges Web3, AI, and immersive experiences by combining various bleeding-edge tools and protocols.🔧 Core Tech StackFrontend:Built usingReact,TailwindCSS, andTypeScriptfor responsive, strongly-typed UI components. We also useReact FibreandThree.jsto render dynamic AR overlays in the browser.AI Booth Recognition:The camera captures booth banners which are sent to a lightweight vision model hosted viaReplicate(or local fallback inference). The model identifies which booth the user is facing (e.g., “Nodit”, “Polygon” or "World-Coin").Geo-Fencing:Browser-based Geolocation API ensures the user is within the defined event zone before proceeding with any interaction. We use GPS radius checks around event coordinates.Stylized Image Generation for Social Sharing:Post-interaction, we pass the booth snapshot through a style transfer pipeline (e.g., Ghibli or pixel-art GAN). The output is cached and offered as a shareable image, ideal for socials.🌉 Smart Contract + Blockchain InfraSource Chain (Mint Trigger):A smart contract is deployed onBase Sepolia. Once AI + geo verification is done, the mint function is triggered here.Ai MultiChain POAP Minting using Intents:Chainlink CCIPhandles the secure routing of mint instructions to the appropriate destination chain (e.g., Polygon). This ensures that POAPs are minted natively on the brand’s chain of choice.POAP Contracts:These live on the target chain and handle minting of NFTs that include:Booth identifierGeo-coordinatesStylized image (stored via IPFS)🔔 Nodit Protocol IntegrationWebhook Notifications:We integrateNodit Webhooksto notify users in real-time when their POAP mint is successful—this includes toast messages and push notifications.Web3 Data APIs:Nodit’s APIs power the user dashboard, showing a list of collected POAPs including metadata (location, style, event name). This enables a dynamic profile experience.🧪 Hacky But CoolWe used abase64-encoded visual classifierprompt to switch between on-device and cloud AI recognition, reducing latency while retaining flexibility.All validations (AR + Geo + AI) are performedoff-chain, and only the validated payload is submitted on-chain—cutting gas costs and failures.The image stylizer uses acascaded two-model pipeline(scene simplifier → pixel-art / Ghibli style) to generate ready-to-share art in ~2-3s.🤝 Partner Tech BenefitsMultiChain with Polygon: Abstracted away cross-chain logic, allowing us to focus on UX without sacrificing decentralization.Nodit Protocol: Supercharged notifications and data sync. No need to roll our own infra for real-time alerts or historical POAP tracking.World ID Integration: Used at the app level asproof of personhood, ensuring that only unique human users can mint POAPs. This added a Sybil-resistant layer of trust to our AR-based, real-world engagement flow.