← Back to home

Vitalik

Video streaming AI assistant helping you with full world context

Problem Statement

πŸ₯½ Vitalik - Personal Smart Glasses AssistantTransform your smart glasses into an AI-powered shopping assistant that understands what you're looking at and handles cryptocurrency payments with just your voice.🎯 What is Vitalik?Vitalik is a cutting-edge AI shopping assistant designed for the next generation of AR/smart glasses. Simply look at any product, say "Hey Vitalik," and instantly get prices, make purchases, and complete transactions using cryptocurrency - all through natural voice commands.See It. Ask About It. Buy It.No screens. No typing. Just natural conversation.✨ Key FeaturesπŸ‘οΈ Visual IntelligenceReal-time object recognition- Identifies products just by looking at themContext-aware responses- Understands what you're looking at and provides relevant informationMulti-item detection- Can identify multiple products in your field of viewπŸŽ™οΈ Voice-First ExperienceWake word activation- "Hey Vitalik" or "Okay Vitalik" to startNatural language processing- Speak naturally, no rigid commandsAudio-only feedback- Designed for screenless interactionπŸ’° Instant Crypto PaymentsPYUSD on Arbitrum- Lightning-fast stablecoin transactionsFlow blockchain- Support for Flow tokens and NFTsOne-voice checkout- Confirm purchases with a simple "yes"On-chain verification- Every transaction is real and verifiableπŸ” Enterprise-Grade SecurityAuthorized vendors only- Curated list of trusted merchantsVoice confirmation required- No accidental purchasesDuplicate protection- Smart detection prevents double-chargingBlockchain transparency- All transactions on public testnetsπŸš€ Live DemoExperience the future of shopping:Enable camera and microphonewhen promptedSay "Hey Vitalik"to activateShow any productto the camera (try a Coke can, phone charger, or water bottle)Ask about pricing- "What does this cost?"Make a purchase- "I want to buy this"Confirm with voice- Say "yes" to complete the transactionπŸ’‘ Use CasesRetail ShoppingWalk through stores and instantly get product information and prices without pulling out your phone.Vending MachinesLook at items in a vending machine and purchase with voice commands - no physical interaction needed.Museum & Gallery ToursGet information about artifacts and artwork, with optional donation or purchase capabilities.AccessibilityEmpowers visually impaired users with voice-guided shopping and audio confirmations.🌟 VisionWe believe the future of shopping is:Frictionless- No apps, no cards, no checkout linesIntuitive- As natural as asking a friendTransparent- Every transaction on-chainAccessible- Voice-first for everyoneVitalikis more than a shopping assistant - it's a glimpse into a world where technology disappears into the background, leaving only natural human interaction with instant, global, programmable money.

Solution

πŸ› οΈ Technology StackAI Vision: Google Gemini 2.5 Flash for real-time visual analysisBlockchain: Arbitrum Sepolia (PYUSD) & Flow TestnetVoice Processing: WebRTC streaming with live transcriptionENS Integration: L2 optimistic name resolutionFramework: Next.js with ReactπŸ—οΈ Architectureβ”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Smart Glasses │────▢│ Gemini AI │────▢│ Blockchain β”‚ β”‚ Camera + Mic β”‚ β”‚ Vision + Voice β”‚ β”‚ Arbitrum/Flow β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β”‚ β”‚ β”‚ β–Ό β”‚ β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ └─────────────▢│ Voice Output β”‚β—€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ Confirmation β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Hackathon

ETHGlobal New York 2025

2025

Prizes

  • πŸ†

    Flow Builder Pool Prize

    Flow

  • πŸ†

    Best use of L2 Primary Names

    ENS

Contributors