The Video Signal

Topic

Edge Computing

All digests tagged Edge Computing

One Operator, Many Drones: Inside Skydio's Autonomy Stack — Suchet Bargoti, Skydio thumbnail

· 20:48

One Operator, Many Drones: Inside Skydio's Autonomy Stack — Suchet Bargoti, Skydio

Skydio presented its full-stack autonomy solution, demonstrating how drones are evolving from hobbyist tools into critical infrastructure. The system enables large-scale, multi-agent orchestration, allowing a single operator to manage multiple drones performing diverse tasks (e.g., utility inspection, tracking stolen vehicles) across different geographical locations simultaneously. The core technical advancements involve splitting intelligence between the edge (on-drone actions) and the cloud (long-term planning, heavy lifting), utilizing World Models for global path planning, and employing Visual Language Models (VLMs) for agentic, rule-free object tracking and semantic reasoning.

Key takeaways

  1. Drones as Infrastructure 2:00

    Skydio is positioning its drones as critical infrastructure, with thousands of docks deployed across utilities, public safety, and construction sectors. This allows for continuous, reliable operation (day/night, rain/sunshine) and scales beyond the limitations of requiring a dedicated pilot for every incident.

  2. Full-Stack Autonomy Architecture 18:50

    The autonomy stack splits intelligence between the edge (for immediate actions) and the cloud (for heavy lifting and long-term planning). This architecture is designed to maintain high reliability (targeting 99.9999%) while managing vast amounts of data and complex decision-making.

  3. Agentic Orchestration

    The system moves beyond hand-coded rules by using agentic tools. A VLM can receive a high-level command (e.g., 'find a white Jeep') and autonomously access APIs and tools to command a drone's trajectory, enabling 'find and follow' without specific coding for every scenario.

Watch on YouTube Full article

A Worm With 302 Neurons Inspired Their Architecture — Ramin Hasani, Liquid AI thumbnail

· 1:09:52

A Worm With 302 Neurons Inspired Their Architecture — Ramin Hasani, Liquid AI

Liquid AI presents a comprehensive view of the next generation of AI architectures, moving beyond pure Transformer models. Their approach is inspired by biological systems, specifically the continuous-time dynamics of worms, leading to the development of Liquid Neural Networks (LNNs). The company emphasizes a 'meta AI' system that systematically searches for hybrid, hardware-aware architectures (e.g., combining convolutions, attention, and LNN elements) to achieve high quality while minimizing memory and latency. A major focus is enabling reliable, high-intelligence deployment at the edge (on-device, in cars, and on laptops), addressing critical needs for privacy, cost efficiency, and air-gapped capabilities.

Key takeaways

  1. Biological Inspiration and Continuous Dynamics 1:55

    Liquid AI's foundational research is inspired by the worm's nervous system, which uses simple first-order differential equations. This leads to Liquid Neural Networks (LNNs), which are continuous-time, differentiable systems, allowing for backpropagation and learning while maintaining biological fidelity. (01:15-02:00)

  2. Architectural Search for Efficiency 4:20

    Instead of committing to a single architecture, Liquid uses a meta AI system to search for optimal hybrid architectures. This search optimizes four criteria: no sacrifice on quality, minimizing memory consumption, minimizing latency, and maximizing computation speed, making the models hardware-aware. (04:20-05:30)

  3. Edge and On-Device Intelligence 8:20

    The company is focused on bringing high-quality intelligence outside of data centers (e.g., cars, laptops, mobile devices). This is driven by cost considerations and the need for enhanced privacy, enabling local, air-gapped capabilities. (08:20-09:30)

  4. The Future of AI: Multimodality and Adaptability 12:40

    Future research focuses on massively multimodal systems (audio, vision, text, DNA) and achieving 'adaptive intelligence'—systems that can combine forward and backward passes simultaneously, moving beyond static training paradigms. (12:40-13:30)

Watch on YouTube Full article

Seattle Spark Hack Winners Livestream Spotlight: LiveKit & Memo thumbnail

· 42:28

Seattle Spark Hack Winners Livestream Spotlight: LiveKit & Memo

This summary covers the NVIDIA DGX Spark Hack winners spotlight, featuring two local AI applications: LifeKit, an offline survival companion, and Memo, a local-first wearable assistant. Both projects demonstrate the capability of running complex, multi-modal AI workflows—including vision, speech, and retrieval—on edge devices like the Acer Veriton GN100. The core technical focus is on achieving reliable, low-latency AI functionality without constant internet connectivity, utilizing advanced NVIDIA models like Neotron and Cosmos.

Key takeaways

  1. Offline AI Capability (LifeKit) 20:00

    LifeKit addresses the critical need for stable information access when internet connectivity fails. It uses local AI and Retrieval Augmented Generation (RAG) against extensive, downloadable knowledge bases (e.g., Wikipedia) to provide guidance on survival topics (first aid, navigation) without relying on external servers.

  2. Selective Memory and Privacy (Memo) 27:30

    Memo is a wearable assistant designed for elderly care, focusing on privacy by only tracking objects explicitly chosen by the user (e.g., keys, wallet). It uses visual evidence and confirmation to save location data, ensuring that the system does not record or store general video feeds.

  3. Concurrent Model Orchestration 22:30

    Both projects rely on running multiple NVIDIA models concurrently (e.g., Neotron, Cosmos, Parakeet, VSSs, NIM, VLM) on the GN100. The primary architectural challenge is orchestrating these disparate tools—from speech transcription to reasoning—into a single, reliable, and deterministic application.

Watch on YouTube Full article

Seattle DGX Spark Hackathon Winners Spotlight thumbnail

· 40:58

Seattle DGX Spark Hackathon Winners Spotlight

This summary covers the NVIDIA DGX Spark Hackathon winners, spotlighting two advanced local AI applications: Kerberos, a shared spatial-awareness system for search-and-rescue (SAR) teams, and VELA, a voice-first, consent-controlled healthcare action system. Both projects demonstrate the power of running complex, multi-agent AI workflows entirely on local hardware (NVIDIA GB10), ensuring data privacy and real-time action capability.

Key takeaways

  1. Local AI for Privacy and Reliability 22:40

    Both winning systems (Kerberos and VELA) are designed to run entirely on the NVIDIA GB10, ensuring that sensitive data (e.g., medical records, live camera feeds) remains local and is not transmitted to the cloud, addressing critical security concerns in healthcare and SAR.

  2. Agentic Workflows for Complex Tasks 25:40

    The projects utilize multi-agent architectures (e.g., VELA's system) where specialized agents (like Parakeet for speech recognition, Neatron for reasoning, and Magpie for speech output) collaborate to perform complex, multi-step tasks, moving beyond simple chatbots to actionable outcomes.

  3. Shared Situational Awareness in SAR 3:40

    Kerberos creates a shared live map for SAR, integrating data from multiple sources (drones, robots, body cameras) to track responders, map searched areas, and pinpoint casualties or hazards, even indoors where GPS fails.

Watch on YouTube Full article

Tell the Robot What You Want — Sandhya Subramani, AWS thumbnail

· 17:23

Tell the Robot What You Want — Sandhya Subramani, AWS

The presentation demonstrates 'Scout,' a rover running on a Raspberry Pi, that has been upgraded from a traditionally programmed robot into an agentic system using AWS's open-source framework, `strands`. This architecture allows the robot to understand and execute complex commands in natural language (e.g., counting people or responding to arbitrary prompts) by having an AI agent orchestrate calls to existing hardware policies/tools. The system utilizes a multi-agent setup (thinker, communication, voice) and operates on a hybrid cloud/edge model for both training (VLA models) and fast runtime execution.

Key takeaways

  1. Agentic Robotics Architecture 2:07

    By implementing an agent layer above existing movement policies, the robot can perform tasks it was never explicitly trained for. The agent decides *what* to do, while the policy determines *how* to execute the action.

  2. Multi-Agent System Design 5:46

    Scout runs three simultaneous agents: a thinker (constantly assessing the environment), a communication agent (via Telegram/web app), and an optional voice agent, allowing for complex, concurrent decision-making.

  3. Hybrid Cloud/Edge Deployment 11:57

    The system is designed to operate on a hybrid model: training (VLA models) occurs in the cloud using `agentcore`, while execution and policy calls happen rapidly at the edge (on the robot's local hardware).

Watch on YouTube Full article

Agentic Sites: Building Hyper Personalized Websites — Carlos Sanchez, Adobe thumbnail

· 20:43

Agentic Sites: Building Hyper Personalized Websites — Carlos Sanchez, Adobe

The presentation details 'Agentic Sites,' a system for building hyper-personalized websites that adapts content in real time based on user intent and browsing behavior. Instead of generating entire pages, the architecture focuses on customizing specific content blocks (e.g., hero sections, product lists) while grounding all generated content within the site's existing corpus to maintain strict brand guidelines. Key technical advancements include continuous model evaluation across multiple providers for both accuracy and speed, achieving impressive generation latencies as low as 1.1 seconds.

Key takeaways

  1. Hyper-Personalization (Audience of One)

    The goal is to personalize pages in real time based on the user's intent or actions, moving beyond one-size-fits-all web experiences. This drives higher engagement and conversions.

  2. Block-Level Personalization 3:40

    Personalization occurs at the block level (e.g., hero card, product list) rather than generating entire pages, which is crucial for adhering to strict brand guidelines and preventing hallucinations.

  3. Speed is Critical for Conversion 10:58

    The system emphasizes speed, noting that a page generation time of 1.1 seconds was significantly faster than the runner-up's 4.6 seconds, demonstrating that low latency is critical to user experience and conversion rates.

Watch on YouTube Full article

IBM’s cloud collab, Meta’s Muse Glimmer & OpenAI’s upcoming Astra model thumbnail

· 36:33

IBM’s cloud collab, Meta’s Muse Glimmer & OpenAI’s upcoming Astra model

The discussion covers major shifts in AI infrastructure and model deployment. IBM is partnering with Together AI to build a massive inference cluster on IBM Cloud using NVIDIA's B300 generation chips for open-source models (expected early 2027). Meta released Muse Glimmer, an open, 30B-parameter dense model designed to run locally on consumer GPUs. Finally, OpenAI discussed its upcoming Astra model, which may achieve 'Critical' cybersecurity capabilities, raising significant concerns about zero-day exploit potential and the need for robust security guardrails.

Key takeaways

  1. IBM Cloud AI Cluster Partnership 1:15

    IBM is teaming up with Together AI to launch an inference cluster on IBM Cloud utilizing NVIDIA's B300 generation chips. This aims to provide cheaper, faster access to open-source AI models for enterprises (1:03).

  2. Meta Muse Glimmer Release 11:29

    Meta open-sourced Muse Glimmer, a 30B-parameter dense model optimized to run locally on consumer GPUs (e.g., Mac M3). It is designed for agentic tasks and tool calling without requiring cloud access (11:43).

  3. OpenAI Astra Model Capabilities 22:36

    OpenAI's upcoming Astra model may achieve 'Critical' cybersecurity capability levels, potentially allowing it to find and exploit zero-days. This raises concerns about the speed and scale of cyber warfare using AI (24:10).

Watch on YouTube Full article

Local Models: Trust, Control, Optimization — Carter Abdallah, NVIDIA thumbnail

· 43:21

Local Models: Trust, Control, Optimization — Carter Abdallah, NVIDIA

The panel emphasized that for AI systems to achieve true sovereignty and trust, the ecosystem must be open—encompassing not just models but the entire training stack. Open weights allow users to own their data traces and customize models (e.g., Neotron, Trinity) via post-training environments, enabling specialized performance far exceeding generalized frontier closed APIs. The future points toward local/on-device compute becoming viable for most daily tasks, shifting AI development from relying solely on massive cloud endpoints.

Key takeaways

  1. Open Models Ensure Trust and Sovereignty 17:32

    Trust in open models is derived from verifiability: users can inspect the files, matrices, and running code (e.g., implementations from Prime Intellect, VLM, SGLang) rather than relying on unverifiable closed APIs. The ability to run a model locally ensures predictable output regardless of geopolitical or corporate access changes.

  2. Specialization Outperforms Generalization 22:00

    Open models allow for deep customization and post-training on specific use cases (e.g., finance automation). This specialization can yield better performance than generalized frontier models while being significantly cheaper to operate, enabling a data flywheel by allowing users to own their output traces.

  3. Local Compute is the Next Inflection Point 40:01

    The industry is moving toward local AI capability. The panel predicts that within the next year, open models will achieve capabilities comparable to frontier closed models (e.g., better than Fable), making it possible for most daily tasks to run on personal devices.

Watch on YouTube Full article

Compression at the Edge — Chris Alexiuk, NVIDIA thumbnail

· 46:01

Compression at the Edge — Chris Alexiuk, NVIDIA

This panel discusses model compression techniques—primarily quantization—that enable running massive Large Language Models (LLMs) on resource-constrained edge devices. Key advancements include formats like NVFP4 and the ability to shrink models dramatically (e.g., GLM 5.2 from 1.5 TB to 250 GB). The discussion emphasizes that successful compression requires understanding model architecture, using advanced methods like Quantization Aware Distillation (QAD), and prioritizing evaluation metrics such as KL divergence over simple accuracy scores.

Key takeaways

  1. Model Compression is Critical for Edge AI

    Compression techniques are essential to democratize LLMs, making them viable for local deployment on consumer hardware (e.g., laptops/phones). The goal is enabling powerful models to run without constant reliance on cloud APIs.

  2. Advanced Quantization Formats and Techniques 0:04

    NVIDIA's NVFP4 is a specialized 4-bit float format where every group of 16 values shares one FP8 scale. For large models (>20B parameters), Post-Training Quantization (PTQ) works well, while smaller models (<20B) require Quantization Aware Distillation (QAD).

  3. Evaluation Focus Shifts to Logits and Architecture 0:08

    Verifying model integrity after compression is complex. The Super Weights paper suggests that quantizing even one number can degrade performance by 20%. Therefore, the preferred signal for evaluation is KL divergence between BF16 and quantized output logits, rather than traditional accuracy scores.

Watch on YouTube Full article

Leopold Aschenbrenner's Warning Signal Apple Completely Missed thumbnail

· 12:15

Leopold Aschenbrenner's Warning Signal Apple Completely Missed

The video analyzes two contrasting investment strategies for Artificial Intelligence: Leopold Aschenbrenner's highly leveraged 'Situational Awareness' thesis and Apple's long-term hardware approach. The discussion highlights how external financial pressures (like Federal Reserve rate calls) can impact high-leverage AI bets, while simultaneously emphasizing that Apple's focus on chips designed for local inference provides a strong, multi-decade competitive advantage in the AI race.

Key takeaways

  1. Aschenbrenner's Thesis and Leverage Risk

    Leopold Aschenbrenner built his success on a thesis of predicting AI investments by reasoning back from compute requirements. His high returns were amplified by leverage, leading to significant pressure when the market faced volatility (e.g., after SK Hynix IPO).

  2. Citadel's Market Intervention 8:27

    Following AI trade pressure and a note predicting Federal Reserve rate hikes (which makes volatile assets less attractive), Citadel Capital stepped in to buy out Aschenbrenner’s entire public equities book, allowing them to enter the AI trade at a discount.

  3. Apple's Hardware Advantage 10:49

    Unlike short-term investment plays, Apple's strategy is focused on 20-30 year hardware longevity. Their chips are optimized for local inference (running AI models directly on the device), positioning them as a default winner regardless of which large model or open-source framework dominates.

Watch on YouTube Full article

Build Small Winners Reveal thumbnail

· 53:45

Build Small Winners Reveal

The Build Small Hackathon winners reveal celebrated projects that emphasize building highly functional applications using small, efficient models and local/on-device processing. The community demonstrated a strong focus on 'local first' AI solutions, achieving impressive metrics like 64% of apps running fully offline. Winning projects showcased practical utility—such as scam defense (Jawbreaker) or specialized coaching (Posify)—proving that powerful, real-world impact can be achieved with tiny model footprints.

Key takeaways

  1. Focus on Local and Small Models 18:05

    The hackathon emphasized building small apps using sub-32 billion parameter models. Key metrics showed that 64% of submissions ran fully offline, highlighting the viability of 'local first' AI architectures.

  2. High Utility in Niche Applications 27:20

    Winning projects demonstrated significant real-world utility. Examples include Jawbreaker (a private scam defense tool for suspicious text/emails) and Agenda Parser (breaking down dense local government agendas), proving the value of small, focused solutions.

  3. Advanced Technical Implementation 30:30

    Winners utilized advanced techniques like WebGPU for browser-based real-time games (Parry) and quantization methods (GGUF) to drastically reduce cold boot times, demonstrating high technical polish.

  4. Open Source Model Ecosystem 22:20

    The most popular model family used was Qwen (288 spaces), followed by MiniCPM OpenBMB and Nematron, confirming the community's reliance on diverse open-source models.

Watch on YouTube Full article