executorch.html

---
layout: default
title: PyTorch ExecuTorch
body-class: announcement
background-class: announcement-background
permalink: /executorch-overview
excerpt: Learn about executorch, a mobile machine learning framework within PyTorch for deploying deep learning models on mobile and embedded devices.
---

<div class="container">
  <div class="row hero-content">
    <div class="col-md-8">
      <h1 class="small">ExecuTorch</h1>
      <p class="lead pt-3">End-to-end solution for enabling on-device inference capabilities across mobile and edge devices</p>
    </div>
    <div class="col-md-2 d-none d-lg-block">
    </div>
  </div>
</div>

<div class="container-fluid light-background-section">
  <div class="container mb-5">
    <div class="row">
      <div class="col-md-10">
        <h2 class="mt-5 mb-2" id="what-is-executorch">What is ExecuTorch?</h2>
        <p>ExecuTorch is an end-to-end solution for enabling on-device inference capabilities across mobile and edge devices including wearables, embedded devices and microcontrollers. It is part of the PyTorch Edge ecosystem and enables efficient deployment of various PyTorch models (vision, speech, Generative AI, and more) to edge devices. Key value propositions of ExecuTorch are:</p>
        
        <div class="container">
          <div class="row mt-3">
            <div class="col-sm-2 pr-0 text-right">
              <img src="/assets/images/mobile-icon.svg" alt="Mobile icon" height="50" />
            </div>
            <div class="col-sm-8 pl-0 align-middle">
              <strong>Portability</strong>: Compatibility with a wide variety of computing platforms, from high-end mobile phones to highly constrained embedded systems and microcontrollers.
            </div>
          </div>
          <div class="row mt-4">
            <div class="col-sm-2 pr-0 text-right">
              <img src="/assets/images/chip-icon.svg" alt="Chip icon" height="50" />
            </div>
            <div class="col-sm-8 pl-0 align-middle">
              <strong>Productivity</strong>: Enabling developers to use the same toolchains and SDK from PyTorch model authoring and conversion, to debugging and deployment to a wide variety of platforms.
            </div>
          </div>
          <div class="row mt-4">
            <div class="col-sm-2 pr-0 text-right">
              <img src="/assets/images/stopwatch-icon.svg" alt="Stopwatch icon" height="50" />
            </div>
            <div class="col-sm-8 pl-0 align-middle">
              <strong>Performance</strong>: Providing end users with a seamless and high-performance experience due to a lightweight runtime and utilizing full hardware capabilities such as CPUs, NPUs and DSPs.
            </div>
          </div>
        </div>

        <h2 class="mt-5 mb-2" id="explore-executorch">Explore ExecuTorch</h2>
        
        <p>ExecuTorch is currently powering various experiences across AR, VR and Family of Apps (FOA) products and services at Meta. We are excited to see how the community leverages our all new on-device AI stack. You can learn more about <a href="https://pytorch.org/executorch/stable/getting-started-architecture">key components</a> of ExecuTorch and its architecture, <a href="https://pytorch.org/executorch/stable/intro-how-it-works">how it works</a>, and explore <a href="https://pytorch.org/executorch">documentation pages</a> and <a href="https://pytorch.org/executorch/stable/#tutorials-and-examples:~:text=Getting%20Started-,Tutorials%20and%20Examples,-Docs">detailed tutorials</a>.</p>
        
        <p>
          <a href="https://pytorch.org/executorch/stable/index.html" class="btn btn-lg with-right-arrow">
            ExecuTorch Documentation
          </a>
        </p>
        
        <h2 class="mt-5 mb-2" id="why-executorch">Why ExecuTorch?</h2>
        
        <p>Supporting on-device AI presents unique challenges with diverse hardware, critical power requirements, low/no internet connectivity, and realtime processing needs. These constraints have historically prevented or slowed down the creation of scalable and performant on-device AI solutions. We designed ExecuTorch, backed by our industry leaders like Meta, Arm, Apple, and Qualcomm, to be highly portable and provide superior developer productivity without losing on performance.</p>
        
        <h2 class="mt-5 mb-2" id="executorch-alpha-release">ExecuTorch Alpha Release</h2>
        
        <p>ExecuTorch was initially introduced to the community at the 2023 <a href="https://pytorch.org/blog/pytorch-conference-2023/">PyTorch Conference</a>. With our most recent alpha release, we further expanded ExecuTorch’s capabilities across multiple dimensions. First, we enabled support for the deployment of large language models (LLMs) on various edge devices. Second, with ExecuTorch alpha, we have further stabilized the API surface. Lastly, we have significantly improved the developer experience by simplifying the installation flow as well as improving observability and developer productivity via the <a href="https://github.com/pytorch/executorch/blob/main/examples/sdk/README.md">ExecuTorch SDK</a>. ExecuTorch alpha release also provides early support for the recently announced Llama 3 8B along with demonstrations on how to run this model on an iPhone 15 Pro and a Samsung Galaxy S24 mobile phone.</p>

      </div>
  </div>
</div>