Lattice sensAI Stack

Accelerate Integration of Flexible Inferencing at the Edge

Full-featured Lattice sensAI stack includes modular hardware platforms, neural network IP cores, software tools, reference designs, and custom design services from eco-system partners.

Flexible inferencing solutions optimized for power consumption from under 1 mW-1 W, package sizes starting at 5.5 mm2, and priced for high volume production.

Accelerates deployment of always-on, on-device AI into a range of Edge applications including mobile, smart home, smart city, smart factory, and smart car products.



sensAI

Jump To

Design Methodology Overview

System Architecture Examples

ECP5 FPGA + MCU

  • Scalable performance/power with ECP5 based neural network acceleration
  • ECP5 based I/O flexibility to seamlessly interface to on-board legacy devices including sensors
  • Low-end MCU for flexible system control

Stand-alone ECP5/iCE40 UltraPlus FPGA

  • Always-on, integrated solutions on ECP5 or iCE40 UltraPlus FPGA
  • Low latency and secure implementation
  • Small form factor packages from 5.5 mm2 to 100 mm2

iCE40 UltraPlus FPGA + ASIC/ASSP

  • iCE40 UltraPlus FPGA for always-on detection of key-phrases or objects
  • Wakes-up a high performance ASIC/ASSP for further analytics only when required
  • Reduces overall system power consumption.

Hardware Platforms

Modular hardware platforms for rapid prototyping of ultra-low power machine learning inferencing designs for Edge applications.

  • Video Interface Platform – ECP5 FPGA-based modular development platform featuring the award winning Embedded Vision Development Kit for AI designs requiring under 1W of power consumption. Flexible interface connectivity boards support MIPI CSI-2, embedded DisplayPort (eDP), HDMI, GigE Vision, USB 3.0 and more.
  • Mobile Development Platform – iCE40 UltraPlus FPGA-based platform for AI designs requiring a few mWs of power consumption, offers a variety of on-board image sensors, microphones, compass/pressure/gyro sensors and more.
  • Himax HM01B0 UPduino Shield - A complete development kit for implementing Artificial Intelligence (AI) using vision and sound as sensory inputs, with iCE40 UltraPlus FPGA based Upduino 2.0 board and Himax image sensor module.
  • DPControl iCEVision board - A vision focused development kit designed by DPControl with iCE40 UltraPlus FPGA and multiple interface connectors compatible with most common camera interfaces.

IP Cores

Neural network accelerator IP cores include support for convolution, pooling and fully connected network layers.

  • Convolutional Neural Network (CNN) Accelerator – Fully parameterizable IP core optimized for ECP5 FPGA implementation, includes support for variable quantization for accuracy versus power consumption tradeoffs.
  • CNN Compact Accelerator – Optimized for iCE40 UltraPlus FPGA, the accelerator supports the implementation of AI designs that allow a few mWs of power consumption.

Software Tools

In addition to FPGA design software, such as Lattice Diamond and Lattice Radiant, the Lattice sensAI stack includes the new Neural Network Compiler tool for deployment of networks developed in Caffe or TensorFlow into Lattice FPGAs – no prior RTL experience required.

  • Neural Network Compiler – Rapidly analyze, simulate, and compile various networks for implementation onto Lattice CNN/CNN Compact Accelerator IP cores.

Demos & Reference Designs

Programmable Logic Demos
  Provider ECP5 / ECP5-5G iCE40 UltraPlus
Face Tracking Lattice  
Hand Gesture Detection Lattice  
Human Face Detection Lattice  
Human Presence Detection Lattice
Key Phrase Detection Lattice  
Object Counting Lattice  
Package Detection Lattice, Wipro  
Speed Sign Detection Lattice  
Vehicle Classification Lattice, Softnautics  
Programmable Logic Reference Designs
  Provider ECP5 / ECP5-5G iCE40 UltraPlus
Face Tracking Lattice  
Hand Gesture Detection Lattice  
Human Face Detection Lattice  
Human Presence Detection Lattice
Key Phrase Detection Lattice  
Object Counting Lattice  
Speed Sign Detection Lattice  

Custom Design Services

The Lattice sensAI stack includes an ecosystem of select, worldwide design service partners that can deliver custom solutions for a range of end-applications, including mobile, smart home, smart city, smart factory, and smart cars. Click here for more information on Lattice sensAI certified partners.

Documentation

Information Resources
TITLE NUMBER VERSION DATE FORMAT SIZE
Lattice sensAI Stack Product Brochure
IO265 3.0 10/3/2018 PDF 941.3 KB
TITLE NUMBER VERSION DATE FORMAT SIZE
Accelerating Implementation of Low Power Artificial Intelligence at the Edge
WP-0014 1.1 11/28/2018 PDF 1.2 MB


Like most websites, we use cookies and similar technologies to enhance your user experience. We also allow third parties to place cookies on our website. By continuing to use this website you consent to the use of cookies as described in our Cookie Policy.