Lattice mVision Solutions Stack

Accelerate Implementation of Low Power Embedded Vision Applications

The Lattice mVision solutions stack includes everything embedded vision system designers need to evaluate, develop, and deploy FPGA-based embedded vision applications, such as machine vision, robotics, ADAS, video surveillance, and drones.

The Lattice mVision solutions stack uses modular hardware platforms, IP building blocks, easy to use FPGA design tools, reference designs and demonstrations, as well as a network of custom design services and solves design challenges as sensor connectivity, bridging, aggregation, and image signal processing.

The Lattice mVision solutions stack is optimized for low power consumption ranging from under 150 mW to 1 W and small package size (2.5 x 2.5 mm to 10 x 10 mm). The solutions stack provides customizable performance and flexible interface connectivity (MIPI CSI-2, LVDS, PCIe, GigE, etc.).

mVision Stack

Jump To

System Architecture Examples

The following diagrams are examples of how FPGAs are commonly used in embedded vision applications.

Sensor Bridging

  • Connect any MIPI, Sub-LVDS sensor to an image processor
  • Maintain existing infrastructure
  • Low latency and small form factor
  • FPGA resources can be used for image processing

Sensor Aggregation

  • Aggregate multiple image sensors for an image processor
  • Maintain existing infrastructure
  • Low latency and small form factor
  • FPGA resources can be used for image processing

Image Processing

  • Image processing, offload compute intensive algorithm from processor
  • Maintain existing infrastructure
  • Low latency and small form factor
  • Commercial grade Image Signal Processing

Connectivity

  • Interface Connectivity, USB, Gig-E, GigE-Vision, Display port
  • Maintain existing infrastructure
  • Low latency and small form factor

Hardware Platform

The Lattice mVision solutions stack uses the award-winning Video Interface Platform (VIP) which is the ideal hardware for embedded vision designs and provides a highly flexible, smart modular solution for embedded vision designers who need to build a prototyping system quickly.

Reference Designs

  • 1 to N MIPI CSI-2/DSI Duplicator

    Reference Design

    1 to N MIPI CSI-2/DSI Duplicator

    Modular MIPI/D-PHY Reference Design - Duplicate one MIPI CSI-2 channel to N DSI channels
  • 4 to 1 Image Aggregation with CrossLink-NX

    Reference Design

    4 to 1 Image Aggregation with CrossLink-NX

    Modular MIPI/D-PHY Reference Design - Aggregates four MIPI CSI-2 inputs to a single output stream.
  • MIPI CSI-2 Virtual Channel Aggregation

    Reference Design

    MIPI CSI-2 Virtual Channel Aggregation

    Modular MIPI/D-PHY Reference Design - Adaptable and flexible solution combines multiple MIPI CSI-2 inputs to a single CSI-2 output stream.
  • MIPI DSI/CSI-2 to OpenLDI LVDS Interface Bridge

    Reference Design

    MIPI DSI/CSI-2 to OpenLDI LVDS Interface Bridge

    Modular MIPI/D-PHY Reference Design - Complete solution integrates the Byte to Pixel Converter, CSI-2/DSI D-PHY Receiver and FPD-LINK (OpenLDI) Transmitter
  • N Input to 1 Output MIPI CSI-2 Side-by-Side Aggregation

    Reference Design

    N Input to 1 Output MIPI CSI-2 Side-by-Side Aggregation

    Modular MIPI/D-PHY Reference Design - Aggregate multiple MIPI CSI-2 inputs up to 5 channels horizontally line by line to a single CSI-2 output
  • IP Cores

  • Byte to Pixel Converter

    IP Core

    Byte to Pixel Converter

    Modular MIPI/D-PHY IP - Converts Parallel Data From a D-PHY Receiver into Pixel Format
  • CSI-2/DSI D-PHY Receiver

    IP Core

    CSI-2/DSI D-PHY Receiver

    Modular MIPI/D-PHY IP - PHY for receiving MIPI CSI-2/DSI Data for further processing. Supports up to 4 MIPI lanes to 10Gb/s
  • CSI-2/DSI D-PHY Transmitter

    IP Core

    CSI-2/DSI D-PHY Transmitter

    Modular MIPI/D-PHY IP - PHY for transmitting MIPI CSI-2/DSI Data. Supports up to 4 MIPI lanes to 10Gb/s
  • FPD-LINK Receiver

    IP Core

    FPD-LINK Receiver

    Modular MIPI/D-PHY IP - Converts FPD-LINK Video Streams to Pixel Clock Domain
  • FPD-LINK Transmitter

    IP Core

    FPD-LINK Transmitter

    Modular MIPI/D-PHY IP - Convert Pixel Data Streams to an FPD-LINK Video Stream
  • Development Kits & Boards

  • Embedded Vision Development Kit

    Board

    Embedded Vision Development Kit

    Three-board Video Interface Platform (VIP) modular kit. Includes 2 MIPI/D-PHY camera input, FPGA processing, HDMI output. More Input/Output boards available.
  • CrossLink-NX VIP Sensor Input Board

    Board

    CrossLink-NX VIP Sensor Input Board

    Intended for use with the Lattice Embedded Vision Development Kit. Includes 4 camera inputs and HyperRam for embedded video applications with CrossLink-NX
  • USB3-GbE VIP IO Board

    Board

    USB3-GbE VIP IO Board

    Output board for Video Interface Platform (VIP) and Embedded Vision Development Kit - adds video over USB 3.0 and Gigabit Ethernet.
  • DisplayPort VIP Input Board

    Board

    DisplayPort VIP Input Board

    Expands the Lattice VIP board ecosystem to support DisplayPort 1.4a (DP) video input - up to 4 lanes at 1.62 or 2.7 Gbps.
  • DisplayPort VIP Output Board

    Board

    DisplayPort VIP Output Board

    Expands the Lattice VIP board ecosystem to support DisplayPort 1.4a (DP) video output - up to 4 lanes at 1.62 or 2.7 Gbps.
  • Demos

  • 4 Input to 1 Output MIPI CSI-2 Image Aggregation Demo

    Demo

    4 Input to 1 Output MIPI CSI-2 Image Aggregation Demo

    Modular MIPI/D-PHY Demonstration - Aggregates four MIPI CSI-2 inputs to a single parallel output stream, which is then displayed on HDMI.
  • DisplayPort Receive Demo

    Demo

    DisplayPort Receive Demo

    Uses Bitec's DisplayPort IP core on the ECP5 FPGA in Lattice's Embedded Vision Development Kit. Compliant with DisplayPort 1.4a (including eDP 1.4 support).
  • DisplayPort Transmit Demo

    Demo

    DisplayPort Transmit Demo

    Uses Bitec's DisplayPort IP core on the ECP5 FPGA in Lattice's Embedded Vision Development Kit. Compliant with DisplayPort 1.4a (including eDP 1.4 support).
  • 3D Depth Mapping

    Demo

    3D Depth Mapping

    Determines the distance between an embedded device and an object using a Semi-Global Block Matching (SGBM) algorithm to determine 64 different disparity levels
  • Software Tools

    Lattice Diamond Design SoftwareLattice Radiant Software

    For the latest Radiant design software that works with the Lattice mVision Solutions stack, please contact Lattice by clicking the button below.

    Custom Design Services

    The Lattice mVision solutions stack includes an ecosystem of selected, worldwide design service partners that can deliver custom solutions for a range of end-applications, including smart factory, smart home, smart city, mobile, and smart cars.

    Documentation

    Information Resources
    TITLE NUMBER VERSION DATE FORMAT SIZE
    Lattice mVision Solutions Stack
    I0270 1.0 2/24/2020 PDF 1 MB


    Awards

    Embedded Computing Design’s Best in Show Award

    Development Tools & Operating Systems
    Like most websites, we use cookies and similar technologies to enhance your user experience. We also allow third parties to place cookies on our website. By continuing to use this website you consent to the use of cookies as described in our Cookie Policy.