UPGRADE YOUR BROWSER

We have detected your current browser version is not the latest one. Xilinx.com uses the latest web technologies to bring you the best online experience possible. Please upgrade to a Xilinx.com supported browser:Chrome, Firefox, Internet Explorer 11, Safari. Thank you!

Responsive and Reconfigurable Vision Systems

The reVISION Zone aggregates useful resources
for vision software, hardware and system developers.

reVISION Enables Responsive and Reconfigurable Vision Systems

More Responsive than Typical SoCs & Embedded GPUs:

  • 6X better images/sec/Watt in machine learning
  • 42X higher frames/sec/Watt for computer vision processing
  • 1/5th the latency

Reconfigurable to the Latest Algorithms and Sensors:

  • Continue to upgrade to the latest machine learning algorithms
  • Support the latest sensor types and connectivity standards
  • Support up to 8K and custom resolutions
Software Defined & Improved Ease of Use:

  • Accelerate development with ready to use OpenCV libraries
  • Leverage any combination of C/C++ and OpenCL languages
  • Develop with popular Machine Learning frameworks including Caffe
  • Seamless integration with Deephi ML IP/librairies in SDSoC

Featured Videos

Zynq® SoCs and MPSoCs

Hundreds of Xilinx’s Embedded Vision customers target Zynq® SoCs and MPSoCs in addition to FPGAs.

Zynq-based Platforms Enable:

  1. Acceleration of computer vision and machine learning algorithms for fast system response
  2. Uniquely provide the reconfigurability required for rapid upgrade to the best available type and mix of sensors
  3. Enable any-to-any connectivity to new machines and/or the cloud
reVISION flow diagram from any-to-any communication to sensor fusion with acceleration

To address the challenges mentioned above, Xilinx provides the reVISION stack which includes a broad range of development resources for platform, algorithm and application development. 

This includes support for the most popular neural networks, including AlexNet, GoogLeNet, SqueezeNet, SSD, and FCN, the functional elements required to build custom neural networks (CNN/DNN), and leverage pre-defined and optimized CNN implementations for network layers. This is complemented by a broad set of acceleration-ready OpenCV functions for computer vision processing.

For application level development, Xilinx supports popular frameworks including Caffe for machine learning and OpenVX for computer vision (to be released in second half 2017). The reVISION stack also includes development platforms from Xilinx and ecosystem partners based on Zynq SoCs and MPSoCs.

reVISION Stack block diagram that includes Application development, algorithm development and platform development

The reVISION stack enables design teams without deep hardware expertise to use a software defined development flow to combine efficient implementations of machine learning and computer vision algorithms into highly responsive systems.  

The reVISION flow starts with a familiar, eclipse-based environment using C, C++ and/or OpenCL languages and associated compiler technology; this is called the SDSoC environment.

Within the SDSoC environment, software and systems engineers can target reVISION hardware platforms, and draw from a pool of acceleration-ready computer vision libraries, and/or the OpenVX framework (late Summer 2017), to quickly build new applications.

For machine learning, popular frameworks like Caffe are used to train a neural network. The Caffe generated .prototxt file is run on an ARM® based scheduler that drives inference processing on pre-optimized implementations of CNN network layers.  

SDSoC Environment for the reVISION Stack block diagram

Expert Xilinx users deploying traditional RTL-based design flows, working with ARM based software developers, spent considerable design time creating highly differentiated machine learning and computer vision applications.  

To further speed design time and reduce the reliance on hardware experts, Xilinx introduced the SDSoC Development Environment, based on C, C++ and OpenCL. While this significantly reduces development cycles, it is not domain specific for Embedded Vision.

Xilinx’s new reVISION stack enables a much broader set of software and systems engineers, with little or no hardware design expertise, to develop intelligent Embedded Vision systems easier and faster. 

reVISION Stack ease of use to development time bar chart

Get started today designing your computer vision system around Zynq SoCs/MPSoCs and FPGAs by leveraging existing Xilinx and ecosystem design hardware, modules and production-ready Systems on Module (SOMs).

Join the discussion on Xilinx forums.

Computer Vision

Introducing Xilinx’s all new library for computer vision, xfOpenCV , accelerating the most critical OpenCV functions. xfOpenCV will allow you to easily compose and accelerate computer vision functions in the FPGA fabric through SDx or HLx environments. In addition, xfOpenCV library is consistent with OpenCV and are optimized for performance, resource utilization and ease of use. xfOpenCV is available to the public on github.

OpenCV library functions are essential to developing many computer vision applications. Xilinx’s xfOpenCV for computer vision, based on key OpenCV functions, will allow you to easily compose and accelerate computer vision functions in the FPGA fabric through SDx or HLx environments. In addition, xfOpenCV library functions are consistent with OpenCV and are optimized for performance, resource utilization and ease of use.

  • Thousands of functions in the OpenCV 3.1 library are available to run on the ARM Cortex™-A9 and Cortex A53 cores in Zynq
  • ~45 OpenCV functions (the OpenVX subset) are available as a library of RTL optimized functions for Xilinx SoCs
  • Complete library user guide with device utilization and performance
  • Support for 1 and 8 pixel parallel versions is available for most functions

reVISION Design Flow for Computer Vision

Library Functions

Basic Functionality Geometric Transforms Image Processing and Filters Feature Detection and Classifiers 3D Reconstruction Motion Analysis and Tracking
Absolute difference Scale/Resize Box Canny edge detection StereoLBM Mean Shift Tracking (MST)
Accumulate StereoRectify Gaussian Fast corner StereoSGM LK Dense Optical Flow
Accumulate squared Warp Affine Median SVM (binary)    
Accumulate weighted Warp Perspective Sobel Harris corner    
Arithmetic addition Remap Custom convolution Histogram of Oriented Gradients (HOG)    
Arithmetic subtraction   Equalize Histogram Houghlines    
Bitwise: AND, OR, XOR, NOT   Dilate      
Pixel-wise multiplication   Erode      
Channel combine   Bilateral      
Channel extract   OTSU Thresholding      
Color convert   Thresholding      
Convert bit depth   Image pyramid      
Table lookup   Color Detection      
    Integral image      
    Gradient Magnitude      
    Histogram      
    Gradient Phase      
    Min/Max Location      
    Mean & Standard Deviation      

Get started today designing your computer vision system around Zynq SoCs/MPSoCs and FPGAs by leveraging existing Xilinx and ecosystem design hardware, modules and production-ready Systems on Module (SOMs).

Join the discussion on Xilinx forums.

Machine Learning

Machine learning and deep learning have gained attention from the development community as a technique that provides enhanced intelligence to many applications including Embedded Vision. While not a new discipline, relatively new breakthroughs in algorithms, access to large data sets for algorithm training and efficient and economically more viable computing platforms have resulted in very rapid interest and adoption of the technology.

Xilinx’s Zynq SoCs/MPSoCs are an ideal fit for machine learning, achieving 6X better images/sec/Watt in machine learning inference relative to embedded GPUs and typical SoCs. Xilinx’s reVISION Stack removes traditional design barriers by allowing you to quickly take a trained network and deploy it on Zynq SoCs and MPSoCs for inference. With the tight integration with Deephi ML IP/libraries in SDSoC, reVISION takes a leap forward towards higher productivity.

Features:

  • Full software stack for deploying machine learning applications
  • Hardware optimized, and supported layers include: Conv, ReLU, Pooling, Dilated conv, Deconv, FC, Detector & Classifier, SoftMax layers
  • Caffe inter-operability allows easy porting from prototxt files for Network definition and trained weights
  • Optimized reference models available for a wide range of network topologies, such as AlexNet, GoogLeNet, Resenet, Yolo, SSD, Densebox, SqueezeNet, FCN and FPN
  • Networks can be customized through software running on the ARM processor without lengthy compilation

Contact your sales representatives for early access.

Connectivity & Sensor Support

The AI revolution has accelerated the development and evolution of sensor technologies across numerous categories. It has also resulted in a mandate for a new level of sensor fusion, combining multiple types of sensors in different combinations to create a full and complete view of the system’s environment and objects in that environment. Whatever sensor configuration is specified today, or implemented tomorrow, needs to be ‘future proofed’ through hardware reconfigurability. Only Xilinx programmable devices offer this level of reconfigurability.

Zynq-based vision platforms offer robust any-to-any connectivity and sensor interfaces. Zynq sensor and connectivity advantages include:

  • Up to 12x more bandwidth relative to alternative SoCs currently in the market, including support for native 8K and custom resolutions
  • Significantly more high and low bandwidth sensor interfaces and channels, enabling highly differentiated combinations of sensors such as RADAR, LiDAR, accelerometers and force torque sensors
  • Industry leading support for the latest data transfer and storage interfaces, easily reconfigured for future standards

Get started today designing your computer vision system around Zynq SoCs/MPSoCs and FPGAs by leveraging existing Xilinx and ecosystem design hardware, modules and production-ready Systems on Module (SOMs).

Join the discussion on Xilinx forums.

Design Examples and Demos for Computer Vision and Machine Learning

The reVISION Stack includes five computer vision design examples and five machine learning demos, with more to come. These examples are intended to get you up-and-running in a very short period of time. These design examples will help you easily see the distinct advantage Xilinx SoCs have in high performance Embedded Vision applications.To access these examples, follow the reVISION Getting Started

Computer Vision Design Examples

Design Example Provided by Xilinx Latest SDSoC Version Supported Board & SOM Supported Provider
LK Dense Optical Flow
iterative and pyramidal based implementation doing motion segmentation
2018.2

ZCU102

ZCU104

Xilinx
Stereo Disparity Map
Calculates disparity map from two sensor inputs using local block matching
Warp Transform
Harris Corner
Bilateral Filter

Machine Learning Demos

Design Example & Descriptions Latest SDSoC Version Supported Board & SOM Supported Provider
GoogLeNet Contact your sales representatives ZCU102 Xilinx Partners
ResNet
AlexNet
VGG-16
SSD-300
FCN-AlexNet
Yolo
Densebox (face detection)
FPN (Segmentation)

Get started today designing your computer vision system around Zynq SoCs/MPSoCs and FPGAs by leveraging existing Xilinx and ecosystem design hardware, modules and production-ready Systems on Module (SOMs).

Join the discussion on Xilinx forums.

Resource Description
Papers & Tutorials A collection of application notes, whitepapers, tutorials and user guides
Xilinx Embedded Vision Videos Various demonstrations and videos on embedded vision
Xcell Daily and Featured Blogs Daily blog articles from Xilinx and Industry
Powered By Xilinx Showcase of Products Enabled by Xilinx Technology
Forums Xilinx Community Forums

Get started today designing your computer vision system around Zynq SoCs/MPSoCs and FPGAs by leveraging existing Xilinx and ecosystem design hardware, modules and production-ready Systems on Module (SOMs).

Join the discussion on Xilinx forums.

Page Bookmarked