Optimized Memory Allocation and Power Minimization for FPGA-Based Image Processing

Paulo Garcia, Deepayan Bhowmik, Robert Stewart, Greg Michaelson, Andrew Michael Wallace

Research output: Contribution to journalArticle

4 Citations (Scopus)
13 Downloads (Pure)

Abstract

Memory is the biggest limiting factor to the widespread use of FPGAs for high-level image processing, which require complete frame(s) to be stored in situ. Since FPGAs have limited on-chip memory capabilities, efficient use of such resources is essential to meet performance, size and power constraints. In this paper, we investigate allocation of on-chip memory resources in order to minimize resource usage and power consumption, contributing to the realization of power-efficient high-level image processing fully contained on FPGAs. We propose methods for generating memory architectures, from both Hardware Description Languages and High Level Synthesis designs, which minimize memory usage and power consumption. Based on a formalization of on-chip memory configuration options and a power model, we demonstrate how our partitioning algorithms can outperform traditional strategies. Compared to commercial FPGA synthesis and High Level Synthesis tools, our results show that the proposed algorithms can result in up to 60% higher utilization efficiency, increasing the sizes and/or number of frames that can be accommodated, and reduce frame buffers’ dynamic power consumption by up to approximately 70%. In our experiments using Optical Flow and MeanShift Tracking, representative high-level algorithms, data show that partitioning algorithms can reduce total power by up to 25% and 30%, respectively, without impacting performance.
Original languageEnglish
Article number7
JournalJournal of Imaging
Volume5
Issue number1
DOIs
Publication statusPublished - 1 Jan 2019

Fingerprint Dive into the research topics of 'Optimized Memory Allocation and Power Minimization for FPGA-Based Image Processing'. Together they form a unique fingerprint.

Cite this