Thomas Potok

Highlights

spiking neural network generated by EONS using the Caspian platform CDA ORNL

Caspian provides a development platform for neuromorphic algorithms and applications research.  The C++ and Python APIs allow for quick and flexible development of new algorithms and…

Visual Analytics System Overview: The system consists of three different views: a lineage view (1), a fitness-parameter view (2), and a network architecture view (3). CDA ORNL

Deep learning is actively used in a wide range of fields for scientific discovery. To effectively apply deep learning to a particular problem, it is important to select an appropriate network…

Summary of Bayesian-based Hyperparameter Optimization Results: a. Grid search: Whetstone accuracy for 256 different HP sets. b. Bayesian-based HP optimization: selected 15 HP combinations to find optimal hyperparameter set (shown with red star). c. Bayesian-based HP optimization result for four state-of-the-art datasets

In this work, the researchers introduced a Bayesian approach for optimizing the hyperparameters of an algorithm for training binary communication networks that can be deployed to neuromorphic…

EONS algorithm overview ORNL CDA Computer Data Analytics

Designing and training an appropriate spiking neural network for neuromorphic deployment remains an open challenge in neuromorphic computing. In 2016, researchers from ORNL introduced an approach for…

Left - Memristive neuromorphic system	Right - Spiking neural network designed by EONS

Designing spiking neural networks for neuromorphic deployment is a non-trivial task.  It is further complicated when there are resource constraints for the neuromorphic implementation, such as…

Bayesian-based Hyperparameter Optimization for Spiking Neuromorphic Systems

Designing a neuromorphic computing system involves selection of several hyperparameters that not only affect the accuracy of the framework, but also the energy efficiency and speed of inference and…

Multi-Objective Optimization for Size and Resilience of Spiking Neural Networks

Neuromorphic architectures are designed and developed with the goal of having small, low power chips that can perform control and machine learning tasks. However, the power consumption of the…

Evolving Energy Efficient Convolutional Neural Networks

In this work, we discuss an approach for that utilizes high-performance computing (HPC) to evolve the hyperparameters and topology of convolutional neural networks in order to investigate the ability…

Gordon Bell Chart

Our deep learning framework is called Multinode Evolutionary Neural Networks for Deep Learning (MENNDL).  MENNDL relies on two optimization methods, genetic algorithms and support vector…