Automatic Machine Learning (AUTO-AUTO-ENCODER!)

From ISLAB/CAISR
Title Automatic Machine Learning (AUTO-AUTO-ENCODER!)
Summary Automatic configuration algorithm for autoencoders
Keywords Deep learning, autoencoder, meta learning, AutoML
TimeFrame Fall 2018
References The following paper summarises the algorithm configuration in the different domain :

http://aad.informatik.uni-freiburg.de/papers/16-AUTOML-AutoNet.pdf

This paper presents the initial idea behind Bayesian optimization for estimating parameter: https://www.cs.ubc.ca/~hutter/papers/10-TR-SMAC.pdf

Previous master thesis on applying autoencoder for histogram data: Robin Ng, “Efficient Implementation of Histogram Dimension Reduction using Deep Learning”, 2017.

Prerequisites Artificial Intelligence and Learning Systems courses,
Author
Supervisor Sławomir Nowaczyk, Sepideh Pashami
Level Master
Status Open

Generate PDF template

For anyone who is tired of machine learning algorithm’s configuration.

Algorithm configuration plays an important role in the performance of machine learning methods. In addition, data scientists every day spend a lot of time with a little guidance to choose the parameters of the algorithm. Further, learning the parameter of the algorithm as automatic as possible enables the use of machine learning for a wider range of science and technology.

Usually, state of the art methods target supervised classification machine learning tasks. This project focuses on parameter configurations of autoencoders for variously available datasets. Autoencoder is unsupervised feature extraction technique based on the neural network which trains in a supervised fashion. Following explains the necessary steps toward achieving an automatic autoencoder during this project.

- Studying recent advances in meta-learning, transfer learning, algorithm selection, and algorithm configuration.
- Studying and implementing autoencoder 
- Adapting existing algorithm configurations for autoencoder and comparing their performance