This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
en:projects:details:neuralsemproject [2011/09/22 16:00] amir |
en:projects:details:neuralsemproject [2016/06/23 11:26] (current) |
||
---|---|---|---|
Line 4: | Line 4: | ||
The database entry: | The database entry: | ||
"type" is one of the following: phd theses, phd semester, master thesis, master semester, bachelor semester | "type" is one of the following: phd theses, phd semester, master thesis, master semester, bachelor semester | ||
- | "status" is one of the following: available, taken, completed (please upgrade accordingly!!!!!!!!!!) | + | "state" is one of the following: available, taken, completed (please upgrade accordingly!!!!!!!!!!) |
"by" should be filled as soon as the project is taken/completed | "by" should be filled as soon as the project is taken/completed | ||
"completed_dt" is the date when the project was completed (YYYY-MM-DD). | "completed_dt" is the date when the project was completed (YYYY-MM-DD). | ||
Line 11: | Line 11: | ||
*/ | */ | ||
---- dataentry project ---- | ---- dataentry project ---- | ||
- | title :Applications of Coding Theory in Increasing the Storage Capacity of Neural Networks | + | title : Implementing Some Feature Extracting Techniques to Model Human Visual System |
contactname: Amir Hesam Salavati | contactname: Amir Hesam Salavati | ||
- | contactmail_mail: hesam[dot] salavati @epfl [dot] ch | + | contactmail_mail: hesam.salavati@epfl.ch |
contacttel: 021 - 693 81 37 | contacttel: 021 - 693 81 37 | ||
contactroom: BC 160 | contactroom: BC 160 | ||
type : master semester | type : master semester | ||
- | status : available | + | state : completed |
created_dt : 2010-11-15 | created_dt : 2010-11-15 | ||
- | taken_dt : YYYY-MM-DD | + | taken_dt : 2013-01-19 |
- | completed_dt : YYYY-MM-DD | + | completed_dt : 2013-06-12 |
- | by : the full name of the student | + | by : Diego Marcos Gonzalez |
- | output_media : en:projects:neural_storage_capacity.pdf|Download Abstract in PDF Format | + | output_media : en:projects:master_semester:marcos_salavati_semester_project_report_2013.pdf|Download Project Report in PDF Format |
table : projects | table : projects | ||
====== | ====== | ||
template:datatemplates:project | template:datatemplates:project | ||
---- | ---- | ||
+ | \\ | ||
+ | \\ | ||
/* Description of the project */ | /* Description of the project */ | ||
- | Memorizing patterns and correctly recalling them later is an essential ingredient of neural activity. In past 25 years, a number of neural networks has been invented memorize and recall patterns. Interestingly, some of these networks are able to recall the correct pattern even if the input pattern contains error and is partially corrupted because of noise. In this regard, these artificial networks resemble error correcting codes, i.e. they are able to recognize the correct pattern in presence of noise. | + | ===== Project Description ===== |
+ | \\ | ||
+ | In computer vision, there are various different techniques to extract important features from images. These features are then later used in patten recognition, image classification, etc. Some of these techniques are comparable to some models of specific parts in human visual system. | ||
- | However, the storage capacity of these networks are quite small compared to their counterparts in coding theory. Given the fact that modern codes use the same basic structure to do error correction and the one used by neural networks, i.e. a bipartite graph with local message passing, it seems interesting to consider applications of modern coding theory to increase the storage capacity of neural networks by finding the appropriate weights for the neural graph. | + | In this project, we are interested in implementing some of the widely used techniques in feature learning (extraction) and applying them to a dataset of natural images. This usually corresponds to solving some optimization problem to find the features that represent the data more accurately. |
- | Up to this point, some weighting schemes (including the Hebbian rule) were tested without much success. Considering more weighting schemes, such as the BCM rule, would be the next step toward the goal of increasing the storage capacity which is the main objective of this project. | + | The implementation can be either done in C or MATLAB (MATLAB is preferred). |
+ | And here are some lines to give you an idea about why we are interested in this project: | ||
+ | Once the feature extraction techniques are implemented, the learned features will then be used as inputs to a neural network which mimics some parts of human memory (neural associative memory). The ultimate goal would be to see if one will get better information storage capacities in artificial neural memories when the inputs are natural stimuli (such as images) and pre-processed before being stored. HEre, pre-processing refers to the feature extraction procedure. | ||
+ | \\ | ||
+ | \\ | ||
+ | This project is suitable for students interested in computer vision, neural networks and mathematics who prefer a combination of theoretical and empirical works. | ||
- | The objectives of this project are: | + | The prerequisites are: |
- | 1)To understand the principles of neural networks and modern codes. | + | 1)Basic knowledge of linear algebra. |
- | 2)Applying different weighting scheme to neural networks and evaluate the performance for storing codewords of a linear code. | + | 2)Being familiar with a suitable programming language (MATLAB is preferred. But C/C++ is acceptable.) |
- | This project is suitable for students who prefer doing simulations to find the appropriate framework for doing theoretical analysis. | + | Some knowledge about feature learning models in computer vision is not necessary but is deeply encouraged. |
- | The prerequisites are: | + | \\ |
- | 1)Basic knowledge of coding theory. | + | \\ |
- | 2)Being familiar with a suitable programming language (C/C++,MATLAB) | + | \\ |
+ | |||
+ | ====== Report ====== | ||
+ | The report is available via the following link: | ||
+ | \\ | ||
+ | {{:en:projects:master_semester:marcos_salavati_semester_project_report_2013.pdf|Implementing Some Feature Extracting Techniques to Model Human Visual System}} |