Differences

This shows you the differences between two versions of the page.

Link to this comparison view

en:projects:details:neuralsemproject [2011/09/23 15:13]
amir
en:projects:details:neuralsemproject [2016/06/23 11:26]
Line 1: Line 1:
-/* This is the template for project details pages */ 
  
-/*  
-  The database entry: 
-  "​type"​ is one of the following: phd theses, phd semester, master thesis, master semester, bachelor semester 
-  "​status"​ is one of the following: available, taken, completed (please upgrade accordingly!!!!!!!!!!) ​ 
-  "​by"​ should be filled as soon as the project is taken/​completed 
-  "​completed_dt"​ is the date when the project was completed (YYYY-MM-DD). ​ 
-  "​output_media"​ is the link to the pdf of the project (wiki syntax) 
-  "​table"​ must be "​projects"​ => don't touch it! 
-*/ 
----- dataentry project ---- 
-title : Neural networks with error correcting abilities and high storage capacities ​ 
-contactname:​ Amir Hesam Salavati 
-contactmail_mail:​ hesam.salavati@epfl.ch 
-contacttel: 021 - 693 81 37 
-contactroom:​ BC 160 
-type : master semester 
-status : available 
-created_dt : 2010-11-15 
-taken_dt : YYYY-MM-DD 
-completed_dt : YYYY-MM-DD 
-by : the full name of the student 
-output_media : en:​projects:​neural_storage_capacity.pdf|Download Abstract in PDF Format 
-table : projects 
-====== 
-template:​datatemplates:​project 
----- 
- 
-/* Description of the project */ 
-===== Background ===== 
-Memorizing patterns and correctly recalling them later is an essential ingredient of neural activity. In past 25 years, a number of neural networks ​ has been invented memorize and recall patterns. Interestingly,​ some of these networks are able to recall the correct pattern even if the input pattern contains error and is partially corrupted because of noise. In this regard, these artificial networks resemble error correcting codes, i.e. they are able to recognize the correct pattern in presence of noise. 
- 
-However, the storage capacity of these networks are quite small compared to their counterparts in coding theory. Given the fact that modern codes use the same basic structure to do error correction and the one used by neural networks, i.e. a bipartite graph with local message passing, it seems interesting to consider applications of modern coding theory to increase the storage capacity of neural networks by finding the appropriate weights as well as proper update rules for the neural graph. 
- 
- 
-===== Project Description ===== 
-This project has three phases: 
-  - In the first phase, we become familiar with the main concepts of neural networks, associative memory and, to some extent, codes on graphs as well as compressed sensing. ​ 
-  - Next, we focus on implementing proper neural update rules for a specific neural network with error correcting capability and compare them based on their convergence speed and error correction ability. This phase is more  
-  - Finally, if time admits, we concentrate on the process of learning the connectivity matrix of such neural networks from training data sets.  
- 
-The first phase requires reading some background literature. The second one needs programming skills (preferably in MATLAB) in order to implement the considered algorithms. Finally, the third step is a combination of theoretical work (doing research) and implementing some new ideas to find the best one in practice. ​ 
- 
-This project is suitable for students interested in neural networks, coding theory and mathematics who prefer a combination of theoretical and empirical works. ​ 
- 
-The prerequisites are: 
-1)Basic knowledge of coding theory and linear algebra (for the last phase). ​ 
-2)Being familiar with a suitable programming language (MATLAB is preferred. But C/C++ is acceptable.)