EE 430 Information Theory & Coding

Dr. Ali Muqaibel

You can use this website in addition to WebCT


Alsalam Alaikum wa Rahmat Allah

Welcome to your EE430 Homepage. It is a pleasure to have you in this course.
 

I pray Allah that you will find this course fruitful and enjoyable.

 

Best Regards,
Dr. Ali Muqaibel


Course Contents:

1. Syllabus

2.  Assignments

    2.1 HW Assignment

HW # Coverage Due Week Class
1 Entropy, Joint Entropy, Conditional Entropy , Efficiency 3 1
2 Huffman , Lempel-Ziv Coding & Decoding 4 1
3 Channels and Channel Capacity 5 2
4 Linear Block Error Correcting Codes 6 2
5 Cyclic Codes - Part I 10 1
6 Convolutional Codes 13 1

     2.2 Computer Assignment & Design Projects

Ass # Coverage Due Week Class
1 Arimoto-Blahut Algorithm for Channel Capacity 5 1
2 Huffman & Lemple-Ziv Compression

Huffman Help (Student Presentations part I & II)

10 1
3 Performance of Channel Codes (Hamming , Convolutional) over BSC 14 2

   Progress Report

    2.3 Reading and Presentation Assignment.
            List of Topics,   Assignment

 

             3. Class Notes:   These notes should not replace the class notes but rather support them.
                                      
                                        If you find any mistake please report them to me.
                                        I will be thankful if you can improve the notes and include any missing part in the lecture.

Chapter 1: Discrete Sources and Entropy



Group Work : Lempel-Ziv Decoding

Chapter 2: Channels and Channel Capacity


Group Work: Equivocation

Chapter 4: Linear Block Error-Correcting Codes

                    4.1 General Consideration (Channel Coding for Error Correction, Error Rate and Distribution for the BSC)
                    Examples (4 pages of additional Notes)+ Hamming Distance and Code Capability
                    Maximum Likelihood Detection
                    Binary Fields and Binary vector spaces and tow dimensional example
                   
                   
                    Group Work: Standard Array Decoding                 

                    Chapter 5: Cyclic Codes

                   
                   
                    External Link JAVA that explains how cyclic codes work http://www.ee.uwa.edu.au/~roberto/teach/itc314/java/CRC/

                    Chapter 6: Convolutional Codes

                   


               

4. Matlab Tutorials

        4.1 Get to Know Matlab (ppt)
        4.2 Vectors, Matrices and Band Operations (ppt)
        4.3 Matlab Primer V. 2.0  (HTML)

5. Solution for Quizzes 072

Q# Coverage Due Week Class
1 Ch 1 : Entropy, Joint Entropy, Conditional Entropy , Efficiency 3 2
2 Ch 1 : Huffman Coding 4 2
3 Ch 2  : Binary Symmetric Channel & Capacity 6 1
4 Ch 5 : Encoding Cyclic Codes 8 2
5 Ch5 : Cyclic Codes (Encoding & Decoding) 10 2
6 Ch6 :  Convolutional Codes 13 2

  6. Solution for Major exams

        6.1 Major I
        6.2 Major II