COE-587 Performance Evaluation & Analysis

Fall 2009 Semester (091)

Marks for final exam are out. I will be in office Saturday Jan 30th from 8:00 to 1:00 pm in case you stop by to review your paper. Please also collect and check your homework and quiz papers for discrepancies. I will finalize marks/grades by Sunday Jan 31st noon time.

Course Syllabus:

Click here for course syllabus.

Lecture Notes:

The textbook's slides can be found at the following link: http://www.cse.wustl.edu/~jain/books/perf_sli.htm

Students are responsible for the material in the book and that in the handouts. The class notes are just "notes"; they may not cover all required material. The book is the reference for the required material. Be advised that the notes below are subject to change.

• Part I: An Overview of Performance Evaluation
  • Chapter 1: Introduction
  • Chapter 2: Common Mistakes and How to Avoid Them
  • Chapter 3: Selection of Techniques and Metrics
• Part II: Measurement Techniques and Tools
  • Chapter 4: Types of Workloads   
  • Chapter 5: The Art of Workload Selection
  • Chapter 6: Workload Characterization Techniques
  • Chapter 10: The Art of Data Presentation
  • Chapter 11: Ratio Games
  • Chapter 12: Summarizing Measured Data
• Part III: Probability Theory and Statistics
  • Chapter 13: Comparing Systems Using Sample Data
  • Chapter 14: Simple Linear Regression
  • Chapter 15: Other Regression Models
• Part IV: Experimental Design and Analysis 
  • Chapter 16: Introduction to Experimental Design
• Chapter 17: 2^k Factorial Designs
• Chapter 18: 2^kr Factorial Designs with Replications
• Chapter 19: 2^{k-p} Fractional Factorial Designs
• Chapter 20: One Factor Experiments
• Chapter 21: Two Factors Full Factorial Design without Replications
• Part V: Simulation
• Chapter 24: Introduction to Simulation
• Chapter 25: Analysis of Simulation Results
• Chapter 28: Random-Variate Generation - Author's slides (needed for quiz07)
• Chapter 29: Commonly Used Distributions (reference material)
• Part VI: Queueing Networks
• Chapter 30: Introduction to Queueing Theory

•    - A tool for probability distributions and quantiles

    - Area under the unit normal distribution: Table A.1

     - Tables for calculating normal quantiles: Table A.2 and Table A.3. For t-variate quantiles: Table A.4.

•     Refer to the instructor's slides on Chapter 12 and Chapter 13 for the needed Matlab code.

 

• Introduction to simulations and Analysis of simulation results.
• My notes on Queueing (Chapter 31) [See author's notes for chapters 30 and 31 too].

Project Material:

• Course projects and deliverables are discussed and specified in class (Week of Oct 31st).

Exam Dates:

•  TBD

Assignments:

• Reading Assignment: Read chapters 1, 2, and 3. There will be a quiz on this material

• Assignment #1: Oct 17, 2009 - Due Mon Oct 26th in class. Matlab code for PCA (example 6_1), highlight.m. - solution key.

• Assignment #2: Oct 26th, 2009 - Due Sat Nov 7th in class. solution key.

• Assignment #3: Nov 7th, 2009 - Due Nov 14th in class. solution key.

•  

Quizzes and Major Exams:

• Quiz01: Oct 17th, 2009 - Due Sat Oct 24th in class. Solution key.
• Quiz02: Nov 2nd, 2009 - Due Sat Nov 7th in class. Solution key.
• Quiz03: Nov 14th, 2009 - Due Wed Nov 18th in class. Solution key.
• Quiz04: Dec 7th, 2009 - Due Mon Dec 14th in class. Solution key.
• Midterm: Dec 10th, 2009 - solution.
• Quiz05: Dec 19th, 2009 - Due Mon Dec 21st, 2009. Solution key.
• Quiz06: Dec 28th, 2009 - Due Sat Jan 2nd, 2010. Solution key.
• Quiz07: Jan 17th, 2010 - Due Sat Jan 23rd, 2010. Solution key - The key solution is not 100% correct (especially for the rejection method). For ideal solution, please refer to solved example (last few slides) in this lecture material.

Check Your Status:

•  To check your marks for quizzes and homework as well as yours exams, bonus, etc click here

Matlab Tutorial Material:

Basic information:

• University of Utah site - Matlab
• Indiana University - Getting Started with Matlab

More detailed material at:

• University of Florida - Matlab Summary and Tutorial
• Michigan Technological University - A practical Introduction to Matlab

The MathWorks website - The makers of Matlab

No of visits to this page: since Oct 10th, 2009.