Robotic Vision introduces you to the field of computer vision and the mathematics and algorithms that underpin it.You’ll learn how to interpret images to determine the color, size, shape and position of objects in the scene.We’ll work with you to build an intelligent vision system that can recognise objects of different colours and shapes.
Combined with the Introduction to Robotics MOOC, this course is based on a 13 week undergraduate course Introduction to Robotics at the Queensland University of Technology.
If you have completed the Robot Project in Introduction to Robotics, you will be able to combine this with the vision system you will develop in this course (optional).
Course Outcomes
By the end of this course you should be able to:
- describe and explain the utility of vision as a sensor for robots and evaluate the challenges inherent in visual information.
- describe the underlying principles of common image processing techniques and the circumstances where they are applicable, the rationale for reducing image pixels to features and the principles image region segmentation and feature extraction.
- describe the mathematical and geometric principles underlying the formation of images.
- describe the principles of continuous spectra, trichromatic vision and the separation of chrominance and luminance information.
- demonstrate the software skills to import images from a variety of sources into MATLAB and perform a number of image processing and feature extraction algorithms using MATLAB.
- apply the mathematical and algorithmic and control principles of computer vision to implement a working vision system (applies to optional project).
- integrate the robot and vision into a functional system in which the desired object is recognised and the robot moves to it (applies to optional project).
Pathways through the course
You can follow three paths through the MOOC:
- You can audit the course: Register and have access to all the content, lectures, quizzes and programming assignments which you can view at your leisure. You do not necessarily have to submit the assessments. You will not receive a certificate at the end of the course.
- To receive a certificate of completion you should register for the course, study all the content and successfully complete at least four assessable quizzes and four programming assignments.
- An additional option is to complete a robot building project which will be peer assessed.
Workload
You should spend about 4–8 hours per week on this course. Depending on your level of skill with MATLAB and programming in general, your studies might include:
- 2 hours viewing the lecture videos and completing the self-assessment quizzes;
- 30 minutes for each of six weekly assessable quizzes
- 2 hours for each of six weekly programming assignments;
- 1–2 hours building the robot or vision system (optional project) or doing further research and/or communicating on forums.
Time required for the last two items will depend on your level of skill with MATLAB and programming in general.
Certificate of Achievement
Throughout the course you will be asked to complete quizzes and programming exercises. These will be automatically marked. If you pass 4 quizzes and 4 programming assignments you will receive a Certificate of Achievement. The programming assignments will consist of several MATLAB tasks and will be based on the lecture content for that week.
The robot project will be peer assessed but doesn’t count towards the Certificate of Completion.
Assumed knowledge
To complete the MOOC you should know some basic programming (either of MATLAB or of an object-oriented programming language) and some of the following areas of maths: matrices, vectors and spaces, eigenvalues and eigenvectors. Below are links to these topics on the Khan Academy. We believe this knowledge will be necessary to complete the course, and recommend that you view these before Week 1 begins, but you might prefer to watch them on an ‘as needed’ basis after you view our content.
- Vectors
- Matrices:
- basic matrix operations including multiplication and inversion
- zero and identity matrices
- vector transformations with matrices
- familiarity with the concepts of eigenvalues and eigenvectors.
Note: A free version of MATLAB will be available for the duration of the course. Also, Professor Corke’s textbook (not essential) will be available at a significant discount.
Requirements Hardware
- Computer: You will need a computer that is capable of running MATLAB. For System Requirements, visit the MathWorks’ System Requirements page.
Software
- MATLAB. This is a proprietary technical computing and visualisation package developed by The Mathworks Inc. It is widely used in the engineering industry, in scientific research and for undergraduate education. MATLAB is a core part of the course and is available for free to students studying this course. It is used to illustrate techniques in the lectures (via screencasts) and also for the assignment (you need to write programs and submit them for automatic grading). A free MATLAB licence and software for installation will be available when you enrol in the course.
- Open source toolboxes for MATLAB. These will also be available from the course site.
Other
- Textbook (optional). Access to the textbook written by Professor Peter Corke (2011), Robotics, Vision and Control: Fundamental Algorithms in MATLAB (Springer) is optional, but considered beneficial.
Progress through the Course
The course content will be released weekly (Midnight Sundays UTC). Each week you will go through the video materials in two lectures. The videos are interspersed with non-assessed quiz questions and exercises to check your understanding. After the two lectures you will be presented with two assessable tasks: a quiz and a programming activity. (You will need to pass four of the six quizzes, and four of the six programming tasks to receive a Certificate of Completion.) Finally, an optional – but exciting – activity is to build your own robot vision system. Throughout the course you will also be encouraged to take part in discussion forums.
