Introduction
This course/book is designed as your 'second course' in programming. It is assumed you've done a first course which taught you the basics of programming in an interpreted language (probably either python or R), and have now had some experience at using these in your research.
You might have felt that your code is holding you back, and that if you could make it faster or use less memory you could take your analysis further. Or you might have got a solution but are unsure whether it's the right approach, or whether you could make it better.
Sometimes seeing the impressive (but sometimes intractable!) code and methods we use for research in bioinformatics can feel intimidating, and I feel there isn't much formal guidance on how to engineer your code this way.
My hope is that this course will give you some extra skills and confidence when developing and improving your research code.
Content
- Optimising python code. We'll start with some ways to make your interpreted code faster, such as arrays, JIT compilation and sparse matrices.
- HPC. How to effectively use and monitor your computation on HPC systems, including compiling code with different options.
- Compiled languages. How using a statically typed language can be faster, how to control memory, and other pros/and cons (using rust as an example). Also understanding how your problem scales, and typical elements of your algorithmic toolbox to solve problems.
- Software engineering. How to turn your research code into a fully fledged software package.
- Recursion and closures. Some new patterns, with more challenging examples to implement.
- Parallel programming. Theory and examples for using multiple CPUs to parallelise code. Examples in multiple languages.
Possible future content
Future modules to be added (possibly):
- CUDA programming for GPU parallelism.
- Foreign function interfaces - linking your compiled code with R and python.
- Machine learning/deep learning.
- Cloud computing.
- Web development.
Resources
Some of this material is based on:
- 'Algorithms for Modern Hardware'. This goes into lots of detail, including a lot of assembly code. This would be good to read after this course, or if you want more evidence and theory behind optimisation.
- The rust book.
- C++ reference guide.
- Rust by practice