MJIT: A Method Based Just-in-time Compiler for Ruby

Summary

Ruby programs are compiled into YARV instructions and executed by a stack-oriented virtual machine, while register-oriented representations can expose more opportunities for compiler optimization. The post explains how YARV represents a simple expression, contrasts stack and register architectures, and introduces Vladimir Makarov’s Ruby RTL, an intermediate representation distinct from GCC’s RTL. MJIT uses RTL generated by MRI to make speculative, operand-specific optimizations, then compiles methods to machine code rather than relying only on interpretation. The interview discusses deoptimization: when assumptions change, MJIT generates a new machine-code version and can switch between JITed execution and RTL interpretation. The participants say this overhead should be tiny and should not degrade performance overall, while acknowledging edge cases where MJIT is not faster and that benchmarking JITs is difficult.

Takeaways

1. 1

   YARV is a stack-oriented intermediate representation and virtual machine for Ruby; its instructions operate by pushing operands onto and popping values from a stack.

2. 2

   Ruby RTL is distinct from GCC’s RTL and enables speculative optimizations based on operand assumptions, such as integer-specific behavior.

3. 3

   MJIT’s deoptimization path generates new machine code when assumptions change; the interview describes the overhead as small but acknowledges cases where MJIT is not faster.