Changes
Jump to navigation
Jump to search
Creating page. Using Wikipedia as a start. Edit it and modify it to our own ends.
In [[computer science]], '''dynamic recompilation''' (sometimes abbreviated to '''dynarec''' or the [[pseudo-acronym]] '''DRC''') is a feature of some [[emulator]]s and [[virtual machine]]s, where the system may [[Compiler|recompile]] some part of a [[Computer program|program]] ''during execution''. By compiling during execution, the system can tailor the generated code to reflect the program's run-time environment, and potentially produce more efficient [[code]] by exploiting information that is not available to a traditional static [[compiler]].
==Uses==
Most dynamic recompilers are used to convert machine code between architectures at runtime. This is a task often needed in the emulation of legacy gaming platforms. In other cases, a system may employ dynamic recompilation as part of an [[adaptive optimization]] strategy to execute a portable program representation such as [[Java (programming language)|Java]] or .NET [[Common Language Runtime]] bytecodes. Full-speed debuggers also utilize dynarec to reduce the space overhead incurred in most [[deoptimization]] techniques, and other features such as dynamic [[thread migration]].
==Tasks==
The main tasks a dynamic recompiler has to perform are:
* Reading in machine code from the source platform
* Emitting machine code for the target platform
A dynamic recompiler may also perform some auxiliary tasks:
* Managing a cache of recompiled code
* Updating of elapsed cycle counts on platforms with cycle count registers
* Management of interrupt checking
* Providing an interface to virtualized support hardware for example a [[GPU]]
* Optimizing higher level code structures to run efficiently on the target hardware (see below)
==Example==
Suppose a program is being run in an emulator and needs to copy a null-terminated [[character string|string]]. The program is compiled originally for a very simple processor. This processor can only copy a [[byte]] at a time, and must do so by first reading it from the source string into a [[processor register|register]], then writing it from that register into the destination string. The original program might look something like this:
<source lang=asm>
beginning:
mov A,[first string pointer] ; Put location of first character of source string
; in register A
mov B,[second string pointer] ; Put location of first character of destination string
; in register B
loop:
mov C,[A] ; Copy byte at address in register A to register C
mov [B],C ; Copy byte in register C to the address in register B
inc A ; Increment the address in register A to point to
; the next byte
inc B ; Increment the address in register B to point to
; the next byte
cmp C,#0 ; Compare the data we just copied to 0 (string end marker)
jnz loop ; If it wasn't 0 then we have more to copy, so go back
; and copy the next byte
end: ; If we didn't loop then we must have finished,
; so carry on with something else.</source>
The emulator might be running on a processor which is similar, but extremely good at copying strings, and the emulator knows it can take advantage of this.
It might recognize the string copy sequence of instructions and decide to rewrite them more efficiently just before execution, to speed up the emulation.
Say there is an instruction on our new processor called ''movs'', specifically designed to copy strings efficiently. Our theoretical movs instruction copies 16 bytes at a time, without having to load them into register C in between,
but will stop if it copies a 0 byte (which marks the end of a string) and set the zero flag. It also knows that the addresses of the strings will be in registers A and B, so it increments A and B by 16 every time it executes, ready for the next copy.
Our new recompiled code might look something like this:
<source lang=asm>beginning:
mov A,[first string pointer] ; Put location of first character of source string
; in register A
mov B,[second string pointer] ; Put location of first character of destination string
; in register B
loop:
movs [B],[A] ; Copy 16 bytes at address in register A to address
; in register B, then increment A and B by 16
jnz loop ; If the zero flag isn't set then we haven't reached
; the end of the string, so go back and copy some more.
end: ; If we didn't loop then we must have finished,
; so carry on with something else.</source>
There is an immediate speed benefit simply because the processor doesn't have to load so many instructions to do the same task, but also because the movs instruction is likely to be optimized by the processor designer to be more efficient than the sequence used in the first example. (For example, it may make better use of [[Parallel computing|parallel execution]] in the processor to increment A and B while it is still copying bytes).
===Gaming===
*[[MAME]] uses dynamic recompilation in its CPU emulators for MIPS, SuperH, PowerPC and even the Voodoo graphics processing units.
*[[1964 (emulator)|1964]], a [[Nintendo 64]] emulator for x86 hardware.
*Wii64, a [[Nintendo 64]] emulator for the Wii.
*WiiSX, a Sony PlayStation emulator for the Nintendo Wii.
*[[Mupen64Plus]], a multi-platform Nintendo 64 emulator.<ref>[http://pandorawiki.org/Mupen64plus_dynamic_recompiler Mupen64Plus]</ref>
*[[Yabause]], a multi-platform [[Sega Saturn|Saturn]] emulator.<ref>[http://wiki.yabause.org/index.php5?title=SH2_dynamic_recompiler SH2]</ref>
*The backwards compatibility functionality of the [[Xbox 360]] (i.e. running games written for the original [[Xbox (console)|Xbox]]) is widely assumed to use dynamic recompilation.
*[[PPSSPP]], a [[Sony]] [[PlayStation Portable]] emulator. Recompilers for both x86 and ARM.
*[[PSEmu Pro]], a [[Sony]] [[PlayStation]] emulator.
*[[Ultrahle]], the first [[Nintendo 64]] emulator to fully run commercial games.
*[[PCSX2]],<ref>[http://www.pcsx2.net PCSX 2]</ref> a [[Sony]] [[PlayStation 2]] emulator, has a recompiler called "microVU", the successor of "SuperVU".
*[[Dolphin (emulator)|Dolphin]], a [[Nintendo GameCube]] and [[Wii]] emulator, has a dynarec option.
*GCemu,<ref>[http://sourceforge.net/projects/gcemu-project GCemu]</ref> a [[Nintendo GameCube]] emulator.
*[[NullDC]], a [[Sega]] [[Dreamcast]] emulator for x86.
*GEM,<ref>{{cite web|url=http://gem.tni.nl/ |title=Gameboy Emulator for MSX | The New Image |publisher=GEM |date= |accessdate=2014-01-12}}</ref> a [[Game Boy|Nintendo Game Boy]] emulator for [[MSX]] uses an optimizing dynamic recompiler.
*[[DeSmuME]],<ref>[http://desmume.org/2013/04/30/desmume-0-9-9-released/ DeSmuME v0.9.9]</ref> a [[Nintendo DS]] emulator, has a dynarec option.
*Soywiz's Psp,<ref>{{cite web|author=Publicado por Carlos Ballesteros Velasco |url=http://pspemu.soywiz.com/2013/07/release-soywizs-psp-emulator-2013-07-28.html |title=Soywiz's PSP Emulator: Release : Soywiz's Psp Emulator 2013-07-28 (r525) |publisher=Pspemu.soywiz.com |date=2013-07-28 |accessdate=2014-01-12}}</ref> a [[Sony]] [[PlayStation Portable]] emulator, has a dynarec option.
==See also==
* [[Comparison of platform virtual machines]]
* [[Binary translation]]
* [[Just-in-time compilation]]
* [[Binary recompiler]]
==References==
{{Reflist|30em}}
==External links==
*[http://web.archive.org/web/20051018182930/www.zenogais.net/Projects/Tutorials/Dynamic+Recompiler.html Dynamic recompiler tutorial]
*[http://emulatemii.com/wordpress/?tag=dynarec Blog posts about writing a MIPS to PPC dynamic recompiler]
[[Category:Virtualization software]]
[[Category:Compiler construction]]
[[Category:Emulation software]]
==Uses==
Most dynamic recompilers are used to convert machine code between architectures at runtime. This is a task often needed in the emulation of legacy gaming platforms. In other cases, a system may employ dynamic recompilation as part of an [[adaptive optimization]] strategy to execute a portable program representation such as [[Java (programming language)|Java]] or .NET [[Common Language Runtime]] bytecodes. Full-speed debuggers also utilize dynarec to reduce the space overhead incurred in most [[deoptimization]] techniques, and other features such as dynamic [[thread migration]].
==Tasks==
The main tasks a dynamic recompiler has to perform are:
* Reading in machine code from the source platform
* Emitting machine code for the target platform
A dynamic recompiler may also perform some auxiliary tasks:
* Managing a cache of recompiled code
* Updating of elapsed cycle counts on platforms with cycle count registers
* Management of interrupt checking
* Providing an interface to virtualized support hardware for example a [[GPU]]
* Optimizing higher level code structures to run efficiently on the target hardware (see below)
==Example==
Suppose a program is being run in an emulator and needs to copy a null-terminated [[character string|string]]. The program is compiled originally for a very simple processor. This processor can only copy a [[byte]] at a time, and must do so by first reading it from the source string into a [[processor register|register]], then writing it from that register into the destination string. The original program might look something like this:
<source lang=asm>
beginning:
mov A,[first string pointer] ; Put location of first character of source string
; in register A
mov B,[second string pointer] ; Put location of first character of destination string
; in register B
loop:
mov C,[A] ; Copy byte at address in register A to register C
mov [B],C ; Copy byte in register C to the address in register B
inc A ; Increment the address in register A to point to
; the next byte
inc B ; Increment the address in register B to point to
; the next byte
cmp C,#0 ; Compare the data we just copied to 0 (string end marker)
jnz loop ; If it wasn't 0 then we have more to copy, so go back
; and copy the next byte
end: ; If we didn't loop then we must have finished,
; so carry on with something else.</source>
The emulator might be running on a processor which is similar, but extremely good at copying strings, and the emulator knows it can take advantage of this.
It might recognize the string copy sequence of instructions and decide to rewrite them more efficiently just before execution, to speed up the emulation.
Say there is an instruction on our new processor called ''movs'', specifically designed to copy strings efficiently. Our theoretical movs instruction copies 16 bytes at a time, without having to load them into register C in between,
but will stop if it copies a 0 byte (which marks the end of a string) and set the zero flag. It also knows that the addresses of the strings will be in registers A and B, so it increments A and B by 16 every time it executes, ready for the next copy.
Our new recompiled code might look something like this:
<source lang=asm>beginning:
mov A,[first string pointer] ; Put location of first character of source string
; in register A
mov B,[second string pointer] ; Put location of first character of destination string
; in register B
loop:
movs [B],[A] ; Copy 16 bytes at address in register A to address
; in register B, then increment A and B by 16
jnz loop ; If the zero flag isn't set then we haven't reached
; the end of the string, so go back and copy some more.
end: ; If we didn't loop then we must have finished,
; so carry on with something else.</source>
There is an immediate speed benefit simply because the processor doesn't have to load so many instructions to do the same task, but also because the movs instruction is likely to be optimized by the processor designer to be more efficient than the sequence used in the first example. (For example, it may make better use of [[Parallel computing|parallel execution]] in the processor to increment A and B while it is still copying bytes).
===Gaming===
*[[MAME]] uses dynamic recompilation in its CPU emulators for MIPS, SuperH, PowerPC and even the Voodoo graphics processing units.
*[[1964 (emulator)|1964]], a [[Nintendo 64]] emulator for x86 hardware.
*Wii64, a [[Nintendo 64]] emulator for the Wii.
*WiiSX, a Sony PlayStation emulator for the Nintendo Wii.
*[[Mupen64Plus]], a multi-platform Nintendo 64 emulator.<ref>[http://pandorawiki.org/Mupen64plus_dynamic_recompiler Mupen64Plus]</ref>
*[[Yabause]], a multi-platform [[Sega Saturn|Saturn]] emulator.<ref>[http://wiki.yabause.org/index.php5?title=SH2_dynamic_recompiler SH2]</ref>
*The backwards compatibility functionality of the [[Xbox 360]] (i.e. running games written for the original [[Xbox (console)|Xbox]]) is widely assumed to use dynamic recompilation.
*[[PPSSPP]], a [[Sony]] [[PlayStation Portable]] emulator. Recompilers for both x86 and ARM.
*[[PSEmu Pro]], a [[Sony]] [[PlayStation]] emulator.
*[[Ultrahle]], the first [[Nintendo 64]] emulator to fully run commercial games.
*[[PCSX2]],<ref>[http://www.pcsx2.net PCSX 2]</ref> a [[Sony]] [[PlayStation 2]] emulator, has a recompiler called "microVU", the successor of "SuperVU".
*[[Dolphin (emulator)|Dolphin]], a [[Nintendo GameCube]] and [[Wii]] emulator, has a dynarec option.
*GCemu,<ref>[http://sourceforge.net/projects/gcemu-project GCemu]</ref> a [[Nintendo GameCube]] emulator.
*[[NullDC]], a [[Sega]] [[Dreamcast]] emulator for x86.
*GEM,<ref>{{cite web|url=http://gem.tni.nl/ |title=Gameboy Emulator for MSX | The New Image |publisher=GEM |date= |accessdate=2014-01-12}}</ref> a [[Game Boy|Nintendo Game Boy]] emulator for [[MSX]] uses an optimizing dynamic recompiler.
*[[DeSmuME]],<ref>[http://desmume.org/2013/04/30/desmume-0-9-9-released/ DeSmuME v0.9.9]</ref> a [[Nintendo DS]] emulator, has a dynarec option.
*Soywiz's Psp,<ref>{{cite web|author=Publicado por Carlos Ballesteros Velasco |url=http://pspemu.soywiz.com/2013/07/release-soywizs-psp-emulator-2013-07-28.html |title=Soywiz's PSP Emulator: Release : Soywiz's Psp Emulator 2013-07-28 (r525) |publisher=Pspemu.soywiz.com |date=2013-07-28 |accessdate=2014-01-12}}</ref> a [[Sony]] [[PlayStation Portable]] emulator, has a dynarec option.
==See also==
* [[Comparison of platform virtual machines]]
* [[Binary translation]]
* [[Just-in-time compilation]]
* [[Binary recompiler]]
==References==
{{Reflist|30em}}
==External links==
*[http://web.archive.org/web/20051018182930/www.zenogais.net/Projects/Tutorials/Dynamic+Recompiler.html Dynamic recompiler tutorial]
*[http://emulatemii.com/wordpress/?tag=dynarec Blog posts about writing a MIPS to PPC dynamic recompiler]
[[Category:Virtualization software]]
[[Category:Compiler construction]]
[[Category:Emulation software]]
