Difference between revisions of "Input lag"

From Emulation General Wiki
Jump to navigation Jump to search
m (1 revision)
(Input)
 
(278 intermediate revisions by 15 users not shown)
Line 1: Line 1:
'''Input lag''' is the delay between pressing a button and seeing the game react.<ref>http://www.anandtech.com/show/2803</ref> The potential causes for "input lag" are described below (steps which have negligible contributions to the input lag have been omitted). Each step in the process increases "input lag", however the net result may be unnoticeable if the overall "input lag" is low enough.
+
'''Input lag''' is the delay between pressing a button and seeing the game react.<ref>http://www.anandtech.com/show/2803</ref> The potential causes for "input lag" are described below (steps which have negligible contributions to the input lag have been omitted). Each step in the process increases "input lag", however, the net result may be unnoticeable if the overall "input lag" is low enough.
 +
 
 +
;Before diving in, let's distinguish between four key terms. Display lag, input lag, system latency, and [https://old.reddit.com/r/apexlegends/comments/f02vxz/apex_netcode_still_worst_of_all_brs/ netcode/network lag]. They might sound similar, but they affect your experience in different ways. While display and system lag can subtly influence input lag, it's crucial not to mix them up.
 +
:''See GamersNexus: [https://www.youtube.com/watch?v=Fj-wZ_KGcsg Framerate Isn't Good Enough: Latency Pipeline, "Input Lag," Reflex, & Engineering Interview] and [https://youtu.be/C_RO8bJop8o Fixing GPU & CPU Benchmarks: Introducing Animation Error] videos for more information about some of these''.
  
 
==Causes==
 
==Causes==
===Display lag===
+
===Display===
 +
This is the lag caused by the modern displays/televisions/monitors (due to the nature of the digital technology). [[Wikipedia:Digital_image_processing|<abbr title="Shouldn't be confused with analog image processing.">Digital image processing</abbr>]] (such as upscaling, motion smoothing and edge smoothing etc.) takes time and therefore [https://www.rtings.com/monitor/tests/inputs/input-lag#why-there-s-input-lag adds some degree of input lag]. [[Displays#CRT_TVs|HD CRTs]], LCDs, OLEDs and other digital displays do have digital image processing and cause noticable input lag.
  
This is the lag caused by the digital televisions and monitors. Image processing (such as upscaling, 100&nbsp;Hz, motion smoothing, edge smoothing) takes time and therefore adds some degree of input lag. It is generally considered that input lag of a television below 30ms is not noticeable.<ref>http://www.bit-tech.net/hardware/monitors/2009/02/06/the-dark-side-of-overdrive/4</ref> Discussions on gaming forums tend to agree with this value. Once the frame has been processed, the final step is the pixel response time for the pixel to display the correct color for the new frame.
+
:;Response time
 +
:Once the digital processing done, the pixels need time to switch to the new frame's colors, which is called '[https://www.rtings.com/monitor/tests/motion/motion-blur-and-response-time pixel response time]' (cause a blur on screen, so it's different from input lag), remember, pixel response affects how fast you see the image update, while input lag impacts how quickly the display reacts to your commands.
  
[[Display FAQ#CRT TVs|CRT TVs]] and monitors have no display lag.
+
:Analog [[Display FAQ#CRT TVs|CRT TVs]] and [[Display_FAQ#CRT_monitors|VGA CRT monitors]] and even [[Displays#CRT_TVs|HD CRTs]] have very fast response times but it's limited by [https://old.reddit.com/r/crtgaming/comments/qyx4r3/is_this_normal_for_a_crt_monitor_if_not_is_there/ phosphor decay time] due to the nature of the technology. [[Displays#OLED_Monitors|OLED]] displays have almost no blur on screen due to their very fast response time and also capable of displaying true black levels, which means that they do not require a backlight to produce an image and this allows OLEDs to turn individual pixels on and off much faster than [[Displays#LCD_monitors|LCDs]], which require a backlight to produce an image.
===Windows Aero===
 
If you're using Windows Vista/7, having [https://en.wikipedia.org/wiki/Windows_Aero Aero] enabled will add a noticeable amount of input lag because it forces vertical synchronization at the OS-level.
 
  
===GPU driver latency===
+
:While <abbr title="Flicker/PWM/BFI/strobe-based motion blur reduction such as LightBoost, ELMB, ULMB, VRB, DyAc, PureXP etc.">BFI (Black Frame Insertion)</abbr> technology can significantly improve motion clarity for LCDs, it still falls short of both OLED and CRT in terms of both perceived clarity and motion resolution, though it's a great alternative/bridge the gap between these display technologies, offering a compromise between OLED's brightness and CRT's legendary motion, although at the cost of some flicker, potential extra input lag and reduced overall brightness. Although strobing (BFI) can eventually become obsolete in the future (including DyAc, ULMB, ELMB, VRB, etc) for modern content supporting 1000fps+ 1000Hz+ reprojection. This is a fully ergonomic PWM-free and flicker-free method of display motion blur reduction. No PWM or flicker.[https://blurbusters.com/frame-generation-essentials-interpolation-extrapolation-and-reprojection#dev]
  
There is video latency caused by the GL drivers in Windows/Linux. Both the GLX X11 and Windows GL/D3D drivers are are full of hacks, codepaths, and buffer schemes that cater to benchmarking applications and games. This is counter productive when the aim is low-latency audio and video synchronization for emulators. You don't want all this stuff going on in the background.
+
If you're in the market for a monitor or TV; check [[Input_lag#External_Links|these websites]] for input lag and display lag performance of various display products. Some of the modern digital displays only have negligible amount of input lag and display lag and even some of them are near identical performance compared to Analog CRTs.
  
Hard GPU sync options in some emulator frontends can reduce or remove latency from buffering at the possible expense of performance.
+
===Input===
 +
[[File:Keyboard Switches demonstration.gif|thumb|298px|[https://thegamingsetup.com/gaming-keyboard/buying-guides/keyboard-switch-chart-table actuation force] demonstration, see [https://www.x360ce.com/Keyboards this page]]]
 +
When it comes to delay of input devices most important thing usually is [[Wikipedia:Keyboard_controller_(computing)|input controllers]] (ASICS/MCU/[[Wikipedia:Embedded_controller|ECs]]), [[#External_Links|sensors]] and [[Wikipedia:Miniature_snap-action_switch|switches]] including [https://deskthority.net/wiki/Category:Keyboard_switches_by_design switch designs]. Wired/wireless usually doesn't matter ([https://kanuan.github.io/DS4WSite/troubleshooting/input-delay-bt/ unless its Bluetooth with power saving mode]); the thing that really matter is "[https://forums.blurbusters.com/viewtopic.php?t=6162&start=10#p55425 consistency about polling rate]"; polling rate fluctuations cause stutters and unstable input device feedback to users. When it comes to wireless technology "consistency" may be affected by lots of environmental factors.
  
This can be avoided by using [https://en.wikipedia.org/wiki/Mode_setting KMS] and [https://en.wikipedia.org/wiki/Direct_Rendering_Manager DRM]/[https://en.wikipedia.org/wiki/EGL_(API) EGL], specifically on Linux. By using these modes, the user is in control of front and back buffers and don't have to rely on APIs, so that they can find where and when a frame was dropped and how to act accordingly with that in mind. It is advisable to get the latest driver to improve performance, as notable graphics chip manufacturers (e.g. AMD, Nvidia) do not find KMS a priority. Intel graphics chips, however, should be fine regardless, but it is still advisable to update drivers.
+
See [[Input_lag#External_Links|these websites]] for various controllers and keyboard/mouse devices for input lag performance benchmarks.
  
Low-level APIs such as Vulkan give the user control over buffering, and may lower latency without resource-heavy solutions like hard GPU sync. However, there is evidence that OpenGL has lower latency than Vulkan in some instances.<ref>http://libretro.com/forums/showthread.php?t=5428&page=30&p=44578&viewfull=1#post44578</ref>
+
* Back in the days some people claim that [[Wikipedia:DIN_connector|DIN/mini-DIN connection]] keyboards and mice give better results compared to cheap [[Wikipedia:USB|USB connection]] peripherals due to the nature of the technology. Although this is far from the truth [https://forums.blurbusters.com/viewtopic.php?t=8411#p65756 it has better handling of the data], whereas the USB busses can be more easily interrupted etc (kinda similar to wired/wireless polling consistency situation mentioned above).
 +
:: [https://www.youtube.com/watch?v=eEswl6kZq5k Battle(non)sense: Keyboard Input Lag 125, 250, 500, 1000Hz USB vs. PS/2]
  
===Controller===
+
* Make sure to use reasonable CPI/DPI and Polling rate values for USB devices because optimizing [https://www.youtube.com/watch?v=lc7JVjcPzL0 input and matrix resolution] may affect input delay little bit.
 +
:: [https://www.youtube.com/watch?v=6AoRfv9W110 Battle(non)sense: Low DPI vs. High DPI and Polling Rate Analysis]
  
For wired controllers, this lag is negligible. For wireless controllers, opinions vary as to the effect of this lag. Some noticed extra lag when using a wireless controller, while others didn't.<ref>http://www.lockergnome.com/uncategorized/2011/08/26/wireless-controller-latency-is-it-a-problem/</ref>
+
===System (BIOS settings, bad drivers, OS misconfiguration) and placebo effect===
 +
Some people claims that default BIOS settings, Windows settings, registry settings, bloated services etc. causes little bit input delay and if you tweak these settings it will improve your system responsiveness. These kind of tweaks on internet considerably popular due to placebo effect but actually some of them really improves input delay a tiny bit. If you're obsessed with hacking your operating system and improving your system responsiveness even for a little bit you can check out [https://docs.google.com/spreadsheets/d/19rFOoJtx8OTF7GumSxwhB_3oCQ5bmY4bSpth7ef69Iw/edit#gid=0 FR33THY's latency analysis] and also [https://www.youtube.com/watch?v=89R9KlJ3ocM optimization pack] which includes useful scripts. Most importantly make sure to use always proper and official drivers for your computer otherwise it may affect your system responsivess negatively (e.g. High DPC Latency, spikes, IRQ issues etc.)
  
==Typical overall response times==
+
See [[#Ways_to_reduce_input_lag|ways to reduce input lag section]] for reducing input delay.
  
Testing has found that overall "input lag" (from controller input to display response) times of approximately 200ms are distracting to the user.<ref>http://www.eurogamer.net/articles/digitalfoundry-lag-factor-article?page=2</ref> It also appears that (excluding the monitor/television display lag) 133ms is an average response time and the most sensitive games achieve response times of 67ms (again, excluding display lag).
+
====[[Wikipedia:Compositing_window_manager|Compositor]]====
 +
If you're using Windows Vista/7 and playing in windowed mode, having [[Wikipedia:Desktop_Window_Manager|DWM]] enabled will add a noticeable amount of input lag because it forces vertical synchronization at the OS-level. The same thing applies to other OSes if their compositor uses V-Sync. [[Wikipedia:Windows_Aero|Windows Aero]] and [[Wikipedia:Desktop_Window_Manager|DWM]] can be disabled in both Vista and 7, thus disabling compositing and lowering input lag when playing in windowed mode, but this can no longer be done from Windows 8 onward due to [[Wikipedia:Windows_Display_Driver_Model#WDDM_1.2|WDDM 1.2+]]. That said, exclusive fullscreen should automatically disable compositing on all Windows OSes, making it the preferred way to emulate in most cases.
 +
 
 +
====GPU driver====
 +
There is video latency caused by the GL drivers in Windows/Linux. Both the GLX X11 and Windows GL/D3D drivers are full of hacks, code paths, and buffer schemes that cater to benchmarking applications and games. This is counterproductive when the aim is low-latency audio and video synchronization for emulators. You don't want all this stuff going on in the background. This can be avoided by using [[Wikipedia:Mode_setting|KMS]] and [[Wikipedia:Direct_Rendering_Manager|DRM]]/[[Wikipedia:EGL_(API)|EGL]], specifically on Linux. By using these modes, the user is in control of front and back buffers and don't have to rely on APIs, so that they can find where and when a frame was dropped and how to act accordingly with that in mind. It is advisable to get the latest driver to improve performance, as notable graphics chip manufacturers (e.g. Nvidia) do not find KMS a priority.<ref>[https://developer.nvidia.com/blog/understanding-and-measuring-pc-latency/ nvidia: Understanding and Measuring PC Latency]</ref> Intel and most AMD graphics chips, however, should be fine regardless, but it is still advisable to update drivers.
  
 
==Ways to reduce input lag==
 
==Ways to reduce input lag==
 +
;Display
 +
:;Option 1
 +
*[[Display FAQ#CRT TVs|CRT TV]] OR [[Display_FAQ#CRT_monitors|VGA CRT]] (not [[Display FAQ#CRT TVs|HD CRTs]]) with analog input/output. If your GPU only support digital output then use [https://old.reddit.com/user/ahayriSG/comments/16q18h6/highend_dacs_for_crts/ high-end DAC/Digital-to-Analog converters] for higher resolutions and refresh rates (Keep in mind that HDMI ones generally [https://youtu.be/WIDeNItt69s?t=1885 pretty bad]). But what about digital-to-analog conversion input lag? See Aperture Grille's video about [https://youtu.be/puu-iyTsZtg?t=840 testing GPU-Passthrough and cheap DAC input lag results]. Also see [https://hardforum.com/threads/24-widescreen-crt-fw900-from-ebay-arrived-comments.952788/page-435#post-1044652495 this thread] for more information about high-end DACs.
 +
::Use Custom resolution/CRTSwitchRes solutions for displaying it on a CRT display in the correct resolutions. You could use built-in Custom resolution/CRTSwitchRes solutions like RetroArch's [https://docs.libretro.com/guides/crtswitchres/ CRTSwitchRes] or [[GroovyMAME]] using with [http://geedorah.com/eiusdemmodi/forum/viewtopic.php?pid=1009#p1009 CRT emudriver] which is much more practical compared to using EDID editor tools such as [[Displays#240p.2F480i|Custom Resolution Utility (CRU)]] or using Linux in KMS mode<ref>https://wiki.archlinux.org/index.php/kernel_mode_setting</ref><ref>https://docs.libretro.com/guides/kms-mode/</ref>. See [https://emulation.gametechwiki.com/index.php?search=%22%23Enhancements|Enhancements%22&title=Special%3ASearch&limit=500&profile=default&fulltext=1 #Enhancements sections] in each page for "built-in custom resolution/CRTSwitchRes" support for emulators.
 +
:;Option 2
 +
*[[#External_Links|Fast-TN or IPS panel LCD or fast-OLED display]], also make sure that you mitigate input lag on [[Displays#LCD_monitors|LCDs]] and [[Displays#OLED_TVs_and_Monitors|OLEDs]] by turning on "game mode" from display OSD if available (this will turn off some post-processing options on display). If your LCD display is old set your [https://www.youtube.com/watch?v=Qdp7VfLXnB4&t=279s native resolution to native panel resolution] for preventing possible poor quality hardware display scaler otherwise you can use [https://forums.blurbusters.com/viewtopic.php?t=6155#p46190 GPU scaling] if you have at least mid range GPU.
 +
::If you have a "gaming" monitor you can also turn on "overdrive" option if available for overclocking pixels (applies overvoltage to pixels) making them react faster (better pixel response time) which results in less ghosting. That said, increasing pixel overdrive may cause inverse ghosting as the increased voltage can cause the pixels to [https://www.rtings.com/monitor/tests/motion/motion-blur-and-response-time#test_4246 overshoot] the colors. See [[#External_Links|these websites and reviews]] to learn information about your display devices capabilities and performance.
 +
::Also you could use latest [[MAME]] with "[https://shmups.system11.org/viewtopic.php?t=65615 -lowlatency]" flag for your variable refresh rate supported monitor.
  
Use:
+
----
*Wired controller
+
;Input
*CRT TV or monitor
+
'''1.''' Wired controller/input device (just for minimizing possible negative factors, just like using wired connection for router and client device)
*Linux OS in KMS mode<ref>https://wiki.archlinux.org/index.php/kernel_mode_setting</ref><ref>https://github.com/libretro/RetroArch/wiki/KMS-mode</ref>
+
----
 +
;System
 +
'''1.''' Use exclusive fullscreen for Windows 8 and onwards if available because with borderless windowed and windowed fullscreen, due to [[Wikipedia:Windows_Display_Driver_Model#WDDM_1.2|WDDM 1.2]] the desktop composition cannot be disabled anymore, so your only hope to avoid the compositing lag penalty is to play in exclusive fullscreen mode.
  
To disable Windows Aero under Windows Vista/7, select the Basic or Classic theme under Control Center > Personalization, or disable desktop composition under .exe properties > Compatibility. Some emulators and frontends allow you to disable desktop composition without having to switch themes. Desktop composition will also be disabled by playing under non-windowed full screen. In Windows 8 and later, desktop composition cannot be disabled manually.
+
'''2.''' Turn off digital image processing and [https://youtu.be/NzYvudM9BmI?t=723 frame generation] options from [https://www.pcgamingwiki.com/wiki/Category:Graphics_Adaptor GPU driver control panel] if it cause additional/noticeable input delay, some of the frame generation technologies can noticeably affect input delay, either positively or negatively, depending on the specific technique used[https://blurbusters.com/frame-generation-essentials-interpolation-extrapolation-and-reprojection]. Also if you're using intensive one turn off post-processing effects from applications/emulators and [https://www.pcgamingwiki.com/wiki/Category:Graphics_Adaptor GPU driver control panel].
 +
:'''2.1.''' Turn on DLSS/FSR upscaling technologies [https://youtu.be/-ajK3netvv4?t=173 if it increases your framerate which will likely decrease your latency].
  
Some emulator frontends like RetroArch or GroovyMAME have the option to delay processing of emulation for a few milliseconds until right before a vsync occurs, which causes inputs to be polled immediately before your display refreshes instead at the beginning of the 16.7ms (for 60 fps) vsync period. The amount of time you can use frame delay without dropping frames is dependent on the performance of the emulator on your machine.
+
'''3.''' Use [https://emulation.gametechwiki.com/index.php?search=%22%23Enhancements|Enhancements%22&title=Special%3ASearch&limit=500&profile=default&fulltext=1 input lag-mitigating techniques] if application supports it.
 +
:'''3.1.''' A relatively new lag-mitigating technique known as [https://github.com/higan-emu/emulation-articles/tree/master/input/run-ahead Run-Ahead] has recently been implemented in several emulators and frontends, which leverages spare performance overhead to run one or more instances of the emulator ahead of the regular instance, then uses save state rollback to lay that instance over what you see, effectively cutting a whole frame or more of input lag. Most games, even on real hardware on a CRT, have at least one hard-coded frame between executing an action on the controller and said action being reflected on screen, so setting Run-Ahead to 1 frame cuts out that superfluous frame and thus is usually considered safe, but setting it to 2 or more can result in dropped frames and perceived video stutter (though some games can benefit from 2 or more frames, particularly a lot of 5th-gen games). This is also quite processor-heavy, as every extra Run-Ahead frame requires a whole extra instance of the emulator, easily doubling or tripling CPU load, and some emulators are currently not able to use Run-Ahead at all. That said, combined with all the other lag reduction techniques on a sufficiently powerful system, Run-Ahead in theory can actually result in less input lag than even real hardware.
 +
:'''3.2.''' Another option for lag-mitigating technique known as Preemptive Frames. See [https://www.youtube.com/watch?v=NDYqRoyOKI4 this video] for information.
  
If you don't have a CRT or can't be bothered with one, you can mitigate input lag on LCDs by setting the display to game mode if available. This turns off some post-processing effects that introduce lag.
+
'''4.''' Always make sure that your [https://youtu.be/7DPqtPFX4xo?t=72 GPU is underutilized] for preventing [https://youtu.be/K_k1mjDeVEo?t=83 render queue bottleneck] which causes considerable amount of input lag. If that is the case use framerate capping such as "in-game frame capping" or equivalent option from [https://www.pcgamingwiki.com/wiki/Category:Graphics_Adaptor GPU driver control panel].
 +
:'''4.1.''' [https://youtu.be/7DPqtPFX4xo?t=650 NVIDIA Reflex feature] from in-game option will prevent this, but unfortunately not all GPUs and [https://www.nvidia.com/en-gb/geforce/technologies/reflex/supported-products/ games supports this feature].
 +
:'''4.2.''' If you have a VRR capable display another option for you to prevent this is simply using both [[Vsync|V-SYNC]] and "Low Latency Mode: ULTRA" or "AMD Anti-Lag+" options '''from [https://www.pcgamingwiki.com/wiki/Category:Graphics_Adaptor GPU driver control panel]'''; this will automatically prevent "render queue bottleneck".<ref name=renderqueueandvsyncbackpressure>[https://www.nvidia.com/en-us/geforce/guides/gfecnt/202010/system-latency-optimization-guide/ Nvidia: System latency optimization guide], [https://forums.blurbusters.com/viewtopic.php?t=8645 BlurBusters thread: Nvidia Reflex and low latency mode]</ref>
 +
::'''4.2.1.''' Keep in mind that if you are using [[Vsync|V-SYNC]] on non-VRR capable display, it will result "V-SYNC backpressure" which will cause additional input lag [https://youtu.be/L07t_mY2LEU?t=530 (especially if it includes triple buffering)].
 +
::'''4.2.2.''' If you have a VRR capable display and using "AMD Anti-Lag+" and also want to eliminate tearing completely with all of these: [https://youtu.be/K_k1mjDeVEo?t=727 you need to use framerate limiter again, because it does not keep the framerate inside the variable refresh rate range of the display] unlike Nvidia's "Low Latency Mode: ULTRA" solution.
 +
 
 +
'''5.''' Some graphics drivers enforce excessive frame buffering, which may be eliminated with GPU commands. RetroArch's [[Vsync#Hard_GPU_Sync|Synchronization Fences/Hard Sync]] for OpenGL does this. If you're using Vulkan backend, be sure to set the [https://arm-software.github.io/vulkan_best_practice_for_mobile_developers/samples/performance/swapchain_images/swapchain_images_tutorial.html max swapchain images] parameter to 2, though weaker GPUs (especially Intel iGPUs), can struggle with this, particularly if using intensive [[Shader_Presets|shader presets]] or increasing [[Resolution|internal or rendering resolution]].
 +
 
 +
'''6.''' Some emulator frontends like [[RetroArch]] or [[GroovyMAME]] have the option named "[https://www.libretro.com/index.php/retroarch-1-9-13-automatic-frame-delay/ Frame Delay]" to delay the processing of emulation for a few milliseconds until right before the given V-SYNC frame period is over, which causes inputs to be polled quickly before your display refreshes instead at the beginning of the newer V-SYNC frame period. The amount of time you can use Frame Delay without dropping frames is dependent on the performance of the emulator on your machine. Use [https://www.libretro.com/index.php/retroarch-1-9-13-automatic-frame-delay/ Automatic Frame Delay] if you don't want to manually give a value for Frame Delay. Keep in mind that realistically, Frame Delay is the last thing to configure, after all other "sync and buffer settings" and "Input lag mitigation techniques" have been configured for your system's performance, as it gives the least lag reduction bang for your CPU load buck. ''Also "Predictive waiting" may also be forced with any DirectX based program through'' [https://community.pcgamingwiki.com/files/file/897-gedosato/ GeDoSaTo].
 +
----
 +
;Summary
 +
It cannot be understated how much system requirements increase the more lag reduction measures are employed. A computer or device that would normally be able to run an emulator or core at full speed with ease can suddenly find itself chugging with said measures implemented, especially once Run-Ahead and Frame Delay come into play, which may necessitate foregoing some of them. Some ways to alleviate the load and unlock more lag mitigation potential include making sure performance options are enabled, turning on speed hacks or dynarecs if applicable (to the extent that they don't hamper the game significantly, that is), or switching to faster, less [[Emulation_accuracy|accurate]] emulator/cores altogether, as the less CPU intensive an emulator is, the more performance overhead is left over for lag reduction. An example would be switching from bsnes to SNES9X, which trades [[Emulation_accuracy|cycle accuracy]] and compatibility with a handful of games for far greater performance and thus more room to reduce input lag. Also, as implied before, if you have to choose between Run-Ahead and Frame Delay, you should almost always choose Run-Ahead. Of course, if your system is powerful enough to run the most [[Emulation_accuracy|accurate]] emulators along with all the input lag reduction techniques all at once, go ahead and do so.
  
 
==References==
 
==References==
 
{{reflist}}
 
{{reflist}}
 +
 +
==External Links==
 +
*[https://inputlag.science/ inputlag.science] - repository of knowledge about input lag in gaming
 +
*[https://docs.google.com/spreadsheets/d/1XvuDUHluuqDJ0DmF_PrWIjsLBgeg8CKVlL0w_Cyguxk/edit#gid=1101422075 Run-Ahead Wiki]
 +
*[https://sensor.fyi/mice/ Mouse devices sensor list]
 +
*[https://old.reddit.com/user/DestinyXZ9/submitted/ DestinyXZ9's investigations about input lag in various emulators]
 +
*[https://www.rtings.com/monitor/tests/inputs/input-lag RTINGS: Input Lag of Monitors]
 +
*[https://www.rtings.com/tv/tests/inputs/input-lag RTINGS: Input Lag of TVs]
 +
*[https://www.rtings.com/monitor/tests/motion/motion-blur-and-response-time RTINGS: Pixel Response Time of Monitors]
 +
*[https://www.rtings.com/tv/tests/motion/motion-blur-and-response-time RTINGS: Pixel Response Time of TVs]
 +
*[https://tftcentral.co.uk/reviews_index TFTCentral: Reviews and Input Lag analysis of Monitors]
 +
*[https://www.aperturegrille.com/reviews/ ApertureGrille: Reviews and Input Lag analysis of Monitors]
 +
*[https://docs.google.com/spreadsheets/d/1KlRObr3Be4zLch7Zyqg6qCJzGuhyGmXaOIUrpfncXIM/edit#gid=0 Controller latency on MiSTer]
 +
*[https://www.youtube.com/watch?v=ahsO5bhBUtk Rocket Science: Controller Input Lag comparison video]
 +
*[https://www.rtings.com/mouse/tests/control/latency RTINGS: Mouse Click Latencies]
 +
*[https://www.rtings.com/mouse/tests/control/cpi RTINGS: Mouse CPI and Speed-Related Accuracy Variation/SRAV results]
 +
*[https://www.rtings.com/mouse/tests/control/sensor-latency RTINGS: Mouse sensor latencies]
 +
*[https://www.rtings.com/keyboard/tests/latency RTINGS: Keyboard Latencies]
 +
*[https://mousespecs.org/mouse-click-latencies/ mousespecs: Mouse Click Latencies]
 +
*[https://www.anandtech.com/show/2803 Derek Wilson/AnandTech: Exploring Input Lag Inside and Out]
 +
*[https://blurbusters.com/gsync/preview2/ BlurBusters: Preview of NVIDIA G-SYNC, Part #2 Input Lag]
 +
*[https://www.retrorgb.com/bsnes-runahead-mode-lag-tested.html RetroRGB: BSNES Runahead Mode Lag Tested]
 +
*[https://www.youtube.com/@RocketJumpNinja/videos Rocket Jump Ninja] - YouTube channel dedicated to mouse reviews
 +
*[https://www.youtube.com/@BattleNonSense/videos Battle(non)sense] - YouTube channel dedicated to analysing netcode performance of games and testing input lag, system responsiveness etc.
 +
*[https://www.youtube.com/@FR33THY/videos FR33THY] - YouTube channel dedicated to computer hardware and peripherals for testing input lag and system responsiveness etc.
 +
*[https://github.com/hrydgard/ppsspp/issues/17685 PPSSPP: Input lag too high, ideas for improvement]
 +
*[https://forums.libretro.com/t/an-input-lag-investigation/4407 Brunnis: An input lag investigation]
 +
*[https://sites.google.com/view/noodallsinputlagtestingresults/video-interrupt-method-results noodalls Input Lag Testing Results]
  
 
[[Category:FAQs]]
 
[[Category:FAQs]]
[[Category:Video hardware]]
 

Latest revision as of 15:39, 13 March 2024

Input lag is the delay between pressing a button and seeing the game react.[1] The potential causes for "input lag" are described below (steps which have negligible contributions to the input lag have been omitted). Each step in the process increases "input lag", however, the net result may be unnoticeable if the overall "input lag" is low enough.

Before diving in, let's distinguish between four key terms. Display lag, input lag, system latency, and netcode/network lag. They might sound similar, but they affect your experience in different ways. While display and system lag can subtly influence input lag, it's crucial not to mix them up.
See GamersNexus: Framerate Isn't Good Enough: Latency Pipeline, "Input Lag," Reflex, & Engineering Interview and Fixing GPU & CPU Benchmarks: Introducing Animation Error videos for more information about some of these.

Causes[edit]

Display[edit]

This is the lag caused by the modern displays/televisions/monitors (due to the nature of the digital technology). Digital image processing (such as upscaling, motion smoothing and edge smoothing etc.) takes time and therefore adds some degree of input lag. HD CRTs, LCDs, OLEDs and other digital displays do have digital image processing and cause noticable input lag.

Response time
Once the digital processing done, the pixels need time to switch to the new frame's colors, which is called 'pixel response time' (cause a blur on screen, so it's different from input lag), remember, pixel response affects how fast you see the image update, while input lag impacts how quickly the display reacts to your commands.
Analog CRT TVs and VGA CRT monitors and even HD CRTs have very fast response times but it's limited by phosphor decay time due to the nature of the technology. OLED displays have almost no blur on screen due to their very fast response time and also capable of displaying true black levels, which means that they do not require a backlight to produce an image and this allows OLEDs to turn individual pixels on and off much faster than LCDs, which require a backlight to produce an image.
While BFI (Black Frame Insertion) technology can significantly improve motion clarity for LCDs, it still falls short of both OLED and CRT in terms of both perceived clarity and motion resolution, though it's a great alternative/bridge the gap between these display technologies, offering a compromise between OLED's brightness and CRT's legendary motion, although at the cost of some flicker, potential extra input lag and reduced overall brightness. Although strobing (BFI) can eventually become obsolete in the future (including DyAc, ULMB, ELMB, VRB, etc) for modern content supporting 1000fps+ 1000Hz+ reprojection. This is a fully ergonomic PWM-free and flicker-free method of display motion blur reduction. No PWM or flicker.[1]

If you're in the market for a monitor or TV; check these websites for input lag and display lag performance of various display products. Some of the modern digital displays only have negligible amount of input lag and display lag and even some of them are near identical performance compared to Analog CRTs.

Input[edit]

actuation force demonstration, see this page

When it comes to delay of input devices most important thing usually is input controllers (ASICS/MCU/ECs), sensors and switches including switch designs. Wired/wireless usually doesn't matter (unless its Bluetooth with power saving mode); the thing that really matter is "consistency about polling rate"; polling rate fluctuations cause stutters and unstable input device feedback to users. When it comes to wireless technology "consistency" may be affected by lots of environmental factors.

See these websites for various controllers and keyboard/mouse devices for input lag performance benchmarks.

  • Back in the days some people claim that DIN/mini-DIN connection keyboards and mice give better results compared to cheap USB connection peripherals due to the nature of the technology. Although this is far from the truth it has better handling of the data, whereas the USB busses can be more easily interrupted etc (kinda similar to wired/wireless polling consistency situation mentioned above).
Battle(non)sense: Keyboard Input Lag 125, 250, 500, 1000Hz USB vs. PS/2
  • Make sure to use reasonable CPI/DPI and Polling rate values for USB devices because optimizing input and matrix resolution may affect input delay little bit.
Battle(non)sense: Low DPI vs. High DPI and Polling Rate Analysis

System (BIOS settings, bad drivers, OS misconfiguration) and placebo effect[edit]

Some people claims that default BIOS settings, Windows settings, registry settings, bloated services etc. causes little bit input delay and if you tweak these settings it will improve your system responsiveness. These kind of tweaks on internet considerably popular due to placebo effect but actually some of them really improves input delay a tiny bit. If you're obsessed with hacking your operating system and improving your system responsiveness even for a little bit you can check out FR33THY's latency analysis and also optimization pack which includes useful scripts. Most importantly make sure to use always proper and official drivers for your computer otherwise it may affect your system responsivess negatively (e.g. High DPC Latency, spikes, IRQ issues etc.)

See ways to reduce input lag section for reducing input delay.

Compositor[edit]

If you're using Windows Vista/7 and playing in windowed mode, having DWM enabled will add a noticeable amount of input lag because it forces vertical synchronization at the OS-level. The same thing applies to other OSes if their compositor uses V-Sync. Windows Aero and DWM can be disabled in both Vista and 7, thus disabling compositing and lowering input lag when playing in windowed mode, but this can no longer be done from Windows 8 onward due to WDDM 1.2+. That said, exclusive fullscreen should automatically disable compositing on all Windows OSes, making it the preferred way to emulate in most cases.

GPU driver[edit]

There is video latency caused by the GL drivers in Windows/Linux. Both the GLX X11 and Windows GL/D3D drivers are full of hacks, code paths, and buffer schemes that cater to benchmarking applications and games. This is counterproductive when the aim is low-latency audio and video synchronization for emulators. You don't want all this stuff going on in the background. This can be avoided by using KMS and DRM/EGL, specifically on Linux. By using these modes, the user is in control of front and back buffers and don't have to rely on APIs, so that they can find where and when a frame was dropped and how to act accordingly with that in mind. It is advisable to get the latest driver to improve performance, as notable graphics chip manufacturers (e.g. Nvidia) do not find KMS a priority.[2] Intel and most AMD graphics chips, however, should be fine regardless, but it is still advisable to update drivers.

Ways to reduce input lag[edit]

Display
Option 1
Use Custom resolution/CRTSwitchRes solutions for displaying it on a CRT display in the correct resolutions. You could use built-in Custom resolution/CRTSwitchRes solutions like RetroArch's CRTSwitchRes or GroovyMAME using with CRT emudriver which is much more practical compared to using EDID editor tools such as Custom Resolution Utility (CRU) or using Linux in KMS mode[3][4]. See #Enhancements sections in each page for "built-in custom resolution/CRTSwitchRes" support for emulators.
Option 2
If you have a "gaming" monitor you can also turn on "overdrive" option if available for overclocking pixels (applies overvoltage to pixels) making them react faster (better pixel response time) which results in less ghosting. That said, increasing pixel overdrive may cause inverse ghosting as the increased voltage can cause the pixels to overshoot the colors. See these websites and reviews to learn information about your display devices capabilities and performance.
Also you could use latest MAME with "-lowlatency" flag for your variable refresh rate supported monitor.

Input

1. Wired controller/input device (just for minimizing possible negative factors, just like using wired connection for router and client device)


System

1. Use exclusive fullscreen for Windows 8 and onwards if available because with borderless windowed and windowed fullscreen, due to WDDM 1.2 the desktop composition cannot be disabled anymore, so your only hope to avoid the compositing lag penalty is to play in exclusive fullscreen mode.

2. Turn off digital image processing and frame generation options from GPU driver control panel if it cause additional/noticeable input delay, some of the frame generation technologies can noticeably affect input delay, either positively or negatively, depending on the specific technique used[2]. Also if you're using intensive one turn off post-processing effects from applications/emulators and GPU driver control panel.

2.1. Turn on DLSS/FSR upscaling technologies if it increases your framerate which will likely decrease your latency.

3. Use input lag-mitigating techniques if application supports it.

3.1. A relatively new lag-mitigating technique known as Run-Ahead has recently been implemented in several emulators and frontends, which leverages spare performance overhead to run one or more instances of the emulator ahead of the regular instance, then uses save state rollback to lay that instance over what you see, effectively cutting a whole frame or more of input lag. Most games, even on real hardware on a CRT, have at least one hard-coded frame between executing an action on the controller and said action being reflected on screen, so setting Run-Ahead to 1 frame cuts out that superfluous frame and thus is usually considered safe, but setting it to 2 or more can result in dropped frames and perceived video stutter (though some games can benefit from 2 or more frames, particularly a lot of 5th-gen games). This is also quite processor-heavy, as every extra Run-Ahead frame requires a whole extra instance of the emulator, easily doubling or tripling CPU load, and some emulators are currently not able to use Run-Ahead at all. That said, combined with all the other lag reduction techniques on a sufficiently powerful system, Run-Ahead in theory can actually result in less input lag than even real hardware.
3.2. Another option for lag-mitigating technique known as Preemptive Frames. See this video for information.

4. Always make sure that your GPU is underutilized for preventing render queue bottleneck which causes considerable amount of input lag. If that is the case use framerate capping such as "in-game frame capping" or equivalent option from GPU driver control panel.

4.1. NVIDIA Reflex feature from in-game option will prevent this, but unfortunately not all GPUs and games supports this feature.
4.2. If you have a VRR capable display another option for you to prevent this is simply using both V-SYNC and "Low Latency Mode: ULTRA" or "AMD Anti-Lag+" options from GPU driver control panel; this will automatically prevent "render queue bottleneck".[5]
4.2.1. Keep in mind that if you are using V-SYNC on non-VRR capable display, it will result "V-SYNC backpressure" which will cause additional input lag (especially if it includes triple buffering).
4.2.2. If you have a VRR capable display and using "AMD Anti-Lag+" and also want to eliminate tearing completely with all of these: you need to use framerate limiter again, because it does not keep the framerate inside the variable refresh rate range of the display unlike Nvidia's "Low Latency Mode: ULTRA" solution.

5. Some graphics drivers enforce excessive frame buffering, which may be eliminated with GPU commands. RetroArch's Synchronization Fences/Hard Sync for OpenGL does this. If you're using Vulkan backend, be sure to set the max swapchain images parameter to 2, though weaker GPUs (especially Intel iGPUs), can struggle with this, particularly if using intensive shader presets or increasing internal or rendering resolution.

6. Some emulator frontends like RetroArch or GroovyMAME have the option named "Frame Delay" to delay the processing of emulation for a few milliseconds until right before the given V-SYNC frame period is over, which causes inputs to be polled quickly before your display refreshes instead at the beginning of the newer V-SYNC frame period. The amount of time you can use Frame Delay without dropping frames is dependent on the performance of the emulator on your machine. Use Automatic Frame Delay if you don't want to manually give a value for Frame Delay. Keep in mind that realistically, Frame Delay is the last thing to configure, after all other "sync and buffer settings" and "Input lag mitigation techniques" have been configured for your system's performance, as it gives the least lag reduction bang for your CPU load buck. Also "Predictive waiting" may also be forced with any DirectX based program through GeDoSaTo.


Summary

It cannot be understated how much system requirements increase the more lag reduction measures are employed. A computer or device that would normally be able to run an emulator or core at full speed with ease can suddenly find itself chugging with said measures implemented, especially once Run-Ahead and Frame Delay come into play, which may necessitate foregoing some of them. Some ways to alleviate the load and unlock more lag mitigation potential include making sure performance options are enabled, turning on speed hacks or dynarecs if applicable (to the extent that they don't hamper the game significantly, that is), or switching to faster, less accurate emulator/cores altogether, as the less CPU intensive an emulator is, the more performance overhead is left over for lag reduction. An example would be switching from bsnes to SNES9X, which trades cycle accuracy and compatibility with a handful of games for far greater performance and thus more room to reduce input lag. Also, as implied before, if you have to choose between Run-Ahead and Frame Delay, you should almost always choose Run-Ahead. Of course, if your system is powerful enough to run the most accurate emulators along with all the input lag reduction techniques all at once, go ahead and do so.

References[edit]

External Links[edit]