QSV Encoding with Latest 2.5.1_BETA - HandBrakeCLI-1.0.7 vs 1.1.2 vs 1.2.2

Try changing your profile to use ffmpeg first (with the latest build), see how it performs.

Handbrake changed it’s libraries starting 1.1 so it’s possible the new libraries aren’t working as well for your hardware as the older ones. It’s also possible that your graphics drivers aren’t working as well with the new libraries (try changing the drivers) - it’s essentially the drivers and libraries compatibility that determines the performance/stability.

I noticed that your system has both AMD and Intel hardware encoders:

→ Detected hardware encoder capability →
{
“hardwareBrand”: “Intel”,
“codecType”: “Encoder”,
“hardwareCodecPresent”: true,
“h265Codec”: false,
“h264Codec”: true
}
→ Detected hardware encoder capability →
{
“hardwareBrand”: “AMD”,
“codecType”: “Encoder”,
“hardwareCodecPresent”: true,
“h265Codec”: true,
“h264Codec”: true
}

It looks like your AMD encoder may be more powerful than your intel encoder, with the latest build you can select the encoder of your choice, try setting it to AMD in the Conversion Task → Expert Settings page.