You can "solve" the issue by forcing lav to pad the video. But avr will still clip so you actually are in a worse situation youve effectively changed 16-235 into 32-219.
What you describe is exactly what id expect if you are clipping rgb full. Ideally I'd bypass your avr