what is the max batch size?
I'm getting the following with clef & kev I have enough vram. Increasing the batch and logical batch doesn't help.
6.24.438.016 E srv send_error: task id = 16, error: input (11982 tokens) is too large to process. increase the physical batch size (current batch size: 512)