Test mlir kv cache

[pfultz2]

No description provided.

[migraphx-bot]

Test	Batch	Rate new 56f736	Rate old 090b5b	Diff	Compare
torchvision-resnet50	64	3,238.05	3,236.43	0.05%	✅
torchvision-resnet50_fp16	64	6,879.26	6,880.95	-0.02%	✅
torchvision-densenet121	32	2,441.85	2,438.89	0.12%	✅
torchvision-densenet121_fp16	32	4,194.86	4,188.26	0.16%	✅
torchvision-inceptionv3	32	1,619.46	1,617.69	0.11%	✅
torchvision-inceptionv3_fp16	32	2,713.15	2,712.94	0.01%	✅
cadene-inceptionv4	16	755.57	755.33	0.03%	✅
cadene-resnext64x4	16	809.76	814.20	-0.55%	✅
slim-mobilenet	64	7,437.04	7,437.23	-0.00%	✅
slim-nasnetalarge	64	208.57	208.58	-0.01%	✅
slim-resnet50v2	64	3,334.64	3,330.25	0.13%	✅
bert-mrpc-onnx	8	1,142.21	1,143.04	-0.07%	✅
bert-mrpc-tf	1	459.79	459.58	0.05%	✅
pytorch-examples-wlang-gru	1	381.50	342.35	11.44%	🔆
pytorch-examples-wlang-lstm	1	487.31	481.67	1.17%	✅
torchvision-resnet50_1	1	798.59	799.82	-0.15%	✅
cadene-dpn92_1	1	415.49	418.81	-0.79%	✅
cadene-resnext101_1	1	387.39	387.73	-0.09%	✅
onnx-taau-downsample	1	395.10	394.91	0.05%	✅
dlrm-criteoterabyte	1	32.21	32.20	0.00%	✅
dlrm-criteoterabyte_fp16	1	51.21	51.25	-0.07%	✅
agentmodel	1	10,185.18	10,011.29	1.74%	✅
unet_fp16	2	59.40	59.41	-0.01%	✅
resnet50v1_fp16	1	1,049.37	1,039.17	0.98%	✅
resnet50v1_int8	1	1,062.46	1,061.19	0.12%	✅
bert_base_cased_fp16	64	1,171.25	1,170.43	0.07%	✅
bert_large_uncased_fp16	32	356.46	356.32	0.04%	✅
bert_large_fp16	1	200.15	199.56	0.30%	✅
distilgpt2_fp16	16	2,225.41	2,229.79	-0.20%	✅
yolov5s	1	545.02	545.34	-0.06%	✅
tinyllama	1	43.66	43.67	-0.04%	✅
vicuna-fastchat	1	44.85	45.02	-0.38%	✅
whisper-tiny-encoder	1	417.71	417.69	0.01%	✅
whisper-tiny-decoder	1	402.10	409.75	-1.87%	✅
llama2_7b	1	19.06	19.06	0.01%	✅
qwen1.5-7b	1	23.44	23.44	0.01%	✅
phi3-3.8b	1	26.53	26.54	-0.04%	✅
mask-rcnn	1	12.63	12.69	-0.49%	✅
llama3-8b	1	21.64	21.66	-0.09%	✅
whisper-large-encoder	1	10.17	10.17	0.05%	✅
whisper-large-decoder	1	101.11	101.14	-0.03%	✅
mistral-7b	1	23.69	23.62	0.29%	✅
FLUX.1-schnell	1	774.43	770.53	0.50%	✅
nan	nan	nan	nan	nan%	❌

This build is not recommended to merge 🔴