Skip to content

Test XAttention #32148

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 24 commits into
base: master
Choose a base branch
from
Draft

Test XAttention #32148

wants to merge 24 commits into from
+4,571 −18

Conversation

peterchen-intel
Copy link
Contributor

Details:

  • item1
  • ...

Tickets:

  • ticket-id

riverlijunjie and others added 22 commits August 29, 2025 18:11
@riverlijunjie
Init PA CM Impl(1st/2nd token and kvcache update)
31f6c19
@riverlijunjie
enabled simple pa unit tests pass
af9e8e5
@riverlijunjie
Fix 2nd_token issue
5f7c5da
@riverlijunjie
Fixed pipeline output corruption issue
840d221 
   1. kvcache update's k/v offset issue
   2. 2nd token lse data overflow issue
@riverlijunjie
Fix 2nd non-16 alignment accuracy issue
d3c1e91
@riverlijunjie
Set best partition size for 2nd
904da7c
@ceciliapeng2011
update KV_BLOCK_SIZE to 256
6c0ea23
@ceciliapeng2011
initiate xattention integration
217001a
@ceciliapeng2011
qwen2.5-1.5b 4k trunk works with xatten.
d7a8ec1
@ceciliapeng2011
4k aligned works.
7858f61
@ceciliapeng2011
fix block_mask not fully initialized issue.
9b806b0
@ceciliapeng2011
fix of find_block
f06a71a
@ceciliapeng2011
xatten: fix accuacy problem caused by debug
c702b1f
@luo-cheng2021
use int32 to store float INV_S to align python version accuracy
66b34ed
@ceciliapeng2011
OV_GPU_XATTN_BLOCK_SIZE and OV_GPU_XATTN_THRESH
b383ec8
@usstq
fix building error on windows.
d15f12c
@ceciliapeng2011
process tail in find_block
39a7b5f
@riverlijunjie @ceciliapeng2011
Fix f16 accuracy issue and optimize 2nd token to improve 5%
05bb45d
@ceciliapeng2011
fix waring_as_error on CI Windows.
238d1ff
@ceciliapeng2011
dump block mask with DUMP_XATTN_BLOCK_MASK for debug
ffdf2f1
@luo-cheng2021
fix xatten case: (tails=q_len % 128) < 16
623f524
@peterchen-intel
Fix C220 warning as error
384e955 
Signed-off-by: Chen, Peter <[email protected]>
@github-actions github-actions bot added the category: GPU OpenVINO GPU plugin label Sep 18, 2025
@peterchen-intel
Disable C2220
64df098 
Signed-off-by: Chen, Peter <[email protected]>
@peterchen-intel
C2220 to 2220
536285a 
Signed-off-by: Chen, Peter <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: GPU OpenVINO GPU plugin do_not_merge do_not_review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@peterchen-intel @riverlijunjie @ceciliapeng2011 @luo-cheng2021 @usstq